2024-09-13T18:45:49.717 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:45:49.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:45:49.880 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota} email: null first_in_suite: false job_id: '7904017' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6geFx0CNgF7Jvhuy52zDbWyaek3CBE79F8pweF0ruSFhlorJG3ApglQQQ730dr8rrsy4jOSMAKGjz0AMaI3DU= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKugETA15Ydh/Iz1tGH0LlT62ju/E7qZY6PBVxgR32dCaK15KKD1SmDPhthc2KACHijqVsWTqY/crimWN4tzb70= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:45:49.881 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:45:49.881 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:45:49.882 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:45:49.883 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:45:49.907 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:45:49.907 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:45:49.907 INFO:teuthology.packaging:ref: None 2024-09-13T18:45:49.907 INFO:teuthology.packaging:tag: None 2024-09-13T18:45:49.908 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:45:49.908 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:45:49.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:45:50.065 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:45:50.067 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:45:50.073 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:45:50.073 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:45:50.080 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:45:50.099 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:45:50.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:45:50.136 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:40:26.610364', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6geFx0CNgF7Jvhuy52zDbWyaek3CBE79F8pweF0ruSFhlorJG3ApglQQQ730dr8rrsy4jOSMAKGjz0AMaI3DU='} 2024-09-13T18:45:50.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:40:26.608380', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKugETA15Ydh/Iz1tGH0LlT62ju/E7qZY6PBVxgR32dCaK15KKD1SmDPhthc2KACHijqVsWTqY/crimWN4tzb70='} 2024-09-13T18:45:50.163 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:45:50.169 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:45:50.169 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:45:50.169 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:45:50.245 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f117546bbe0>, signals=[15]) 2024-09-13T18:45:50.245 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:45:50.253 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:45:50.253 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:45:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:45:50.350 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:45:50.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:45:50.454 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:45:50.461 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-09-13T18:45:50.479 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-09-13T18:45:50.480 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:45:50.539 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:45:50.540 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:45:50.540 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:45:50.540 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-09-13T18:45:50.569 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-13T18:45:50.588 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-13T18:45:50.588 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-13T18:45:50.644 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:45:50.645 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:45:50.646 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-13T18:45:50.677 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:45:50.686 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:45:50.691 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:45:50.691 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:45:50.694 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:45:50.709 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:45:50.716 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:45:50.716 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:45:50.750 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:45:50.794 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:45:50.862 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:45:50.877 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:45:50.877 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T18:45:50.877 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T18:45:50.878 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:45:50.878 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:45:50.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:50.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T18:45:50.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:50.906 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T18:45:51.070 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:45:51.070 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:45:51.071 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-13T18:45:51.088 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:45:51.088 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:45:51.088 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:45:51.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum upgrade -y linux-firmware 2024-09-13T18:45:51.093 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:45:51.093 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:45:51.093 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-13T18:45:51.111 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:45:51.111 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:45:51.111 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:45:51.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum upgrade -y linux-firmware 2024-09-13T18:45:53.417 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-13T18:45:54.473 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-13T18:45:56.499 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T18:45:57.818 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-13T18:46:02.052 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-13T18:46:03.512 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-13T18:46:03.591 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-13T18:46:04.441 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-13T18:46:05.249 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-13T18:46:06.620 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T18:46:09.905 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-13T18:46:12.005 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-13T18:46:12.005 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-13T18:46:12.006 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-13T18:46:12.117 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:46:12.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:46:12.271 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T18:46:12.271 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T18:46:12.274 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi103.front.sepia.ceph.com to complete... 2024-09-13T18:46:12.301 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-13T18:46:14.431 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-13T18:46:14.432 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-09-13T18:46:14.432 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-13T18:46:14.539 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:46:14.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:46:14.692 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T18:46:14.692 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T18:46:14.699 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi033.front.sepia.ceph.com to complete... 2024-09-13T18:46:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13 18:46:21 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T18:46:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:FINISHED --2024-09-13 18:46:21-- 2024-09-13T18:46:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:Total wall clock time: 8.8s 2024-09-13T18:46:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:Downloaded: 1 files, 343M in 8.5s (40.3 MB/s) 2024-09-13T18:46:21.085 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:46:21.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T18:46:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying... ######################################## 2024-09-13T18:46:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing... ######################################## 2024-09-13T18:46:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:Updating / installing... 2024-09-13T18:46:24.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13 18:46:24 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T18:46:24.493 INFO:teuthology.orchestra.run.smithi033.stderr:FINISHED --2024-09-13 18:46:24-- 2024-09-13T18:46:24.493 INFO:teuthology.orchestra.run.smithi033.stderr:Total wall clock time: 9.8s 2024-09-13T18:46:24.494 INFO:teuthology.orchestra.run.smithi033.stderr:Downloaded: 1 files, 343M in 9.3s (36.7 MB/s) 2024-09-13T18:46:24.497 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:46:24.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying... ######################################## 2024-09-13T18:46:26.839 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing... ######################################## 2024-09-13T18:46:26.954 INFO:teuthology.orchestra.run.smithi033.stdout:Updating / installing... 2024-09-13T18:46:31.406 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T18:46:35.377 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T18:47:12.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T18:47:12.238 DEBUG:teuthology.orchestra.run.smithi103:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T18:47:12.329 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:47:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:47:12.331 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T18:47:12.332 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:47:12.333 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T18:47:12.334 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:47:12.335 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:47:12.336 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:47:12.337 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:47:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:47:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:47:12.340 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T18:47:12.341 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:47:12.342 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:47:12.343 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:47:12.344 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:47:12.345 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:47:12.346 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T18:47:12.347 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T18:47:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:47:12.349 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:47:12.350 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:47:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:47:12.352 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:47:12.353 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:47:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:47:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:47:12.356 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:47:12.357 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:47:12.358 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:47:12.359 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:47:12.360 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:47:12.361 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:47:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:47:12.363 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:47:12.364 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:47:12.365 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T18:47:12.366 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:47:12.367 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T18:47:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:47:12.369 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:47:12.370 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:47:12.371 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:47:12.372 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:47:12.373 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:47:12.374 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:47:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T18:47:12.376 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T18:47:12.377 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:47:12.378 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T18:47:12.379 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:47:12.380 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T18:47:12.381 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:47:12.382 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:47:12.383 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T18:47:12.384 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:47:12.385 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T18:47:12.386 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:47:12.387 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T18:47:12.388 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:47:12.389 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T18:47:12.390 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:47:12.391 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:47:12.392 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T18:47:12.393 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:47:12.394 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:47:12.395 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:47:12.396 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T18:47:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:47:12.398 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:47:12.399 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:47:12.400 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:47:12.401 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:47:12.402 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:47:12.403 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:47:12.404 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:47:12.405 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:47:12.406 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T18:47:12.407 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:47:12.408 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T18:47:12.409 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:47:12.412 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:47:12.413 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:47:12.416 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:47:12.417 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:47:12.418 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:47:12.419 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:47:12.420 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:47:12.421 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:47:12.422 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:47:12.423 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T18:47:12.424 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:47:12.425 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:47:12.426 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:47:12.427 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:47:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T18:47:12.429 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:47:12.432 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:47:12.433 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T18:47:12.434 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T18:47:12.435 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T18:47:12.436 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:47:12.437 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:47:12.438 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:47:12.439 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T18:47:12.440 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:47:12.441 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:47:12.442 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:47:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T18:47:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:47:12.445 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:47:12.446 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:47:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:47:12.448 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:47:12.449 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:47:12.450 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:47:12.451 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:47:12.452 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:47:12.453 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:47:12.454 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:47:12.455 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:47:12.456 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:47:12.457 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:47:12.458 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:47:12.459 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:47:12.460 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:47:12.461 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:47:12.462 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:47:12.463 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:47:12.464 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:47:12.465 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:47:12.466 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:47:12.467 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:47:12.468 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T18:47:12.469 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:47:12.470 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:47:12.471 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:47:12.472 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:47:12.473 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T18:47:12.474 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T18:47:12.475 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:47:12.476 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T18:47:12.477 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:47:12.480 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.481 DEBUG:teuthology.orchestra.run.smithi103:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T18:47:12.506 INFO:teuthology.orchestra.run.smithi103.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout:for file in vmlinuz System.map config; do 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: fi 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout:done 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:12.507 INFO:teuthology.orchestra.run.smithi103.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.508 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-13T18:47:12.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-13T18:47:12.586 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-13T18:47:12.587 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:47:12.588 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:47:12.589 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:47:12.589 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:12.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:47:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-13T18:47:14.645 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:47:14.672 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-13T18:47:14.681 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-13T18:47:14.696 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.9lsRM4ccM0 2024-09-13T18:47:14.696 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9lsRM4ccM0 2024-09-13T18:47:14.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.9lsRM4ccM0 2024-09-13T18:47:14.910 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.9lsRM4ccM0 is 6KB 2024-09-13T18:47:14.958 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.9lsRM4ccM0 2024-09-13T18:47:14.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:47:15.035 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:47:15.036 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:47:15.036 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:47:15.036 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T18:47:15.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-13T18:47:15.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T18:47:15.425 DEBUG:teuthology.orchestra.run.smithi033:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T18:47:15.554 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.554 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:47:15.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:47:15.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:47:15.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:47:15.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T18:47:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:47:15.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:47:15.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:47:15.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:47:15.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:47:15.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:47:15.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T18:47:15.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:47:15.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T18:47:15.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T18:47:15.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:47:15.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T18:47:15.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T18:47:15.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:47:15.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:47:15.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:47:15.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:47:15.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:47:15.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:47:15.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:47:15.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:47:15.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:47:15.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:47:15.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:47:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:47:15.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:47:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:47:15.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:47:15.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:47:15.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:47:15.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:47:15.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T18:47:15.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T18:47:15.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:47:15.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:47:15.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:47:15.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:47:15.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:47:15.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:47:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:47:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T18:47:15.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:47:15.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T18:47:15.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:47:15.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T18:47:15.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:47:15.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T18:47:15.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T18:47:15.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:47:15.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:47:15.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T18:47:15.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T18:47:15.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T18:47:15.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T18:47:15.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T18:47:15.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:47:15.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:47:15.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:47:15.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:47:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:47:15.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:47:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T18:47:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T18:47:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T18:47:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:47:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:47:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T18:47:15.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:47:15.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:47:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:47:15.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:47:15.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T18:47:15.631 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:47:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T18:47:15.633 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:47:15.634 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T18:47:15.635 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:47:15.636 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:47:15.637 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T18:47:15.638 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:47:15.639 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:47:15.640 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:47:15.641 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:47:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:47:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:47:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:47:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:47:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:47:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T18:47:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:47:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:47:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:47:15.651 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:47:15.652 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T18:47:15.653 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:47:15.654 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:47:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:47:15.657 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:47:15.660 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:47:15.663 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:47:15.672 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:47:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:47:15.675 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:47:15.676 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:47:15.682 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:47:15.684 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:47:15.687 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:47:15.688 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:47:15.689 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:47:15.690 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:47:15.691 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:47:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:47:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:47:15.694 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T18:47:15.696 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:47:15.697 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T18:47:15.698 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:47:15.701 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.701 DEBUG:teuthology.orchestra.run.smithi033:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T18:47:15.724 INFO:teuthology.orchestra.run.smithi033.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout:for file in vmlinuz System.map config; do 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: fi 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout:done 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:15.725 INFO:teuthology.orchestra.run.smithi033.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.726 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-13T18:47:15.727 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-09-13T18:47:15.801 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-09-13T18:47:15.801 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-09-13T18:47:15.801 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-09-13T18:47:15.801 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 82.el9 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8274670 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-09-13T18:47:15.802 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:47:15.803 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:47:15.804 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:47:15.804 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:15.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:47:16.407 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-09-13T18:47:17.775 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:47:17.806 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-09-13T18:47:17.808 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-13T18:47:17.822 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.hSgKVsjD2s 2024-09-13T18:47:17.823 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hSgKVsjD2s 2024-09-13T18:47:17.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.hSgKVsjD2s 2024-09-13T18:47:18.024 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.hSgKVsjD2s is 6KB 2024-09-13T18:47:18.044 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.hSgKVsjD2s 2024-09-13T18:47:18.058 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:47:18.120 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:47:18.120 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:47:18.120 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:47:18.120 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T18:47:18.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:47:18.259 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-09-13T18:47:45.209 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T18:47:45.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:47:45.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:47:48.264 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T18:47:48.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:47:48.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:48:03.649 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-13T18:48:06.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-13T18:48:12.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:48:12.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:48:15.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:48:15.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:48:15.745 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-13T18:48:27.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:48:27.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:49:15.779 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:49:27.777 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:49:27.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:49:27.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:49:28.162 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-13T18:49:28.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:49:28.654 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:49:28.654 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-13T18:49:28.689 INFO:teuthology.orchestra.run.smithi033.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:49:28.689 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:49:28.689 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:49:28.689 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:49:29.690 DEBUG:teuthology.parallel:result is None 2024-09-13T18:49:42.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:49:42.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:49:43.230 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-13T18:49:43.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:49:43.716 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:49:43.717 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-13T18:49:43.751 INFO:teuthology.orchestra.run.smithi103.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:49:43.751 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:49:43.752 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:49:43.752 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:49:44.754 DEBUG:teuthology.parallel:result is None 2024-09-13T18:49:44.754 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:49:44.761 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:49:44.761 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:49:44.766 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:49:44.805 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:49:44.811 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:49:44.817 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:49:44.817 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:49:44.845 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:49:44.897 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:49:44.904 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:49:44.904 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:49:44.908 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:49:45.018 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:49:45.025 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:49:45.048 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:49:45.053 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:49:45.056 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:49:45.064 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:49:45.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:49:45.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:49:45.125 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:49:45.136 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:49:45.136 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:49:45.140 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:49:45.175 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:49:45.273 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:49:45.350 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:49:45.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:49:45.484 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:49:45.484 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:49:45.539 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:49:45.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:49:45.678 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:49:45.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:49:45.811 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:49:45.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:49:45.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-09-13T18:49:45.870 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-13T18:49:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:49:45.986 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:49:46.423 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:49:46.430 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:49:46.431 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:49:46.441 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:49:46.450 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:49:46.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-09-13T18:49:46.547 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-09-13T18:49:46.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-13T18:49:46.634 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-13T18:49:46.637 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:49:46.638 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-09-13T18:49:46.693 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-09-13T18:49:46.693 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-13T18:49:46.741 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-13T18:49:46.741 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:49:46.742 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:49:46.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:49:46.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:49:46.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:49:46.858 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:49:46.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:49:46.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:49:46.977 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:49:46.986 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:49:46.989 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:49:47.129 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:49:47.141 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:49:47.142 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:54:29.295 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2024-09-13T18:54:29.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:54:29.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:54:29.393 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-13T18:54:29.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-13T18:54:29.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:54:29.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:54:29.597 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-13T18:54:29.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-13T18:54:29.707 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:54:29.716 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:54:29.717 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:54:29.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:54:29.721 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:54:29.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:54:29.781 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:54:29.807 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:54:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:54:29.836 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:54:29.863 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-09-13T18:54:29.887 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-13T18:54:29.888 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-09-13T18:54:29.912 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-13T18:54:29.917 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:54:29.940 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:54:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:54:29.970 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:54:30.048 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:54:30.054 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:54:30.055 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-13T18:54:30.055 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.055 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.055 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.055 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.072 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:54:30.079 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:54:30.079 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-13T18:54:30.079 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.079 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.080 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.080 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:54:30.081 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:54:30.088 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:54:30.088 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:54:30.089 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:54:30.089 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:54:30.094 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:54:30.094 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:54:30.095 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:54:30.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:54:30.097 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:54:30.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:54:30.243 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:54:30.244 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:54:30.256 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:54:30.256 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:54:30.364 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:54:30.365 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:54:30.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:54:30.376 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:54:30.376 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:54:30.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:54:30.422 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:54:30.422 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:54:30.432 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:54:30.432 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:54:30.519 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:54:30.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:54:30.598 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:54:30.607 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:54:30.653 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-09-13T18:54:30.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-09-13T18:54:30.662 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-13T18:54:30.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-13T18:54:30.951 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-13T18:54:30.956 INFO:teuthology.orchestra.run.smithi033.stdout:45 files removed 2024-09-13T18:54:30.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:54:30.989 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:54:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 265 kB/s | 78 kB 00:00 2024-09-13T18:54:31.715 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 259 kB/s | 78 kB 00:00 2024-09-13T18:54:32.007 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 47 kB/s | 11 kB 00:00 2024-09-13T18:54:32.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-09-13T18:54:32.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T18:54:32.291 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-13T18:54:32.742 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-13T18:54:32.924 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T18:54:35.936 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-13T18:54:36.151 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-13T18:54:40.678 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-13T18:54:41.302 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T18:54:42.429 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-13T18:54:43.153 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-13T18:54:43.325 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-13T18:54:44.031 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-13T18:54:49.673 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:54:50.704 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:54:52.189 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:54:52.190 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:54:52.203 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:54:52.204 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:54:52.205 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:54:52.206 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:54:52.208 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:54:52.211 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:54:52.212 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:54:52.277 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:54:52.308 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:54:52.309 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:54:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:54:52.311 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:54:52.312 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:54:52.313 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:54:52.314 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:54:52.315 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:54:52.316 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:54:52.317 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:54:52.318 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout:Install 130 Packages 2024-09-13T18:54:52.319 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-13T18:54:52.320 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:54:52.320 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 203 M 2024-09-13T18:54:52.320 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-13T18:54:53.033 INFO:teuthology.orchestra.run.smithi103.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-13T18:54:53.200 INFO:teuthology.orchestra.run.smithi103.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 5.0 MB/s | 852 kB 00:00 2024-09-13T18:54:53.294 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:54:53.295 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:54:53.300 INFO:teuthology.orchestra.run.smithi103.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.4 MB/s | 142 kB 00:00 2024-09-13T18:54:53.309 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:54:53.310 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:54:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:54:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:54:53.314 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:54:53.317 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:54:53.318 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:54:53.387 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-13T18:54:53.407 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-13T18:54:53.407 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-09-13T18:54:53.407 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:54:53.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:54:53.409 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-09-13T18:54:53.410 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:54:53.411 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:54:53.412 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:54:53.413 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:54:53.415 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:54:53.416 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:54:53.417 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-13T18:54:53.418 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================== 2024-09-13T18:54:53.419 INFO:teuthology.orchestra.run.smithi033.stdout:Install 130 Packages 2024-09-13T18:54:53.419 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 8 Packages 2024-09-13T18:54:53.419 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:54:53.419 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 203 M 2024-09-13T18:54:53.419 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-13T18:54:53.425 INFO:teuthology.orchestra.run.smithi103.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 9.8 MB/s | 5.1 MB 00:00 2024-09-13T18:54:53.493 INFO:teuthology.orchestra.run.smithi103.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 11 MB/s | 2.1 MB 00:00 2024-09-13T18:54:53.543 INFO:teuthology.orchestra.run.smithi103.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-13T18:54:53.922 INFO:teuthology.orchestra.run.smithi033.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-13T18:54:53.951 INFO:teuthology.orchestra.run.smithi103.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 18 MB/s | 18 MB 00:01 2024-09-13T18:54:54.043 INFO:teuthology.orchestra.run.smithi103.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 8.5 MB/s | 4.7 MB 00:00 2024-09-13T18:54:54.135 INFO:teuthology.orchestra.run.smithi103.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 274 kB/s | 25 kB 00:00 2024-09-13T18:54:54.181 INFO:teuthology.orchestra.run.smithi033.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.2 MB/s | 852 kB 00:00 2024-09-13T18:54:54.264 INFO:teuthology.orchestra.run.smithi033.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.7 MB/s | 142 kB 00:00 2024-09-13T18:54:54.477 INFO:teuthology.orchestra.run.smithi103.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 15 MB/s | 7.7 MB 00:00 2024-09-13T18:54:54.681 INFO:teuthology.orchestra.run.smithi033.stdout:(4/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 5.0 MB/s | 2.1 MB 00:00 2024-09-13T18:54:54.702 INFO:teuthology.orchestra.run.smithi103.stdout:(11/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 14 MB/s | 17 MB 00:01 2024-09-13T18:54:54.728 INFO:teuthology.orchestra.run.smithi103.stdout:(12/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 897 kB/s | 224 kB 00:00 2024-09-13T18:54:54.778 INFO:teuthology.orchestra.run.smithi103.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 414 kB/s | 31 kB 00:00 2024-09-13T18:54:54.815 INFO:teuthology.orchestra.run.smithi033.stdout:(5/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 5.0 MB/s | 5.1 MB 00:01 2024-09-13T18:54:54.820 INFO:teuthology.orchestra.run.smithi103.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 7.6 MB/s | 712 kB 00:00 2024-09-13T18:54:54.846 INFO:teuthology.orchestra.run.smithi103.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T18:54:54.896 INFO:teuthology.orchestra.run.smithi103.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 1.7 MB/s | 127 kB 00:00 2024-09-13T18:54:54.921 INFO:teuthology.orchestra.run.smithi103.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 6.2 MB/s | 478 kB 00:00 2024-09-13T18:54:54.931 INFO:teuthology.orchestra.run.smithi033.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 5.8 MB/s | 1.5 MB 00:00 2024-09-13T18:54:55.013 INFO:teuthology.orchestra.run.smithi103.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 489 kB/s | 45 kB 00:00 2024-09-13T18:54:55.105 INFO:teuthology.orchestra.run.smithi103.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.4 MB/s | 129 kB 00:00 2024-09-13T18:54:55.205 INFO:teuthology.orchestra.run.smithi103.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 1.6 MB/s | 162 kB 00:00 2024-09-13T18:54:55.272 INFO:teuthology.orchestra.run.smithi103.stdout:(21/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.5 MB 00:00 2024-09-13T18:54:55.297 INFO:teuthology.orchestra.run.smithi103.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 3.4 MB/s | 321 kB 00:00 2024-09-13T18:54:55.331 INFO:teuthology.orchestra.run.smithi103.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T18:54:55.356 INFO:teuthology.orchestra.run.smithi103.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T18:54:55.399 INFO:teuthology.orchestra.run.smithi103.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.3 MB/s | 87 kB 00:00 2024-09-13T18:54:55.449 INFO:teuthology.orchestra.run.smithi033.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 18 MB 00:01 2024-09-13T18:54:55.465 INFO:teuthology.orchestra.run.smithi103.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T18:54:55.563 INFO:teuthology.orchestra.run.smithi033.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 6.3 MB/s | 4.7 MB 00:00 2024-09-13T18:54:55.583 INFO:teuthology.orchestra.run.smithi103.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 3.0 MB 00:00 2024-09-13T18:54:55.633 INFO:teuthology.orchestra.run.smithi103.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 146 kB/s | 24 kB 00:00 2024-09-13T18:54:55.641 INFO:teuthology.orchestra.run.smithi033.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 327 kB/s | 25 kB 00:00 2024-09-13T18:54:55.658 INFO:teuthology.orchestra.run.smithi103.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.8 MB/s | 139 kB 00:00 2024-09-13T18:54:55.958 INFO:teuthology.orchestra.run.smithi103.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 11 MB/s | 3.5 MB 00:00 2024-09-13T18:54:55.991 INFO:teuthology.orchestra.run.smithi033.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 14 MB/s | 7.7 MB 00:00 2024-09-13T18:54:56.025 INFO:teuthology.orchestra.run.smithi103.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 3.6 MB/s | 246 kB 00:00 2024-09-13T18:54:56.058 INFO:teuthology.orchestra.run.smithi033.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.3 MB/s | 224 kB 00:00 2024-09-13T18:54:56.117 INFO:teuthology.orchestra.run.smithi103.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 538 kB/s | 49 kB 00:00 2024-09-13T18:54:56.125 INFO:teuthology.orchestra.run.smithi033.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 468 kB/s | 31 kB 00:00 2024-09-13T18:54:56.193 INFO:teuthology.orchestra.run.smithi103.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 219 kB/s | 16 kB 00:00 2024-09-13T18:54:56.200 INFO:teuthology.orchestra.run.smithi033.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 9.3 MB/s | 712 kB 00:00 2024-09-13T18:54:56.268 INFO:teuthology.orchestra.run.smithi103.stdout:(34/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 3.5 MB/s | 264 kB 00:00 2024-09-13T18:54:56.275 INFO:teuthology.orchestra.run.smithi033.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.2 MB/s | 166 kB 00:00 2024-09-13T18:54:56.334 INFO:teuthology.orchestra.run.smithi033.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 2.1 MB/s | 127 kB 00:00 2024-09-13T18:54:56.360 INFO:teuthology.orchestra.run.smithi103.stdout:(35/138): ceph-mgr-diskprediction-local-18.2.4- 11 MB/s | 7.4 MB 00:00 2024-09-13T18:54:56.385 INFO:teuthology.orchestra.run.smithi103.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 1.9 MB/s | 226 kB 00:00 2024-09-13T18:54:56.393 INFO:teuthology.orchestra.run.smithi033.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 8.0 MB/s | 478 kB 00:00 2024-09-13T18:54:56.452 INFO:teuthology.orchestra.run.smithi103.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 199 kB/s | 18 kB 00:00 2024-09-13T18:54:56.561 INFO:teuthology.orchestra.run.smithi103.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-13T18:54:56.675 INFO:teuthology.orchestra.run.smithi103.stdout:(39/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-13T18:54:56.760 INFO:teuthology.orchestra.run.smithi033.stdout:(17/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 9.0 MB/s | 17 MB 00:01 2024-09-13T18:54:56.843 INFO:teuthology.orchestra.run.smithi033.stdout:(18/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 9.9 MB/s | 4.5 MB 00:00 2024-09-13T18:54:56.869 INFO:teuthology.orchestra.run.smithi033.stdout:(19/138): python3-ceph-argparse-18.2.4-860.g6c6 415 kB/s | 45 kB 00:00 2024-09-13T18:54:56.894 INFO:teuthology.orchestra.run.smithi033.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 2.5 MB/s | 129 kB 00:00 2024-09-13T18:54:56.919 INFO:teuthology.orchestra.run.smithi033.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T18:54:56.961 INFO:teuthology.orchestra.run.smithi033.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 4.7 MB/s | 321 kB 00:00 2024-09-13T18:54:56.986 INFO:teuthology.orchestra.run.smithi033.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 4.4 MB/s | 301 kB 00:00 2024-09-13T18:54:57.003 INFO:teuthology.orchestra.run.smithi033.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 2.3 MB/s | 99 kB 00:00 2024-09-13T18:54:57.037 INFO:teuthology.orchestra.run.smithi033.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T18:54:57.104 INFO:teuthology.orchestra.run.smithi033.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T18:54:57.120 INFO:teuthology.orchestra.run.smithi103.stdout:(40/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 13 MB/s | 40 MB 00:02 2024-09-13T18:54:57.154 INFO:teuthology.orchestra.run.smithi103.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-13T18:54:57.179 INFO:teuthology.orchestra.run.smithi103.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 503 kB/s | 253 kB 00:00 2024-09-13T18:54:57.187 INFO:teuthology.orchestra.run.smithi033.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 3.0 MB 00:00 2024-09-13T18:54:57.204 INFO:teuthology.orchestra.run.smithi103.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T18:54:57.205 INFO:teuthology.orchestra.run.smithi033.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 244 kB/s | 24 kB 00:00 2024-09-13T18:54:57.238 INFO:teuthology.orchestra.run.smithi033.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T18:54:57.263 INFO:teuthology.orchestra.run.smithi103.stdout:(44/138): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T18:54:57.289 INFO:teuthology.orchestra.run.smithi103.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-13T18:54:57.330 INFO:teuthology.orchestra.run.smithi103.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-13T18:54:57.447 INFO:teuthology.orchestra.run.smithi103.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-13T18:54:57.496 INFO:teuthology.orchestra.run.smithi033.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 12 MB/s | 3.5 MB 00:00 2024-09-13T18:54:57.540 INFO:teuthology.orchestra.run.smithi103.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-13T18:54:57.606 INFO:teuthology.orchestra.run.smithi103.stdout:(49/138): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-13T18:54:57.622 INFO:teuthology.orchestra.run.smithi033.stdout:(31/138): ceph-mgr-diskprediction-local-18.2.4- 19 MB/s | 7.4 MB 00:00 2024-09-13T18:54:57.631 INFO:teuthology.orchestra.run.smithi103.stdout:(50/138): boost-program-options-1.75.0-8.el9.x8 582 kB/s | 107 kB 00:00 2024-09-13T18:54:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 1.6 MB/s | 246 kB 00:00 2024-09-13T18:54:57.672 INFO:teuthology.orchestra.run.smithi033.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 984 kB/s | 49 kB 00:00 2024-09-13T18:54:57.673 INFO:teuthology.orchestra.run.smithi103.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 163 kB/s | 22 kB 00:00 2024-09-13T18:54:57.698 INFO:teuthology.orchestra.run.smithi033.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 329 kB/s | 16 kB 00:00 2024-09-13T18:54:57.699 INFO:teuthology.orchestra.run.smithi103.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-13T18:54:57.723 INFO:teuthology.orchestra.run.smithi033.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 5.1 MB/s | 264 kB 00:00 2024-09-13T18:54:57.740 INFO:teuthology.orchestra.run.smithi103.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-09-13T18:54:57.748 INFO:teuthology.orchestra.run.smithi033.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T18:54:57.774 INFO:teuthology.orchestra.run.smithi033.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 365 kB/s | 18 kB 00:00 2024-09-13T18:54:57.783 INFO:teuthology.orchestra.run.smithi103.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-13T18:54:57.825 INFO:teuthology.orchestra.run.smithi103.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-13T18:54:57.850 INFO:teuthology.orchestra.run.smithi103.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-13T18:54:57.892 INFO:teuthology.orchestra.run.smithi103.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-09-13T18:54:57.916 INFO:teuthology.orchestra.run.smithi033.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-13T18:54:57.999 INFO:teuthology.orchestra.run.smithi033.stdout:(39/138): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-13T18:54:58.009 INFO:teuthology.orchestra.run.smithi103.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-13T18:54:58.033 INFO:teuthology.orchestra.run.smithi033.stdout:(40/138): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-13T18:54:58.043 INFO:teuthology.orchestra.run.smithi103.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-13T18:54:58.058 INFO:teuthology.orchestra.run.smithi033.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-13T18:54:58.093 INFO:teuthology.orchestra.run.smithi103.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-13T18:54:58.117 INFO:teuthology.orchestra.run.smithi033.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T18:54:58.143 INFO:teuthology.orchestra.run.smithi103.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-09-13T18:54:58.160 INFO:teuthology.orchestra.run.smithi033.stdout:(43/138): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-13T18:54:58.184 INFO:teuthology.orchestra.run.smithi033.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-13T18:54:58.201 INFO:teuthology.orchestra.run.smithi033.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-13T18:54:58.202 INFO:teuthology.orchestra.run.smithi103.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T18:54:58.243 INFO:teuthology.orchestra.run.smithi033.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T18:54:58.252 INFO:teuthology.orchestra.run.smithi103.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-13T18:54:58.311 INFO:teuthology.orchestra.run.smithi103.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.7 MB/s | 3.0 MB 00:00 2024-09-13T18:54:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-13T18:54:58.410 INFO:teuthology.orchestra.run.smithi033.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-13T18:54:58.444 INFO:teuthology.orchestra.run.smithi033.stdout:(49/138): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-13T18:54:58.469 INFO:teuthology.orchestra.run.smithi033.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-13T18:54:58.495 INFO:teuthology.orchestra.run.smithi033.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi033.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-13T18:54:58.562 INFO:teuthology.orchestra.run.smithi033.stdout:(53/138): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-13T18:54:58.611 INFO:teuthology.orchestra.run.smithi103.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-09-13T18:54:58.629 INFO:teuthology.orchestra.run.smithi033.stdout:(54/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-13T18:54:58.654 INFO:teuthology.orchestra.run.smithi033.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-13T18:54:58.679 INFO:teuthology.orchestra.run.smithi033.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-13T18:54:58.705 INFO:teuthology.orchestra.run.smithi033.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-13T18:54:58.738 INFO:teuthology.orchestra.run.smithi033.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-13T18:54:58.781 INFO:teuthology.orchestra.run.smithi033.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-13T18:54:58.786 INFO:teuthology.orchestra.run.smithi103.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-13T18:54:58.797 INFO:teuthology.orchestra.run.smithi033.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-13T18:54:58.814 INFO:teuthology.orchestra.run.smithi033.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-13T18:54:58.845 INFO:teuthology.orchestra.run.smithi103.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T18:54:58.848 INFO:teuthology.orchestra.run.smithi033.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-13T18:54:58.865 INFO:teuthology.orchestra.run.smithi033.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi033.stdout:(64/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-09-13T18:54:59.037 INFO:teuthology.orchestra.run.smithi103.stdout:(68/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-09-13T18:54:59.091 INFO:teuthology.orchestra.run.smithi033.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-13T18:54:59.491 INFO:teuthology.orchestra.run.smithi033.stdout:(66/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 10 MB/s | 40 MB 00:03 2024-09-13T18:54:59.529 INFO:teuthology.orchestra.run.smithi103.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-13T18:54:59.533 INFO:teuthology.orchestra.run.smithi033.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 2.0 MB/s | 910 kB 00:00 2024-09-13T18:54:59.566 INFO:teuthology.orchestra.run.smithi033.stdout:(68/138): postgresql-13.16-1.el9.x86_64.rpm 2.9 MB/s | 1.6 MB 00:00 2024-09-13T18:54:59.686 INFO:teuthology.orchestra.run.smithi103.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-13T18:54:59.767 INFO:teuthology.orchestra.run.smithi033.stdout:(69/138): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-13T18:54:59.787 INFO:teuthology.orchestra.run.smithi103.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T18:54:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:(70/138): postgresql-private-libs-13.16-1.el9.x 457 kB/s | 137 kB 00:00 2024-09-13T18:54:59.817 INFO:teuthology.orchestra.run.smithi033.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T18:54:59.859 INFO:teuthology.orchestra.run.smithi033.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-13T18:54:59.863 INFO:teuthology.orchestra.run.smithi103.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-13T18:54:59.947 INFO:teuthology.orchestra.run.smithi103.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 230 kB/s | 19 kB 00:00 2024-09-13T18:54:59.951 INFO:teuthology.orchestra.run.smithi033.stdout:(73/138): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T18:54:59.976 INFO:teuthology.orchestra.run.smithi033.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-13T18:55:00.002 INFO:teuthology.orchestra.run.smithi033.stdout:(75/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-09-13T18:55:00.052 INFO:teuthology.orchestra.run.smithi033.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-13T18:55:00.094 INFO:teuthology.orchestra.run.smithi033.stdout:(77/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-13T18:55:00.114 INFO:teuthology.orchestra.run.smithi103.stdout:(74/138): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-13T18:55:00.119 INFO:teuthology.orchestra.run.smithi033.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-13T18:55:00.145 INFO:teuthology.orchestra.run.smithi033.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T18:55:00.147 INFO:teuthology.orchestra.run.smithi103.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 860 kB/s | 172 kB 00:00 2024-09-13T18:55:00.170 INFO:teuthology.orchestra.run.smithi033.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T18:55:00.189 INFO:teuthology.orchestra.run.smithi103.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 465 kB/s | 35 kB 00:00 2024-09-13T18:55:00.195 INFO:teuthology.orchestra.run.smithi033.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-13T18:55:00.220 INFO:teuthology.orchestra.run.smithi033.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T18:55:00.245 INFO:teuthology.orchestra.run.smithi033.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-13T18:55:00.271 INFO:teuthology.orchestra.run.smithi033.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T18:55:00.273 INFO:teuthology.orchestra.run.smithi103.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-13T18:55:00.296 INFO:teuthology.orchestra.run.smithi033.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T18:55:00.338 INFO:teuthology.orchestra.run.smithi033.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T18:55:00.373 INFO:teuthology.orchestra.run.smithi103.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-13T18:55:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-13T18:55:00.424 INFO:teuthology.orchestra.run.smithi103.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T18:55:00.430 INFO:teuthology.orchestra.run.smithi033.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T18:55:00.481 INFO:teuthology.orchestra.run.smithi033.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T18:55:00.499 INFO:teuthology.orchestra.run.smithi103.stdout:(80/138): python3-babel-2.9.1-2.el9.noarch.rpm 4.1 MB/s | 6.0 MB 00:01 2024-09-13T18:55:00.531 INFO:teuthology.orchestra.run.smithi033.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T18:55:00.566 INFO:teuthology.orchestra.run.smithi103.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 298 kB/s | 42 kB 00:00 2024-09-13T18:55:00.591 INFO:teuthology.orchestra.run.smithi103.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-13T18:55:00.658 INFO:teuthology.orchestra.run.smithi103.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-09-13T18:55:00.683 INFO:teuthology.orchestra.run.smithi103.stdout:(84/138): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-13T18:55:00.698 INFO:teuthology.orchestra.run.smithi033.stdout:(91/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-13T18:55:00.724 INFO:teuthology.orchestra.run.smithi033.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-13T18:55:00.725 INFO:teuthology.orchestra.run.smithi103.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 806 kB/s | 54 kB 00:00 2024-09-13T18:55:00.774 INFO:teuthology.orchestra.run.smithi033.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T18:55:00.801 INFO:teuthology.orchestra.run.smithi103.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 556 kB/s | 42 kB 00:00 2024-09-13T18:55:00.816 INFO:teuthology.orchestra.run.smithi033.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T18:55:00.833 INFO:teuthology.orchestra.run.smithi033.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-13T18:55:00.850 INFO:teuthology.orchestra.run.smithi033.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-13T18:55:00.884 INFO:teuthology.orchestra.run.smithi103.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-13T18:55:00.933 INFO:teuthology.orchestra.run.smithi033.stdout:(97/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-13T18:55:00.975 INFO:teuthology.orchestra.run.smithi033.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-09-13T18:55:01.036 INFO:teuthology.orchestra.run.smithi033.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-09-13T18:55:01.051 INFO:teuthology.orchestra.run.smithi033.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-13T18:55:01.068 INFO:teuthology.orchestra.run.smithi033.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-13T18:55:01.076 INFO:teuthology.orchestra.run.smithi103.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-09-13T18:55:01.085 INFO:teuthology.orchestra.run.smithi033.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 856 kB/s | 14 kB 00:00 2024-09-13T18:55:01.119 INFO:teuthology.orchestra.run.smithi033.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-13T18:55:01.160 INFO:teuthology.orchestra.run.smithi103.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-13T18:55:01.160 INFO:teuthology.orchestra.run.smithi033.stdout:(104/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-13T18:55:01.194 INFO:teuthology.orchestra.run.smithi033.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-13T18:55:01.220 INFO:teuthology.orchestra.run.smithi033.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-13T18:55:01.235 INFO:teuthology.orchestra.run.smithi103.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 64 kB 00:00 2024-09-13T18:55:01.245 INFO:teuthology.orchestra.run.smithi033.stdout:(107/138): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-13T18:55:01.278 INFO:teuthology.orchestra.run.smithi033.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-09-13T18:55:01.304 INFO:teuthology.orchestra.run.smithi033.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 397 kB/s | 23 kB 00:00 2024-09-13T18:55:01.311 INFO:teuthology.orchestra.run.smithi103.stdout:(91/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-13T18:55:01.329 INFO:teuthology.orchestra.run.smithi033.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T18:55:01.354 INFO:teuthology.orchestra.run.smithi033.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T18:55:01.361 INFO:teuthology.orchestra.run.smithi103.stdout:(92/138): fmt-8.1.1-5.el9.x86_64.rpm 2.2 MB/s | 111 kB 00:00 2024-09-13T18:55:01.371 INFO:teuthology.orchestra.run.smithi033.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-13T18:55:01.396 INFO:teuthology.orchestra.run.smithi033.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T18:55:01.416 INFO:teuthology.orchestra.run.smithi103.stdout:(93/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 5.6 MB/s | 308 kB 00:00 2024-09-13T18:55:01.422 INFO:teuthology.orchestra.run.smithi033.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-13T18:55:01.497 INFO:teuthology.orchestra.run.smithi033.stdout:(115/138): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-13T18:55:01.522 INFO:teuthology.orchestra.run.smithi033.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-13T18:55:01.537 INFO:teuthology.orchestra.run.smithi103.stdout:(94/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.7 MB/s | 5.1 MB 00:01 2024-09-13T18:55:01.547 INFO:teuthology.orchestra.run.smithi033.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-13T18:55:01.572 INFO:teuthology.orchestra.run.smithi033.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T18:55:01.598 INFO:teuthology.orchestra.run.smithi033.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-13T18:55:01.612 INFO:teuthology.orchestra.run.smithi103.stdout:(95/138): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-13T18:55:01.623 INFO:teuthology.orchestra.run.smithi033.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T18:55:01.654 INFO:teuthology.orchestra.run.smithi103.stdout:(96/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-09-13T18:55:01.657 INFO:teuthology.orchestra.run.smithi033.stdout:(121/138): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-09-13T18:55:01.682 INFO:teuthology.orchestra.run.smithi033.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-09-13T18:55:01.696 INFO:teuthology.orchestra.run.smithi103.stdout:(97/138): liboath-2.6.7-2.el9.x86_64.rpm 596 kB/s | 49 kB 00:00 2024-09-13T18:55:01.708 INFO:teuthology.orchestra.run.smithi033.stdout:(123/138): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-13T18:55:01.722 INFO:teuthology.orchestra.run.smithi103.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-13T18:55:01.733 INFO:teuthology.orchestra.run.smithi033.stdout:(124/138): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-13T18:55:01.763 INFO:teuthology.orchestra.run.smithi103.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-09-13T18:55:01.766 INFO:teuthology.orchestra.run.smithi033.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T18:55:01.805 INFO:teuthology.orchestra.run.smithi103.stdout:(100/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-13T18:55:01.869 INFO:teuthology.orchestra.run.smithi103.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 412 kB/s | 43 kB 00:00 2024-09-13T18:55:01.914 INFO:teuthology.orchestra.run.smithi103.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 296 kB/s | 32 kB 00:00 2024-09-13T18:55:01.950 INFO:teuthology.orchestra.run.smithi033.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 116 kB/s | 20 kB 00:00 2024-09-13T18:55:01.956 INFO:teuthology.orchestra.run.smithi103.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 163 kB/s | 14 kB 00:00 2024-09-13T18:55:01.975 INFO:teuthology.orchestra.run.smithi033.stdout:(127/138): python3-webob-1.8.8-2.el9.noarch.rpm 788 kB/s | 230 kB 00:00 2024-09-13T18:55:01.990 INFO:teuthology.orchestra.run.smithi103.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-13T18:55:02.001 INFO:teuthology.orchestra.run.smithi033.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T18:55:02.024 INFO:teuthology.orchestra.run.smithi103.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-13T18:55:02.026 INFO:teuthology.orchestra.run.smithi033.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 1.4 MB/s | 427 kB 00:00 2024-09-13T18:55:02.049 INFO:teuthology.orchestra.run.smithi103.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-13T18:55:02.085 INFO:teuthology.orchestra.run.smithi033.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T18:55:02.099 INFO:teuthology.orchestra.run.smithi103.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-09-13T18:55:02.150 INFO:teuthology.orchestra.run.smithi103.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-09-13T18:55:02.200 INFO:teuthology.orchestra.run.smithi103.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-09-13T18:55:02.251 INFO:teuthology.orchestra.run.smithi103.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-09-13T18:55:02.318 INFO:teuthology.orchestra.run.smithi033.stdout:(131/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 10 MB/s | 3.0 MB 00:00 2024-09-13T18:55:02.322 INFO:teuthology.orchestra.run.smithi103.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 161 kB/s | 20 kB 00:00 2024-09-13T18:55:02.377 INFO:teuthology.orchestra.run.smithi033.stdout:(132/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.8 MB/s | 3.3 MB 00:00 2024-09-13T18:55:02.381 INFO:teuthology.orchestra.run.smithi103.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 798 kB/s | 46 kB 00:00 2024-09-13T18:55:02.407 INFO:teuthology.orchestra.run.smithi103.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T18:55:02.427 INFO:teuthology.orchestra.run.smithi033.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-09-13T18:55:02.457 INFO:teuthology.orchestra.run.smithi103.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T18:55:02.485 INFO:teuthology.orchestra.run.smithi033.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-13T18:55:02.491 INFO:teuthology.orchestra.run.smithi103.stdout:(115/138): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T18:55:02.511 INFO:teuthology.orchestra.run.smithi033.stdout:(135/138): NetworkManager-team-1.49.90-1.el9.x8 304 kB/s | 41 kB 00:00 2024-09-13T18:55:02.533 INFO:teuthology.orchestra.run.smithi103.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 395 kB/s | 16 kB 00:00 2024-09-13T18:55:02.558 INFO:teuthology.orchestra.run.smithi103.stdout:(117/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-13T18:55:02.578 INFO:teuthology.orchestra.run.smithi033.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-13T18:55:02.600 INFO:teuthology.orchestra.run.smithi103.stdout:(118/138): python3-repoze-lru-0.7-16.el9.noarch 738 kB/s | 31 kB 00:00 2024-09-13T18:55:02.620 INFO:teuthology.orchestra.run.smithi033.stdout:(137/138): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-13T18:55:02.634 INFO:teuthology.orchestra.run.smithi103.stdout:(119/138): python3-routes-2.5.1-5.el9.noarch.rp 5.6 MB/s | 188 kB 00:00 2024-09-13T18:55:02.668 INFO:teuthology.orchestra.run.smithi103.stdout:(120/138): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-13T18:55:02.709 INFO:teuthology.orchestra.run.smithi103.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-09-13T18:55:02.777 INFO:teuthology.orchestra.run.smithi103.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-09-13T18:55:02.801 INFO:teuthology.orchestra.run.smithi103.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 810 kB/s | 74 kB 00:00 2024-09-13T18:55:02.827 INFO:teuthology.orchestra.run.smithi103.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T18:55:02.852 INFO:teuthology.orchestra.run.smithi103.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T18:55:02.895 INFO:teuthology.orchestra.run.smithi033.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-09-13T18:55:02.900 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:55:02.900 INFO:teuthology.orchestra.run.smithi033.stdout:Total 21 MB/s | 203 MB 00:09 2024-09-13T18:55:02.902 INFO:teuthology.orchestra.run.smithi103.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 402 kB/s | 20 kB 00:00 2024-09-13T18:55:02.936 INFO:teuthology.orchestra.run.smithi103.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T18:55:02.962 INFO:teuthology.orchestra.run.smithi103.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-13T18:55:03.029 INFO:teuthology.orchestra.run.smithi103.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T18:55:03.296 INFO:teuthology.orchestra.run.smithi103.stdout:(130/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-13T18:55:03.371 INFO:teuthology.orchestra.run.smithi103.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.1 MB/s | 3.3 MB 00:00 2024-09-13T18:55:03.463 INFO:teuthology.orchestra.run.smithi103.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 6.9 MB/s | 3.0 MB 00:00 2024-09-13T18:55:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 318 kB/s | 41 kB 00:00 2024-09-13T18:55:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-09-13T18:55:03.689 INFO:teuthology.orchestra.run.smithi103.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 5.7 MB/s | 1.8 MB 00:00 2024-09-13T18:55:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 2.0 MB/s | 249 kB 00:00 2024-09-13T18:55:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-13T18:55:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-13T18:55:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:55:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T18:55:04.738 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-13T18:55:04.926 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-13T18:55:04.926 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-13T18:55:05.662 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-13T18:55:05.834 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-13T18:55:05.834 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-13T18:55:07.233 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-13T18:55:07.234 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-13T18:55:08.074 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-13T18:55:08.074 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-13T18:55:13.319 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-13T18:55:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:55:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:55:13.928 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:55:13.970 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:55:14.001 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:55:14.044 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-13T18:55:14.054 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:55:14.212 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:55:14.262 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:55:14.344 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:55:14.435 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:55:14.534 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:55:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:55:14.671 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:55:14.702 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:55:14.724 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:55:14.785 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:55:14.816 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:55:14.849 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:55:15.069 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:55:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:55:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:55:15.165 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:55:15.255 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:55:15.290 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:55:15.315 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:55:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:55:15.440 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:55:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:55:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:55:15.596 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:55:15.754 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:55:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:55:15.868 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:55:15.887 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:15.894 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:55:16.009 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:55:16.021 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:16.045 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:55:16.268 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:55:16.413 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:55:16.478 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:55:16.522 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:55:16.562 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:55:16.655 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:55:16.669 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:16.688 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:55:16.779 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:55:16.841 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:55:16.875 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:55:16.922 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:55:17.012 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:55:17.024 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:55:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:55:17.066 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:55:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:55:17.110 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:55:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:55:17.191 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:55:17.235 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:55:17.278 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:55:17.384 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:55:17.414 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:55:17.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:55:17.482 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:55:17.528 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:55:17.607 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:55:17.643 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:55:17.688 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:55:17.805 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:55:17.973 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:55:18.035 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:55:18.085 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:55:18.198 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:55:18.262 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:55:18.306 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:55:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:55:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:55:18.639 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:55:18.671 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:55:18.787 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:55:18.841 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:55:18.843 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:55:18.879 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:55:18.931 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:55:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:55:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:55:19.100 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:55:19.108 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:55:19.171 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:55:19.174 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:55:19.214 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:55:19.273 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:55:19.318 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:55:19.325 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:55:19.358 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:55:19.384 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:55:19.418 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:55:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:55:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:55:19.561 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:55:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:55:19.608 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:55:19.651 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:55:19.654 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:55:19.706 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:55:19.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:55:19.775 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:55:19.820 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:55:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:55:19.891 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:55:19.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:55:19.928 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:55:19.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:55:19.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:55:20.043 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:55:20.087 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:55:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:55:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:55:20.265 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:55:20.285 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:55:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:55:20.333 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:55:20.333 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:55:20.377 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:55:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:55:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:55:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:55:20.441 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:55:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:55:20.474 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:55:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:55:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:55:20.559 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:55:20.608 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:55:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:55:20.645 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:55:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:55:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:55:20.742 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:55:20.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:55:20.845 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:55:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:55:21.018 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:55:21.077 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:55:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:55:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:55:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:55:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:55:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:55:21.969 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:55:22.037 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:55:22.071 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:55:22.152 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:55:22.182 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:55:22.183 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:55:22.229 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:55:22.286 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:55:22.526 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:55:22.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:55:23.155 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:55:23.310 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:55:23.420 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:55:23.565 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:55:24.969 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:55:25.062 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:55:25.133 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:55:25.173 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:55:25.273 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:55:25.334 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:55:25.472 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:55:25.511 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:55:25.624 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:55:25.670 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:55:25.675 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:55:25.721 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:55:25.724 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:55:25.891 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:55:25.926 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:55:25.976 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:55:26.230 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:55:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:55:26.349 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:55:26.540 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:55:26.567 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:55:28.901 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:28.937 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:29.602 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:29.649 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:55:29.678 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:55:29.726 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:55:29.788 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:55:29.788 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:55:29.788 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:55:29.788 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:29.834 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:55:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:55:29.866 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:55:29.866 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:55:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:55:42.616 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:55:42.616 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-13T18:55:42.616 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-13T18:55:42.616 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-13T18:55:42.617 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-13T18:55:42.617 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-13T18:55:42.617 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-13T18:55:42.617 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-13T18:55:42.617 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:42.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:55:42.885 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:55:42.885 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:42.885 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:55:42.885 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-09-13T18:55:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:43.126 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:55:43.162 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:55:43.162 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:43.162 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:55:43.162 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:44.430 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:55:44.487 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:44.722 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:55:44.772 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:55:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:55:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:55:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:55:44.773 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:44.795 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:55:44.855 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:55:44.855 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:44.856 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:55:44.856 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:55:44.856 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:55:44.856 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:45.104 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:55:45.156 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:55:45.156 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:45.156 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:55:45.156 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:55:45.157 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:55:45.157 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:55:45.306 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:55:45.307 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:45.307 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:55:45.307 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:55:45.307 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:55:45.307 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:45.439 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:55:45.499 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:55:45.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:55:45.671 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:55:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:45.790 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:55:45.856 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:55:45.860 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:55:45.917 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:55:45.946 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:55:46.015 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:55:46.055 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:55:46.220 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:55:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:55:46.268 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:55:46.308 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:55:46.326 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:55:46.334 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:55:46.432 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:55:46.542 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:55:46.716 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:55:46.767 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:55:46.807 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:55:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:55:47.001 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:55:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:55:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:55:47.191 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:55:47.223 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:55:47.365 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:55:47.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:55:47.444 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:55:47.516 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:55:47.545 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:55:48.439 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:55:48.492 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:55:48.833 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:55:48.880 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:55:49.585 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:55:49.609 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:55:49.747 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:55:49.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:55:49.953 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:55:50.004 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:50.033 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:55:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:55:50.091 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:55:50.117 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:55:50.215 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:55:50.224 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:55:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:55:50.415 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:55:50.466 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:55:50.518 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:50.575 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:55:50.601 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:55:50.708 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:55:50.781 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:55:51.060 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:55:51.090 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:55:51.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:51.190 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:55:51.240 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:55:51.240 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.241 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:55:51.241 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:51.299 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:55:51.351 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:55:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:55:51.667 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:55:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:55:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:55:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:55:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:55:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:51.717 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:55:51.718 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.718 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:55:51.718 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:55:51.718 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:55:51.718 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:55:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:55:51.795 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.795 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:55:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:55:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:52.254 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:55:52.305 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:55:52.306 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:55:52.306 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:55:52.306 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:55:52.306 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:55:52.306 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:55:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:55:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:55:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:55:55.870 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:55:56.119 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:55:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:55:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:55:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:55:56.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:55:56.568 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:55:56.611 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:55:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:55:56.900 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:55:56.954 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:55:56.984 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:55:57.015 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:55:57.051 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:55:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:57.810 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:57.857 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:57.899 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:55:58.543 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:55:58.664 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:55:58.709 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:55:58.866 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:55:58.891 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:55:58.928 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:55:58.928 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:55:59.052 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:55:59.052 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:55:59.161 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:55:59.186 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:55:59.202 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:55:59.202 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:55:59.282 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:55:59.410 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:55:59.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:55:59.470 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:55:59.470 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:55:59.572 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:55:59.607 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:55:59.634 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:55:59.640 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:55:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:55:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:55:59.703 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:55:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:55:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:55:59.885 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:55:59.910 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:55:59.923 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:55:59.924 INFO:teuthology.orchestra.run.smithi103.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T18:55:59.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:55:59.926 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:55:59.926 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:56:00.170 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:56:00.171 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:56:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:56:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:56:00.608 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:56:00.608 INFO:teuthology.orchestra.run.smithi033.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T18:56:00.608 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:56:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:56:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:56:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:56:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:56:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:56:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:56:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:56:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:56:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:56:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:56:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:56:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:56:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:56:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:56:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:56:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:56:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:56:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:56:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:56:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:56:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:56:05.894 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:56:05.895 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:56:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:56:05.897 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:56:05.907 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:56:05.907 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:56:05.907 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:56:05.907 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:56:05.907 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:56:05.908 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:56:05.909 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:56:05.910 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:56:05.912 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:56:05.913 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:56:05.914 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:56:05.915 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:56:05.916 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:56:05.916 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:56:05.916 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:56:05.916 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:56:07.433 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:56:07.433 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:56:07.434 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:56:07.436 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:56:07.437 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:56:07.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:56:07.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:56:07.441 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:56:07.442 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:56:07.443 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:56:07.444 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:56:07.444 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:56:07.444 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:07.444 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-13T18:56:08.068 DEBUG:teuthology.parallel:result is None 2024-09-13T18:56:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:56:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:08.166 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-09-13T18:56:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:56:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:56:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:56:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:56:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:56:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:56:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:56:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:56:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:08.177 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-13T18:56:08.819 DEBUG:teuthology.parallel:result is None 2024-09-13T18:56:08.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:56:08.975 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:56:09.022 INFO:teuthology.orchestra.run.smithi033.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:56:09.023 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:56:09.023 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:56:09.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:56:09.178 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:56:09.223 INFO:teuthology.orchestra.run.smithi103.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:56:09.223 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:56:09.223 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:56:09.225 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:56:09.225 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:09.225 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:56:09.293 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:09.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:56:09.353 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:56:09.353 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:09.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:56:09.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:56:09.508 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:09.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:56:09.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:56:09.668 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:56:09.668 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:09.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:56:09.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:56:09.827 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:09.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:56:09.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:56:09.983 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:56:09.983 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:09.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:56:10.043 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:56:10.143 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:10.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:56:10.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:56:10.300 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:56:10.378 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:56:10.378 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2024-09-13T18:56:10.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-13T18:56:10.440 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:56:10.441 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:56:10.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:56:10.500 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:56:10.500 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:56:10.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:56:10.572 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:56:10.573 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:56:10.573 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:56:10.573 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:10.573 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:56:10.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:10.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:10.841 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:10.841 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:56:10.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:11.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:11.114 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:56:11.114 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:56:11.114 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7904017', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6geFx0CNgF7Jvhuy52zDbWyaek3CBE79F8pweF0ruSFhlorJG3ApglQQQ730dr8rrsy4jOSMAKGjz0AMaI3DU=', 'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKugETA15Ydh/Iz1tGH0LlT62ju/E7qZY6PBVxgR32dCaK15KKD1SmDPhthc2KACHijqVsWTqY/crimWN4tzb70='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:56:11.115 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:56:11.119 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:56:11.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:56:11.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:56:11.252 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:11.252 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:56:11.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:56:11.287 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-09-13T18:56:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-13 18:56:00.960778782 +0000 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-13 18:54:04.442508686 +0000 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-13 18:54:04.442508686 +0000 2024-09-13T18:56:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-13 18:54:04.442508686 +0000 2024-09-13T18:56:11.362 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:56:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-13T18:56:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-13T18:56:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000319208 s, 1.6 MB/s 2024-09-13T18:56:11.458 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:56:11.495 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-13 18:56:00.961778766 +0000 2024-09-13T18:56:11.571 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-13 18:54:04.946500548 +0000 2024-09-13T18:56:11.572 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-13 18:54:04.946500548 +0000 2024-09-13T18:56:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-13 18:54:04.946500548 +0000 2024-09-13T18:56:11.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:56:11.663 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-13T18:56:11.663 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-13T18:56:11.663 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000297654 s, 1.7 MB/s 2024-09-13T18:56:11.666 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:56:11.702 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-09-13T18:56:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-13 18:56:00.962778749 +0000 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-13 18:54:05.453492360 +0000 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-13 18:54:05.453492360 +0000 2024-09-13T18:56:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-13 18:54:05.453492360 +0000 2024-09-13T18:56:11.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:56:11.872 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-13T18:56:11.873 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-13T18:56:11.873 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000344174 s, 1.5 MB/s 2024-09-13T18:56:11.876 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:56:11.912 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-09-13T18:56:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:56:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:11.989 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-13T18:56:11.989 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:11.989 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:11.990 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-13 18:56:00.963778733 +0000 2024-09-13T18:56:11.990 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-13 18:54:05.980483850 +0000 2024-09-13T18:56:11.990 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-13 18:54:05.980483850 +0000 2024-09-13T18:56:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-13 18:54:05.980483850 +0000 2024-09-13T18:56:11.990 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-13T18:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-13T18:56:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000247599 s, 2.1 MB/s 2024-09-13T18:56:12.084 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:56:12.121 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:12.121 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:12.121 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:56:12.158 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:56:12.158 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-13 18:56:00.287816009 +0000 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-13 18:54:04.146936153 +0000 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-13 18:54:04.146936153 +0000 2024-09-13T18:56:12.234 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-13 18:54:04.146936153 +0000 2024-09-13T18:56:12.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:56:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-13T18:56:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-13T18:56:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000286134 s, 1.8 MB/s 2024-09-13T18:56:12.330 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:56:12.367 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-13 18:56:00.288815990 +0000 2024-09-13T18:56:12.443 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-13 18:54:04.627927195 +0000 2024-09-13T18:56:12.444 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-13 18:54:04.627927195 +0000 2024-09-13T18:56:12.444 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-13 18:54:04.627927195 +0000 2024-09-13T18:56:12.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:56:12.537 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-13T18:56:12.537 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-13T18:56:12.537 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000283126 s, 1.8 MB/s 2024-09-13T18:56:12.539 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:56:12.576 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:12.652 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-13 18:56:00.288815990 +0000 2024-09-13T18:56:12.653 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-13 18:54:05.106918274 +0000 2024-09-13T18:56:12.653 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-13 18:54:05.106918274 +0000 2024-09-13T18:56:12.653 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-13 18:54:05.106918274 +0000 2024-09-13T18:56:12.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:56:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-13T18:56:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-13T18:56:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000299812 s, 1.7 MB/s 2024-09-13T18:56:12.749 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:56:12.785 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-13T18:56:12.861 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-13 18:56:00.289815971 +0000 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-13 18:54:05.567909689 +0000 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-13 18:54:05.567909689 +0000 2024-09-13T18:56:12.862 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-13 18:54:05.567909689 +0000 2024-09-13T18:56:12.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-13T18:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-13T18:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00028712 s, 1.8 MB/s 2024-09-13T18:56:12.958 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:56:12.994 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:12.995 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:56:12.995 INFO:tasks.ceph:Generating config... 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:56:12.996 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:56:12.996 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T18:56:12.996 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:56:12.996 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:56:12.996 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:56:12.996 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:56:12.997 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T18:56:12.998 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:56:12.999 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:56:12.999 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:56:12.999 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:56:12.999 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:56:12.999 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:56:12.999 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:56:12.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:56:13.095 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:56:13.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:56:13.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:56:13.244 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.103'), ('mon.c', '[v2:172.21.15.103:3301,v1:172.21.15.103:6790]')] 2024-09-13T18:56:13.244 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:56:13.245 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:13.245 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:56:13.280 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.103 --addv c '[v2:172.21.15.103:3301,v1:172.21.15.103:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 6d8de347-8986-4090-a81e-548bd7528fe4 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = pacific 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 6d8de347-8986-4090-a81e-548bd7528fe4 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2024-09-13T18:56:13.395127+0000 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-13T18:56:13.395127+0000 2024-09-13T18:56:13.397 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 16 (pacific) 2024-09-13T18:56:13.398 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2024-09-13T18:56:13.398 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-13T18:56:13.398 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-09-13T18:56:13.398 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] mon.c 2024-09-13T18:56:13.398 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:56:13.400 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:56:13.435 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6d8de347-8986-4090-a81e-548bd7528fe4... 2024-09-13T18:56:13.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:56:13.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:56:13.572 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-09-13T18:56:13.572 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2024-09-13T18:56:13.572 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:56:13.572 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2024-09-13T18:56:13.572 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.573 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:56:13.574 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]" 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on skipped message = False 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 6d8de347-8986-4090-a81e-548bd7528fe4 2024-09-13T18:56:13.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.576 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2024-09-13T18:56:13.577 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2024-09-13T18:56:13.578 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-09-13T18:56:13.579 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:56:13.580 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on pool no app = False 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:56:13.581 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2024-09-13T18:56:13.582 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-09-13T18:56:13.583 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.584 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.585 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-13T18:56:13.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.33,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]" 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on skipped message = False 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 6d8de347-8986-4090-a81e-548bd7528fe4 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-13T18:56:13.587 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:56:13.588 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-09-13T18:56:13.589 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 1/20 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 1/20 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 4/10 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-13T18:56:13.590 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-13T18:56:13.591 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:56:13.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on pool no app = False 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2024-09-13T18:56:13.593 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2024-09-13T18:56:13.594 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2024-09-13T18:56:13.595 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2024-09-13T18:56:13.595 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-13T18:56:13.595 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-13T18:56:13.595 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-13T18:56:13.603 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:56:13.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:56:13.700 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:56:13.700 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:13.700 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:56:13.735 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:13.735 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:56:13.810 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:56:13.810 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:13.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:56:13.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:56:13.928 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:13.929 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:14.004 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:56:14.004 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:14.004 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:56:14.004 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:56:14.082 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:14.082 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:14.157 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:56:14.157 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:56:14.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:56:14.261 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:56:14.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:56:14.381 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:56:14.387 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:56:14.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:56:14.491 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:56:14.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:56:14.553 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:56:14.657 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:56:14.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:56:14.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:56:14.822 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:56:14.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:56:14.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:56:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:56:14.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:56:15.046 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:56:15.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:56:15.128 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:56:15.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:56:15.237 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:56:15.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:56:15.346 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:56:15.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:56:15.452 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:56:15.479 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:56:15.479 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:56:15.480 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:56:15.536 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:15.536 INFO:tasks.ceph:role: osd.0 2024-09-13T18:56:15.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:56:15.536 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:56:15.598 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:15.599 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:16.007 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-13T18:56:16.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-13T18:56:16.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:56:16.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:56:16.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:56:16.266 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:16.266 INFO:tasks.ceph:role: osd.1 2024-09-13T18:56:16.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:56:16.267 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:56:16.329 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:16.329 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:16.330 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:16.687 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-13T18:56:16.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-13T18:56:16.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:56:16.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:56:16.839 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:56:16.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:16.894 INFO:tasks.ceph:role: osd.2 2024-09-13T18:56:16.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:56:16.895 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:16.957 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:16.958 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:17.340 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-13T18:56:17.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-13T18:56:17.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:56:17.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:56:17.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:56:17.564 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:17.564 INFO:tasks.ceph:role: osd.3 2024-09-13T18:56:17.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:56:17.564 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:56:17.628 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:17.628 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:17.628 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:17.629 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:18.044 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-13T18:56:18.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-13T18:56:18.048 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:56:18.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:56:18.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:18.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.379+0000 7f4bd8fbf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:56:18.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.384+0000 7f4bd8fbf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:56:18.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.384+0000 7f4bd8fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:56:18.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.384+0000 7f4bd8fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:56:18.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.384+0000 7f4bd8fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:56:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:18.393+0000 7f4bd8fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:56:21.324 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:56:21.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:21.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.474+0000 7f4ca3218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:56:21.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.474+0000 7f4ca3218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:56:21.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.474+0000 7f4ca3218640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:56:21.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.474+0000 7f4ca3218640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:56:21.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.474+0000 7f4ca3218640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:56:21.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:21.477+0000 7f4ca3218640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:56:24.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:56:24.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.544+0000 7f94bae5e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:56:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.545+0000 7f94bae5e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:56:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.545+0000 7f94bae5e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:56:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.545+0000 7f94bae5e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:56:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.545+0000 7f94bae5e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:56:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:24.547+0000 7f94bae5e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:56:27.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:56:27.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:27.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.652+0000 7f4e0e0d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:56:27.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.653+0000 7f4e0e0d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:56:27.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.653+0000 7f4e0e0d6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:56:27.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.653+0000 7f4e0e0d6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:56:27.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.653+0000 7f4e0e0d6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:56:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:27.655+0000 7f4e0e0d6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:56:30.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:56:30.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:56:30.699 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:30.699 INFO:tasks.ceph:role: osd.4 2024-09-13T18:56:30.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:56:30.699 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:30.764 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:31.175 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-13T18:56:31.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-13T18:56:31.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:56:31.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:56:31.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:56:31.449 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:31.449 INFO:tasks.ceph:role: osd.5 2024-09-13T18:56:31.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:56:31.449 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:31.513 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-13T18:56:31.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-13T18:56:31.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:56:31.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:56:32.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:56:32.076 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:32.076 INFO:tasks.ceph:role: osd.6 2024-09-13T18:56:32.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:56:32.076 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:32.139 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:32.140 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:32.140 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:32.527 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-13T18:56:32.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-13T18:56:32.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:56:32.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:56:32.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:56:32.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:56:32.749 INFO:tasks.ceph:role: osd.7 2024-09-13T18:56:32.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:56:32.749 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:56:32.812 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:56:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:56:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:56:32.813 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:56:33.230 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-13T18:56:33.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-13T18:56:33.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:56:33.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:56:33.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:33.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.536+0000 7fa6e240b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:56:33.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.541+0000 7fa6e240b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:56:33.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.541+0000 7fa6e240b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:56:33.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.541+0000 7fa6e240b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:56:33.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.541+0000 7fa6e240b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:56:33.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:33.548+0000 7fa6e240b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:56:36.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:56:36.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:36.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.664+0000 7fd894569640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:56:36.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.665+0000 7fd894569640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:56:36.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.665+0000 7fd894569640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:56:36.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.665+0000 7fd894569640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:56:36.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.665+0000 7fd894569640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:56:36.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:36.667+0000 7fd894569640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:56:39.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:56:39.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:39.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.750+0000 7f5706031640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:56:39.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.751+0000 7f5706031640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:56:39.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.751+0000 7f5706031640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:56:39.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.751+0000 7f5706031640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:56:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.751+0000 7f5706031640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:56:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:39.753+0000 7f5706031640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:56:41.116 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:41.121 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:42.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:56:42.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:42.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.818+0000 7fa4e103e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:56:42.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.818+0000 7fa4e103e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:56:42.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.818+0000 7fa4e103e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:56:42.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.818+0000 7fa4e103e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:56:42.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.818+0000 7fa4e103e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:56:42.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:42.820+0000 7fa4e103e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:56:45.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:56:45.801 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:56:45.801 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:45.801 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:56:45.864 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:45.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:56:45.962 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:45.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:56:46.060 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:46.060 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:56:46.156 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:46.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:56:46.251 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:46.251 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:56:46.346 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:46.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:56:46.442 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:56:46.498 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:56:46.594 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:56:46.690 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:56:46.785 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:56:46.881 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:56:46.976 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:46.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:56:47.071 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:47.071 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:56:47.109 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:47.109 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:56:47.185 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:47.186 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:56:47.220 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:47.221 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:56:47.294 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:56:47.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:56:47.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg== 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A== 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw== 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2024-09-13T18:56:47.349 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ== 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2024-09-13T18:56:47.350 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[client.2] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ== 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout:[client.3] 2024-09-13T18:56:47.351 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw== 2024-09-13T18:56:47.386 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ== 2024-09-13T18:56:47.387 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ== 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw== 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ== 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg== 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w== 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-09-13T18:56:47.388 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA== 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA== 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog== 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout:[client.2] 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg== 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ== 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout:[client.3] 2024-09-13T18:56:47.389 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw== 2024-09-13T18:56:47.390 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:56:47.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:56:47.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:47.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:47.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:47.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:47.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:47.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:47.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:47.821 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:47.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:47.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.107 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:56:48.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:56:48.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:48.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:48.302 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:48.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:56:48.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.498 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.594 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:56:48.787 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:48.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:48.887 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:48.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:48.986 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:48.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:49.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:49.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:56:49.184 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:56:49.184 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:56:49.242 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:56:49.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:56:49.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:56:49.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:56:49.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:56:49.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:56:49.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:56:49.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:56:49.843 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:49.847 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:56:49.882 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:56:49.882 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:56:49.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:56:49.923 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:56:49.923 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:56:49.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:56:49.927 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:56:49.927 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:56:49.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:56:49.931 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:56:49.931 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:56:49.931 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:56:49.931 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:56:49.935 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:56:49.935 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:56:49.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:56:49.938 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:56:49.939 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:56:49.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:56:50.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.091+0000 7f28f2600640 1 Processor -- start 2024-09-13T18:56:50.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.091+0000 7f28f2600640 1 -- start start 2024-09-13T18:56:50.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.092+0000 7f28f2600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.092+0000 7f28f2600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.092+0000 7f28f2600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec13fbc0 con 0x7f28ec160370 2024-09-13T18:56:50.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.092+0000 7f28f2600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec06cca0 con 0x7f28ec0b3a40 2024-09-13T18:56:50.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.092+0000 7f28f2600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0ad200 con 0x7f28ec0ac870 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54362/0 (socket says 172.21.15.33:54362) 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 learned_addr learned my addr 172.21.15.33:0/3984499480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 msgr2=0x7f28ec1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 msgr2=0x7f28ec1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:56:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28ebe00640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28ec0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28ebe00640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28ec0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:56:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.093+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 msgr2=0x7f28ec1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 msgr2=0x7f28ec1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28ebe00640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28ec0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28ebe00640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28ec0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:56:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.294+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:56:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.297+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990346620 0 0) 0x7f28ec13fbc0 con 0x7f28ec160370 2024-09-13T18:56:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.297+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0003520 con 0x7f28ec160370 2024-09-13T18:56:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.297+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281364402 0 0) 0x7f28d0003520 con 0x7f28ec160370 2024-09-13T18:56:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28ec0accc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:56:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28ec0accc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 msgr2=0x7f28ec1428a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 --2- 172.21.15.33:0/3984499480 >> v2:172.21.15.33:3300/0 conn(0x7f28ec0b3a40 0x7f28ec1428a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec15ce80 con 0x7f28ec160370 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f28d4001670 con 0x7f28ec160370 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 >> v1:172.21.15.103:6789/0 conn(0x7f28ec160370 legacy=0x7f28ec0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0004d00 0x7f28d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0ad200 con 0x7f28d0004d00 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000bb10 con 0x7f28d0003970 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000bcd0 con 0x7f28ec0ac870 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28e3e00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.298+0000 7f28ebe00640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0004d00 0x7f28d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.299+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 msgr2=0x7f28d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.299+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec0ac870 0x7f28d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.299+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0004d00 msgr2=0x7f28d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.299+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d0004d00 0x7f28d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.299+0000 7f28eb400640 1 -- 172.21.15.33:0/3984499480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0003520 con 0x7f28d0003970 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.300+0000 7f28eb400640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28d0003d90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009940 tx=0x7f28d00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d3be6de7aab449 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.300+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc033410 con 0x7f28d0003970 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.300+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc02d030 con 0x7f28d0003970 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.300+0000 7f28eaa00640 1 -- 172.21.15.33:0/3984499480 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0337b0 con 0x7f28d0003970 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 -- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 msgr2=0x7f28d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 --2- 172.21.15.33:0/3984499480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28d0003d90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009940 tx=0x7f28d00057f0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28ebe00640 1 -- 172.21.15.33:0/3984499480 reap_dead start 2024-09-13T18:56:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 -- 172.21.15.33:0/3984499480 shutdown_connections 2024-09-13T18:56:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 -- 172.21.15.33:0/3984499480 >> 172.21.15.33:0/3984499480 conn(0x7f28ec0b0510 msgr2=0x7f28ec0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 -- 172.21.15.33:0/3984499480 shutdown_connections 2024-09-13T18:56:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.301+0000 7f28f2600640 1 -- 172.21.15.33:0/3984499480 wait complete. 2024-09-13T18:56:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.303+0000 7f28f2600640 1 Processor -- start 2024-09-13T18:56:50.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.304+0000 7f28f2600640 1 -- start start 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 0x7f28ec144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 0x7f28ec1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec132450 con 0x7f28ec1454e0 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec141200 con 0x7f28d0003970 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28f2600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1405f0 con 0x7f28ec141690 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28e3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 0x7f28ec144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:47322/0 (socket says 172.21.15.33:47322) 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.305+0000 7f28eb400640 1 -- 172.21.15.33:0/2227504308 learned_addr learned my addr 172.21.15.33:0/2227504308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 0x7f28ec1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 -- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 msgr2=0x7f28ec144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 0x7f28ec144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 -- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 msgr2=0x7f28ec131f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 -- 172.21.15.33:0/2227504308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec1408d0 con 0x7f28ec1454e0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28eb400640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28e3e00640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 0x7f28ec144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28ebe00640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 0x7f28ec1f2630 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0ce6f0 tx=0x7f28e4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.306+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4009ea0 con 0x7f28ec1454e0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400f040 con 0x7f28ec1454e0 2024-09-13T18:56:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec140bb0 con 0x7f28ec1454e0 2024-09-13T18:56:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4016680 con 0x7f28ec1454e0 2024-09-13T18:56:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec1401e0 con 0x7f28ec1454e0 2024-09-13T18:56:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f28e4016cf0 con 0x7f28ec1454e0 2024-09-13T18:56:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.307+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28e4020e30 con 0x7f28ec1454e0 2024-09-13T18:56:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.308+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec140370 con 0x7f28ec1454e0 2024-09-13T18:56:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.313+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f28e40204f0 con 0x7f28ec1454e0 2024-09-13T18:56:50.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.397+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f28ec141370 con 0x7f28ec1454e0 2024-09-13T18:56:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.400+0000 7f28e3400640 1 -- 172.21.15.33:0/2227504308 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f28e4020690 con 0x7f28ec1454e0 2024-09-13T18:56:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 msgr2=0x7f28ec1f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 0x7f28ec1f2630 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0ce6f0 tx=0x7f28e4007700 comp rx=0 tx=0).stop 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 shutdown_connections 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28ec1454e0 0x7f28ec1f2630 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28ec141690 0x7f28ec144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 --2- 172.21.15.33:0/2227504308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d0003970 0x7f28ec131f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:50.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 >> 172.21.15.33:0/2227504308 conn(0x7f28ec0b0510 msgr2=0x7f28ec06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:50.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 shutdown_connections 2024-09-13T18:56:50.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:50.402+0000 7f28f2600640 1 -- 172.21.15.33:0/2227504308 wait complete. 2024-09-13T18:56:50.420 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:56:50.420 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:56:50.420 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:50.420 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:56:50.447 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:50.444+0000 7f42c2e0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:56:50.451 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:50.448+0000 7faaaae14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:56:50.477 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:50.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:56:50.498 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:50.495+0000 7f42c2e0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:56:50.500 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:50.497+0000 7faaaae14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:56:50.553 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:50.553 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:56:50.649 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:56:50.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:56:50.664 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:50.661+0000 7faaaae14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:56:50.683 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:50.680+0000 7f42c2e0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:56:50.721 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:50.718+0000 7faaaae14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:56:50.738 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:50.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:56:50.746 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:50.742+0000 7f42c2e0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:56:50.794 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:50.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:56:50.890 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:50.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:56:50.905 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:50.902+0000 7faaaae14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:56:50.935 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:50.932+0000 7f42c2e0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:56:50.960 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:56:50.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:56:51.038 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:51.035+0000 7faaaae14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:56:51.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 60955b6d-5159-48a6-a896-8faf79641779 0 2024-09-13T18:56:51.067 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:51.064+0000 7f42c2e0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:56:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.241+0000 7f79e9800640 1 Processor -- start 2024-09-13T18:56:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.242+0000 7f79e9800640 1 -- start start 2024-09-13T18:56:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e9800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e41675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e9800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40d0130 con 0x7f79e40cf180 2024-09-13T18:56:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e9800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40d0410 con 0x7f79e406c3f0 2024-09-13T18:56:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e9800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e406bbf0 con 0x7f79e4145d90 2024-09-13T18:56:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e3400640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79e406c3f0 0x7f79e4163ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33634/0 (socket says 172.21.15.103:33634) 2024-09-13T18:56:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e3400640 1 -- 172.21.15.103:0/768429669 learned_addr learned my addr 172.21.15.103:0/768429669 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.243+0000 7f79e8e00640 1 --2- 172.21.15.103:0/768429669 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e41675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246191823 0 0) 0x7f79e40d0410 con 0x7f79e406c3f0 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c8003520 con 0x7f79e406c3f0 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123526171 0 0) 0x7f79e40d0130 con 0x7f79e40cf180 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e40d0410 con 0x7f79e40cf180 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e8e00640 1 -- 172.21.15.103:0/768429669 >> v1:172.21.15.103:6789/0 conn(0x7f79e406c3f0 legacy=0x7f79e4163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e8e00640 1 -- 172.21.15.103:0/768429669 >> v1:172.21.15.33:6789/0 conn(0x7f79e40cf180 legacy=0x7f79e40cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.244+0000 7f79e8e00640 1 -- 172.21.15.103:0/768429669 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e406bed0 con 0x7f79e4145d90 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.245+0000 7f79e8e00640 1 --2- 172.21.15.103:0/768429669 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e41675d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009dc0 tx=0x7f79dc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1900eda3b3dff8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.245+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc007740 con 0x7f79e4145d90 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.245+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc02d050 con 0x7f79e4145d90 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.245+0000 7f79e2a00640 1 -- 172.21.15.103:0/768429669 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc007aa0 con 0x7f79e4145d90 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.245+0000 7f79e9800640 1 -- 172.21.15.103:0/768429669 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 msgr2=0x7f79e41675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 --2- 172.21.15.103:0/768429669 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e41675d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009dc0 tx=0x7f79dc02a6d0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 -- 172.21.15.103:0/768429669 shutdown_connections 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 --2- 172.21.15.103:0/768429669 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e41675d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 -- 172.21.15.103:0/768429669 >> 172.21.15.103:0/768429669 conn(0x7f79e40b44c0 msgr2=0x7f79e40b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 -- 172.21.15.103:0/768429669 shutdown_connections 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.246+0000 7f79e9800640 1 -- 172.21.15.103:0/768429669 wait complete. 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.247+0000 7f79e9800640 1 Processor -- start 2024-09-13T18:56:51.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.247+0000 7f79e9800640 1 -- start start 2024-09-13T18:56:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 0x7f79e41e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 0x7f79e40c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41e3b40 con 0x7f79e406c3f0 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41e44a0 con 0x7f79e40cf180 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.248+0000 7f79e9800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41e2ec0 con 0x7f79e4145d90 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 0x7f79e41e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 0x7f79e40c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 0x7f79e41e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.103:43416/0 (socket says 172.21.15.103:43416) 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3e00640 1 -- 172.21.15.103:0/3974865806 learned_addr learned my addr 172.21.15.103:0/3974865806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e8e00640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 -- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 msgr2=0x7f79e40cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e40cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 -- 172.21.15.103:0/3974865806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 msgr2=0x7f79e41e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 0x7f79e41e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 -- 172.21.15.103:0/3974865806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009a70 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.249+0000 7f79e3400640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 0x7f79e40c7800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c3e0 tx=0x7f79d000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0005ce0 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0005e40 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00072d0 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e41e31a0 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40c7d40 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f79d001c440 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.250+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f79d0012780 con 0x7f79e40cf180 2024-09-13T18:56:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.251+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e41e3c80 con 0x7f79e40cf180 2024-09-13T18:56:51.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.254+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f79e41e3c80 con 0x7f79e40cf180 2024-09-13T18:56:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.325+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60955b6d-5159-48a6-a896-8faf79641779", "id": 0} v 0) v1 -- 0x7f79e40cfd40 con 0x7f79e40cf180 2024-09-13T18:56:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79dbe00640 1 -- 172.21.15.103:0/3974865806 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60955b6d-5159-48a6-a896-8faf79641779", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79d0021060 con 0x7f79e40cf180 2024-09-13T18:56:51.334 INFO:teuthology.orchestra.run.smithi103.stdout:0 2024-09-13T18:56:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 msgr2=0x7f79e40c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 0x7f79e40c7800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c3e0 tx=0x7f79d000c8a0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 shutdown_connections 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79e4145d90 0x7f79e40cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e40cf180 0x7f79e40c7800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 --2- 172.21.15.103:0/3974865806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e406c3f0 0x7f79e41e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.331+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 >> 172.21.15.103:0/3974865806 conn(0x7f79e40b44c0 msgr2=0x7f79e40b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.332+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 shutdown_connections 2024-09-13T18:56:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.332+0000 7f79e9800640 1 -- 172.21.15.103:0/3974865806 wait complete. 2024-09-13T18:56:51.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new c6efa374-4e9c-4b37-877d-af163da1970e 1 2024-09-13T18:56:51.419 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:51.416+0000 7faaaae14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:56:51.436 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:51.433+0000 7f42c2e0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:56:51.484 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:51.481+0000 7faaaae14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:56:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.495+0000 7f5aa1c00640 1 Processor -- start 2024-09-13T18:56:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.495+0000 7f5aa1c00640 1 -- start start 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5aa1c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 0x7f5a9c0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5aa1c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0cfaa0 con 0x7f5a9c145d90 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5aa1c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0d0130 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5aa1c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0d0410 con 0x7f5a9c0cf180 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a93400640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5a9c06c3f0 0x7f5a9c162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33636/0 (socket says 172.21.15.103:33636) 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a93400640 1 -- 172.21.15.103:0/1940322313 learned_addr learned my addr 172.21.15.103:0/1940322313 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-13T18:56:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9be00640 1 --2- 172.21.15.103:0/1940322313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 0x7f5a9c0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9b400640 1 -- 172.21.15.103:0/1940322313 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055467450 0 0) 0x7f5a9c0d0130 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9b400640 1 -- 172.21.15.103:0/1940322313 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a80003520 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9be00640 1 -- 172.21.15.103:0/1940322313 >> v1:172.21.15.103:6789/0 conn(0x7f5a9c06c3f0 legacy=0x7f5a9c162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9be00640 1 -- 172.21.15.103:0/1940322313 >> v1:172.21.15.33:6789/0 conn(0x7f5a9c145d90 legacy=0x7f5a9c1665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.497+0000 7f5a9be00640 1 -- 172.21.15.103:0/1940322313 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c06bbf0 con 0x7f5a9c0cf180 2024-09-13T18:56:51.503 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:51.497+0000 7f42c2e0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.498+0000 7f5a9be00640 1 --2- 172.21.15.103:0/1940322313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 0x7f5a9c0cf560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009dc0 tx=0x7f5a8c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=141efee4ad64f1d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5a9b400640 1 -- 172.21.15.103:0/1940322313 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c007740 con 0x7f5a9c0cf180 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5a9b400640 1 -- 172.21.15.103:0/1940322313 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c02d050 con 0x7f5a9c0cf180 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5a9b400640 1 -- 172.21.15.103:0/1940322313 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c007aa0 con 0x7f5a9c0cf180 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5aa1c00640 1 -- 172.21.15.103:0/1940322313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 msgr2=0x7f5a9c0cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/1940322313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 0x7f5a9c0cf560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009dc0 tx=0x7f5a8c02a680 comp rx=0 tx=0).stop 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5aa1c00640 1 -- 172.21.15.103:0/1940322313 shutdown_connections 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/1940322313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c0cf180 0x7f5a9c0cf560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.499+0000 7f5aa1c00640 1 -- 172.21.15.103:0/1940322313 >> 172.21.15.103:0/1940322313 conn(0x7f5a9c0b44c0 msgr2=0x7f5a9c0b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.500+0000 7f5aa1c00640 1 -- 172.21.15.103:0/1940322313 shutdown_connections 2024-09-13T18:56:51.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.500+0000 7f5aa1c00640 1 -- 172.21.15.103:0/1940322313 wait complete. 2024-09-13T18:56:51.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.501+0000 7f5aa1c00640 1 Processor -- start 2024-09-13T18:56:51.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.501+0000 7f5aa1c00640 1 -- start start 2024-09-13T18:56:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 0x7f5a9c1e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c145d90 0x7f5a9c13f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15ac10 con 0x7f5a9c0cf180 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1e18b0 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5aa1c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1e5ab0 con 0x7f5a9c145d90 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.502+0000 7f5a9be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53402/0 (socket says 172.21.15.103:53402) 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5aa1200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c145d90 0x7f5a9c13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 -- 172.21.15.103:0/2549792929 learned_addr learned my addr 172.21.15.103:0/2549792929 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a93400640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 0x7f5a9c1e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 -- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c145d90 msgr2=0x7f5a9c13f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c145d90 0x7f5a9c13f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 -- 172.21.15.103:0/2549792929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 msgr2=0x7f5a9c1e4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 0x7f5a9c1e4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 -- 172.21.15.103:0/2549792929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c009a70 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a93400640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 0x7f5a9c1e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.503+0000 7f5a9be00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009ee0 tx=0x7f5a8c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c03c830 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c03c990 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c03cd00 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c1e1b00 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c1e20c0 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5a8c044710 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.504+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5a8c0319d0 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.505+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c066fd0 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.509+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5a8c049020 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.580+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6efa374-4e9c-4b37-877d-af163da1970e", "id": 1} v 0) v1 -- 0x7f5a9c0cfd40 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.586+0000 7f5a98c00640 1 -- 172.21.15.103:0/2549792929 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6efa374-4e9c-4b37-877d-af163da1970e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a8c040070 con 0x7f5a9c06c3f0 2024-09-13T18:56:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:56:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 msgr2=0x7f5a9c1f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009ee0 tx=0x7f5a8c004a40 comp rx=0 tx=0).stop 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 shutdown_connections 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a9c145d90 0x7f5a9c13f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a9c0cf180 0x7f5a9c1e4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 --2- 172.21.15.103:0/2549792929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a9c06c3f0 0x7f5a9c1f1cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.587+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 >> 172.21.15.103:0/2549792929 conn(0x7f5a9c0b44c0 msgr2=0x7f5a9c144490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.588+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 shutdown_connections 2024-09-13T18:56:51.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.588+0000 7f5aa1c00640 1 -- 172.21.15.103:0/2549792929 wait complete. 2024-09-13T18:56:51.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 795d61d4-1c34-4be4-b67d-86c86c30e081 2 2024-09-13T18:56:51.664 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:51.661+0000 7faaaae14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:56:51.675 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:51.672+0000 7f42c2e0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:56:51.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.751+0000 7fe82f200640 1 Processor -- start 2024-09-13T18:56:51.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.751+0000 7fe82f200640 1 -- start start 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.752+0000 7fe82f200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe83015ca40 0x7fe8300d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.752+0000 7fe82f200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8300cd630 0x7fe8300d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.752+0000 7fe82f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8300d06e0 con 0x7fe8300d1b90 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.752+0000 7fe82f200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8300b1ce0 con 0x7fe8300cd630 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.752+0000 7fe82f200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8300d2510 con 0x7fe83015ca40 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe83015ca40 0x7fe8300d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe83015ca40 0x7fe8300d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53408/0 (socket says 172.21.15.103:53408) 2024-09-13T18:56:51.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 -- 172.21.15.103:0/1127977880 learned_addr learned my addr 172.21.15.103:0/1127977880 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:51.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 -- 172.21.15.103:0/1127977880 >> v2:172.21.15.33:3300/0 conn(0x7fe8300cd630 msgr2=0x7fe8300d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:51.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 --2- 172.21.15.103:0/1127977880 >> v2:172.21.15.33:3300/0 conn(0x7fe8300cd630 0x7fe8300d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 -- 172.21.15.103:0/1127977880 >> v1:172.21.15.33:6789/0 conn(0x7fe8300d1b90 legacy=0x7fe8300ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:51.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.753+0000 7fe82de00640 1 -- 172.21.15.103:0/1127977880 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300cdb30 con 0x7fe83015ca40 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.754+0000 7fe82de00640 1 --2- 172.21.15.103:0/1127977880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8300d1410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8300676e0 tx=0x7fe82002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae4ffd1b51c2f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.754+0000 7fe82ca00640 1 -- 172.21.15.103:0/1127977880 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820032440 con 0x7fe83015ca40 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82ca00640 1 -- 172.21.15.103:0/1127977880 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200325a0 con 0x7fe83015ca40 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82ca00640 1 -- 172.21.15.103:0/1127977880 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820032930 con 0x7fe83015ca40 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 -- 172.21.15.103:0/1127977880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 msgr2=0x7fe8300d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 --2- 172.21.15.103:0/1127977880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8300d1410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8300676e0 tx=0x7fe82002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 -- 172.21.15.103:0/1127977880 shutdown_connections 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 --2- 172.21.15.103:0/1127977880 >> v2:172.21.15.33:3300/0 conn(0x7fe8300cd630 0x7fe8300d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 --2- 172.21.15.103:0/1127977880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8300d1410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 -- 172.21.15.103:0/1127977880 >> 172.21.15.103:0/1127977880 conn(0x7fe8300cf560 msgr2=0x7fe8300cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 -- 172.21.15.103:0/1127977880 shutdown_connections 2024-09-13T18:56:51.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.755+0000 7fe82f200640 1 -- 172.21.15.103:0/1127977880 wait complete. 2024-09-13T18:56:51.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.757+0000 7fe82f200640 1 Processor -- start 2024-09-13T18:56:51.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.757+0000 7fe82f200640 1 -- start start 2024-09-13T18:56:51.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 0x7fe8301522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8301e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830155940 con 0x7fe8300d1b90 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830156410 con 0x7fe83015ca40 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830155b70 con 0x7fe8300cd630 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8301e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:49770/0 (socket says 172.21.15.103:49770) 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82de00640 1 -- 172.21.15.103:0/2424929337 learned_addr learned my addr 172.21.15.103:0/2424929337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.758+0000 7fe82d400640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 0x7fe8301522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 -- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 msgr2=0x7fe8301e6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8301e6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 -- 172.21.15.103:0/2424929337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 msgr2=0x7fe8301522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 0x7fe8301522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 -- 172.21.15.103:0/2424929337 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8200094d0 con 0x7fe8300cd630 2024-09-13T18:56:51.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82e800640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8301e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:51.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82d400640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 0x7fe8301522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:51.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.759+0000 7fe82de00640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8200090b0 tx=0x7fe8200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820032440 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820030b80 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82003b400 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe830155e50 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83015cf50 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe820039040 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.760+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe82003bc80 con 0x7fe8300cd630 2024-09-13T18:56:51.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.761+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8300d1fd0 con 0x7fe8300cd630 2024-09-13T18:56:51.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.764+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe82004c060 con 0x7fe8300cd630 2024-09-13T18:56:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.834+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "795d61d4-1c34-4be4-b67d-86c86c30e081", "id": 2} v 0) v1 -- 0x7fe8300b8640 con 0x7fe8300cd630 2024-09-13T18:56:51.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.840+0000 7fe826000640 1 -- 172.21.15.103:0/2424929337 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "795d61d4-1c34-4be4-b67d-86c86c30e081", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe820042070 con 0x7fe8300cd630 2024-09-13T18:56:51.844 INFO:teuthology.orchestra.run.smithi103.stdout:2 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.841+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 msgr2=0x7fe830155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.841+0000 7fe82f200640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8200090b0 tx=0x7fe8200046c0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 shutdown_connections 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe83015ca40 0x7fe8301e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8300d1b90 0x7fe8301522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 --2- 172.21.15.103:0/2424929337 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8300cd630 0x7fe830155400 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:51.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 >> 172.21.15.103:0/2424929337 conn(0x7fe8300cf560 msgr2=0x7fe8300b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:51.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 shutdown_connections 2024-09-13T18:56:51.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:51.842+0000 7fe82f200640 1 -- 172.21.15.103:0/2424929337 wait complete. 2024-09-13T18:56:51.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d36b8624-f3b8-4fff-87cd-01200098c1d7 3 2024-09-13T18:56:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.005+0000 7f22e4000640 1 Processor -- start 2024-09-13T18:56:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.005+0000 7f22e4000640 1 -- start start 2024-09-13T18:56:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.006+0000 7f22e4000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f22dc0b3590 0x7f22dc0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.006+0000 7f22e4000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f22dc0d1010 0x7f22dc0d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.006+0000 7f22e4000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0b3a00 con 0x7f22dc15cb90 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.006+0000 7f22e4000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0d34f0 con 0x7f22dc0d1010 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.006+0000 7f22e4000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0b3170 con 0x7f22dc0b3590 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e0c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f22dc0b3590 0x7f22dc0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e1600640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f22dc15cb90 0x7f22dc0d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54274/0 (socket says 172.21.15.103:54274) 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e1600640 1 -- 172.21.15.103:0/4200437409 learned_addr learned my addr 172.21.15.103:0/4200437409 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e2000640 1 --2- 172.21.15.103:0/4200437409 >> v2:172.21.15.33:3300/0 conn(0x7f22dc0d1010 0x7f22dc0d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e0c00640 1 -- 172.21.15.103:0/4200437409 >> v2:172.21.15.33:3300/0 conn(0x7f22dc0d1010 msgr2=0x7f22dc0d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e0c00640 1 --2- 172.21.15.103:0/4200437409 >> v2:172.21.15.33:3300/0 conn(0x7f22dc0d1010 0x7f22dc0d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e0c00640 1 -- 172.21.15.103:0/4200437409 >> v1:172.21.15.103:6789/0 conn(0x7f22dc15cb90 legacy=0x7f22dc0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22e0c00640 1 -- 172.21.15.103:0/4200437409 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc15cf70 con 0x7f22dc0b3590 2024-09-13T18:56:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.007+0000 7f22dbe00640 1 -- 172.21.15.103:0/4200437409 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586148898 0 0) 0x7f22d0001110 con 0x7f22dc15cb90 2024-09-13T18:56:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.008+0000 7f22e0c00640 1 --2- 172.21.15.103:0/4200437409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0d0ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22dc08b930 tx=0x7f22c802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a3533902cde4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.008+0000 7f22dbe00640 1 -- 172.21.15.103:0/4200437409 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8032440 con 0x7f22dc0b3590 2024-09-13T18:56:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.008+0000 7f22dbe00640 1 -- 172.21.15.103:0/4200437409 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c80325a0 con 0x7f22dc0b3590 2024-09-13T18:56:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22dbe00640 1 -- 172.21.15.103:0/4200437409 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8032930 con 0x7f22dc0b3590 2024-09-13T18:56:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 -- 172.21.15.103:0/4200437409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 msgr2=0x7f22dc0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 --2- 172.21.15.103:0/4200437409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0d0ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22dc08b930 tx=0x7f22c802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 -- 172.21.15.103:0/4200437409 shutdown_connections 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 --2- 172.21.15.103:0/4200437409 >> v2:172.21.15.33:3300/0 conn(0x7f22dc0d1010 0x7f22dc0d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 --2- 172.21.15.103:0/4200437409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0d0ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 -- 172.21.15.103:0/4200437409 >> 172.21.15.103:0/4200437409 conn(0x7f22dc08bf90 msgr2=0x7f22dc08c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 -- 172.21.15.103:0/4200437409 shutdown_connections 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.009+0000 7f22e4000640 1 -- 172.21.15.103:0/4200437409 wait complete. 2024-09-13T18:56:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.011+0000 7f22e4000640 1 Processor -- start 2024-09-13T18:56:52.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.011+0000 7f22e4000640 1 -- start start 2024-09-13T18:56:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 0x7f22dc1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc14c7f0 con 0x7f22dc0d1010 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c95e0 con 0x7f22dc0b3590 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e4000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc1f67b0 con 0x7f22dc15cb90 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e2000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.012+0000 7f22e2000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:55458/0 (socket says 172.21.15.103:55458) 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56320/0 (socket says 172.21.15.103:56320) 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 -- 172.21.15.103:0/973745818 learned_addr learned my addr 172.21.15.103:0/973745818 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e0c00640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 0x7f22dc1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 -- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 msgr2=0x7f22dc0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 -- 172.21.15.103:0/973745818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 msgr2=0x7f22dc1f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 0x7f22dc1f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 -- 172.21.15.103:0/973745818 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009400 con 0x7f22dc15cb90 2024-09-13T18:56:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e0c00640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 0x7f22dc1f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.013+0000 7f22e2000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009dd0 tx=0x7f22d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4014480 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400f040 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc14bbe0 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4014840 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc14c1a0 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f22d4014ca0 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.014+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f22d4013870 con 0x7f22dc15cb90 2024-09-13T18:56:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.015+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc0d0ad0 con 0x7f22dc15cb90 2024-09-13T18:56:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.017+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f22d4018020 con 0x7f22dc15cb90 2024-09-13T18:56:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.088+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d36b8624-f3b8-4fff-87cd-01200098c1d7", "id": 3} v 0) v1 -- 0x7f22dc15b740 con 0x7f22dc15cb90 2024-09-13T18:56:52.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.096+0000 7f22d9600640 1 -- 172.21.15.103:0/973745818 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d36b8624-f3b8-4fff-87cd-01200098c1d7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22d4013610 con 0x7f22dc15cb90 2024-09-13T18:56:52.100 INFO:teuthology.orchestra.run.smithi103.stdout:3 2024-09-13T18:56:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.097+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 msgr2=0x7f22dc06afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.097+0000 7f22e4000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009dd0 tx=0x7f22d400c490 comp rx=0 tx=0).stop 2024-09-13T18:56:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 shutdown_connections 2024-09-13T18:56:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22dc15cb90 0x7f22dc06afc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22dc0d1010 0x7f22dc1f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 --2- 172.21.15.103:0/973745818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22dc0b3590 0x7f22dc0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 >> 172.21.15.103:0/973745818 conn(0x7f22dc08bf90 msgr2=0x7f22dc0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 shutdown_connections 2024-09-13T18:56:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.098+0000 7f22e4000640 1 -- 172.21.15.103:0/973745818 wait complete. 2024-09-13T18:56:52.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new c665d7c5-361b-4630-8e25-9ee736497bb6 4 2024-09-13T18:56:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.260+0000 7fc333e00640 1 Processor -- start 2024-09-13T18:56:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.260+0000 7fc333e00640 1 -- start start 2024-09-13T18:56:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc333e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc32c0b6d20 0x7fc32c0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc333e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0ce4b0 con 0x7fc32c15c8d0 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc333e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0ce790 con 0x7fc32c0d2d10 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc333e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c0cea70 con 0x7fc32c0b6d20 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc330a00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc32c0d2d10 0x7fc32c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54278/0 (socket says 172.21.15.103:54278) 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc330a00640 1 -- 172.21.15.103:0/1966939853 learned_addr learned my addr 172.21.15.103:0/1966939853 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.261+0000 7fc331e00640 1 --2- 172.21.15.103:0/1966939853 >> v2:172.21.15.33:3300/0 conn(0x7fc32c0b6d20 0x7fc32c0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276415034 0 0) 0x7fc32c0ce790 con 0x7fc32c0d2d10 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc314003520 con 0x7fc32c0d2d10 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc331e00640 1 -- 172.21.15.103:0/1966939853 >> v1:172.21.15.103:6789/0 conn(0x7fc32c0d2d10 legacy=0x7fc32c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc331e00640 1 -- 172.21.15.103:0/1966939853 >> v1:172.21.15.33:6789/0 conn(0x7fc32c15c8d0 legacy=0x7fc32c0d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467807106 0 0) 0x7fc32c0ce4b0 con 0x7fc32c15c8d0 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.262+0000 7fc331e00640 1 -- 172.21.15.103:0/1966939853 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0ced50 con 0x7fc32c0b6d20 2024-09-13T18:56:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.263+0000 7fc331e00640 1 --2- 172.21.15.103:0/1966939853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0cde50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc324009d90 tx=0x7fc32402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8470f0e21429680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.263+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324007740 con 0x7fc32c0b6d20 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.263+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3240078a0 con 0x7fc32c0b6d20 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.263+0000 7fc32be00640 1 -- 172.21.15.103:0/1966939853 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324007c30 con 0x7fc32c0b6d20 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 -- 172.21.15.103:0/1966939853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b6d20 msgr2=0x7fc32c0cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 --2- 172.21.15.103:0/1966939853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0cde50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc324009d90 tx=0x7fc32402a780 comp rx=0 tx=0).stop 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 -- 172.21.15.103:0/1966939853 shutdown_connections 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 --2- 172.21.15.103:0/1966939853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0cde50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 -- 172.21.15.103:0/1966939853 >> 172.21.15.103:0/1966939853 conn(0x7fc32c08bf90 msgr2=0x7fc32c08c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 -- 172.21.15.103:0/1966939853 shutdown_connections 2024-09-13T18:56:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.264+0000 7fc333e00640 1 -- 172.21.15.103:0/1966939853 wait complete. 2024-09-13T18:56:52.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.266+0000 7fc333e00640 1 Processor -- start 2024-09-13T18:56:52.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.266+0000 7fc333e00640 1 -- start start 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 0x7fc32c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc32c15c8d0 0x7fc32c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c153410 con 0x7fc32c0d2d10 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c152800 con 0x7fc32c0b6d20 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc333e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c152ae0 con 0x7fc32c15c8d0 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc331400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc331400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56330/0 (socket says 172.21.15.103:56330) 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc331400640 1 -- 172.21.15.103:0/1832030445 learned_addr learned my addr 172.21.15.103:0/1832030445 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc330a00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 0x7fc32c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.267+0000 7fc331e00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc32c15c8d0 0x7fc32c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 -- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc32c15c8d0 msgr2=0x7fc32c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc32c15c8d0 0x7fc32c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 -- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 msgr2=0x7fc32c0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 -- 172.21.15.103:0/1832030445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc324009a70 con 0x7fc32c0d2d10 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc331400640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc330a00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 0x7fc32c0ca230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c400 tx=0x7fc31800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318005ce0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318005e40 con 0x7fc32c0d2d10 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c152dc0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180072f0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.268+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c0c8df0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.269+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc31801c440 con 0x7fc32c0d2d10 2024-09-13T18:56:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.269+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc31801cc00 con 0x7fc32c0d2d10 2024-09-13T18:56:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.269+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c0d2600 con 0x7fc32c0d2d10 2024-09-13T18:56:52.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.272+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc318017070 con 0x7fc32c0d2d10 2024-09-13T18:56:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.347+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c665d7c5-361b-4630-8e25-9ee736497bb6", "id": 4} v 0) v1 -- 0x7fc32c0b38a0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.354+0000 7fc329600640 1 -- 172.21.15.103:0/1832030445 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c665d7c5-361b-4630-8e25-9ee736497bb6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc31801c7c0 con 0x7fc32c0d2d10 2024-09-13T18:56:52.358 INFO:teuthology.orchestra.run.smithi103.stdout:4 2024-09-13T18:56:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 msgr2=0x7fc32c0ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 0x7fc32c0ca230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c400 tx=0x7fc31800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 shutdown_connections 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc32c15c8d0 0x7fc32c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0d2d10 0x7fc32c0ca230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 --2- 172.21.15.103:0/1832030445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc32c0b6d20 0x7fc32c0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 >> 172.21.15.103:0/1832030445 conn(0x7fc32c08bf90 msgr2=0x7fc32c150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 shutdown_connections 2024-09-13T18:56:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.356+0000 7fc333e00640 1 -- 172.21.15.103:0/1832030445 wait complete. 2024-09-13T18:56:52.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new f0857cc5-18c0-462d-8fdb-d7df105bc7f7 5 2024-09-13T18:56:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.521+0000 7fbfdd400640 1 Processor -- start 2024-09-13T18:56:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.521+0000 7fbfdd400640 1 -- start start 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbfd815ca40 0x7fbfd80d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdd400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfd80cd630 0x7fbfd80d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdd400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd80d06e0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdd400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd80b1ce0 con 0x7fbfd815ca40 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdd400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd80d2510 con 0x7fbfd80cd630 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfd80cd630 0x7fbfd80d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbfd80cd630 0x7fbfd80d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56344/0 (socket says 172.21.15.103:56344) 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 -- 172.21.15.103:0/815122419 learned_addr learned my addr 172.21.15.103:0/815122419 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfd7e00640 1 --2- 172.21.15.103:0/815122419 >> v2:172.21.15.33:3300/0 conn(0x7fbfd815ca40 0x7fbfd80d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 -- 172.21.15.103:0/815122419 >> v2:172.21.15.33:3300/0 conn(0x7fbfd815ca40 msgr2=0x7fbfd80d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 --2- 172.21.15.103:0/815122419 >> v2:172.21.15.33:3300/0 conn(0x7fbfd815ca40 0x7fbfd80d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 -- 172.21.15.103:0/815122419 >> v1:172.21.15.33:6789/0 conn(0x7fbfd80d1b90 legacy=0x7fbfd80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.522+0000 7fbfdca00640 1 -- 172.21.15.103:0/815122419 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80cdb30 con 0x7fbfd80cd630 2024-09-13T18:56:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.523+0000 7fbfdca00640 1 --2- 172.21.15.103:0/815122419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd80cd630 0x7fbfd80d1fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbfd808bce0 tx=0x7fbfd002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f106e66233e687b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfd7400640 1 -- 172.21.15.103:0/815122419 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0031600 con 0x7fbfd80cd630 2024-09-13T18:56:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfd7400640 1 -- 172.21.15.103:0/815122419 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd002d050 con 0x7fbfd80cd630 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfd7400640 1 -- 172.21.15.103:0/815122419 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0031980 con 0x7fbfd80cd630 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 -- 172.21.15.103:0/815122419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd80cd630 msgr2=0x7fbfd80d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 --2- 172.21.15.103:0/815122419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd80cd630 0x7fbfd80d1fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbfd808bce0 tx=0x7fbfd002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 -- 172.21.15.103:0/815122419 shutdown_connections 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 --2- 172.21.15.103:0/815122419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd80cd630 0x7fbfd80d1fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 --2- 172.21.15.103:0/815122419 >> v2:172.21.15.33:3300/0 conn(0x7fbfd815ca40 0x7fbfd80d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 -- 172.21.15.103:0/815122419 >> 172.21.15.103:0/815122419 conn(0x7fbfd80cf560 msgr2=0x7fbfd80cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.524+0000 7fbfdd400640 1 -- 172.21.15.103:0/815122419 shutdown_connections 2024-09-13T18:56:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.525+0000 7fbfdd400640 1 -- 172.21.15.103:0/815122419 wait complete. 2024-09-13T18:56:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.526+0000 7fbfdd400640 1 Processor -- start 2024-09-13T18:56:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.526+0000 7fbfdd400640 1 -- start start 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 0x7fbfd8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd815ca40 0x7fbfd81566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8156230 con 0x7fbfd80cd630 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81f66a0 con 0x7fbfd815ca40 2024-09-13T18:56:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdd400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8155be0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfcfe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 0x7fbfd8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfdca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd815ca40 0x7fbfd81566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfcfe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:55480/0 (socket says 172.21.15.103:55480) 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.527+0000 7fbfcfe00640 1 -- 172.21.15.103:0/604053988 learned_addr learned my addr 172.21.15.103:0/604053988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 -- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd815ca40 msgr2=0x7fbfd81566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd815ca40 0x7fbfd81566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 -- 172.21.15.103:0/604053988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 msgr2=0x7fbfd8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 0x7fbfd8153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 -- 172.21.15.103:0/604053988 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0009b30 con 0x7fbfd80d1b90 2024-09-13T18:56:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfd7e00640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 0x7fbfd8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfcfe00640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c400 tx=0x7fbfc000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00052d0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0005430 con 0x7fbfd80d1b90 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0003830 con 0x7fbfd80d1b90 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd8155ec0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.528+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd81f6350 con 0x7fbfd80d1b90 2024-09-13T18:56:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.529+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbfc0003c90 con 0x7fbfd80d1b90 2024-09-13T18:56:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.529+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbfc0012420 con 0x7fbfd80d1b90 2024-09-13T18:56:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.530+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd80d1fd0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.532+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbfc0017070 con 0x7fbfd80d1b90 2024-09-13T18:56:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.611+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0857cc5-18c0-462d-8fdb-d7df105bc7f7", "id": 5} v 0) v1 -- 0x7fbfd80cc5a0 con 0x7fbfd80d1b90 2024-09-13T18:56:52.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.619+0000 7fbfd4c00640 1 -- 172.21.15.103:0/604053988 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0857cc5-18c0-462d-8fdb-d7df105bc7f7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfc0011590 con 0x7fbfd80d1b90 2024-09-13T18:56:52.623 INFO:teuthology.orchestra.run.smithi103.stdout:5 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 msgr2=0x7fbfd81531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c400 tx=0x7fbfc000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 shutdown_connections 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfd815ca40 0x7fbfd81566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfd80d1b90 0x7fbfd81531d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 --2- 172.21.15.103:0/604053988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd80cd630 0x7fbfd8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 >> 172.21.15.103:0/604053988 conn(0x7fbfd80cf560 msgr2=0x7fbfd806c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 shutdown_connections 2024-09-13T18:56:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.620+0000 7fbfdd400640 1 -- 172.21.15.103:0/604053988 wait complete. 2024-09-13T18:56:52.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 0c6ca12f-45d2-4ba9-b5a3-613b7d783c45 6 2024-09-13T18:56:52.786 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:52.783+0000 7f42c2e0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:56:52.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.784+0000 7f7f8fc00640 1 Processor -- start 2024-09-13T18:56:52.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.784+0000 7f7f8fc00640 1 -- start start 2024-09-13T18:56:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.785+0000 7f7f8fc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7f880b3590 0x7f7f880d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.785+0000 7f7f8fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 0x7f7f880d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.785+0000 7f7f8fc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f880b3a00 con 0x7f7f8815cb90 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.785+0000 7f7f8fc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880d34f0 con 0x7f7f880b3590 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.785+0000 7f7f8fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b3170 con 0x7f7f880d1010 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f8dc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 0x7f7f880d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7f880b3590 0x7f7f880d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f8dc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 0x7f7f880d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:55488/0 (socket says 172.21.15.103:55488) 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f8dc00640 1 -- 172.21.15.103:0/625734651 learned_addr learned my addr 172.21.15.103:0/625734651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f87e00640 1 -- 172.21.15.103:0/625734651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 msgr2=0x7f7f880d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f87e00640 1 --2- 172.21.15.103:0/625734651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 0x7f7f880d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f87e00640 1 -- 172.21.15.103:0/625734651 >> v1:172.21.15.33:6789/0 conn(0x7f7f8815cb90 legacy=0x7f7f880d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.786+0000 7f7f87e00640 1 -- 172.21.15.103:0/625734651 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8815cf70 con 0x7f7f880b3590 2024-09-13T18:56:52.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.787+0000 7f7f87e00640 1 --2- 172.21.15.103:0/625734651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880d0ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097a0 tx=0x7f7f7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70edcf4855d1c08a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.787+0000 7f7f87400640 1 -- 172.21.15.103:0/625734651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032440 con 0x7f7f880b3590 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.787+0000 7f7f87400640 1 -- 172.21.15.103:0/625734651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f740325a0 con 0x7f7f880b3590 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.787+0000 7f7f87400640 1 -- 172.21.15.103:0/625734651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032930 con 0x7f7f880b3590 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 -- 172.21.15.103:0/625734651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 msgr2=0x7f7f880d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/625734651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880d0ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097a0 tx=0x7f7f7402a180 comp rx=0 tx=0).stop 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 -- 172.21.15.103:0/625734651 shutdown_connections 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/625734651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f880d1010 0x7f7f880d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/625734651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880d0ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 -- 172.21.15.103:0/625734651 >> 172.21.15.103:0/625734651 conn(0x7f7f8808bf90 msgr2=0x7f7f8808c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 -- 172.21.15.103:0/625734651 shutdown_connections 2024-09-13T18:56:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.788+0000 7f7f8fc00640 1 -- 172.21.15.103:0/625734651 wait complete. 2024-09-13T18:56:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.790+0000 7f7f8fc00640 1 Processor -- start 2024-09-13T18:56:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.790+0000 7f7f8fc00640 1 -- start start 2024-09-13T18:56:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880d1010 0x7f7f88151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 0x7f7f880b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880ca520 con 0x7f7f880b3590 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cae80 con 0x7f7f880d1010 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b81f0 con 0x7f7f8815cb90 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8dc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 0x7f7f880b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.103:53042/0 (socket says 172.21.15.103:53042) 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f8d200640 1 -- 172.21.15.103:0/3864235905 learned_addr learned my addr 172.21.15.103:0/3864235905 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.791+0000 7f7f87e00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880d1010 0x7f7f88151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 -- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880d1010 msgr2=0x7f7f88151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880d1010 0x7f7f88151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 -- 172.21.15.103:0/3864235905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 msgr2=0x7f7f880ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 -- 172.21.15.103:0/3864235905 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74009400 con 0x7f7f8815cb90 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8d200640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8dc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 0x7f7f880b76f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000efc0 tx=0x7f7f8000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000cd20 con 0x7f7f8815cb90 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000f040 con 0x7f7f8815cb90 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80003bd0 con 0x7f7f8815cb90 2024-09-13T18:56:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880c9b80 con 0x7f7f8815cb90 2024-09-13T18:56:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.792+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880ca140 con 0x7f7f8815cb90 2024-09-13T18:56:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.793+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7f80004330 con 0x7f7f8815cb90 2024-09-13T18:56:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.793+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7f80014ad0 con 0x7f7f8815cb90 2024-09-13T18:56:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.793+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880ca660 con 0x7f7f8815cb90 2024-09-13T18:56:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.796+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7f880ca660 con 0x7f7f8815cb90 2024-09-13T18:56:52.850 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:52.846+0000 7f42c2e0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:56:52.850 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:52.846+0000 7faaaae14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:56:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.866+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0c6ca12f-45d2-4ba9-b5a3-613b7d783c45", "id": 6} v 0) v1 -- 0x7f7f880d0ad0 con 0x7f7f8815cb90 2024-09-13T18:56:52.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.873+0000 7f7f84c00640 1 -- 172.21.15.103:0/3864235905 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c6ca12f-45d2-4ba9-b5a3-613b7d783c45", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f800047c0 con 0x7f7f8815cb90 2024-09-13T18:56:52.877 INFO:teuthology.orchestra.run.smithi103.stdout:6 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.874+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 msgr2=0x7f7f880b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.874+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 0x7f7f880b76f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000efc0 tx=0x7f7f8000c490 comp rx=0 tx=0).stop 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.874+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 shutdown_connections 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.874+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f8815cb90 0x7f7f880b76f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.874+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880d1010 0x7f7f88151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.875+0000 7f7f8fc00640 1 --2- 172.21.15.103:0/3864235905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f880b3590 0x7f7f880ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.875+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 >> 172.21.15.103:0/3864235905 conn(0x7f7f8808bf90 msgr2=0x7f7f8806b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.875+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 shutdown_connections 2024-09-13T18:56:52.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:52.875+0000 7f7f8fc00640 1 -- 172.21.15.103:0/3864235905 wait complete. 2024-09-13T18:56:52.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 43cf2024-fe96-4120-b898-31cdd51ffb56 7 2024-09-13T18:56:52.913 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:52.910+0000 7faaaae14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:56:53.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.036+0000 7ff936c00640 1 Processor -- start 2024-09-13T18:56:53.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.036+0000 7ff936c00640 1 -- start start 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff93015ca40 0x7ff9300d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300d06e0 con 0x7ff9300d1b90 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300cdb30 con 0x7ff9300cd630 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300b1ce0 con 0x7ff93015ca40 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936200640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff9300cd630 0x7ff9300b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54294/0 (socket says 172.21.15.103:54294) 2024-09-13T18:56:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.038+0000 7ff936200640 1 -- 172.21.15.103:0/7115163 learned_addr learned my addr 172.21.15.103:0/7115163 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff935800640 1 --2- 172.21.15.103:0/7115163 >> v2:172.21.15.33:3300/0 conn(0x7ff93015ca40 0x7ff9300d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154662527 0 0) 0x7ff9300d06e0 con 0x7ff9300d1b90 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff918003520 con 0x7ff9300d1b90 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613050352 0 0) 0x7ff9300cdb30 con 0x7ff9300cd630 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9300d06e0 con 0x7ff9300cd630 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857905535 0 0) 0x7ff918003520 con 0x7ff9300d1b90 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 >> v2:172.21.15.33:3300/0 conn(0x7ff93015ca40 msgr2=0x7ff9300d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 --2- 172.21.15.103:0/7115163 >> v2:172.21.15.33:3300/0 conn(0x7ff93015ca40 0x7ff9300d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 >> v1:172.21.15.103:6789/0 conn(0x7ff9300cd630 legacy=0x7ff9300b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300d0930 con 0x7ff9300d1b90 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7ff91c001670 con 0x7ff9300d1b90 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 >> v1:172.21.15.33:6789/0 conn(0x7ff9300d1b90 legacy=0x7ff9300ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 0x7ff918003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9180047c0 0x7ff918004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9180051d0 0x7ff91800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300b1ce0 con 0x7ff918003b50 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800c100 con 0x7ff9180047c0 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800c2c0 con 0x7ff9180051d0 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff934e00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9180047c0 0x7ff918004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.039+0000 7ff935800640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 0x7ff918003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff936200640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9180051d0 0x7ff91800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff935800640 1 -- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9180051d0 msgr2=0x7ff91800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff935800640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9180051d0 0x7ff91800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff935800640 1 -- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9180047c0 msgr2=0x7ff918004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff935800640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9180047c0 0x7ff918004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff935800640 1 -- 172.21.15.103:0/7115163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918003520 con 0x7ff918003b50 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff934e00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9180047c0 0x7ff918004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff936200640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9180051d0 0x7ff91800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:56:53.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.040+0000 7ff936200640 1 -- 172.21.15.103:0/7115163 reap_dead start 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.041+0000 7ff935800640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 0x7ff918003f50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff924009ac0 tx=0x7ff9180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742ec12d825fdf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.041+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924031400 con 0x7ff918003b50 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.041+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92402d050 con 0x7ff918003b50 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.041+0000 7ff92fe00640 1 -- 172.21.15.103:0/7115163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924031780 con 0x7ff918003b50 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 -- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 msgr2=0x7ff918003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 0x7ff918003f50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff924009ac0 tx=0x7ff9180057f0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 -- 172.21.15.103:0/7115163 shutdown_connections 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 --2- 172.21.15.103:0/7115163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff918003b50 0x7ff918003f50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 -- 172.21.15.103:0/7115163 >> 172.21.15.103:0/7115163 conn(0x7ff9300cf560 msgr2=0x7ff9300cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 -- 172.21.15.103:0/7115163 shutdown_connections 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.042+0000 7ff936c00640 1 -- 172.21.15.103:0/7115163 wait complete. 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.044+0000 7ff936c00640 1 Processor -- start 2024-09-13T18:56:53.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.044+0000 7ff936c00640 1 -- start start 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9301e7010 0x7ff93015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9301e6120 0x7ff93015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301598e0 con 0x7ff9301e6120 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301e7ae0 con 0x7ff918003b50 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301e7520 con 0x7ff9301e7010 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff934e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9301e7010 0x7ff93015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56396/0 (socket says 172.21.15.103:56396) 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 -- 172.21.15.103:0/2642773449 learned_addr learned my addr 172.21.15.103:0/2642773449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff936200640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9301e6120 0x7ff93015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 -- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9301e7010 msgr2=0x7ff93015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9301e7010 0x7ff93015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 -- 172.21.15.103:0/2642773449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9301e6120 msgr2=0x7ff93015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9301e6120 0x7ff93015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.045+0000 7ff935800640 1 -- 172.21.15.103:0/2642773449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9301e7800 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff935800640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff92402aae0 tx=0x7ff924004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924003e90 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92403b400 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9300c7490 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92403b790 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93015d5f0 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff92403bbf0 con 0x7ff918003b50 2024-09-13T18:56:53.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.046+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff924043b80 con 0x7ff918003b50 2024-09-13T18:56:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.047+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300b43f0 con 0x7ff918003b50 2024-09-13T18:56:53.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.049+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff924062e30 con 0x7ff918003b50 2024-09-13T18:56:53.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.120+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43cf2024-fe96-4120-b898-31cdd51ffb56", "id": 7} v 0) v1 -- 0x7ff93015d780 con 0x7ff918003b50 2024-09-13T18:56:53.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.128+0000 7ff92d600640 1 -- 172.21.15.103:0/2642773449 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43cf2024-fe96-4120-b898-31cdd51ffb56", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff924051030 con 0x7ff918003b50 2024-09-13T18:56:53.131 INFO:teuthology.orchestra.run.smithi103.stdout:7 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 msgr2=0x7ff9301593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff92402aae0 tx=0x7ff924004730 comp rx=0 tx=0).stop 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 shutdown_connections 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9301e6120 0x7ff93015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9301e7010 0x7ff93015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 --2- 172.21.15.103:0/2642773449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff918003b50 0x7ff9301593a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 >> 172.21.15.103:0/2642773449 conn(0x7ff9300cf560 msgr2=0x7ff9300b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 shutdown_connections 2024-09-13T18:56:53.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-13T18:56:53.129+0000 7ff936c00640 1 -- 172.21.15.103:0/2642773449 wait complete. 2024-09-13T18:56:53.146 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:56:53.147 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:56:53.150 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:56:53.151 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:56:53.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:56:53.154 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:56:53.155 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:56:53.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:56:53.159 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:56:53.159 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:56:53.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:56:53.164 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:56:53.164 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:56:53.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:56:53.191 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:56:53.191 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:56:53.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:56:53.197 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:56:53.197 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:56:53.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:56:53.202 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:56:53.202 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:56:53.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:56:53.207 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:56:53.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:56:53.365 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.362+0000 7f42c2e0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:56:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.401+0000 7fa3b7400640 1 Processor -- start 2024-09-13T18:56:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.401+0000 7fa3b7400640 1 -- start start 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.402+0000 7fa3b7400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa3b006a5e0 0x7fa3b01674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.402+0000 7fa3b7400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00ae1e0 con 0x7fa3b015cb50 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.402+0000 7fa3b7400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00ad140 con 0x7fa3b015c770 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.402+0000 7fa3b7400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00ad420 con 0x7fa3b006a5e0 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa3b006a5e0 0x7fa3b01674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa3b006a5e0 0x7fa3b01674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59028/0 (socket says 172.21.15.33:59028) 2024-09-13T18:56:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 -- 172.21.15.33:0/2092918694 learned_addr learned my addr 172.21.15.33:0/2092918694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 -- 172.21.15.33:0/2092918694 >> v1:172.21.15.103:6789/0 conn(0x7fa3b015c770 legacy=0x7fa3b0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3af400640 1 -- 172.21.15.33:0/2092918694 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636525036 0 0) 0x7fa3b00ae1e0 con 0x7fa3b015cb50 2024-09-13T18:56:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 -- 172.21.15.33:0/2092918694 >> v1:172.21.15.33:6789/0 conn(0x7fa3b015cb50 legacy=0x7fa3b00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.403+0000 7fa3b5400640 1 -- 172.21.15.33:0/2092918694 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00ad700 con 0x7fa3b006a5e0 2024-09-13T18:56:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.404+0000 7fa3b5400640 1 --2- 172.21.15.33:0/2092918694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b01674a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009e50 tx=0x7fa3a802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24512098036300 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3af400640 1 -- 172.21.15.33:0/2092918694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8031600 con 0x7fa3b006a5e0 2024-09-13T18:56:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3af400640 1 -- 172.21.15.33:0/2092918694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a802d050 con 0x7fa3b006a5e0 2024-09-13T18:56:53.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3af400640 1 -- 172.21.15.33:0/2092918694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8031980 con 0x7fa3b006a5e0 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 -- 172.21.15.33:0/2092918694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 msgr2=0x7fa3b01674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 --2- 172.21.15.33:0/2092918694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b01674a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009e50 tx=0x7fa3a802a6d0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 -- 172.21.15.33:0/2092918694 shutdown_connections 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 --2- 172.21.15.33:0/2092918694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b01674a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 -- 172.21.15.33:0/2092918694 >> 172.21.15.33:0/2092918694 conn(0x7fa3b006afe0 msgr2=0x7fa3b006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 -- 172.21.15.33:0/2092918694 shutdown_connections 2024-09-13T18:56:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.405+0000 7fa3b7400640 1 -- 172.21.15.33:0/2092918694 wait complete. 2024-09-13T18:56:53.410 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.406+0000 7faaaae14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:56:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.407+0000 7fa3b7400640 1 Processor -- start 2024-09-13T18:56:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.407+0000 7fa3b7400640 1 -- start start 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b015c770 0x7fa3b00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3b015cb50 0x7fa3b01f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b1520 con 0x7fa3b006a5e0 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b0bf0 con 0x7fa3b015c770 2024-09-13T18:56:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b7400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b0ed0 con 0x7fa3b015cb50 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59030/0 (socket says 172.21.15.33:59030) 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3b4a00640 1 -- 172.21.15.33:0/1758017951 learned_addr learned my addr 172.21.15.33:0/1758017951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.408+0000 7fa3afe00640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b015c770 0x7fa3b00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b5400640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3b015cb50 0x7fa3b01f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 -- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3b015cb50 msgr2=0x7fa3b01f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3b015cb50 0x7fa3b01f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 -- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b015c770 msgr2=0x7fa3b00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b015c770 0x7fa3b00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 -- 172.21.15.33:0/1758017951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009b30 con 0x7fa3b006a5e0 2024-09-13T18:56:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3b4a00640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c780 tx=0x7fa3a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4005270 con 0x7fa3b006a5e0 2024-09-13T18:56:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.409+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40053f0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.410+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400a880 con 0x7fa3b006a5e0 2024-09-13T18:56:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.410+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00b11b0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.410+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0153e10 con 0x7fa3b006a5e0 2024-09-13T18:56:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.410+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa3a400ace0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.410+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa3a401bad0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.411+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0069ed0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.413+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa3a40035f0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.470 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.467+0000 7f42c2e0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:56:53.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.474+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b01592f0 con 0x7fa3b006a5e0 2024-09-13T18:56:53.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.475+0000 7fa3acc00640 1 -- 172.21.15.33:0/1758017951 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa3a4003e60 con 0x7fa3b006a5e0 2024-09-13T18:56:53.478 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:56:53.478 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:56:53.122939+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:56:53.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 msgr2=0x7fa3b00b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:53.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c780 tx=0x7fa3a400cc40 comp rx=0 tx=0).stop 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 shutdown_connections 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3b015cb50 0x7fa3b01f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b015c770 0x7fa3b00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 --2- 172.21.15.33:0/1758017951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b006a5e0 0x7fa3b00b19b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 >> 172.21.15.33:0/1758017951 conn(0x7fa3b006afe0 msgr2=0x7fa3b00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 shutdown_connections 2024-09-13T18:56:53.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:56:53.476+0000 7fa3b7400640 1 -- 172.21.15.33:0/1758017951 wait complete. 2024-09-13T18:56:53.495 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:56:53.495 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:56:53.505 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.502+0000 7faaaae14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:56:53.596 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.593+0000 7f42c2e0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:56:53.625 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.621+0000 7faaaae14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:56:53.652 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.649+0000 7f42c2e0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:56:53.680 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.676+0000 7faaaae14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:56:53.783 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.780+0000 7f42c2e0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:56:53.803 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.800+0000 7faaaae14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:56:53.848 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.845+0000 7f42c2e0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:56:53.850 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-13T18:56:53.847+0000 7f13be00d640 -1 Falling back to public interface 2024-09-13T18:56:53.853 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-13T18:56:53.851+0000 7f02e4444640 -1 Falling back to public interface 2024-09-13T18:56:53.865 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.861+0000 7faaaae14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:56:53.874 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-13T18:56:53.871+0000 7f09b482f640 -1 Falling back to public interface 2024-09-13T18:56:53.879 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-13T18:56:53.876+0000 7f22a9ed6640 -1 Falling back to public interface 2024-09-13T18:56:53.882 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-13T18:56:53.879+0000 7f08f87bd640 -1 Falling back to public interface 2024-09-13T18:56:53.882 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-13T18:56:53.879+0000 7f5d378d6640 -1 Falling back to public interface 2024-09-13T18:56:53.891 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-13T18:56:53.888+0000 7faef6951640 -1 Falling back to public interface 2024-09-13T18:56:53.905 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:53.902+0000 7f42c2e0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:56:53.908 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-13T18:56:53.902+0000 7f89df642640 -1 Falling back to public interface 2024-09-13T18:56:53.921 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:53.918+0000 7faaaae14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:56:54.035 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.032+0000 7f42c2e0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:56:54.047 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.043+0000 7faaaae14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:56:54.095 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.092+0000 7f42c2e0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:56:54.104 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.101+0000 7faaaae14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:56:54.158 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.155+0000 7f42c2e0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:56:54.164 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.161+0000 7faaaae14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:56:54.239 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.236+0000 7f42c2e0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:56:54.243 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.239+0000 7faaaae14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:56:54.293 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.290+0000 7f42c2e0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:56:54.294 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.291+0000 7faaaae14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:56:54.299 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:56:54.346 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:54.343+0000 7faaaae14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:56:54.350 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:54.347+0000 7f42c2e0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:56:54.437 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.434+0000 7f5a80200640 1 Processor -- start 2024-09-13T18:56:54.437 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.434+0000 7f5a80200640 1 -- start start 2024-09-13T18:56:54.438 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.435+0000 7f5a80200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7806c720 0x7f5a780b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:54.438 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.435+0000 7f5a80200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a7815d980 0x7f5a780b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:54.438 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.435+0000 7f5a80200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b51e0 con 0x7f5a7815ce90 2024-09-13T18:56:54.438 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.435+0000 7f5a80200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7806afe0 con 0x7f5a7815d980 2024-09-13T18:56:54.439 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.435+0000 7f5a80200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780b54c0 con 0x7f5a7806c720 2024-09-13T18:56:54.439 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a7815d980 0x7f5a780b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a7815d980 0x7f5a780b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59046/0 (socket says 172.21.15.33:59046) 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7d800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5a7815ce90 0x7f5a7815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43384/0 (socket says 172.21.15.33:43384) 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 -- 172.21.15.33:0/492818418 learned_addr learned my addr 172.21.15.33:0/492818418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7ce00640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7806c720 0x7f5a780b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 -- 172.21.15.33:0/492818418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7806c720 msgr2=0x7f5a780b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7806c720 0x7f5a780b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 -- 172.21.15.33:0/492818418 >> v1:172.21.15.33:6789/0 conn(0x7f5a7815ce90 legacy=0x7f5a7815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a7e200640 1 -- 172.21.15.33:0/492818418 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780b57a0 con 0x7f5a7815d980 2024-09-13T18:56:54.440 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.436+0000 7f5a77e00640 1 -- 172.21.15.33:0/492818418 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111181303 0 0) 0x7f5a780b51e0 con 0x7f5a7815ce90 2024-09-13T18:56:54.441 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.437+0000 7f5a7e200640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7815d980 0x7f5a780b4990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009e50 tx=0x7f5a7002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0580912861adf84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:54.441 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.437+0000 7f5a77e00640 1 -- 172.21.15.33:0/492818418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70031600 con 0x7f5a7815d980 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.437+0000 7f5a77e00640 1 -- 172.21.15.33:0/492818418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7002d050 con 0x7f5a7815d980 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.437+0000 7f5a77e00640 1 -- 172.21.15.33:0/492818418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70031980 con 0x7f5a7815d980 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 -- 172.21.15.33:0/492818418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7815d980 msgr2=0x7f5a780b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7815d980 0x7f5a780b4990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009e50 tx=0x7f5a7002a710 comp rx=0 tx=0).stop 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 -- 172.21.15.33:0/492818418 shutdown_connections 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7806c720 0x7f5a780b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 --2- 172.21.15.33:0/492818418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7815d980 0x7f5a780b4990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 -- 172.21.15.33:0/492818418 >> 172.21.15.33:0/492818418 conn(0x7f5a78071b80 msgr2=0x7f5a78099a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 -- 172.21.15.33:0/492818418 shutdown_connections 2024-09-13T18:56:54.442 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.438+0000 7f5a80200640 1 -- 172.21.15.33:0/492818418 wait complete. 2024-09-13T18:56:54.443 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.440+0000 7f5a80200640 1 Processor -- start 2024-09-13T18:56:54.443 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.440+0000 7f5a80200640 1 -- start start 2024-09-13T18:56:54.445 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7815ce90 0x7f5a780b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7815d980 0x7f5a780b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78157600 con 0x7f5a7806c720 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78148880 con 0x7f5a7815d980 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a80200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780b2980 con 0x7f5a7815ce90 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a7d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a7d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59050/0 (socket says 172.21.15.33:59050) 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a7d800640 1 -- 172.21.15.33:0/3606946983 learned_addr learned my addr 172.21.15.33:0/3606946983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a7ce00640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7815ce90 0x7f5a780b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.441+0000 7f5a7e200640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7815d980 0x7f5a780b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 -- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7815ce90 msgr2=0x7f5a780b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7815ce90 0x7f5a780b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.446 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 -- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7815d980 msgr2=0x7f5a780b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7815d980 0x7f5a780b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 -- 172.21.15.33:0/3606946983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009b30 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a7d800640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c500 tx=0x7f5a6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c007560 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0047e0 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a780b2c60 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c004b90 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a78148510 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.442+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5a6c012400 con 0x7f5a7806c720 2024-09-13T18:56:54.447 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.443+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5a6c01b360 con 0x7f5a7806c720 2024-09-13T18:56:54.448 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.443+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7815d270 con 0x7f5a7806c720 2024-09-13T18:56:54.449 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.446+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5a6c018070 con 0x7f5a7806c720 2024-09-13T18:56:54.510 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.507+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a780b37c0 con 0x7f5a7806c720 2024-09-13T18:56:54.511 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.507+0000 7f5a75600640 1 -- 172.21.15.33:0/3606946983 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5a6c012710 con 0x7f5a7806c720 2024-09-13T18:56:54.511 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-13T18:56:54.511 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:56:53.122939+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.508+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 msgr2=0x7f5a781477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.508+0000 7f5a80200640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c500 tx=0x7f5a6c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 shutdown_connections 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7815d980 0x7f5a780b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a7815ce90 0x7f5a780b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 --2- 172.21.15.33:0/3606946983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a7806c720 0x7f5a781477f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 >> 172.21.15.33:0/3606946983 conn(0x7f5a78071b80 msgr2=0x7f5a7806d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:54.512 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 shutdown_connections 2024-09-13T18:56:54.513 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:56:54.509+0000 7f5a80200640 1 -- 172.21.15.33:0/3606946983 wait complete. 2024-09-13T18:56:54.524 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:56:55.080 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:55.077+0000 7faaaae14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:56:55.118 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-13T18:56:55.115+0000 7f42c2e0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:56:56.102 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:56.098+0000 7faa4b200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:56:56.103 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-13T18:56:56.100+0000 7faa4b200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:56:57.432 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-13T18:56:57.429+0000 7f09b482f640 -1 osd.1 0 log_to_monitors true 2024-09-13T18:56:57.443 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-13T18:56:57.440+0000 7f02e4444640 -1 osd.0 0 log_to_monitors true 2024-09-13T18:56:57.465 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-13T18:56:57.462+0000 7f13be00d640 -1 osd.3 0 log_to_monitors true 2024-09-13T18:56:57.472 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-13T18:56:57.469+0000 7f22a9ed6640 -1 osd.6 0 log_to_monitors true 2024-09-13T18:56:57.473 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-13T18:56:57.470+0000 7f5d378d6640 -1 osd.7 0 log_to_monitors true 2024-09-13T18:56:57.503 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-13T18:56:57.500+0000 7f08f87bd640 -1 osd.2 0 log_to_monitors true 2024-09-13T18:56:57.529 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-13T18:56:57.526+0000 7f89df642640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:56:57.550 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-13T18:56:57.547+0000 7faef6951640 -1 osd.5 0 log_to_monitors true 2024-09-13T18:57:01.330 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:01.397 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-13T18:57:01.392+0000 7f02de800640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:57:01.399 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-13T18:57:01.396+0000 7f5d31e00640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:57:01.404 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-13T18:57:01.401+0000 7f02d5200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.405 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-13T18:57:01.402+0000 7f5d28800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.420 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-13T18:57:01.416+0000 7f13b8000640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:57:01.422 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-13T18:57:01.419+0000 7f89d9a00640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:57:01.426 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-13T18:57:01.423+0000 7faef0e00640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:57:01.428 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-13T18:57:01.425+0000 7f13aea00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.430 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-13T18:57:01.426+0000 7f22a4400640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:57:01.431 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-13T18:57:01.428+0000 7f89d0400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.433 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-13T18:57:01.430+0000 7faee7800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.438 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-13T18:57:01.435+0000 7f229ae00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.443 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-13T18:57:01.440+0000 7f09aec00640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:57:01.445 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-13T18:57:01.442+0000 7f08f2c00640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:57:01.448 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-13T18:57:01.445+0000 7f09a5600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.456 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-13T18:57:01.453+0000 7f08e9600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:57:01.514 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.510+0000 7f4fff000640 1 Processor -- start 2024-09-13T18:57:01.514 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.511+0000 7f4fff000640 1 -- start start 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4fff000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ff8143f50 0x7f4ff8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4fff000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 0x7f4ff80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4fff000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff8071980 con 0x7f4ff80caa80 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4fff000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff8071c60 con 0x7f4ff8143f50 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4fff000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cb520 con 0x7f4ff80714e0 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4ffe600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4ff80caa80 0x7f4ff8069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43386/0 (socket says 172.21.15.33:43386) 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4ffe600640 1 -- 172.21.15.33:0/1418620459 learned_addr learned my addr 172.21.15.33:0/1418620459 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/1418620459 >> v2:172.21.15.103:3300/0 conn(0x7f4ff8143f50 0x7f4ff8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.512+0000 7f4ffd200640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 0x7f4ff80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.516 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ff7e00640 1 -- 172.21.15.33:0/1418620459 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002587915 0 0) 0x7f4ff8071980 con 0x7f4ff80caa80 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ff7e00640 1 -- 172.21.15.33:0/1418620459 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe0003520 con 0x7f4ff80caa80 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ffdc00640 1 -- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 msgr2=0x7f4ff80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 0x7f4ff80affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ffdc00640 1 -- 172.21.15.33:0/1418620459 >> v1:172.21.15.33:6789/0 conn(0x7f4ff80caa80 legacy=0x7f4ff8069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ffdc00640 1 -- 172.21.15.33:0/1418620459 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80cb800 con 0x7f4ff8143f50 2024-09-13T18:57:01.517 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.513+0000 7f4ffd200640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 0x7f4ff80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.514+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff8143f50 0x7f4ff8070fa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097d0 tx=0x7f4fec02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75698724f0aac060 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.514+0000 7f4ff7e00640 1 -- 172.21.15.33:0/1418620459 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032440 con 0x7f4ff8143f50 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.514+0000 7f4ff7e00640 1 -- 172.21.15.33:0/1418620459 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec0325a0 con 0x7f4ff8143f50 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.514+0000 7f4ff7e00640 1 -- 172.21.15.33:0/1418620459 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032910 con 0x7f4ff8143f50 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 -- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff8143f50 msgr2=0x7f4ff8070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff8143f50 0x7f4ff8070fa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097d0 tx=0x7f4fec02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.519 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 -- 172.21.15.33:0/1418620459 shutdown_connections 2024-09-13T18:57:01.520 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff80714e0 0x7f4ff80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.520 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 --2- 172.21.15.33:0/1418620459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff8143f50 0x7f4ff8070fa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.520 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 -- 172.21.15.33:0/1418620459 >> 172.21.15.33:0/1418620459 conn(0x7f4ff80660e0 msgr2=0x7f4ff806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:01.520 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 -- 172.21.15.33:0/1418620459 shutdown_connections 2024-09-13T18:57:01.520 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.515+0000 7f4fff000640 1 -- 172.21.15.33:0/1418620459 wait complete. 2024-09-13T18:57:01.522 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.517+0000 7f4fff000640 1 Processor -- start 2024-09-13T18:57:01.522 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.517+0000 7f4fff000640 1 -- start start 2024-09-13T18:57:01.522 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff80caa80 0x7f4ff80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff8143f50 0x7f4ff8142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f5490 con 0x7f4ff80714e0 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f6360 con 0x7f4ff80caa80 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4fff000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f56e0 con 0x7f4ff8143f50 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59114/0 (socket says 172.21.15.33:59114) 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 -- 172.21.15.33:0/3186758967 learned_addr learned my addr 172.21.15.33:0/3186758967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffd200640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff80caa80 0x7f4ff80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffe600640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff8143f50 0x7f4ff8142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 -- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff8143f50 msgr2=0x7f4ff8142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff8143f50 0x7f4ff8142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.523 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 -- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff80caa80 msgr2=0x7f4ff80b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff80caa80 0x7f4ff80b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.518+0000 7f4ffdc00640 1 -- 172.21.15.33:0/3186758967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009400 con 0x7f4ff80714e0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4ffdc00640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fec02a7b0 tx=0x7f4fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec03e920 con 0x7f4ff80714e0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec03ea80 con 0x7f4ff80714e0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec009400 con 0x7f4ff80714e0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec03ee30 con 0x7f4ff80714e0 2024-09-13T18:57:01.524 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.519+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff81f5ca0 con 0x7f4ff80714e0 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.520+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff8132d60 con 0x7f4ff80714e0 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.521+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f4fec03c400 con 0x7f4ff80714e0 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.522+0000 7f4ff5600640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 0x7f4fd806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.522+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4fec0a9220 con 0x7f4ff80714e0 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.522+0000 7f4ffd200640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 0x7f4fd806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:01.525 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.523+0000 7f4ffd200640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 0x7f4fd806d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8130ba0 tx=0x7f4fe4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:01.530 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.527+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4ff8132d60 con 0x7f4ff80714e0 2024-09-13T18:57:01.709 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.706+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ff8132d60 con 0x7f4ff80714e0 2024-09-13T18:57:01.710 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.706+0000 7f4ff5600640 1 -- 172.21.15.33:0/3186758967 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4ff8132d60 con 0x7f4ff80714e0 2024-09-13T18:57:01.710 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-13T18:57:01.710 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":12,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:56:59.099822+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:01.712 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.708+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 msgr2=0x7f4fd806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.712 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 0x7f4fd806d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8130ba0 tx=0x7f4fe4009190 comp rx=0 tx=0).stop 2024-09-13T18:57:01.712 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 msgr2=0x7f4ff8130cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:01.712 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fec02a7b0 tx=0x7f4fec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 shutdown_connections 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4fd806ab70 0x7f4fd806d030 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ff8143f50 0x7f4ff8142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff80caa80 0x7f4ff80b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 --2- 172.21.15.33:0/3186758967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ff80714e0 0x7f4ff8130cd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 >> 172.21.15.33:0/3186758967 conn(0x7f4ff80660e0 msgr2=0x7f4ff80b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 shutdown_connections 2024-09-13T18:57:01.713 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:01.709+0000 7f4fff000640 1 -- 172.21.15.33:0/3186758967 wait complete. 2024-09-13T18:57:01.725 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:57:08.532 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:08.677 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.674+0000 7ff3bee00640 1 Processor -- start 2024-09-13T18:57:08.678 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.674+0000 7ff3bee00640 1 -- start start 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.675+0000 7ff3bee00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3b80adda0 0x7ff3b806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.675+0000 7ff3bee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b80cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3bee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80ae180 con 0x7ff3b815acb0 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3bee00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b815b810 con 0x7ff3b80adda0 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3bee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80cc060 con 0x7ff3b80cb6e0 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3b80adda0 0x7ff3b806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3b80adda0 0x7ff3b806b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50200/0 (socket says 172.21.15.33:50200) 2024-09-13T18:57:08.679 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 -- 172.21.15.33:0/924219984 learned_addr learned my addr 172.21.15.33:0/924219984 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:08.680 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3afe00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b80cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.680 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 -- 172.21.15.33:0/924219984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 msgr2=0x7ff3b80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:08.680 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b80cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.680 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 -- 172.21.15.33:0/924219984 >> v1:172.21.15.103:6789/0 conn(0x7ff3b815acb0 legacy=0x7ff3b815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.681 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3b7e00640 1 -- 172.21.15.33:0/924219984 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b815ba20 con 0x7ff3b80adda0 2024-09-13T18:57:08.681 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.676+0000 7ff3afe00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b80cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:08.681 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.677+0000 7ff3b7e00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b80adda0 0x7ff3b806b540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a400d00fd2cfa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3b7400640 1 -- 172.21.15.33:0/924219984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8032440 con 0x7ff3b80adda0 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3b7400640 1 -- 172.21.15.33:0/924219984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a80325a0 con 0x7ff3b80adda0 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3b7400640 1 -- 172.21.15.33:0/924219984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8032930 con 0x7ff3b80adda0 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 -- 172.21.15.33:0/924219984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b80adda0 msgr2=0x7ff3b806b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b80adda0 0x7ff3b806b540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a802a270 comp rx=0 tx=0).stop 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 -- 172.21.15.33:0/924219984 shutdown_connections 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b80cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 --2- 172.21.15.33:0/924219984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b80adda0 0x7ff3b806b540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.682 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 -- 172.21.15.33:0/924219984 >> 172.21.15.33:0/924219984 conn(0x7ff3b8069ed0 msgr2=0x7ff3b806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:08.683 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 -- 172.21.15.33:0/924219984 shutdown_connections 2024-09-13T18:57:08.683 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.678+0000 7ff3bee00640 1 -- 172.21.15.33:0/924219984 wait complete. 2024-09-13T18:57:08.683 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.680+0000 7ff3bee00640 1 Processor -- start 2024-09-13T18:57:08.683 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.680+0000 7ff3bee00640 1 -- start start 2024-09-13T18:57:08.684 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b80adda0 0x7ff3b81e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.684 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b81e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.684 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81e3f20 con 0x7ff3b815acb0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81e4200 con 0x7ff3b80adda0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81e44e0 con 0x7ff3b80cb6e0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3afe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b81e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3b7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b80adda0 0x7ff3b81e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50202/0 (socket says 172.21.15.33:50202) 2024-09-13T18:57:08.685 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.681+0000 7ff3bce00640 1 -- 172.21.15.33:0/3173443778 learned_addr learned my addr 172.21.15.33:0/3173443778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 -- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 msgr2=0x7ff3b81e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b81e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 -- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b80adda0 msgr2=0x7ff3b81e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b80adda0 0x7ff3b81e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 -- 172.21.15.33:0/3173443778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80094d0 con 0x7ff3b815acb0 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bce00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c6b0 tx=0x7ff3b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0003b70 con 0x7ff3b815acb0 2024-09-13T18:57:08.687 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0003cf0 con 0x7ff3b815acb0 2024-09-13T18:57:08.688 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0003ea0 con 0x7ff3b815acb0 2024-09-13T18:57:08.688 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b81e47c0 con 0x7ff3b815acb0 2024-09-13T18:57:08.688 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.682+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b81e4d80 con 0x7ff3b815acb0 2024-09-13T18:57:08.688 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.684+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80ad900 con 0x7ff3b815acb0 2024-09-13T18:57:08.688 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.684+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff3b0005310 con 0x7ff3b815acb0 2024-09-13T18:57:08.689 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.685+0000 7ff3b4c00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 0x7ff39406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:08.689 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.685+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3b0088d40 con 0x7ff3b815acb0 2024-09-13T18:57:08.689 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.686+0000 7ff3b7e00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 0x7ff39406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:08.689 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.686+0000 7ff3b7e00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 0x7ff39406d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8034000 tx=0x7ff3a802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:08.693 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.690+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff3b0054280 con 0x7ff3b815acb0 2024-09-13T18:57:08.875 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.872+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b80cbb20 con 0x7ff3b815acb0 2024-09-13T18:57:08.876 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.873+0000 7ff3b4c00640 1 -- 172.21.15.33:0/3173443778 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7ff3b00578a0 con 0x7ff3b815acb0 2024-09-13T18:57:08.876 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-13T18:57:08.876 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":16,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:05.413526+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 msgr2=0x7ff39406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 0x7ff39406d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8034000 tx=0x7ff3a802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 msgr2=0x7ff3b806b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000c6b0 tx=0x7ff3b000cb70 comp rx=0 tx=0).stop 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 shutdown_connections 2024-09-13T18:57:08.879 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff39406ac00 0x7ff39406d0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b815acb0 0x7ff3b806b6b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3b80cb6e0 0x7ff3b81e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 --2- 172.21.15.33:0/3173443778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b80adda0 0x7ff3b81e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.875+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 >> 172.21.15.33:0/3173443778 conn(0x7ff3b8069ed0 msgr2=0x7ff3b815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.876+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 shutdown_connections 2024-09-13T18:57:08.880 INFO:teuthology.misc.health.smithi033.stderr:2024-09-13T18:57:08.876+0000 7ff3bee00640 1 -- 172.21.15.33:0/3173443778 wait complete. 2024-09-13T18:57:08.891 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:57:08.891 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:57:08.892 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:57:08.892 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:57:08.896 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:57:08.896 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:57:08.896 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:57:08.899 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:57:08.900 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:57:08.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:57:08.904 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:57:08.904 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:57:08.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:57:08.908 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:57:08.909 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:57:08.909 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:09.026 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T18:57:09.032 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:57:09.046 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:57:09.046 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T18:57:09.048 INFO:tasks.ceph.mds.d.smithi103.stderr:2024-09-13T18:57:09.046+0000 7fcba2200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:57:09.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.074+0000 7f2210600640 1 Processor -- start 2024-09-13T18:57:09.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.074+0000 7f2210600640 1 -- start start 2024-09-13T18:57:09.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f2210600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f220815c770 0x7f2208069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f2210600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f220806a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f2210600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080ae1e0 con 0x7f220815cb50 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f2210600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080ad140 con 0x7f220815c770 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f2210600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080ad420 con 0x7f22080b3da0 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.075+0000 7f220d200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f220815cb50 0x7f22080b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60712/0 (socket says 172.21.15.33:60712) 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220d200640 1 -- 172.21.15.33:0/1665882038 learned_addr learned my addr 172.21.15.33:0/1665882038 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220dc00640 1 --2- 172.21.15.33:0/1665882038 >> v2:172.21.15.103:3300/0 conn(0x7f220815c770 0x7f2208069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220e600640 1 --2- 172.21.15.33:0/1665882038 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f220806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f2207e00640 1 -- 172.21.15.33:0/1665882038 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654359380 0 0) 0x7f22080ae1e0 con 0x7f220815cb50 2024-09-13T18:57:09.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f2207e00640 1 -- 172.21.15.33:0/1665882038 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f0003520 con 0x7f220815cb50 2024-09-13T18:57:09.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220e600640 1 -- 172.21.15.33:0/1665882038 >> v2:172.21.15.103:3300/0 conn(0x7f220815c770 msgr2=0x7f2208069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220e600640 1 --2- 172.21.15.33:0/1665882038 >> v2:172.21.15.103:3300/0 conn(0x7f220815c770 0x7f2208069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220e600640 1 -- 172.21.15.33:0/1665882038 >> v1:172.21.15.33:6789/0 conn(0x7f220815cb50 legacy=0x7f22080b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.076+0000 7f220e600640 1 -- 172.21.15.33:0/1665882038 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080ad700 con 0x7f22080b3da0 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.077+0000 7f220e600640 1 --2- 172.21.15.33:0/1665882038 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f220806a410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1b7283498a2f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.077+0000 7f2207e00640 1 -- 172.21.15.33:0/1665882038 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200007740 con 0x7f22080b3da0 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.077+0000 7f2207e00640 1 -- 172.21.15.33:0/1665882038 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220002d050 con 0x7f22080b3da0 2024-09-13T18:57:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.077+0000 7f2207e00640 1 -- 172.21.15.33:0/1665882038 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200007ac0 con 0x7f22080b3da0 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 -- 172.21.15.33:0/1665882038 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 msgr2=0x7f220806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 --2- 172.21.15.33:0/1665882038 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f220806a410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220002a660 comp rx=0 tx=0).stop 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 -- 172.21.15.33:0/1665882038 shutdown_connections 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 --2- 172.21.15.33:0/1665882038 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f220806a410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 --2- 172.21.15.33:0/1665882038 >> v2:172.21.15.103:3300/0 conn(0x7f220815c770 0x7f2208069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 -- 172.21.15.33:0/1665882038 >> 172.21.15.33:0/1665882038 conn(0x7f220806afe0 msgr2=0x7f220806b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 -- 172.21.15.33:0/1665882038 shutdown_connections 2024-09-13T18:57:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.078+0000 7f2210600640 1 -- 172.21.15.33:0/1665882038 wait complete. 2024-09-13T18:57:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.080+0000 7f2210600640 1 Processor -- start 2024-09-13T18:57:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.080+0000 7f2210600640 1 -- start start 2024-09-13T18:57:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f22080b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815cb50 0x7f22080b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220814e070 con 0x7f220815c770 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080b0c20 con 0x7f220815cb50 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f2210600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080b0f00 con 0x7f22080b3da0 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50230/0 (socket says 172.21.15.33:50230) 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 -- 172.21.15.33:0/3243653031 learned_addr learned my addr 172.21.15.33:0/3243653031 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220dc00640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f22080b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220e600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815cb50 0x7f22080b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 -- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 msgr2=0x7f22080b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f22080b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 -- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815cb50 msgr2=0x7f22080b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815cb50 0x7f22080b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.081+0000 7f220d200640 1 -- 172.21.15.33:0/3243653031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a70 con 0x7f220815c770 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f220d200640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c410 tx=0x7f21f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4005ce0 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4005e40 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40072f0 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080b11e0 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.082+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080b17a0 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.083+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22080b3690 con 0x7f220815c770 2024-09-13T18:57:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.084+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21f4007450 con 0x7f220815c770 2024-09-13T18:57:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.085+0000 7f2205600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 0x7f21e806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.085+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f21f40885e0 con 0x7f220815c770 2024-09-13T18:57:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.085+0000 7f220dc00640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 0x7f21e806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.086+0000 7f220dc00640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 0x7f21e806d0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009b40 tx=0x7f21fc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.089+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21f4053c70 con 0x7f220815c770 2024-09-13T18:57:09.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.270+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f220815a7b0 con 0x7f220815c770 2024-09-13T18:57:09.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.271+0000 7f2205600640 1 -- 172.21.15.33:0/3243653031 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f21f4057290 con 0x7f220815c770 2024-09-13T18:57:09.274 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:09.274 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:05.413526+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:09.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 msgr2=0x7f21e806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 0x7f21e806d0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009b40 tx=0x7f21fc009190 comp rx=0 tx=0).stop 2024-09-13T18:57:09.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 msgr2=0x7f220814db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c410 tx=0x7f21f400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 shutdown_connections 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21e806ac30 0x7f21e806d0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815cb50 0x7f22080b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220815c770 0x7f220814db30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 --2- 172.21.15.33:0/3243653031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f22080b3da0 0x7f22080b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 >> 172.21.15.33:0/3243653031 conn(0x7f220806afe0 msgr2=0x7f220806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 shutdown_connections 2024-09-13T18:57:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.273+0000 7f2210600640 1 -- 172.21.15.33:0/3243653031 wait complete. 2024-09-13T18:57:09.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:09.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.446+0000 7f2c3b200640 1 Processor -- start 2024-09-13T18:57:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.446+0000 7f2c3b200640 1 -- start start 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.447+0000 7f2c3b200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c3c0b2e20 0x7f2c3c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.447+0000 7f2c3b200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0cc370 con 0x7f2c3c15d980 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.447+0000 7f2c3b200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0cd1b0 con 0x7f2c3c1594a0 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.447+0000 7f2c3b200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c159880 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c3a800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2c3c15d980 0x7f2c3c06f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60714/0 (socket says 172.21.15.33:60714) 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c39400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c3c0b2e20 0x7f2c3c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c3a800640 1 -- 172.21.15.33:0/130614414 learned_addr learned my addr 172.21.15.33:0/130614414 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c38a00640 1 -- 172.21.15.33:0/130614414 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286327807 0 0) 0x7f2c3c0cc370 con 0x7f2c3c15d980 2024-09-13T18:57:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c39400640 1 -- 172.21.15.33:0/130614414 >> v1:172.21.15.103:6789/0 conn(0x7f2c3c1594a0 legacy=0x7f2c3c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c39400640 1 -- 172.21.15.33:0/130614414 >> v1:172.21.15.33:6789/0 conn(0x7f2c3c15d980 legacy=0x7f2c3c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.448+0000 7f2c39400640 1 -- 172.21.15.33:0/130614414 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0cc5a0 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.449+0000 7f2c39400640 1 --2- 172.21.15.33:0/130614414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c0cdf10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bdba84d54dc6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.449+0000 7f2c38a00640 1 -- 172.21.15.33:0/130614414 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2802ade0 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.449+0000 7f2c38a00640 1 -- 172.21.15.33:0/130614414 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c28032440 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.449+0000 7f2c38a00640 1 -- 172.21.15.33:0/130614414 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280327d0 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 -- 172.21.15.33:0/130614414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 msgr2=0x7f2c3c0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 --2- 172.21.15.33:0/130614414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c0cdf10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802a0d0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 -- 172.21.15.33:0/130614414 shutdown_connections 2024-09-13T18:57:09.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 --2- 172.21.15.33:0/130614414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c0cdf10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 -- 172.21.15.33:0/130614414 >> 172.21.15.33:0/130614414 conn(0x7f2c3c0b0200 msgr2=0x7f2c3c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:09.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 -- 172.21.15.33:0/130614414 shutdown_connections 2024-09-13T18:57:09.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.450+0000 7f2c3b200640 1 -- 172.21.15.33:0/130614414 wait complete. 2024-09-13T18:57:09.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.452+0000 7f2c3b200640 1 Processor -- start 2024-09-13T18:57:09.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.452+0000 7f2c3b200640 1 -- start start 2024-09-13T18:57:09.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 0x7f2c3c14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c3c15d980 0x7f2c3c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c14a730 con 0x7f2c3c1594a0 2024-09-13T18:57:09.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c157980 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0c7880 con 0x7f2c3c15d980 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 0x7f2c3c14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 0x7f2c3c14a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50234/0 (socket says 172.21.15.33:50234) 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:40672/0 (socket says 172.21.15.33:40672) 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39400640 1 -- 172.21.15.33:0/3426866033 learned_addr learned my addr 172.21.15.33:0/3426866033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c3a800640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c3c15d980 0x7f2c3c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 -- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c3c15d980 msgr2=0x7f2c3c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c3c15d980 0x7f2c3c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 -- 172.21.15.33:0/3426866033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 msgr2=0x7f2c3c14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 0x7f2c3c14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.453+0000 7f2c39e00640 1 -- 172.21.15.33:0/3426866033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28009400 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c39e00640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c550 tx=0x7f2c2c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c005480 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c0035f0 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0039a0 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c0c7b60 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.454+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0c8120 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.455+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c0c8310 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.456+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c2c003b00 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.457+0000 7f2c32000640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 0x7f2c1c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.457+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c2c088f60 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.457+0000 7f2c39400640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 0x7f2c1c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.458+0000 7f2c39400640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 0x7f2c1c06d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.461+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c2c054550 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.641+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c3c0cde00 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.641+0000 7f2c32000640 1 -- 172.21.15.33:0/3426866033 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c2c057b70 con 0x7f2c3c0b2e20 2024-09-13T18:57:09.645 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 msgr2=0x7f2c1c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 0x7f2c1c06d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 msgr2=0x7f2c3c14a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c550 tx=0x7f2c2c00ca10 comp rx=0 tx=0).stop 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 shutdown_connections 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1c06ac30 0x7f2c1c06d0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c3c15d980 0x7f2c3c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3c1594a0 0x7f2c3c14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.643+0000 7f2c3b200640 1 --2- 172.21.15.33:0/3426866033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c3c0b2e20 0x7f2c3c14a960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.644+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 >> 172.21.15.33:0/3426866033 conn(0x7f2c3c0b0200 msgr2=0x7f2c3c154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.644+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 shutdown_connections 2024-09-13T18:57:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.644+0000 7f2c3b200640 1 -- 172.21.15.33:0/3426866033 wait complete. 2024-09-13T18:57:09.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:57:09.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.812+0000 7f3934400640 1 Processor -- start 2024-09-13T18:57:09.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.812+0000 7f3934400640 1 -- start start 2024-09-13T18:57:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 0x7f392c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f392c0cde50 0x7f392c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c06bc00 con 0x7f392c0cde50 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c06bea0 con 0x7f392c0b1b00 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.813+0000 7f3934400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c06c180 con 0x7f392c15a520 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f392c0cde50 0x7f392c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f392c0cde50 0x7f392c0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50236/0 (socket says 172.21.15.33:50236) 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 -- 172.21.15.33:0/3953546738 learned_addr learned my addr 172.21.15.33:0/3953546738 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3931000640 1 --2- 172.21.15.33:0/3953546738 >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 0x7f392c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3931a00640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 -- 172.21.15.33:0/3953546738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 msgr2=0x7f392c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 -- 172.21.15.33:0/3953546738 >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 msgr2=0x7f392c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 --2- 172.21.15.33:0/3953546738 >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 0x7f392c0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3932400640 1 -- 172.21.15.33:0/3953546738 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c06c460 con 0x7f392c0cde50 2024-09-13T18:57:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3931000640 1 --2- 172.21.15.33:0/3953546738 >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 0x7f392c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.814+0000 7f3931a00640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.815+0000 7f3932400640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0cde50 0x7f392c0b2490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f392402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70195e4562948be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.815+0000 7f392be00640 1 -- 172.21.15.33:0/3953546738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924031600 con 0x7f392c0cde50 2024-09-13T18:57:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.815+0000 7f392be00640 1 -- 172.21.15.33:0/3953546738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392402d050 con 0x7f392c0cde50 2024-09-13T18:57:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.815+0000 7f392be00640 1 -- 172.21.15.33:0/3953546738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924031980 con 0x7f392c0cde50 2024-09-13T18:57:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 -- 172.21.15.33:0/3953546738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0cde50 msgr2=0x7f392c0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0cde50 0x7f392c0b2490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f392402a6d0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 -- 172.21.15.33:0/3953546738 shutdown_connections 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0cde50 0x7f392c0b2490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 --2- 172.21.15.33:0/3953546738 >> v2:172.21.15.103:3300/0 conn(0x7f392c0b1b00 0x7f392c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 --2- 172.21.15.33:0/3953546738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 -- 172.21.15.33:0/3953546738 >> 172.21.15.33:0/3953546738 conn(0x7f392c0b0510 msgr2=0x7f392c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 -- 172.21.15.33:0/3953546738 shutdown_connections 2024-09-13T18:57:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.816+0000 7f3934400640 1 -- 172.21.15.33:0/3953546738 wait complete. 2024-09-13T18:57:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.818+0000 7f3934400640 1 Processor -- start 2024-09-13T18:57:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.818+0000 7f3934400640 1 -- start start 2024-09-13T18:57:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.818+0000 7f3934400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3934400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f392c0cde50 0x7f392c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3934400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3934400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c14b970 con 0x7f392c0b1b00 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3934400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c14b420 con 0x7f392c0cde50 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3934400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c154130 con 0x7f392c15a520 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50240/0 (socket says 172.21.15.33:50240) 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 -- 172.21.15.33:0/3677240938 learned_addr learned my addr 172.21.15.33:0/3677240938 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931000640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f392c0cde50 0x7f392c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3932400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 -- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 msgr2=0x7f392c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 -- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f392c0cde50 msgr2=0x7f392c14a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f392c0cde50 0x7f392c14a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 -- 172.21.15.33:0/3677240938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009b30 con 0x7f392c0b1b00 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3932400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.819+0000 7f3931a00640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f392000c7f0 tx=0x7f392000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.820+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007820 con 0x7f392c0b1b00 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.820+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920007980 con 0x7f392c0b1b00 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.820+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007cf0 con 0x7f392c0b1b00 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.820+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c154410 con 0x7f392c0b1b00 2024-09-13T18:57:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.820+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c1549d0 con 0x7f392c0b1b00 2024-09-13T18:57:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.821+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c0cd910 con 0x7f392c0b1b00 2024-09-13T18:57:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.822+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39200113f0 con 0x7f392c0b1b00 2024-09-13T18:57:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.822+0000 7f3929600640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 0x7f390c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.823+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39200892e0 con 0x7f392c0b1b00 2024-09-13T18:57:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.823+0000 7f3931000640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 0x7f390c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.824+0000 7f3931000640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 0x7f390c06d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f392c1e9eb0 tx=0x7f3918008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:09.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:09.827+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f39200548a0 con 0x7f392c0b1b00 2024-09-13T18:57:10.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.045+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f392c0aca00 con 0x7f392c0b1b00 2024-09-13T18:57:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.046+0000 7f3929600640 1 -- 172.21.15.33:0/3677240938 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f392001fde0 con 0x7f392c0b1b00 2024-09-13T18:57:10.049 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:10.049 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:57:10.050 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 msgr2=0x7f390c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 0x7f390c06d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f392c1e9eb0 tx=0x7f3918008040 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 msgr2=0x7f392c14bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f392000c7f0 tx=0x7f392000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 shutdown_connections 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f390c06ac00 0x7f390c06d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f392c15a520 0x7f392c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f392c0cde50 0x7f392c14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 --2- 172.21.15.33:0/3677240938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f392c0b1b00 0x7f392c14bff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 >> 172.21.15.33:0/3677240938 conn(0x7f392c0b0510 msgr2=0x7f392c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 shutdown_connections 2024-09-13T18:57:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.048+0000 7f3934400640 1 -- 172.21.15.33:0/3677240938 wait complete. 2024-09-13T18:57:10.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.220+0000 7f70a3e00640 1 Processor -- start 2024-09-13T18:57:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.221+0000 7f70a3e00640 1 -- start start 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a415a5c0 0x7f70a40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a40cbac0 0x7f70a40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40cce20 con 0x7f70a40cbac0 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40cbfc0 con 0x7f70a415a5c0 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40707a0 con 0x7f70a40afe10 2024-09-13T18:57:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f709a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a40cbac0 0x7f70a40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f709a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a40cbac0 0x7f70a40b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50246/0 (socket says 172.21.15.33:50246) 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f709a000640 1 -- 172.21.15.33:0/2123717063 learned_addr learned my addr 172.21.15.33:0/2123717063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a2a00640 1 --2- 172.21.15.33:0/2123717063 >> v2:172.21.15.103:3300/0 conn(0x7f70a415a5c0 0x7f70a40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.222+0000 7f70a3400640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.223+0000 7f709a000640 1 -- 172.21.15.33:0/2123717063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 msgr2=0x7f70a406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.223+0000 7f709a000640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a406f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.223+0000 7f709a000640 1 -- 172.21.15.33:0/2123717063 >> v2:172.21.15.103:3300/0 conn(0x7f70a415a5c0 msgr2=0x7f70a40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.223+0000 7f709a000640 1 --2- 172.21.15.33:0/2123717063 >> v2:172.21.15.103:3300/0 conn(0x7f70a415a5c0 0x7f70a40b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.223+0000 7f709a000640 1 -- 172.21.15.33:0/2123717063 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4070a80 con 0x7f70a40cbac0 2024-09-13T18:57:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f709a000640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70a4067270 tx=0x7f708c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d2e365e7545766 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f70a2000640 1 -- 172.21.15.33:0/2123717063 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c032440 con 0x7f70a40cbac0 2024-09-13T18:57:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f70a2000640 1 -- 172.21.15.33:0/2123717063 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c0325a0 con 0x7f70a40cbac0 2024-09-13T18:57:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f70a2000640 1 -- 172.21.15.33:0/2123717063 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c032930 con 0x7f70a40cbac0 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f70a3e00640 1 -- 172.21.15.33:0/2123717063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 msgr2=0x7f70a40b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.224+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70a4067270 tx=0x7f708c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 -- 172.21.15.33:0/2123717063 shutdown_connections 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a406f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2123717063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2123717063 >> v2:172.21.15.103:3300/0 conn(0x7f70a415a5c0 0x7f70a40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 -- 172.21.15.33:0/2123717063 >> 172.21.15.33:0/2123717063 conn(0x7f70a40ae310 msgr2=0x7f70a40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 -- 172.21.15.33:0/2123717063 shutdown_connections 2024-09-13T18:57:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.225+0000 7f70a3e00640 1 -- 172.21.15.33:0/2123717063 wait complete. 2024-09-13T18:57:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.226+0000 7f70a3e00640 1 Processor -- start 2024-09-13T18:57:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.226+0000 7f70a3e00640 1 -- start start 2024-09-13T18:57:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a40acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 0x7f70a4148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a414f460 con 0x7f70a40cbac0 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a414f740 con 0x7f70a415a5c0 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f70a3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a414fa20 con 0x7f70a40afe10 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.227+0000 7f709a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50248/0 (socket says 172.21.15.33:50248) 2024-09-13T18:57:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 -- 172.21.15.33:0/2850883620 learned_addr learned my addr 172.21.15.33:0/2850883620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:10.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f70a3400640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 0x7f70a4148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f70a2a00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a40acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 -- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 msgr2=0x7f70a40acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a40acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 -- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 msgr2=0x7f70a4148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 0x7f70a4148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 -- 172.21.15.33:0/2850883620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0094d0 con 0x7f70a40cbac0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f70a3400640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 0x7f70a4148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f70a2a00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a40acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.228+0000 7f709a000640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f708c02a220 tx=0x7f708c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.229+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c03d830 con 0x7f70a40cbac0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.229+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c03d990 con 0x7f70a40cbac0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.229+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c03dd40 con 0x7f70a40cbac0 2024-09-13T18:57:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.229+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a414fd00 con 0x7f70a40cbac0 2024-09-13T18:57:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.229+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a40b29a0 con 0x7f70a40cbac0 2024-09-13T18:57:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.230+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a4067360 con 0x7f70a40cbac0 2024-09-13T18:57:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.231+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f708c039040 con 0x7f70a40cbac0 2024-09-13T18:57:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.231+0000 7f709b400640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 0x7f708006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.231+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f708c0a9a20 con 0x7f70a40cbac0 2024-09-13T18:57:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.232+0000 7f70a2a00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 0x7f708006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.232+0000 7f70a2a00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 0x7f708006d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a20 tx=0x7f7094008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.236+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f708c074f40 con 0x7f70a40cbac0 2024-09-13T18:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.415+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a4150220 con 0x7f70a40cbac0 2024-09-13T18:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.416+0000 7f709b400640 1 -- 172.21.15.33:0/2850883620 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f70a4150220 con 0x7f70a40cbac0 2024-09-13T18:57:10.419 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:10.419 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:05.413526+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 msgr2=0x7f708006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 0x7f708006d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a20 tx=0x7f7094008040 comp rx=0 tx=0).stop 2024-09-13T18:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 msgr2=0x7f70a40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f708c02a220 tx=0x7f708c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 shutdown_connections 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f708006ac00 0x7f708006d0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a415a5c0 0x7f70a4148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a40cbac0 0x7f70a40b3090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 --2- 172.21.15.33:0/2850883620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a40afe10 0x7f70a40acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 >> 172.21.15.33:0/2850883620 conn(0x7f70a40ae310 msgr2=0x7f70a41579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 shutdown_connections 2024-09-13T18:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.418+0000 7f70a3e00640 1 -- 172.21.15.33:0/2850883620 wait complete. 2024-09-13T18:57:10.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:10.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.592+0000 7f004cc00640 1 Processor -- start 2024-09-13T18:57:10.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.592+0000 7f004cc00640 1 -- start start 2024-09-13T18:57:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f004cc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00480ac590 0x7f004806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f004cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00480b3df0 0x7f00480ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f004cc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00480ad5f0 con 0x7f004815c720 2024-09-13T18:57:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f004cc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480b4240 con 0x7f00480ac590 2024-09-13T18:57:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f004cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480b3050 con 0x7f00480b3df0 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f0045e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f004815c720 0x7f00480abe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60722/0 (socket says 172.21.15.33:60722) 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.593+0000 7f0045e00640 1 -- 172.21.15.33:0/2518476727 learned_addr learned my addr 172.21.15.33:0/2518476727 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0045400640 1 --2- 172.21.15.33:0/2518476727 >> v2:172.21.15.103:3300/0 conn(0x7f00480ac590 0x7f004806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0046800640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00480b3df0 0x7f00480ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0044a00640 1 -- 172.21.15.33:0/2518476727 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314687795 0 0) 0x7f00480ad5f0 con 0x7f004815c720 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0044a00640 1 -- 172.21.15.33:0/2518476727 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f002c003520 con 0x7f004815c720 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0045400640 1 -- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00480b3df0 msgr2=0x7f00480ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0045400640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00480b3df0 0x7f00480ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0045400640 1 -- 172.21.15.33:0/2518476727 >> v1:172.21.15.33:6789/0 conn(0x7f004815c720 legacy=0x7f00480abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.594+0000 7f0045400640 1 -- 172.21.15.33:0/2518476727 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480b3330 con 0x7f00480ac590 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.595+0000 7f0045400640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004806bee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00340097a0 tx=0x7f003402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98505a2ca5617fca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f0044a00640 1 -- 172.21.15.33:0/2518476727 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034032440 con 0x7f00480ac590 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f0044a00640 1 -- 172.21.15.33:0/2518476727 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00340325a0 con 0x7f00480ac590 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f0044a00640 1 -- 172.21.15.33:0/2518476727 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034032930 con 0x7f00480ac590 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 -- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 msgr2=0x7f004806bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004806bee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00340097a0 tx=0x7f003402a180 comp rx=0 tx=0).stop 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 -- 172.21.15.33:0/2518476727 shutdown_connections 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00480b3df0 0x7f00480ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 --2- 172.21.15.33:0/2518476727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004806bee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 -- 172.21.15.33:0/2518476727 >> 172.21.15.33:0/2518476727 conn(0x7f00480b0ba0 msgr2=0x7f00480b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 -- 172.21.15.33:0/2518476727 shutdown_connections 2024-09-13T18:57:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.596+0000 7f004cc00640 1 -- 172.21.15.33:0/2518476727 wait complete. 2024-09-13T18:57:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.598+0000 7f004cc00640 1 Processor -- start 2024-09-13T18:57:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.598+0000 7f004cc00640 1 -- start start 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004809c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f004815c720 0x7f00480ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0048099a00 con 0x7f00480b3df0 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00481f1d40 con 0x7f00480ac590 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f004cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480c90d0 con 0x7f004815c720 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f0045400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f0045400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50258/0 (socket says 172.21.15.33:50258) 2024-09-13T18:57:10.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f0045400640 1 -- 172.21.15.33:0/3157213888 learned_addr learned my addr 172.21.15.33:0/3157213888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f0045e00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004809c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.599+0000 7f0046800640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f004815c720 0x7f00480ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 -- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f004815c720 msgr2=0x7f00480ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f004815c720 0x7f00480ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 -- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 msgr2=0x7f004809c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004809c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 -- 172.21.15.33:0/3157213888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034009400 con 0x7f00480b3df0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f0045400640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0034035040 tx=0x7f00340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003403d8f0 con 0x7f00480b3df0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003403da70 con 0x7f00480b3df0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003403de20 con 0x7f00480b3df0 2024-09-13T18:57:10.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480c93b0 con 0x7f00480b3df0 2024-09-13T18:57:10.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.600+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0048099ef0 con 0x7f00480b3df0 2024-09-13T18:57:10.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.601+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00480b1110 con 0x7f00480b3df0 2024-09-13T18:57:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.602+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0034039040 con 0x7f00480b3df0 2024-09-13T18:57:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.603+0000 7f003e000640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 0x7f002806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.603+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00340a9770 con 0x7f00480b3df0 2024-09-13T18:57:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.604+0000 7f0045e00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 0x7f002806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.604+0000 7f0045e00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 0x7f002806d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00380011e0 tx=0x7f0038009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.607+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0034074db0 con 0x7f00480b3df0 2024-09-13T18:57:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.783+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0048067e20 con 0x7f00480b3df0 2024-09-13T18:57:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.783+0000 7f003e000640 1 -- 172.21.15.33:0/3157213888 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00340783d0 con 0x7f00480b3df0 2024-09-13T18:57:10.787 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 msgr2=0x7f002806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 0x7f002806d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00380011e0 tx=0x7f0038009040 comp rx=0 tx=0).stop 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 msgr2=0x7f00481580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0034035040 tx=0x7f00340046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 shutdown_connections 2024-09-13T18:57:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f002806ac00 0x7f002806d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f004815c720 0x7f00480ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00480b3df0 0x7f00481580d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 --2- 172.21.15.33:0/3157213888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00480ac590 0x7f004809c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 >> 172.21.15.33:0/3157213888 conn(0x7f00480b0ba0 msgr2=0x7f00480aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 shutdown_connections 2024-09-13T18:57:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.785+0000 7f004cc00640 1 -- 172.21.15.33:0/3157213888 wait complete. 2024-09-13T18:57:10.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:57:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.955+0000 7fad8fc00640 1 Processor -- start 2024-09-13T18:57:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.955+0000 7fad8fc00640 1 -- start start 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.956+0000 7fad8fc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad880b34c0 0x7fad880cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.956+0000 7fad8fc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad88070710 con 0x7fad88159610 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.956+0000 7fad8fc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880709e0 con 0x7fad880b3080 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.956+0000 7fad8fc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad881599f0 con 0x7fad880b34c0 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8d200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fad88159610 0x7fad88070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60728/0 (socket says 172.21.15.33:60728) 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8d200640 1 -- 172.21.15.33:0/1073056744 learned_addr learned my addr 172.21.15.33:0/1073056744 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8dc00640 1 --2- 172.21.15.33:0/1073056744 >> v2:172.21.15.103:3300/0 conn(0x7fad880b34c0 0x7fad880cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643524579 0 0) 0x7fad88070710 con 0x7fad88159610 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad70005730 con 0x7fad88159610 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8dc00640 1 -- 172.21.15.33:0/1073056744 >> v1:172.21.15.103:6789/0 conn(0x7fad880b3080 legacy=0x7fad880cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391186826 0 0) 0x7fad880709e0 con 0x7fad880b3080 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8dc00640 1 -- 172.21.15.33:0/1073056744 >> v1:172.21.15.33:6789/0 conn(0x7fad88159610 legacy=0x7fad88070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.957+0000 7fad8dc00640 1 -- 172.21.15.33:0/1073056744 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88070cc0 con 0x7fad880b34c0 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.958+0000 7fad8dc00640 1 --2- 172.21.15.33:0/1073056744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b34c0 0x7fad880cd790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad8002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8d44458ac7b8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80007740 con 0x7fad880b34c0 2024-09-13T18:57:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8002d050 con 0x7fad880b34c0 2024-09-13T18:57:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad87400640 1 -- 172.21.15.33:0/1073056744 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80007ac0 con 0x7fad880b34c0 2024-09-13T18:57:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 -- 172.21.15.33:0/1073056744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b34c0 msgr2=0x7fad880cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 --2- 172.21.15.33:0/1073056744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b34c0 0x7fad880cd790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad8002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 -- 172.21.15.33:0/1073056744 shutdown_connections 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 --2- 172.21.15.33:0/1073056744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b34c0 0x7fad880cd790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 -- 172.21.15.33:0/1073056744 >> 172.21.15.33:0/1073056744 conn(0x7fad880b0510 msgr2=0x7fad880b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 -- 172.21.15.33:0/1073056744 shutdown_connections 2024-09-13T18:57:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.959+0000 7fad8fc00640 1 -- 172.21.15.33:0/1073056744 wait complete. 2024-09-13T18:57:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.961+0000 7fad8fc00640 1 Processor -- start 2024-09-13T18:57:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.961+0000 7fad8fc00640 1 -- start start 2024-09-13T18:57:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b3080 0x7fad880b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad880b34c0 0x7fad88150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881f3120 con 0x7fad88159610 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad880b2ee0 con 0x7fad880b3080 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad881512d0 con 0x7fad880b34c0 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8dc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8dc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50272/0 (socket says 172.21.15.33:50272) 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8dc00640 1 -- 172.21.15.33:0/3161127605 learned_addr learned my addr 172.21.15.33:0/3161127605 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad8d200640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b3080 0x7fad880b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.962+0000 7fad87e00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad880b34c0 0x7fad88150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 -- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad880b34c0 msgr2=0x7fad88150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad880b34c0 0x7fad88150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 -- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b3080 msgr2=0x7fad880b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b3080 0x7fad880b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 -- 172.21.15.33:0/3161127605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009a70 con 0x7fad88159610 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8dc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8003c8f0 con 0x7fad88159610 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8003ca50 con 0x7fad88159610 2024-09-13T18:57:10.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8003cde0 con 0x7fad88159610 2024-09-13T18:57:10.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.963+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8815a750 con 0x7fad88159610 2024-09-13T18:57:10.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.964+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad881f27b0 con 0x7fad88159610 2024-09-13T18:57:10.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.965+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad881f3290 con 0x7fad88159610 2024-09-13T18:57:10.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.965+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad80031400 con 0x7fad88159610 2024-09-13T18:57:10.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.966+0000 7fad84c00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 0x7fad6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:10.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.966+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad800aa460 con 0x7fad88159610 2024-09-13T18:57:10.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.967+0000 7fad8d200640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 0x7fad6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:10.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.967+0000 7fad8d200640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 0x7fad6806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005880 tx=0x7fad7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:10.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:10.970+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fad881f3290 con 0x7fad88159610 2024-09-13T18:57:11.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.151+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad881f3290 con 0x7fad88159610 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.152+0000 7fad84c00640 1 -- 172.21.15.33:0/3161127605 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad881f3290 con 0x7fad88159610 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T18:57:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T18:57:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:57:11.156 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T18:57:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 msgr2=0x7fad6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 0x7fad6806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad7c005880 tx=0x7fad7c009040 comp rx=0 tx=0).stop 2024-09-13T18:57:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 msgr2=0x7fad880b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad80009d90 tx=0x7fad80004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 shutdown_connections 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad6806ac30 0x7fad6806d0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad88159610 0x7fad880b1810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad880b34c0 0x7fad88150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 --2- 172.21.15.33:0/3161127605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad880b3080 0x7fad880b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 >> 172.21.15.33:0/3161127605 conn(0x7fad880b0510 msgr2=0x7fad88158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 shutdown_connections 2024-09-13T18:57:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.154+0000 7fad8fc00640 1 -- 172.21.15.33:0/3161127605 wait complete. 2024-09-13T18:57:11.172 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:57:11.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:57:11.231 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:57:11.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:57:11.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.329+0000 7f3fdb200640 1 Processor -- start 2024-09-13T18:57:11.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.329+0000 7f3fdb200640 1 -- start start 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.330+0000 7f3fdb200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 0x7f3fd40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.330+0000 7f3fdb200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd4151a20 con 0x7f3fd415b770 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.330+0000 7f3fdb200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd40cc430 con 0x7f3fd406cd60 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.330+0000 7f3fdb200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40b1bb0 con 0x7f3fd40cdf80 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd3400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3fd415b770 0x7f3fd40cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60734/0 (socket says 172.21.15.33:60734) 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd3400640 1 -- 172.21.15.33:0/324809864 learned_addr learned my addr 172.21.15.33:0/324809864 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd9200640 1 --2- 172.21.15.33:0/324809864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 0x7f3fd40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267203541 0 0) 0x7f3fd4151a20 con 0x7f3fd415b770 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb8003520 con 0x7f3fd415b770 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634447421 0 0) 0x7f3fd40cc430 con 0x7f3fd406cd60 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd4151a20 con 0x7f3fd406cd60 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd9200640 1 -- 172.21.15.33:0/324809864 >> v1:172.21.15.103:6789/0 conn(0x7f3fd406cd60 legacy=0x7f3fd40cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd9200640 1 -- 172.21.15.33:0/324809864 >> v1:172.21.15.33:6789/0 conn(0x7f3fd415b770 legacy=0x7f3fd40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.331+0000 7f3fd9200640 1 -- 172.21.15.33:0/324809864 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40b1e70 con 0x7f3fd40cdf80 2024-09-13T18:57:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.332+0000 7f3fd9200640 1 --2- 172.21.15.33:0/324809864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 0x7f3fd40b2950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dc0 tx=0x7f3fcc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6858b19b902c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.333+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc007740 con 0x7f3fd40cdf80 2024-09-13T18:57:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.333+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc02d050 con 0x7f3fd40cdf80 2024-09-13T18:57:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.333+0000 7f3fd2a00640 1 -- 172.21.15.33:0/324809864 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc007ac0 con 0x7f3fd40cdf80 2024-09-13T18:57:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.333+0000 7f3fdb200640 1 -- 172.21.15.33:0/324809864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 msgr2=0x7f3fd40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.333+0000 7f3fdb200640 1 --2- 172.21.15.33:0/324809864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 0x7f3fd40b2950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009dc0 tx=0x7f3fcc02a6d0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.334+0000 7f3fdb200640 1 -- 172.21.15.33:0/324809864 shutdown_connections 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.334+0000 7f3fdb200640 1 --2- 172.21.15.33:0/324809864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd40cdf80 0x7f3fd40b2950 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.334+0000 7f3fdb200640 1 -- 172.21.15.33:0/324809864 >> 172.21.15.33:0/324809864 conn(0x7f3fd40b0510 msgr2=0x7f3fd40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.334+0000 7f3fdb200640 1 -- 172.21.15.33:0/324809864 shutdown_connections 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.334+0000 7f3fdb200640 1 -- 172.21.15.33:0/324809864 wait complete. 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.335+0000 7f3fdb200640 1 Processor -- start 2024-09-13T18:57:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.335+0000 7f3fdb200640 1 -- start start 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd40cdf80 0x7f3fd415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd415b770 0x7f3fd415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4153470 con 0x7f3fd406cd60 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4152b40 con 0x7f3fd40cdf80 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fdb200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4152e20 con 0x7f3fd415b770 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.336+0000 7f3fd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50280/0 (socket says 172.21.15.33:50280) 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 -- 172.21.15.33:0/3019819413 learned_addr learned my addr 172.21.15.33:0/3019819413 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3400640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd40cdf80 0x7f3fd415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd9200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd415b770 0x7f3fd415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:11.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 -- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd415b770 msgr2=0x7f3fd415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd415b770 0x7f3fd415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 -- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd40cdf80 msgr2=0x7f3fd415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd40cdf80 0x7f3fd415cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 -- 172.21.15.33:0/3019819413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc009a70 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fd3e00640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c500 tx=0x7f3fc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.337+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40052d0 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.338+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4005430 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.338+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4012850 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.338+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd4153100 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.338+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4152760 con 0x7f3fd406cd60 2024-09-13T18:57:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.339+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd40b2950 con 0x7f3fd406cd60 2024-09-13T18:57:11.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.340+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3fc40129b0 con 0x7f3fd406cd60 2024-09-13T18:57:11.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.340+0000 7f3fcbe00640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 0x7f3fb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:11.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.340+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fc4088bb0 con 0x7f3fd406cd60 2024-09-13T18:57:11.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.341+0000 7f3fd3400640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 0x7f3fb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:11.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.341+0000 7f3fd3400640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 0x7f3fb406d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fd41507d0 tx=0x7f3fc0007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:11.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.345+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3fc4054100 con 0x7f3fd406cd60 2024-09-13T18:57:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:11.523+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3fd415a480 con 0x7f3fd406cd60 2024-09-13T18:57:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.049+0000 7f3fcbe00640 1 -- 172.21.15.33:0/3019819413 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3fc4057720 con 0x7f3fd406cd60 2024-09-13T18:57:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T18:57:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 msgr2=0x7f3fb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 0x7f3fb406d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fd41507d0 tx=0x7f3fc0007d30 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 msgr2=0x7f3fd4144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c500 tx=0x7f3fc400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 shutdown_connections 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3fb406ac00 0x7f3fb406d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3fd415b770 0x7f3fd415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fd40cdf80 0x7f3fd415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 --2- 172.21.15.33:0/3019819413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fd406cd60 0x7f3fd4144080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.053+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 >> 172.21.15.33:0/3019819413 conn(0x7f3fd40b0510 msgr2=0x7f3fd40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:12.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.054+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 shutdown_connections 2024-09-13T18:57:12.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.055+0000 7f3fdb200640 1 -- 172.21.15.33:0/3019819413 wait complete. 2024-09-13T18:57:12.078 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:57:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.278+0000 7f2b69600640 1 Processor -- start 2024-09-13T18:57:12.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.278+0000 7f2b69600640 1 -- start start 2024-09-13T18:57:12.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.279+0000 7f2b69600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 0x7f2b6415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.279+0000 7f2b69600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2b640cafa0 0x7f2b640cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.279+0000 7f2b69600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6406f5f0 con 0x7f2b64156f60 2024-09-13T18:57:12.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.279+0000 7f2b69600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6415aa30 con 0x7f2b640cafa0 2024-09-13T18:57:12.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.279+0000 7f2b69600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64070450 con 0x7f2b64071690 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b64156f60 0x7f2b64070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60744/0 (socket says 172.21.15.33:60744) 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62a00640 1 -- 172.21.15.33:0/2779514926 learned_addr learned my addr 172.21.15.33:0/2779514926 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62000640 1 --2- 172.21.15.33:0/2779514926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 0x7f2b6415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b63400640 1 --2- 172.21.15.33:0/2779514926 >> v2:172.21.15.103:3300/0 conn(0x7f2b640cafa0 0x7f2b640cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b61600640 1 -- 172.21.15.33:0/2779514926 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309309749 0 0) 0x7f2b6406f5f0 con 0x7f2b64156f60 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b61600640 1 -- 172.21.15.33:0/2779514926 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003520 con 0x7f2b64156f60 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62000640 1 -- 172.21.15.33:0/2779514926 >> v2:172.21.15.103:3300/0 conn(0x7f2b640cafa0 msgr2=0x7f2b640cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62000640 1 --2- 172.21.15.33:0/2779514926 >> v2:172.21.15.103:3300/0 conn(0x7f2b640cafa0 0x7f2b640cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62000640 1 -- 172.21.15.33:0/2779514926 >> v1:172.21.15.33:6789/0 conn(0x7f2b64156f60 legacy=0x7f2b64070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.280+0000 7f2b62000640 1 -- 172.21.15.33:0/2779514926 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6406f840 con 0x7f2b64071690 2024-09-13T18:57:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.281+0000 7f2b62000640 1 --2- 172.21.15.33:0/2779514926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 0x7f2b6415a4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097a0 tx=0x7f2b5002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17eadf829a44bd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b61600640 1 -- 172.21.15.33:0/2779514926 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032440 con 0x7f2b64071690 2024-09-13T18:57:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b61600640 1 -- 172.21.15.33:0/2779514926 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500325a0 con 0x7f2b64071690 2024-09-13T18:57:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b61600640 1 -- 172.21.15.33:0/2779514926 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032930 con 0x7f2b64071690 2024-09-13T18:57:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b69600640 1 -- 172.21.15.33:0/2779514926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 msgr2=0x7f2b6415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b69600640 1 --2- 172.21.15.33:0/2779514926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 0x7f2b6415a4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097a0 tx=0x7f2b5002a180 comp rx=0 tx=0).stop 2024-09-13T18:57:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b69600640 1 -- 172.21.15.33:0/2779514926 shutdown_connections 2024-09-13T18:57:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b69600640 1 --2- 172.21.15.33:0/2779514926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64071690 0x7f2b6415a4f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.282+0000 7f2b69600640 1 --2- 172.21.15.33:0/2779514926 >> v2:172.21.15.103:3300/0 conn(0x7f2b640cafa0 0x7f2b640cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.283+0000 7f2b69600640 1 -- 172.21.15.33:0/2779514926 >> 172.21.15.33:0/2779514926 conn(0x7f2b640b0580 msgr2=0x7f2b640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.283+0000 7f2b69600640 1 -- 172.21.15.33:0/2779514926 shutdown_connections 2024-09-13T18:57:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.283+0000 7f2b69600640 1 -- 172.21.15.33:0/2779514926 wait complete. 2024-09-13T18:57:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.284+0000 7f2b69600640 1 Processor -- start 2024-09-13T18:57:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.284+0000 7f2b69600640 1 -- start start 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 0x7f2b640ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 0x7f2b640b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64156240 con 0x7f2b640cafa0 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64157dd0 con 0x7f2b64071690 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.285+0000 7f2b69600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641580b0 con 0x7f2b64156f60 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 0x7f2b640ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b63400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 0x7f2b640b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 0x7f2b640ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:40762/0 (socket says 172.21.15.33:40762) 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62a00640 1 -- 172.21.15.33:0/1346028786 learned_addr learned my addr 172.21.15.33:0/1346028786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50296/0 (socket says 172.21.15.33:50296) 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 -- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 msgr2=0x7f2b640b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 0x7f2b640b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 -- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 msgr2=0x7f2b640ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 0x7f2b640ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 -- 172.21.15.33:0/1346028786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009400 con 0x7f2b640cafa0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b63400640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 0x7f2b640b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.286+0000 7f2b62000640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b50031000 tx=0x7f2b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.287+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50006e10 con 0x7f2b640cafa0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.287+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50030980 con 0x7f2b640cafa0 2024-09-13T18:57:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.287+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50030d10 con 0x7f2b640cafa0 2024-09-13T18:57:12.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.287+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b64158390 con 0x7f2b640cafa0 2024-09-13T18:57:12.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.287+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b64158950 con 0x7f2b640cafa0 2024-09-13T18:57:12.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.288+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b640cb910 con 0x7f2b640cafa0 2024-09-13T18:57:12.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.290+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b50039040 con 0x7f2b640cafa0 2024-09-13T18:57:12.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.291+0000 7f2b5aa00640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 0x7f2b4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:12.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.291+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2b500aa2d0 con 0x7f2b640cafa0 2024-09-13T18:57:12.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.291+0000 7f2b62a00640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 0x7f2b4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:12.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.292+0000 7f2b62a00640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 0x7f2b4406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b540011e0 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.294+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b50075720 con 0x7f2b640cafa0 2024-09-13T18:57:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:12.478+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2b640cb630 con 0x7f2b640cafa0 2024-09-13T18:57:13.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.055+0000 7f2b5aa00640 1 -- 172.21.15.33:0/1346028786 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2b50078d40 con 0x7f2b640cafa0 2024-09-13T18:57:13.062 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T18:57:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 msgr2=0x7f2b4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 0x7f2b4406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b540011e0 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2024-09-13T18:57:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 msgr2=0x7f2b64158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b50031000 tx=0x7f2b500046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 shutdown_connections 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b4406ac00 0x7f2b4406d0c0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b540011e0 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b64156f60 0x7f2b640b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b640cafa0 0x7f2b64158e70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 --2- 172.21.15.33:0/1346028786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b64071690 0x7f2b640ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.061+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 >> 172.21.15.33:0/1346028786 conn(0x7f2b640b0580 msgr2=0x7f2b6406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.066+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 shutdown_connections 2024-09-13T18:57:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.068+0000 7f2b69600640 1 -- 172.21.15.33:0/1346028786 wait complete. 2024-09-13T18:57:13.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:57:13.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.250+0000 7f02be600640 1 Processor -- start 2024-09-13T18:57:13.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.250+0000 7f02be600640 1 -- start start 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b8156f60 0x7f02b815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f02b80cafa0 0x7f02b8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b80714c0 0x7f02b815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b815aa30 con 0x7f02b80cafa0 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b8071930 con 0x7f02b80714c0 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.251+0000 7f02be600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b806f5f0 con 0x7f02b8156f60 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f02b80cafa0 0x7f02b8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f02b80cafa0 0x7f02b8070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60600/0 (socket says 172.21.15.33:60600) 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 -- 172.21.15.33:0/960573975 learned_addr learned my addr 172.21.15.33:0/960573975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b7400640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b8156f60 0x7f02b815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b7e00640 1 --2- 172.21.15.33:0/960573975 >> v2:172.21.15.103:3300/0 conn(0x7f02b80714c0 0x7f02b815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 -- 172.21.15.33:0/960573975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b8156f60 msgr2=0x7f02b815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b8156f60 0x7f02b815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 -- 172.21.15.33:0/960573975 >> v2:172.21.15.103:3300/0 conn(0x7f02b80714c0 msgr2=0x7f02b815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 --2- 172.21.15.33:0/960573975 >> v2:172.21.15.103:3300/0 conn(0x7f02b80714c0 0x7f02b815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.252+0000 7f02b6a00640 1 -- 172.21.15.33:0/960573975 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8070450 con 0x7f02b80cafa0 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.253+0000 7f02b6a00640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80cafa0 0x7f02b8070f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02b806bb70 tx=0x7f02a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ca7e2edf1da25d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.253+0000 7f02b6000640 1 -- 172.21.15.33:0/960573975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4032440 con 0x7f02b80cafa0 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.253+0000 7f02b6000640 1 -- 172.21.15.33:0/960573975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a40325a0 con 0x7f02b80cafa0 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.253+0000 7f02b6000640 1 -- 172.21.15.33:0/960573975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4032930 con 0x7f02b80cafa0 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 -- 172.21.15.33:0/960573975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80cafa0 msgr2=0x7f02b8070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80cafa0 0x7f02b8070f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02b806bb70 tx=0x7f02a402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 -- 172.21.15.33:0/960573975 shutdown_connections 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 --2- 172.21.15.33:0/960573975 >> v2:172.21.15.103:3300/0 conn(0x7f02b80714c0 0x7f02b815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80cafa0 0x7f02b8070f80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 --2- 172.21.15.33:0/960573975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b8156f60 0x7f02b815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 -- 172.21.15.33:0/960573975 >> 172.21.15.33:0/960573975 conn(0x7f02b80b0580 msgr2=0x7f02b80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:13.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 -- 172.21.15.33:0/960573975 shutdown_connections 2024-09-13T18:57:13.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.254+0000 7f02be600640 1 -- 172.21.15.33:0/960573975 wait complete. 2024-09-13T18:57:13.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.256+0000 7f02be600640 1 Processor -- start 2024-09-13T18:57:13.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.256+0000 7f02be600640 1 -- start start 2024-09-13T18:57:13.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b80cafa0 0x7f02b815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b8156f60 0x7f02b815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815def0 con 0x7f02b80714c0 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b815dcf0 con 0x7f02b8156f60 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02be600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b814deb0 con 0x7f02b80cafa0 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60604/0 (socket says 172.21.15.33:60604) 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 -- 172.21.15.33:0/153740272 learned_addr learned my addr 172.21.15.33:0/153740272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b6a00640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b80cafa0 0x7f02b815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7e00640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b8156f60 0x7f02b815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 -- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b80cafa0 msgr2=0x7f02b815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b80cafa0 0x7f02b815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 -- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b8156f60 msgr2=0x7f02b815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b8156f60 0x7f02b815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.257+0000 7f02b7400640 1 -- 172.21.15.33:0/153740272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40094d0 con 0x7f02b80714c0 2024-09-13T18:57:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02b7400640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e870 tx=0x7f02a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a80094f0 con 0x7f02b80714c0 2024-09-13T18:57:13.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800c940 con 0x7f02b80714c0 2024-09-13T18:57:13.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800ccf0 con 0x7f02b80714c0 2024-09-13T18:57:13.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b814e190 con 0x7f02b80714c0 2024-09-13T18:57:13.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.258+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b814e750 con 0x7f02b80714c0 2024-09-13T18:57:13.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.259+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8070970 con 0x7f02b80714c0 2024-09-13T18:57:13.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.260+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f02a8013470 con 0x7f02b80714c0 2024-09-13T18:57:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.261+0000 7f02af400640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.261+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f02a80893d0 con 0x7f02b80714c0 2024-09-13T18:57:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.261+0000 7f02b6a00640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.262+0000 7f02b6a00640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 0x7f029806d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f02a4034000 tx=0x7f02a402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.266+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f02a8054620 con 0x7f02b80714c0 2024-09-13T18:57:13.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.479+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f02b8152320 con 0x7f02b80714c0 2024-09-13T18:57:13.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.487+0000 7f02af400640 1 -- 172.21.15.33:0/153740272 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f02a8057c40 con 0x7f02b80714c0 2024-09-13T18:57:13.491 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:57:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 msgr2=0x7f029806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 0x7f029806d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f02a4034000 tx=0x7f02a402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 msgr2=0x7f02b80af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e870 tx=0x7f02a800ed30 comp rx=0 tx=0).stop 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 shutdown_connections 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b8156f60 0x7f02b815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02b80cafa0 0x7f02b815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 --2- 172.21.15.33:0/153740272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02b80714c0 0x7f02b80af450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.491+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 >> 172.21.15.33:0/153740272 conn(0x7f02b80b0580 msgr2=0x7f02b806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.492+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 shutdown_connections 2024-09-13T18:57:13.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.492+0000 7f02be600640 1 -- 172.21.15.33:0/153740272 wait complete. 2024-09-13T18:57:13.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:13.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.679+0000 7fe07d200640 1 Processor -- start 2024-09-13T18:57:13.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.680+0000 7fe07d200640 1 -- start start 2024-09-13T18:57:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe07d200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe07815c620 0x7fe07815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe07d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0780cf930 0x7fe0780cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe07d200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07815db10 con 0x7fe078071510 2024-09-13T18:57:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe07d200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07806fe70 con 0x7fe07815c620 2024-09-13T18:57:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe07d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780d02e0 con 0x7fe0780cf930 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe07815c620 0x7fe07815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe07815c620 0x7fe07815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60612/0 (socket says 172.21.15.33:60612) 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe076a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe078071510 0x7fe07806f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36612/0 (socket says 172.21.15.33:36612) 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 -- 172.21.15.33:0/4001609686 learned_addr learned my addr 172.21.15.33:0/4001609686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077e00640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0780cf930 0x7fe0780cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 -- 172.21.15.33:0/4001609686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0780cf930 msgr2=0x7fe0780cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0780cf930 0x7fe0780cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 -- 172.21.15.33:0/4001609686 >> v1:172.21.15.33:6789/0 conn(0x7fe078071510 legacy=0x7fe07806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.681+0000 7fe077400640 1 -- 172.21.15.33:0/4001609686 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780719a0 con 0x7fe07815c620 2024-09-13T18:57:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.682+0000 7fe077400640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815c620 0x7fe07815d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe068009870 tx=0x7fe06802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9991c8187d8ac9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe076000640 1 -- 172.21.15.33:0/4001609686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068032440 con 0x7fe07815c620 2024-09-13T18:57:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe076000640 1 -- 172.21.15.33:0/4001609686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0680325a0 con 0x7fe07815c620 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe076000640 1 -- 172.21.15.33:0/4001609686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068032930 con 0x7fe07815c620 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 -- 172.21.15.33:0/4001609686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815c620 msgr2=0x7fe07815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815c620 0x7fe07815d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe068009870 tx=0x7fe06802a250 comp rx=0 tx=0).stop 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 -- 172.21.15.33:0/4001609686 shutdown_connections 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0780cf930 0x7fe0780cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 --2- 172.21.15.33:0/4001609686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815c620 0x7fe07815d5d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 -- 172.21.15.33:0/4001609686 >> 172.21.15.33:0/4001609686 conn(0x7fe0780b2250 msgr2=0x7fe0780b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 -- 172.21.15.33:0/4001609686 shutdown_connections 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.683+0000 7fe07d200640 1 -- 172.21.15.33:0/4001609686 wait complete. 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.685+0000 7fe07d200640 1 Processor -- start 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.685+0000 7fe07d200640 1 -- start start 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0780cf930 0x7fe0780cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe07815c620 0x7fe0780cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780cd9e0 con 0x7fe07815bbe0 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780cd700 con 0x7fe0780cf930 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe07d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780caa80 con 0x7fe07815c620 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe077e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe077e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60624/0 (socket says 172.21.15.33:60624) 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe077e00640 1 -- 172.21.15.33:0/3912671791 learned_addr learned my addr 172.21.15.33:0/3912671791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe077400640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0780cf930 0x7fe0780cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.686+0000 7fe076a00640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe07815c620 0x7fe0780cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 -- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe07815c620 msgr2=0x7fe0780cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe07815c620 0x7fe0780cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 -- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0780cf930 msgr2=0x7fe0780cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0780cf930 0x7fe0780cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 -- 172.21.15.33:0/3912671791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680094d0 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe077e00640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe070007e40 tx=0x7fe07000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070014620 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000ee90 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0700149e0 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0780cad60 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.687+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780cd490 con 0x7fe07815bbe0 2024-09-13T18:57:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.688+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078158740 con 0x7fe07815bbe0 2024-09-13T18:57:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.689+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe070014b40 con 0x7fe07815bbe0 2024-09-13T18:57:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.690+0000 7fe06f400640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 0x7fe05806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.690+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe070089b90 con 0x7fe07815bbe0 2024-09-13T18:57:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.691+0000 7fe077400640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 0x7fe05806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.691+0000 7fe077400640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 0x7fe05806d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe068034000 tx=0x7fe06802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:13.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.695+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe078158740 con 0x7fe07815bbe0 2024-09-13T18:57:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.873+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe078158740 con 0x7fe07815bbe0 2024-09-13T18:57:13.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.875+0000 7fe06f400640 1 -- 172.21.15.33:0/3912671791 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16518 (secure 0 0 0) 0x7fe078158740 con 0x7fe07815bbe0 2024-09-13T18:57:13.878 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:13.878 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:13.481325+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 msgr2=0x7fe05806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 0x7fe05806d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe068034000 tx=0x7fe06802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 msgr2=0x7fe0781576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe070007e40 tx=0x7fe07000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 shutdown_connections 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe05806ac00 0x7fe05806d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe07815bbe0 0x7fe0781576d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe07815c620 0x7fe0780cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 --2- 172.21.15.33:0/3912671791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0780cf930 0x7fe0780cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 >> 172.21.15.33:0/3912671791 conn(0x7fe0780b2250 msgr2=0x7fe07815f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 shutdown_connections 2024-09-13T18:57:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:13.877+0000 7fe07d200640 1 -- 172.21.15.33:0/3912671791 wait complete. 2024-09-13T18:57:13.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.047+0000 7f9fc1200640 1 Processor -- start 2024-09-13T18:57:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.047+0000 7f9fc1200640 1 -- start start 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fc1200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc159480 0x7f9fbc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fc1200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9fbc06f4b0 0x7f9fbc070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fc1200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0717c0 con 0x7f9fbc071390 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fc1200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0cd850 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fc1200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0cd570 con 0x7f9fbc159480 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fb3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9fbc06f4b0 0x7f9fbc070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fb3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9fbc06f4b0 0x7f9fbc070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60626/0 (socket says 172.21.15.33:60626) 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fb3e00640 1 -- 172.21.15.33:0/1392697951 learned_addr learned my addr 172.21.15.33:0/1392697951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fbb400640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc159480 0x7f9fbc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.049+0000 7f9fb3e00640 1 -- 172.21.15.33:0/1392697951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc159480 msgr2=0x7f9fbc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.050+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc159480 0x7f9fbc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.050+0000 7f9fb3e00640 1 -- 172.21.15.33:0/1392697951 >> v1:172.21.15.103:6789/0 conn(0x7f9fbc071390 legacy=0x7f9fbc15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.050+0000 7f9fb3e00640 1 -- 172.21.15.33:0/1392697951 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0b1740 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.050+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc06f4b0 0x7f9fbc070e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009870 tx=0x7f9fa402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf98fdbaac12dac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fbaa00640 1 -- 172.21.15.33:0/1392697951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4032440 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fbaa00640 1 -- 172.21.15.33:0/1392697951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa40325a0 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fbaa00640 1 -- 172.21.15.33:0/1392697951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4032930 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 -- 172.21.15.33:0/1392697951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc06f4b0 msgr2=0x7f9fbc070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc06f4b0 0x7f9fbc070e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009870 tx=0x7f9fa402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 -- 172.21.15.33:0/1392697951 shutdown_connections 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc06f4b0 0x7f9fbc070e50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 --2- 172.21.15.33:0/1392697951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc159480 0x7f9fbc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.051+0000 7f9fc1200640 1 -- 172.21.15.33:0/1392697951 >> 172.21.15.33:0/1392697951 conn(0x7f9fbc0ae310 msgr2=0x7f9fbc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.052+0000 7f9fc1200640 1 -- 172.21.15.33:0/1392697951 shutdown_connections 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.052+0000 7f9fc1200640 1 -- 172.21.15.33:0/1392697951 wait complete. 2024-09-13T18:57:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.053+0000 7f9fc1200640 1 Processor -- start 2024-09-13T18:57:14.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.053+0000 7f9fc1200640 1 -- start start 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 0x7f9fbc13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc071390 0x7f9fbc154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc1403c0 con 0x7f9fbc159480 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc15b2c0 con 0x7f9fbc071390 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fc1200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc15b5a0 con 0x7f9fbc06f4b0 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60640/0 (socket says 172.21.15.33:60640) 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.054+0000 7f9fbbe00640 1 -- 172.21.15.33:0/970846581 learned_addr learned my addr 172.21.15.33:0/970846581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc071390 0x7f9fbc154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbb400640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 0x7f9fbc13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 -- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 msgr2=0x7f9fbc13fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 0x7f9fbc13fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 -- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc071390 msgr2=0x7f9fbc154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc071390 0x7f9fbc154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 -- 172.21.15.33:0/970846581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40094d0 con 0x7f9fbc159480 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbb400640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 0x7f9fbc13fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c7a0 tx=0x7f9fb400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4003b70 con 0x7f9fbc159480 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4003cf0 con 0x7f9fbc159480 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4003ea0 con 0x7f9fbc159480 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.055+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc15b880 con 0x7f9fbc159480 2024-09-13T18:57:14.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.056+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc15be40 con 0x7f9fbc159480 2024-09-13T18:57:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.057+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc067360 con 0x7f9fbc159480 2024-09-13T18:57:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.057+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9fb400aa90 con 0x7f9fbc159480 2024-09-13T18:57:14.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.058+0000 7f9fb3400640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 0x7f9f9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.058+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fb4089260 con 0x7f9fbc159480 2024-09-13T18:57:14.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.058+0000 7f9fbb400640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 0x7f9f9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.059+0000 7f9fbb400640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 0x7f9f9806d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009af0 tx=0x7f9fac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.062+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9fb4054310 con 0x7f9fbc159480 2024-09-13T18:57:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.245+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fbc0ccf90 con 0x7f9fbc159480 2024-09-13T18:57:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.246+0000 7f9fb3400640 1 -- 172.21.15.33:0/970846581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f9fb4057930 con 0x7f9fbc159480 2024-09-13T18:57:14.250 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:14.250 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:13.481325+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 msgr2=0x7f9f9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 0x7f9f9806d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009af0 tx=0x7f9fac008040 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 msgr2=0x7f9fbc155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c7a0 tx=0x7f9fb400cc60 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 shutdown_connections 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac00 0x7f9f9806d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc159480 0x7f9fbc155280 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc071390 0x7f9fbc154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 --2- 172.21.15.33:0/970846581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fbc06f4b0 0x7f9fbc13fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 >> 172.21.15.33:0/970846581 conn(0x7f9fbc0ae310 msgr2=0x7f9fbc0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 shutdown_connections 2024-09-13T18:57:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.248+0000 7f9fc1200640 1 -- 172.21.15.33:0/970846581 wait complete. 2024-09-13T18:57:14.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:57:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.422+0000 7f2e7c400640 1 Processor -- start 2024-09-13T18:57:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.422+0000 7f2e7c400640 1 -- start start 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.423+0000 7f2e7c400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e740cbac0 0x7f2e740cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.423+0000 7f2e7c400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740ce490 con 0x7f2e74154ad0 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e7c400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7406b7c0 con 0x7f2e7406f830 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e7c400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740cc490 con 0x7f2e740cbac0 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e79a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2e74154ad0 0x7f2e740cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36624/0 (socket says 172.21.15.33:36624) 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e79a00640 1 -- 172.21.15.33:0/980111578 learned_addr learned my addr 172.21.15.33:0/980111578 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e7a400640 1 --2- 172.21.15.33:0/980111578 >> v2:172.21.15.103:3300/0 conn(0x7f2e740cbac0 0x7f2e740cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146806930 0 0) 0x7f2e740ce490 con 0x7f2e74154ad0 2024-09-13T18:57:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e5c003520 con 0x7f2e74154ad0 2024-09-13T18:57:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572876785 0 0) 0x7f2e5c003520 con 0x7f2e74154ad0 2024-09-13T18:57:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 >> v2:172.21.15.103:3300/0 conn(0x7f2e740cbac0 msgr2=0x7f2e740cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 --2- 172.21.15.33:0/980111578 >> v2:172.21.15.103:3300/0 conn(0x7f2e740cbac0 0x7f2e740cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 >> v1:172.21.15.103:6789/0 conn(0x7f2e7406f830 legacy=0x7f2e7406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7406baa0 con 0x7f2e74154ad0 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.424+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f2e68001670 con 0x7f2e74154ad0 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 >> v1:172.21.15.33:6789/0 conn(0x7f2e74154ad0 legacy=0x7f2e740cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e5c0047c0 0x7f2e5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e5c005180 0x7f2e5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740cc490 con 0x7f2e5c003970 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c00c120 con 0x7f2e5c0047c0 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c00c2e0 con 0x7f2e5c005180 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e7a400640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e5c005180 0x7f2e5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79000640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e5c0047c0 0x7f2e5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 -- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e5c005180 msgr2=0x7f2e5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e5c005180 0x7f2e5c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 -- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e5c0047c0 msgr2=0x7f2e5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e5c0047c0 0x7f2e5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79a00640 1 -- 172.21.15.33:0/980111578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c003520 con 0x7f2e5c003970 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e79000640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e5c0047c0 0x7f2e5c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.425+0000 7f2e7a400640 1 -- 172.21.15.33:0/980111578 reap_dead start 2024-09-13T18:57:14.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.426+0000 7f2e79a00640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e5c003d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c240 tx=0x7f2e5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfb11a11a9c92d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.426+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68005ad0 con 0x7f2e5c003970 2024-09-13T18:57:14.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.426+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6802d070 con 0x7f2e5c003970 2024-09-13T18:57:14.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e73e00640 1 -- 172.21.15.33:0/980111578 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68007070 con 0x7f2e5c003970 2024-09-13T18:57:14.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 -- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 msgr2=0x7f2e5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e5c003d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c240 tx=0x7f2e5c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 -- 172.21.15.33:0/980111578 shutdown_connections 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 --2- 172.21.15.33:0/980111578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e5c003d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 -- 172.21.15.33:0/980111578 >> 172.21.15.33:0/980111578 conn(0x7f2e740b0580 msgr2=0x7f2e740b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 -- 172.21.15.33:0/980111578 shutdown_connections 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.427+0000 7f2e7c400640 1 -- 172.21.15.33:0/980111578 wait complete. 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.429+0000 7f2e7c400640 1 Processor -- start 2024-09-13T18:57:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.429+0000 7f2e7c400640 1 -- start start 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7414d2e0 0x7f2e7406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 0x7f2e7414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74138600 con 0x7f2e5c003970 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740708a0 con 0x7f2e7414d2e0 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7c400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74150200 con 0x7f2e74070420 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e79a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e79a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60664/0 (socket says 172.21.15.33:60664) 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e79a00640 1 -- 172.21.15.33:0/1892630052 learned_addr learned my addr 172.21.15.33:0/1892630052 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e79000640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7414d2e0 0x7f2e7406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.430+0000 7f2e7a400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 0x7f2e7414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 -- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 msgr2=0x7f2e7414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 0x7f2e7414f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 -- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7414d2e0 msgr2=0x7f2e7406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7414d2e0 0x7f2e7406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 -- 172.21.15.33:0/1892630052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7413bcf0 con 0x7f2e5c003970 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e7a400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 0x7f2e7414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e79a00640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e6802ad00 tx=0x7f2e68001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680049e0 con 0x7f2e5c003970 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68004b40 con 0x7f2e5c003970 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7413c870 con 0x7f2e5c003970 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68007070 con 0x7f2e5c003970 2024-09-13T18:57:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.431+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7413ed20 con 0x7f2e5c003970 2024-09-13T18:57:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.432+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740cbf50 con 0x7f2e5c003970 2024-09-13T18:57:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.433+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e6802f030 con 0x7f2e5c003970 2024-09-13T18:57:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.434+0000 7f2e71600640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 0x7f2e5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.434+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e680a8180 con 0x7f2e5c003970 2024-09-13T18:57:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.434+0000 7f2e79000640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 0x7f2e5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.435+0000 7f2e79000640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 0x7f2e5406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e741539a0 tx=0x7f2e60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.438+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2e680733f0 con 0x7f2e5c003970 2024-09-13T18:57:14.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:14.656+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e74154070 con 0x7f2e5c003970 2024-09-13T18:57:15.050 INFO:tasks.ceph.mds.d.smithi103.stderr:2024-09-13T18:57:15.048+0000 7fcb9aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:57:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.493+0000 7f2e71600640 1 -- 172.21.15.33:0/1892630052 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e68076a10 con 0x7f2e5c003970 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.496+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 msgr2=0x7f2e5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.496+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 0x7f2e5406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e741539a0 tx=0x7f2e60009040 comp rx=0 tx=0).stop 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.496+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 msgr2=0x7f2e741380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.496+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e6802ad00 tx=0x7f2e68001a00 comp rx=0 tx=0).stop 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 shutdown_connections 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2e5406ac00 0x7f2e5406d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2e74070420 0x7f2e7414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7414d2e0 0x7f2e7406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 --2- 172.21.15.33:0/1892630052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e5c003970 0x7f2e741380c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 >> 172.21.15.33:0/1892630052 conn(0x7f2e740b0580 msgr2=0x7f2e7415bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:15.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 shutdown_connections 2024-09-13T18:57:15.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.497+0000 7f2e7c400640 1 -- 172.21.15.33:0/1892630052 wait complete. 2024-09-13T18:57:15.518 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:57:15.518 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:57:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.676+0000 7ff6f8a00640 1 Processor -- start 2024-09-13T18:57:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.676+0000 7ff6f8a00640 1 -- start start 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.677+0000 7ff6f8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6f40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6f40ce2c0 0x7ff6f40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f8a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f406b7c0 con 0x7ff6f406f830 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f8a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f406b5b0 con 0x7ff6f40ce2c0 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f406baa0 con 0x7ff6f4154ad0 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6ebe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff6f406f830 0x7ff6f406fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36636/0 (socket says 172.21.15.33:36636) 2024-09-13T18:57:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6ebe00640 1 -- 172.21.15.33:0/3667872344 learned_addr learned my addr 172.21.15.33:0/3667872344 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f1e00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6f40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f2800640 1 --2- 172.21.15.33:0/3667872344 >> v2:172.21.15.103:3300/0 conn(0x7ff6f40ce2c0 0x7ff6f40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824381463 0 0) 0x7ff6f406b7c0 con 0x7ff6f406f830 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.678+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d8003520 con 0x7ff6f406f830 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490070588 0 0) 0x7ff6d8003520 con 0x7ff6f406f830 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 msgr2=0x7ff6f40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6f40cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 >> v2:172.21.15.103:3300/0 conn(0x7ff6f40ce2c0 msgr2=0x7ff6f40cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 --2- 172.21.15.33:0/3667872344 >> v2:172.21.15.103:3300/0 conn(0x7ff6f40ce2c0 0x7ff6f40cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f406bd80 con 0x7ff6f406f830 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7ff6dc001670 con 0x7ff6f406f830 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 >> v1:172.21.15.33:6789/0 conn(0x7ff6f406f830 legacy=0x7ff6f406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d8003970 0x7ff6d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f406b5b0 con 0x7ff6d80047c0 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f406baa0 con 0x7ff6d8003970 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d800b9d0 con 0x7ff6f4154ad0 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f2800640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6f1e00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d8003970 0x7ff6d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 -- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 msgr2=0x7ff6d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4154ad0 0x7ff6d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 -- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d8003970 msgr2=0x7ff6d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d8003970 0x7ff6d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.679+0000 7ff6ebe00640 1 -- 172.21.15.33:0/3667872344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8003520 con 0x7ff6d80047c0 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.680+0000 7ff6ebe00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40677f0 tx=0x7ff6d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261bfd06d69221c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc005ad0 con 0x7ff6d80047c0 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc02d070 con 0x7ff6d80047c0 2024-09-13T18:57:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f1400640 1 -- 172.21.15.33:0/3667872344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc007070 con 0x7ff6d80047c0 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 -- 172.21.15.33:0/3667872344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6d80047c0 msgr2=0x7ff6d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/3667872344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6d80047c0 0x7ff6d8004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40677f0 tx=0x7ff6d80057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f2800640 1 -- 172.21.15.33:0/3667872344 reap_dead start 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 -- 172.21.15.33:0/3667872344 shutdown_connections 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 -- 172.21.15.33:0/3667872344 >> 172.21.15.33:0/3667872344 conn(0x7ff6f40b0580 msgr2=0x7ff6f40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 -- 172.21.15.33:0/3667872344 shutdown_connections 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.681+0000 7ff6f8a00640 1 -- 172.21.15.33:0/3667872344 wait complete. 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.683+0000 7ff6f8a00640 1 Processor -- start 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.683+0000 7ff6f8a00640 1 -- start start 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80047c0 0x7ff6f41473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4152da0 0x7ff6f40a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f415d570 con 0x7ff6f415cb80 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4147930 con 0x7ff6d80047c0 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4154340 con 0x7ff6f4152da0 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.684+0000 7ff6f2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80047c0 0x7ff6f41473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60676/0 (socket says 172.21.15.33:60676) 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 -- 172.21.15.33:0/4228684138 learned_addr learned my addr 172.21.15.33:0/4228684138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6ebe00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4152da0 0x7ff6f40a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 -- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4152da0 msgr2=0x7ff6f40a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4152da0 0x7ff6f40a8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 -- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80047c0 msgr2=0x7ff6f41473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80047c0 0x7ff6f41473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 -- 172.21.15.33:0/4228684138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f41532a0 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f2800640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40ce7a0 tx=0x7ff6ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00e040 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00f040 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f4153580 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.685+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec015670 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.686+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f4153b40 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.686+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f40cdd80 con 0x7ff6f415cb80 2024-09-13T18:57:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.687+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6ec0157d0 con 0x7ff6f415cb80 2024-09-13T18:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.688+0000 7ff6ea000640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 0x7ff6d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.688+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6ec089cf0 con 0x7ff6f415cb80 2024-09-13T18:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.689+0000 7ff6f1e00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 0x7ff6d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:15.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.689+0000 7ff6f1e00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 0x7ff6d006d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009ae0 tx=0x7ff6e4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.693+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff6ec054ec0 con 0x7ff6f415cb80 2024-09-13T18:57:15.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:15.905+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff6f40cb5e0 con 0x7ff6f415cb80 2024-09-13T18:57:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.495+0000 7ff6ea000640 1 -- 172.21.15.33:0/4228684138 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6ec0584e0 con 0x7ff6f415cb80 2024-09-13T18:57:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 msgr2=0x7ff6d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 0x7ff6d006d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009ae0 tx=0x7ff6e4009190 comp rx=0 tx=0).stop 2024-09-13T18:57:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 msgr2=0x7ff6f415d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40ce7a0 tx=0x7ff6ec00f580 comp rx=0 tx=0).stop 2024-09-13T18:57:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 shutdown_connections 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff6d006ac30 0x7ff6d006d0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6f415cb80 0x7ff6f415d030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6f4152da0 0x7ff6f40a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 --2- 172.21.15.33:0/4228684138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80047c0 0x7ff6f41473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 >> 172.21.15.33:0/4228684138 conn(0x7ff6f40b0580 msgr2=0x7ff6f40aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 shutdown_connections 2024-09-13T18:57:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.498+0000 7ff6f8a00640 1 -- 172.21.15.33:0/4228684138 wait complete. 2024-09-13T18:57:16.520 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:57:16.521 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:57:16.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.682+0000 7f0e13200640 1 Processor -- start 2024-09-13T18:57:16.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.682+0000 7f0e13200640 1 -- start start 2024-09-13T18:57:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.683+0000 7f0e13200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e1406a140 0x7f0e14070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.683+0000 7f0e13200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e1406a520 0x7f0e140ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.683+0000 7f0e13200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140b4ac0 con 0x7f0e140aeb80 2024-09-13T18:57:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.683+0000 7f0e13200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140b3910 con 0x7f0e1406a520 2024-09-13T18:57:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.683+0000 7f0e13200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140713b0 con 0x7f0e1406a140 2024-09-13T18:57:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e1406a520 0x7f0e140ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e11e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e1406a140 0x7f0e14070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e1406a520 0x7f0e140ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:60384/0 (socket says 172.21.15.33:60384) 2024-09-13T18:57:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 -- 172.21.15.33:0/960017518 learned_addr learned my addr 172.21.15.33:0/960017518 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 -- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e1406a140 msgr2=0x7f0e14070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 --2- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e1406a140 0x7f0e14070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 -- 172.21.15.33:0/960017518 >> v1:172.21.15.103:6789/0 conn(0x7f0e140aeb80 legacy=0x7f0e140b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.684+0000 7f0e12800640 1 -- 172.21.15.33:0/960017518 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140b3bb0 con 0x7f0e1406a520 2024-09-13T18:57:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.685+0000 7f0e12800640 1 --2- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ac870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009e50 tx=0x7f0e0c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf0b8c4d625ac17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.685+0000 7f0e11400640 1 -- 172.21.15.33:0/960017518 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c031600 con 0x7f0e1406a520 2024-09-13T18:57:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.685+0000 7f0e11400640 1 -- 172.21.15.33:0/960017518 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c02d050 con 0x7f0e1406a520 2024-09-13T18:57:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.685+0000 7f0e11400640 1 -- 172.21.15.33:0/960017518 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c031980 con 0x7f0e1406a520 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 -- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 msgr2=0x7f0e140ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 --2- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ac870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009e50 tx=0x7f0e0c02a710 comp rx=0 tx=0).stop 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 -- 172.21.15.33:0/960017518 shutdown_connections 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 --2- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ac870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 --2- 172.21.15.33:0/960017518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e1406a140 0x7f0e14070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 -- 172.21.15.33:0/960017518 >> 172.21.15.33:0/960017518 conn(0x7f0e140cf4f0 msgr2=0x7f0e140cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 -- 172.21.15.33:0/960017518 shutdown_connections 2024-09-13T18:57:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.686+0000 7f0e13200640 1 -- 172.21.15.33:0/960017518 wait complete. 2024-09-13T18:57:16.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.687+0000 7f0e13200640 1 Processor -- start 2024-09-13T18:57:16.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 -- start start 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e140aeb80 0x7f0e1415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14157780 con 0x7f0e1406a140 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140cf290 con 0x7f0e1406a520 2024-09-13T18:57:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.688+0000 7f0e13200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140cc650 con 0x7f0e140aeb80 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60692/0 (socket says 172.21.15.33:60692) 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 -- 172.21.15.33:0/2582943470 learned_addr learned my addr 172.21.15.33:0/2582943470 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e0be00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 -- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e140aeb80 msgr2=0x7f0e1415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e140aeb80 0x7f0e1415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 -- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 msgr2=0x7f0e140ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 -- 172.21.15.33:0/2582943470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c009b30 con 0x7f0e1406a140 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e0be00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.689+0000 7f0e11e00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e9b0 tx=0x7f0e0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.690+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04009670 con 0x7f0e1406a140 2024-09-13T18:57:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.690+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400c9a0 con 0x7f0e1406a140 2024-09-13T18:57:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.690+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400cd50 con 0x7f0e1406a140 2024-09-13T18:57:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.690+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e141f2330 con 0x7f0e1406a140 2024-09-13T18:57:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.690+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141f28f0 con 0x7f0e1406a140 2024-09-13T18:57:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.691+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e140ad140 con 0x7f0e1406a140 2024-09-13T18:57:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.692+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e04013470 con 0x7f0e1406a140 2024-09-13T18:57:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.692+0000 7f0e0a000640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 0x7f0df006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.693+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e04089690 con 0x7f0e1406a140 2024-09-13T18:57:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.693+0000 7f0e0be00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 0x7f0df006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.694+0000 7f0e0be00640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 0x7f0df006d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e140cbbc0 tx=0x7f0dfc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:16.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.697+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e040547d0 con 0x7f0e1406a140 2024-09-13T18:57:16.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.910+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e14157940 con 0x7f0e1406a140 2024-09-13T18:57:16.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.911+0000 7f0e0a000640 1 -- 172.21.15.33:0/2582943470 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f0e04057df0 con 0x7f0e1406a140 2024-09-13T18:57:16.914 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:16.914 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:57:16.914 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:57:16.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 msgr2=0x7f0df006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 0x7f0df006d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e140cbbc0 tx=0x7f0dfc009040 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 msgr2=0x7f0e14157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e9b0 tx=0x7f0e0400ee70 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 shutdown_connections 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0df006ac00 0x7f0df006d0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e140aeb80 0x7f0e1415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1406a520 0x7f0e140ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 --2- 172.21.15.33:0/2582943470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e1406a140 0x7f0e14157240 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 >> 172.21.15.33:0/2582943470 conn(0x7f0e140cf4f0 msgr2=0x7f0e1406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 shutdown_connections 2024-09-13T18:57:16.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:16.913+0000 7f0e13200640 1 -- 172.21.15.33:0/2582943470 wait complete. 2024-09-13T18:57:16.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:17.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.085+0000 7f7c79a00640 1 Processor -- start 2024-09-13T18:57:17.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.085+0000 7f7c79a00640 1 -- start start 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c79a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c7415fdd0 0x7f7c740d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c79a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7c740b1c50 0x7f7c740d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c79a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c741601b0 con 0x7f7c741603b0 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c79a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c740cd6a0 con 0x7f7c740b1c50 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c79a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c740d17e0 con 0x7f7c7415fdd0 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c6b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7c740b1c50 0x7f7c740d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c6b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7c740b1c50 0x7f7c740d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60708/0 (socket says 172.21.15.33:60708) 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c6b400640 1 -- 172.21.15.33:0/2943826903 learned_addr learned my addr 172.21.15.33:0/2943826903 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:17.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.086+0000 7f7c73e00640 1 --2- 172.21.15.33:0/2943826903 >> v2:172.21.15.103:3300/0 conn(0x7f7c7415fdd0 0x7f7c740d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.087+0000 7f7c6b400640 1 -- 172.21.15.33:0/2943826903 >> v2:172.21.15.103:3300/0 conn(0x7f7c7415fdd0 msgr2=0x7f7c740d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:17.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.087+0000 7f7c6b400640 1 --2- 172.21.15.33:0/2943826903 >> v2:172.21.15.103:3300/0 conn(0x7f7c7415fdd0 0x7f7c740d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.087+0000 7f7c6b400640 1 -- 172.21.15.33:0/2943826903 >> v1:172.21.15.103:6789/0 conn(0x7f7c741603b0 legacy=0x7f7c741607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.087+0000 7f7c6b400640 1 -- 172.21.15.33:0/2943826903 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740cfd50 con 0x7f7c740b1c50 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c6b400640 1 --2- 172.21.15.33:0/2943826903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740b1c50 0x7f7c740d1fd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c7408bc20 tx=0x7f7c5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0eb955b11901a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c73400640 1 -- 172.21.15.33:0/2943826903 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c032440 con 0x7f7c740b1c50 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c73400640 1 -- 172.21.15.33:0/2943826903 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c0325a0 con 0x7f7c740b1c50 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c73400640 1 -- 172.21.15.33:0/2943826903 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c032930 con 0x7f7c740b1c50 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c79a00640 1 -- 172.21.15.33:0/2943826903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740b1c50 msgr2=0x7f7c740d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c79a00640 1 --2- 172.21.15.33:0/2943826903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740b1c50 0x7f7c740d1fd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c7408bc20 tx=0x7f7c5c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c79a00640 1 -- 172.21.15.33:0/2943826903 shutdown_connections 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c79a00640 1 --2- 172.21.15.33:0/2943826903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740b1c50 0x7f7c740d1fd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.088+0000 7f7c79a00640 1 --2- 172.21.15.33:0/2943826903 >> v2:172.21.15.103:3300/0 conn(0x7f7c7415fdd0 0x7f7c740d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.089+0000 7f7c79a00640 1 -- 172.21.15.33:0/2943826903 >> 172.21.15.33:0/2943826903 conn(0x7f7c7406a7c0 msgr2=0x7f7c7406abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.089+0000 7f7c79a00640 1 -- 172.21.15.33:0/2943826903 shutdown_connections 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.089+0000 7f7c79a00640 1 -- 172.21.15.33:0/2943826903 wait complete. 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.090+0000 7f7c79a00640 1 Processor -- start 2024-09-13T18:57:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.090+0000 7f7c79a00640 1 -- start start 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c740b1c50 0x7f7c740cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 0x7f7c74156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74155880 con 0x7f7c7415fdd0 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740cbc40 con 0x7f7c741603b0 2024-09-13T18:57:17.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c79a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740ca250 con 0x7f7c740b1c50 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c6b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c6b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60716/0 (socket says 172.21.15.33:60716) 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.091+0000 7f7c6b400640 1 -- 172.21.15.33:0/3146916909 learned_addr learned my addr 172.21.15.33:0/3146916909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c73e00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c740b1c50 0x7f7c740cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c79000640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 0x7f7c74156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 -- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c740b1c50 msgr2=0x7f7c740cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c740b1c50 0x7f7c740cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 -- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 msgr2=0x7f7c74156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 0x7f7c74156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 -- 172.21.15.33:0/3146916909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0094d0 con 0x7f7c7415fdd0 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c79000640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 0x7f7c74156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c6b400640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c02a220 tx=0x7f7c5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c032440 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c030980 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c030d10 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.092+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c740cb960 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.093+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c740ca7d0 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.094+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c740ca9c0 con 0x7f7c7415fdd0 2024-09-13T18:57:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.094+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c5c039040 con 0x7f7c7415fdd0 2024-09-13T18:57:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.096+0000 7f7c70c00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 0x7f7c5006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.096+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c5c0a9c70 con 0x7f7c7415fdd0 2024-09-13T18:57:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.096+0000 7f7c73e00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 0x7f7c5006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.097+0000 7f7c73e00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 0x7f7c5006d0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009b40 tx=0x7f7c64009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.100+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c5c074e40 con 0x7f7c7415fdd0 2024-09-13T18:57:17.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.278+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c740b1700 con 0x7f7c7415fdd0 2024-09-13T18:57:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.279+0000 7f7c70c00640 1 -- 172.21.15.33:0/3146916909 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7c5c041090 con 0x7f7c7415fdd0 2024-09-13T18:57:17.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:17.283 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 msgr2=0x7f7c5006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 0x7f7c5006d0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009b40 tx=0x7f7c64009190 comp rx=0 tx=0).stop 2024-09-13T18:57:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 msgr2=0x7f7c741523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c02a220 tx=0x7f7c5c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 shutdown_connections 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5006ac30 0x7f7c5006d0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c741603b0 0x7f7c74156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c7415fdd0 0x7f7c741523d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 --2- 172.21.15.33:0/3146916909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c740b1c50 0x7f7c740cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 >> 172.21.15.33:0/3146916909 conn(0x7f7c7406a7c0 msgr2=0x7f7c740b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 shutdown_connections 2024-09-13T18:57:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.281+0000 7f7c79a00640 1 -- 172.21.15.33:0/3146916909 wait complete. 2024-09-13T18:57:17.300 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:57:17.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.452+0000 7f4595c00640 1 Processor -- start 2024-09-13T18:57:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.452+0000 7f4595c00640 1 -- start start 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f4595c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45900b1b00 0x7f45900cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f4595c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459006bea0 con 0x7f459015a520 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f4595c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459006c180 con 0x7f45900cde50 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f4595c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459006c460 con 0x7f45900b1b00 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f458ea00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f459015a520 0x7f459006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36648/0 (socket says 172.21.15.33:36648) 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f458ea00640 1 -- 172.21.15.33:0/1014334273 learned_addr learned my addr 172.21.15.33:0/1014334273 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f4587e00640 1 --2- 172.21.15.33:0/1014334273 >> v2:172.21.15.103:3300/0 conn(0x7f45900b1b00 0x7f45900cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225082726 0 0) 0x7f459006bea0 con 0x7f459015a520 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.454+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4574003520 con 0x7f459015a520 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558748784 0 0) 0x7f459006c180 con 0x7f45900cde50 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f459006bea0 con 0x7f45900cde50 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080374212 0 0) 0x7f4574003520 con 0x7f459015a520 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 >> v2:172.21.15.103:3300/0 conn(0x7f45900b1b00 msgr2=0x7f45900cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 --2- 172.21.15.33:0/1014334273 >> v2:172.21.15.103:3300/0 conn(0x7f45900b1b00 0x7f45900cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 >> v1:172.21.15.103:6789/0 conn(0x7f45900cde50 legacy=0x7f459015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459006c740 con 0x7f459015a520 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f45800015f0 con 0x7f459015a520 2024-09-13T18:57:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 >> v1:172.21.15.33:6789/0 conn(0x7f459015a520 legacy=0x7f459006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4574003b50 0x7f4574003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f4574004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4574005180 0x7f457400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459006c460 con 0x7f45740047c0 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457400c050 con 0x7f4574003b50 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457400c210 con 0x7f4574005180 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f4574004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458ea00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4574003b50 0x7f4574003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458f400640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4574005180 0x7f457400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 -- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4574005180 msgr2=0x7f457400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4574005180 0x7f457400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 -- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4574003b50 msgr2=0x7f4574003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4574003b50 0x7f4574003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f4587e00640 1 -- 172.21.15.33:0/1014334273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574003520 con 0x7f45740047c0 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.455+0000 7f458f400640 1 -- 172.21.15.33:0/1014334273 reap_dead start 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.456+0000 7f4587e00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f4574004c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4578009ac0 tx=0x7f45740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ad675cb406ef6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578031400 con 0x7f45740047c0 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457802d050 con 0x7f45740047c0 2024-09-13T18:57:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f458e000640 1 -- 172.21.15.33:0/1014334273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578031780 con 0x7f45740047c0 2024-09-13T18:57:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 -- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 msgr2=0x7f4574004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f4574004c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4578009ac0 tx=0x7f45740057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 -- 172.21.15.33:0/1014334273 shutdown_connections 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 --2- 172.21.15.33:0/1014334273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f4574004c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 -- 172.21.15.33:0/1014334273 >> 172.21.15.33:0/1014334273 conn(0x7f45900b0510 msgr2=0x7f45900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 -- 172.21.15.33:0/1014334273 shutdown_connections 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.457+0000 7f4595c00640 1 -- 172.21.15.33:0/1014334273 wait complete. 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.459+0000 7f4595c00640 1 Processor -- start 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.459+0000 7f4595c00640 1 -- start start 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f459006ff10 0x7f459015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4590070370 0x7f45901478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459015a900 con 0x7f45740047c0 2024-09-13T18:57:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459015abe0 con 0x7f4590070370 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4595c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459015aec0 con 0x7f459006ff10 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f458ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f458ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60734/0 (socket says 172.21.15.33:60734) 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f458ea00640 1 -- 172.21.15.33:0/1304760765 learned_addr learned my addr 172.21.15.33:0/1304760765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f458f400640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4590070370 0x7f45901478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.460+0000 7f4587e00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f459006ff10 0x7f459015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 -- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f459006ff10 msgr2=0x7f459015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f459006ff10 0x7f459015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 -- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4590070370 msgr2=0x7f45901478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4590070370 0x7f45901478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 -- 172.21.15.33:0/1304760765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459015b1a0 con 0x7f45740047c0 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f458ea00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45800072c0 tx=0x7f4580007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000f7b0 con 0x7f45740047c0 2024-09-13T18:57:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458000f950 con 0x7f45740047c0 2024-09-13T18:57:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000fd00 con 0x7f45740047c0 2024-09-13T18:57:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459015b480 con 0x7f45740047c0 2024-09-13T18:57:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.461+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459015de40 con 0x7f45740047c0 2024-09-13T18:57:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.462+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459015b9a0 con 0x7f45740047c0 2024-09-13T18:57:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.463+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f458001d460 con 0x7f45740047c0 2024-09-13T18:57:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.464+0000 7f4586a00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 0x7f456c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.464+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45800894a0 con 0x7f45740047c0 2024-09-13T18:57:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.464+0000 7f4587e00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 0x7f456c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.465+0000 7f4587e00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 0x7f456c06d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4578033000 tx=0x7f4578008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.468+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4580054600 con 0x7f45740047c0 2024-09-13T18:57:17.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.643+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f459006cf40 con 0x7f456c06ac00 2024-09-13T18:57:17.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.652+0000 7f4586a00640 1 -- 172.21.15.33:0/1304760765 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261735 (secure 0 0 0) 0x7f4578004210 con 0x7f456c06ac00 2024-09-13T18:57:17.659 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 msgr2=0x7f456c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 0x7f456c06d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4578033000 tx=0x7f4578008030 comp rx=0 tx=0).stop 2024-09-13T18:57:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 msgr2=0x7f45901471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45800072c0 tx=0x7f4580007780 comp rx=0 tx=0).stop 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 shutdown_connections 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f456c06ac00 0x7f456c06d0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4590070370 0x7f45901478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f459006ff10 0x7f459015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 --2- 172.21.15.33:0/1304760765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45740047c0 0x7f45901471d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.655+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 >> 172.21.15.33:0/1304760765 conn(0x7f45900b0510 msgr2=0x7f45900ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.656+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 shutdown_connections 2024-09-13T18:57:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.656+0000 7f4595c00640 1 -- 172.21.15.33:0/1304760765 wait complete. 2024-09-13T18:57:17.675 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:57:17.095509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":1593120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046444"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061677+0000","last_change":"2024-09-13T18:57:13.061677+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061677+0000","last_undegraded":"2024-09-13T18:57:13.061677+0000","last_fullsized":"2024-09-13T18:57:13.061677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066779+0000","last_change":"2024-09-13T18:57:13.066779+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066779+0000","last_undegraded":"2024-09-13T18:57:13.066779+0000","last_fullsized":"2024-09-13T18:57:13.066779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063644+0000","last_change":"2024-09-13T18:57:13.063644+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063644+0000","last_undegraded":"2024-09-13T18:57:13.063644+0000","last_fullsized":"2024-09-13T18:57:13.063644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069107+0000","last_change":"2024-09-13T18:57:13.069107+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069107+0000","last_undegraded":"2024-09-13T18:57:13.069107+0000","last_fullsized":"2024-09-13T18:57:13.069107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059636+0000","last_change":"2024-09-13T18:57:13.059636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059636+0000","last_undegraded":"2024-09-13T18:57:13.059636+0000","last_fullsized":"2024-09-13T18:57:13.059636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066478+0000","last_change":"2024-09-13T18:57:13.066478+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066478+0000","last_undegraded":"2024-09-13T18:57:13.066478+0000","last_fullsized":"2024-09-13T18:57:13.066478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058765+0000","last_change":"2024-09-13T18:57:13.058765+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058765+0000","last_undegraded":"2024-09-13T18:57:13.058765+0000","last_fullsized":"2024-09-13T18:57:13.058765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066907+0000","last_change":"2024-09-13T18:57:13.066907+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066907+0000","last_undegraded":"2024-09-13T18:57:13.066907+0000","last_fullsized":"2024-09-13T18:57:13.066907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059762+0000","last_change":"2024-09-13T18:57:13.059762+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059762+0000","last_undegraded":"2024-09-13T18:57:13.059762+0000","last_fullsized":"2024-09-13T18:57:13.059762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.073214+0000","last_change":"2024-09-13T18:57:13.073214+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.073214+0000","last_undegraded":"2024-09-13T18:57:13.073214+0000","last_fullsized":"2024-09-13T18:57:13.073214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065227+0000","last_change":"2024-09-13T18:57:13.065227+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065227+0000","last_undegraded":"2024-09-13T18:57:13.065227+0000","last_fullsized":"2024-09-13T18:57:13.065227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056690+0000","last_change":"2024-09-13T18:57:13.056690+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056690+0000","last_undegraded":"2024-09-13T18:57:13.056690+0000","last_fullsized":"2024-09-13T18:57:13.056690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067317+0000","last_change":"2024-09-13T18:57:13.067317+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067317+0000","last_undegraded":"2024-09-13T18:57:13.067317+0000","last_fullsized":"2024-09-13T18:57:13.067317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068510+0000","last_change":"2024-09-13T18:57:13.068510+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068510+0000","last_undegraded":"2024-09-13T18:57:13.068510+0000","last_fullsized":"2024-09-13T18:57:13.068510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064845+0000","last_change":"2024-09-13T18:57:13.064845+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064845+0000","last_undegraded":"2024-09-13T18:57:13.064845+0000","last_fullsized":"2024-09-13T18:57:13.064845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062337+0000","last_change":"2024-09-13T18:57:13.062337+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062337+0000","last_undegraded":"2024-09-13T18:57:13.062337+0000","last_fullsized":"2024-09-13T18:57:13.062337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061454+0000","last_change":"2024-09-13T18:57:13.061454+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061454+0000","last_undegraded":"2024-09-13T18:57:13.061454+0000","last_fullsized":"2024-09-13T18:57:13.061454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060760+0000","last_change":"2024-09-13T18:57:13.060760+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060760+0000","last_undegraded":"2024-09-13T18:57:13.060760+0000","last_fullsized":"2024-09-13T18:57:13.060760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061728+0000","last_change":"2024-09-13T18:57:13.061728+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061728+0000","last_undegraded":"2024-09-13T18:57:13.061728+0000","last_fullsized":"2024-09-13T18:57:13.061728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065831+0000","last_change":"2024-09-13T18:57:13.065831+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065831+0000","last_undegraded":"2024-09-13T18:57:13.065831+0000","last_fullsized":"2024-09-13T18:57:13.065831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070423+0000","last_change":"2024-09-13T18:57:13.070423+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070423+0000","last_undegraded":"2024-09-13T18:57:13.070423+0000","last_fullsized":"2024-09-13T18:57:13.070423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063447+0000","last_change":"2024-09-13T18:57:13.063447+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063447+0000","last_undegraded":"2024-09-13T18:57:13.063447+0000","last_fullsized":"2024-09-13T18:57:13.063447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062663+0000","last_change":"2024-09-13T18:57:13.062663+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062663+0000","last_undegraded":"2024-09-13T18:57:13.062663+0000","last_fullsized":"2024-09-13T18:57:13.062663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061477+0000","last_change":"2024-09-13T18:57:13.061477+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061477+0000","last_undegraded":"2024-09-13T18:57:13.061477+0000","last_fullsized":"2024-09-13T18:57:13.061477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064126+0000","last_change":"2024-09-13T18:57:13.064126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064126+0000","last_undegraded":"2024-09-13T18:57:13.064126+0000","last_fullsized":"2024-09-13T18:57:13.064126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071540+0000","last_change":"2024-09-13T18:57:13.071540+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071540+0000","last_undegraded":"2024-09-13T18:57:13.071540+0000","last_fullsized":"2024-09-13T18:57:13.071540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066627+0000","last_change":"2024-09-13T18:57:13.066627+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066627+0000","last_undegraded":"2024-09-13T18:57:13.066627+0000","last_fullsized":"2024-09-13T18:57:13.066627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062126+0000","last_change":"2024-09-13T18:57:13.062126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062126+0000","last_undegraded":"2024-09-13T18:57:13.062126+0000","last_fullsized":"2024-09-13T18:57:13.062126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069810+0000","last_change":"2024-09-13T18:57:13.069810+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069810+0000","last_undegraded":"2024-09-13T18:57:13.069810+0000","last_fullsized":"2024-09-13T18:57:13.069810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062344+0000","last_change":"2024-09-13T18:57:13.062344+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062344+0000","last_undegraded":"2024-09-13T18:57:13.062344+0000","last_fullsized":"2024-09-13T18:57:13.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060636+0000","last_change":"2024-09-13T18:57:13.060636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060636+0000","last_undegraded":"2024-09-13T18:57:13.060636+0000","last_fullsized":"2024-09-13T18:57:13.060636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070574+0000","last_change":"2024-09-13T18:57:13.070574+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070574+0000","last_undegraded":"2024-09-13T18:57:13.070574+0000","last_fullsized":"2024-09-13T18:57:13.070574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057113+0000","last_change":"2024-09-13T18:57:13.057113+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057113+0000","last_undegraded":"2024-09-13T18:57:13.057113+0000","last_fullsized":"2024-09-13T18:57:13.057113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078706+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.078706+0000","last_peered":"2024-09-13T18:57:13.078706+0000","last_clean":"2024-09-13T18:57:13.078706+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.078706+0000","last_undegraded":"2024-09-13T18:57:13.078706+0000","last_fullsized":"2024-09-13T18:57:13.078706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065219+0000","last_change":"2024-09-13T18:57:13.065219+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065219+0000","last_undegraded":"2024-09-13T18:57:13.065219+0000","last_fullsized":"2024-09-13T18:57:13.065219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088053+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.088053+0000","last_peered":"2024-09-13T18:57:13.088053+0000","last_clean":"2024-09-13T18:57:13.088053+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.088053+0000","last_undegraded":"2024-09-13T18:57:13.088053+0000","last_fullsized":"2024-09-13T18:57:13.088053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084672+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.084672+0000","last_peered":"2024-09-13T18:57:13.084672+0000","last_clean":"2024-09-13T18:57:13.084672+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.084672+0000","last_undegraded":"2024-09-13T18:57:13.084672+0000","last_fullsized":"2024-09-13T18:57:13.084672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062516+0000","last_change":"2024-09-13T18:57:13.062516+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062516+0000","last_undegraded":"2024-09-13T18:57:13.062516+0000","last_fullsized":"2024-09-13T18:57:13.062516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086429+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.086429+0000","last_peered":"2024-09-13T18:57:13.086429+0000","last_clean":"2024-09-13T18:57:13.086429+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.086429+0000","last_undegraded":"2024-09-13T18:57:13.086429+0000","last_fullsized":"2024-09-13T18:57:13.086429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067468+0000","last_change":"2024-09-13T18:57:13.067468+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067468+0000","last_undegraded":"2024-09-13T18:57:13.067468+0000","last_fullsized":"2024-09-13T18:57:13.067468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093433+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.093433+0000","last_peered":"2024-09-13T18:57:13.093433+0000","last_clean":"2024-09-13T18:57:13.093433+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.093433+0000","last_undegraded":"2024-09-13T18:57:13.093433+0000","last_fullsized":"2024-09-13T18:57:13.093433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064866+0000","last_change":"2024-09-13T18:57:13.064866+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064866+0000","last_undegraded":"2024-09-13T18:57:13.064866+0000","last_fullsized":"2024-09-13T18:57:13.064866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086518+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.086518+0000","last_peered":"2024-09-13T18:57:13.086518+0000","last_clean":"2024-09-13T18:57:13.086518+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.086518+0000","last_undegraded":"2024-09-13T18:57:13.086518+0000","last_fullsized":"2024-09-13T18:57:13.086518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068838+0000","last_change":"2024-09-13T18:57:13.068838+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068838+0000","last_undegraded":"2024-09-13T18:57:13.068838+0000","last_fullsized":"2024-09-13T18:57:13.068838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086568+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.086568+0000","last_peered":"2024-09-13T18:57:13.086568+0000","last_clean":"2024-09-13T18:57:13.086568+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.086568+0000","last_undegraded":"2024-09-13T18:57:13.086568+0000","last_fullsized":"2024-09-13T18:57:13.086568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056090+0000","last_change":"2024-09-13T18:57:13.056090+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056090+0000","last_undegraded":"2024-09-13T18:57:13.056090+0000","last_fullsized":"2024-09-13T18:57:13.056090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086135+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.086135+0000","last_peered":"2024-09-13T18:57:13.086135+0000","last_clean":"2024-09-13T18:57:13.086135+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.086135+0000","last_undegraded":"2024-09-13T18:57:13.086135+0000","last_fullsized":"2024-09-13T18:57:13.086135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057175+0000","last_change":"2024-09-13T18:57:13.057175+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057175+0000","last_undegraded":"2024-09-13T18:57:13.057175+0000","last_fullsized":"2024-09-13T18:57:13.057175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081516+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.081516+0000","last_peered":"2024-09-13T18:57:13.081516+0000","last_clean":"2024-09-13T18:57:13.081516+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.081516+0000","last_undegraded":"2024-09-13T18:57:13.081516+0000","last_fullsized":"2024-09-13T18:57:13.081516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064698+0000","last_change":"2024-09-13T18:57:13.064698+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064698+0000","last_undegraded":"2024-09-13T18:57:13.064698+0000","last_fullsized":"2024-09-13T18:57:13.064698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086471+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.086471+0000","last_peered":"2024-09-13T18:57:13.086471+0000","last_clean":"2024-09-13T18:57:13.086471+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.086471+0000","last_undegraded":"2024-09-13T18:57:13.086471+0000","last_fullsized":"2024-09-13T18:57:13.086471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055234+0000","last_change":"2024-09-13T18:57:13.055234+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055234+0000","last_undegraded":"2024-09-13T18:57:13.055234+0000","last_fullsized":"2024-09-13T18:57:13.055234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079462+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.079462+0000","last_peered":"2024-09-13T18:57:13.079462+0000","last_clean":"2024-09-13T18:57:13.079462+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.079462+0000","last_undegraded":"2024-09-13T18:57:13.079462+0000","last_fullsized":"2024-09-13T18:57:13.079462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065994+0000","last_change":"2024-09-13T18:57:13.065994+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065994+0000","last_undegraded":"2024-09-13T18:57:13.065994+0000","last_fullsized":"2024-09-13T18:57:13.065994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084298+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.084298+0000","last_peered":"2024-09-13T18:57:13.084298+0000","last_clean":"2024-09-13T18:57:13.084298+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.084298+0000","last_undegraded":"2024-09-13T18:57:13.084298+0000","last_fullsized":"2024-09-13T18:57:13.084298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055965+0000","last_change":"2024-09-13T18:57:13.055965+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055965+0000","last_undegraded":"2024-09-13T18:57:13.055965+0000","last_fullsized":"2024-09-13T18:57:13.055965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088242+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.088242+0000","last_peered":"2024-09-13T18:57:13.088242+0000","last_clean":"2024-09-13T18:57:13.088242+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.088242+0000","last_undegraded":"2024-09-13T18:57:13.088242+0000","last_fullsized":"2024-09-13T18:57:13.088242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056332+0000","last_change":"2024-09-13T18:57:13.056332+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056332+0000","last_undegraded":"2024-09-13T18:57:13.056332+0000","last_fullsized":"2024-09-13T18:57:13.056332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081348+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.081348+0000","last_peered":"2024-09-13T18:57:13.081348+0000","last_clean":"2024-09-13T18:57:13.081348+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.081348+0000","last_undegraded":"2024-09-13T18:57:13.081348+0000","last_fullsized":"2024-09-13T18:57:13.081348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056024+0000","last_change":"2024-09-13T18:57:13.056024+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056024+0000","last_undegraded":"2024-09-13T18:57:13.056024+0000","last_fullsized":"2024-09-13T18:57:13.056024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.089541+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.089541+0000","last_peered":"2024-09-13T18:57:13.089541+0000","last_clean":"2024-09-13T18:57:13.089541+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.089541+0000","last_undegraded":"2024-09-13T18:57:13.089541+0000","last_fullsized":"2024-09-13T18:57:13.089541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067544+0000","last_change":"2024-09-13T18:57:13.067544+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067544+0000","last_undegraded":"2024-09-13T18:57:13.067544+0000","last_fullsized":"2024-09-13T18:57:13.067544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075971+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.075971+0000","last_peered":"2024-09-13T18:57:13.075971+0000","last_clean":"2024-09-13T18:57:13.075971+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.075971+0000","last_undegraded":"2024-09-13T18:57:13.075971+0000","last_fullsized":"2024-09-13T18:57:13.075971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055809+0000","last_change":"2024-09-13T18:57:13.055809+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055809+0000","last_undegraded":"2024-09-13T18:57:13.055809+0000","last_fullsized":"2024-09-13T18:57:13.055809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:57:12.054851+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:12.054851+0000","last_peered":"2024-09-13T18:57:12.054851+0000","last_clean":"2024-09-13T18:57:12.054851+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:12.054851+0000","last_undegraded":"2024-09-13T18:57:12.054851+0000","last_fullsized":"2024-09-13T18:57:12.054851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086469+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.086469+0000","last_peered":"2024-09-13T18:57:13.086469+0000","last_clean":"2024-09-13T18:57:13.086469+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.086469+0000","last_undegraded":"2024-09-13T18:57:13.086469+0000","last_fullsized":"2024-09-13T18:57:13.086469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059523+0000","last_change":"2024-09-13T18:57:13.059523+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059523+0000","last_undegraded":"2024-09-13T18:57:13.059523+0000","last_fullsized":"2024-09-13T18:57:13.059523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078543+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.078543+0000","last_peered":"2024-09-13T18:57:13.078543+0000","last_clean":"2024-09-13T18:57:13.078543+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.078543+0000","last_undegraded":"2024-09-13T18:57:13.078543+0000","last_fullsized":"2024-09-13T18:57:13.078543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061667+0000","last_change":"2024-09-13T18:57:13.061667+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061667+0000","last_undegraded":"2024-09-13T18:57:13.061667+0000","last_fullsized":"2024-09-13T18:57:13.061667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075234+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.075234+0000","last_peered":"2024-09-13T18:57:13.075234+0000","last_clean":"2024-09-13T18:57:13.075234+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.075234+0000","last_undegraded":"2024-09-13T18:57:13.075234+0000","last_fullsized":"2024-09-13T18:57:13.075234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071631+0000","last_change":"2024-09-13T18:57:13.071631+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071631+0000","last_undegraded":"2024-09-13T18:57:13.071631+0000","last_fullsized":"2024-09-13T18:57:13.071631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.087967+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.087967+0000","last_peered":"2024-09-13T18:57:13.087967+0000","last_clean":"2024-09-13T18:57:13.087967+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.087967+0000","last_undegraded":"2024-09-13T18:57:13.087967+0000","last_fullsized":"2024-09-13T18:57:13.087967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058299+0000","last_change":"2024-09-13T18:57:13.058299+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058299+0000","last_undegraded":"2024-09-13T18:57:13.058299+0000","last_fullsized":"2024-09-13T18:57:13.058299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084096+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.084096+0000","last_peered":"2024-09-13T18:57:13.084096+0000","last_clean":"2024-09-13T18:57:13.084096+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.084096+0000","last_undegraded":"2024-09-13T18:57:13.084096+0000","last_fullsized":"2024-09-13T18:57:13.084096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062105+0000","last_change":"2024-09-13T18:57:13.062105+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062105+0000","last_undegraded":"2024-09-13T18:57:13.062105+0000","last_fullsized":"2024-09-13T18:57:13.062105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085954+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.085954+0000","last_peered":"2024-09-13T18:57:13.085954+0000","last_clean":"2024-09-13T18:57:13.085954+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.085954+0000","last_undegraded":"2024-09-13T18:57:13.085954+0000","last_fullsized":"2024-09-13T18:57:13.085954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069539+0000","last_change":"2024-09-13T18:57:13.069539+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069539+0000","last_undegraded":"2024-09-13T18:57:13.069539+0000","last_fullsized":"2024-09-13T18:57:13.069539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084911+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:13.084911+0000","last_peered":"2024-09-13T18:57:13.084911+0000","last_clean":"2024-09-13T18:57:13.084911+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:13.084911+0000","last_undegraded":"2024-09-13T18:57:13.084911+0000","last_fullsized":"2024-09-13T18:57:13.084911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059328+0000","last_change":"2024-09-13T18:57:13.059328+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059328+0000","last_undegraded":"2024-09-13T18:57:13.059328+0000","last_fullsized":"2024-09-13T18:57:13.059328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093412+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.093412+0000","last_peered":"2024-09-13T18:57:13.093412+0000","last_clean":"2024-09-13T18:57:13.093412+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.093412+0000","last_undegraded":"2024-09-13T18:57:13.093412+0000","last_fullsized":"2024-09-13T18:57:13.093412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068815+0000","last_change":"2024-09-13T18:57:13.068815+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068815+0000","last_undegraded":"2024-09-13T18:57:13.068815+0000","last_fullsized":"2024-09-13T18:57:13.068815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085884+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.085884+0000","last_peered":"2024-09-13T18:57:13.085884+0000","last_clean":"2024-09-13T18:57:13.085884+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.085884+0000","last_undegraded":"2024-09-13T18:57:13.085884+0000","last_fullsized":"2024-09-13T18:57:13.085884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055309+0000","last_change":"2024-09-13T18:57:13.055309+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055309+0000","last_undegraded":"2024-09-13T18:57:13.055309+0000","last_fullsized":"2024-09-13T18:57:13.055309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084892+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.084892+0000","last_peered":"2024-09-13T18:57:13.084892+0000","last_clean":"2024-09-13T18:57:13.084892+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.084892+0000","last_undegraded":"2024-09-13T18:57:13.084892+0000","last_fullsized":"2024-09-13T18:57:13.084892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060777+0000","last_change":"2024-09-13T18:57:13.060777+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060777+0000","last_undegraded":"2024-09-13T18:57:13.060777+0000","last_fullsized":"2024-09-13T18:57:13.060777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084873+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.084873+0000","last_peered":"2024-09-13T18:57:13.084873+0000","last_clean":"2024-09-13T18:57:13.084873+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.084873+0000","last_undegraded":"2024-09-13T18:57:13.084873+0000","last_fullsized":"2024-09-13T18:57:13.084873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060749+0000","last_change":"2024-09-13T18:57:13.060749+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060749+0000","last_undegraded":"2024-09-13T18:57:13.060749+0000","last_fullsized":"2024-09-13T18:57:13.060749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086047+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.086047+0000","last_peered":"2024-09-13T18:57:13.086047+0000","last_clean":"2024-09-13T18:57:13.086047+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.086047+0000","last_undegraded":"2024-09-13T18:57:13.086047+0000","last_fullsized":"2024-09-13T18:57:13.086047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066689+0000","last_change":"2024-09-13T18:57:13.066689+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066689+0000","last_undegraded":"2024-09-13T18:57:13.066689+0000","last_fullsized":"2024-09-13T18:57:13.066689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064307+0000","last_change":"2024-09-13T18:57:13.064307+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064307+0000","last_undegraded":"2024-09-13T18:57:13.064307+0000","last_fullsized":"2024-09-13T18:57:13.064307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079501+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.079501+0000","last_peered":"2024-09-13T18:57:13.079501+0000","last_clean":"2024-09-13T18:57:13.079501+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.079501+0000","last_undegraded":"2024-09-13T18:57:13.079501+0000","last_fullsized":"2024-09-13T18:57:13.079501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068047+0000","last_change":"2024-09-13T18:57:13.068047+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068047+0000","last_undegraded":"2024-09-13T18:57:13.068047+0000","last_fullsized":"2024-09-13T18:57:13.068047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085797+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.085797+0000","last_peered":"2024-09-13T18:57:13.085797+0000","last_clean":"2024-09-13T18:57:13.085797+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.085797+0000","last_undegraded":"2024-09-13T18:57:13.085797+0000","last_fullsized":"2024-09-13T18:57:13.085797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069304+0000","last_change":"2024-09-13T18:57:13.069304+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069304+0000","last_undegraded":"2024-09-13T18:57:13.069304+0000","last_fullsized":"2024-09-13T18:57:13.069304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084648+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.084648+0000","last_peered":"2024-09-13T18:57:13.084648+0000","last_clean":"2024-09-13T18:57:13.084648+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.084648+0000","last_undegraded":"2024-09-13T18:57:13.084648+0000","last_fullsized":"2024-09-13T18:57:13.084648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061006+0000","last_change":"2024-09-13T18:57:13.061006+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061006+0000","last_undegraded":"2024-09-13T18:57:13.061006+0000","last_fullsized":"2024-09-13T18:57:13.061006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086775+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.086775+0000","last_peered":"2024-09-13T18:57:13.086775+0000","last_clean":"2024-09-13T18:57:13.086775+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.086775+0000","last_undegraded":"2024-09-13T18:57:13.086775+0000","last_fullsized":"2024-09-13T18:57:13.086775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:17.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:17.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.868+0000 7fdf52400640 1 Processor -- start 2024-09-13T18:57:17.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.868+0000 7fdf52400640 1 -- start start 2024-09-13T18:57:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf52400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf4c071950 0x7fdf4c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf52400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c1442a0 con 0x7fdf4c071510 2024-09-13T18:57:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf52400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c15a970 con 0x7fdf4c143ec0 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf52400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c15b8b0 con 0x7fdf4c071950 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf4be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdf4c071510 0x7fdf4c06ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36656/0 (socket says 172.21.15.33:36656) 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf4be00640 1 -- 172.21.15.33:0/1565387440 learned_addr learned my addr 172.21.15.33:0/1565387440 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf51a00640 1 --2- 172.21.15.33:0/1565387440 >> v2:172.21.15.103:3300/0 conn(0x7fdf4c071950 0x7fdf4c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf4b400640 1 -- 172.21.15.33:0/1565387440 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616784542 0 0) 0x7fdf4c1442a0 con 0x7fdf4c071510 2024-09-13T18:57:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf4b400640 1 -- 172.21.15.33:0/1565387440 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf34003520 con 0x7fdf4c071510 2024-09-13T18:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf51a00640 1 -- 172.21.15.33:0/1565387440 >> v1:172.21.15.103:6789/0 conn(0x7fdf4c143ec0 legacy=0x7fdf4c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.870+0000 7fdf51a00640 1 -- 172.21.15.33:0/1565387440 >> v1:172.21.15.33:6789/0 conn(0x7fdf4c071510 legacy=0x7fdf4c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.871+0000 7fdf51a00640 1 -- 172.21.15.33:0/1565387440 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c15ac30 con 0x7fdf4c071950 2024-09-13T18:57:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf51a00640 1 --2- 172.21.15.33:0/1565387440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c06f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009d90 tx=0x7fdf4402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9adb94e820ae6f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf4b400640 1 -- 172.21.15.33:0/1565387440 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44007740 con 0x7fdf4c071950 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf4b400640 1 -- 172.21.15.33:0/1565387440 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4402d050 con 0x7fdf4c071950 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf4b400640 1 -- 172.21.15.33:0/1565387440 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44007ac0 con 0x7fdf4c071950 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf52400640 1 -- 172.21.15.33:0/1565387440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 msgr2=0x7fdf4c06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.872+0000 7fdf52400640 1 --2- 172.21.15.33:0/1565387440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c06f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009d90 tx=0x7fdf4402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.873+0000 7fdf52400640 1 -- 172.21.15.33:0/1565387440 shutdown_connections 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.873+0000 7fdf52400640 1 --2- 172.21.15.33:0/1565387440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c06f590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.873+0000 7fdf52400640 1 -- 172.21.15.33:0/1565387440 >> 172.21.15.33:0/1565387440 conn(0x7fdf4c0b2250 msgr2=0x7fdf4c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.873+0000 7fdf52400640 1 -- 172.21.15.33:0/1565387440 shutdown_connections 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.873+0000 7fdf52400640 1 -- 172.21.15.33:0/1565387440 wait complete. 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.874+0000 7fdf52400640 1 Processor -- start 2024-09-13T18:57:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.874+0000 7fdf52400640 1 -- start start 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdf4c071510 0x7fdf4c139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0b11d0 con 0x7fdf4c143ec0 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0b0550 con 0x7fdf4c071950 2024-09-13T18:57:17.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.875+0000 7fdf52400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0b0830 con 0x7fdf4c071510 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60742/0 (socket says 172.21.15.33:60742) 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 -- 172.21.15.33:0/3542488383 learned_addr learned my addr 172.21.15.33:0/3542488383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51000640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdf4c071510 0x7fdf4c139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf4be00640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 -- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdf4c071510 msgr2=0x7fdf4c139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdf4c071510 0x7fdf4c139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 -- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 msgr2=0x7fdf4c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 -- 172.21.15.33:0/3542488383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44009a70 con 0x7fdf4c143ec0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.876+0000 7fdf51a00640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009eb0 tx=0x7fdf44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.877+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4403c830 con 0x7fdf4c143ec0 2024-09-13T18:57:17.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.877+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4403c990 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.877+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4403cd00 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.877+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c0b0b10 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.877+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c0b15f0 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.878+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c0b1310 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.879+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf44031400 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.880+0000 7fdf48c00640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 0x7fdf2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.880+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf440aa840 con 0x7fdf4c143ec0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.880+0000 7fdf51000640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 0x7fdf2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:17.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.881+0000 7fdf51000640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 0x7fdf2c06d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000f60 tx=0x7fdf40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:17.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:17.884+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf4c0b1310 con 0x7fdf4c143ec0 2024-09-13T18:57:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.059+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf4c15b4d0 con 0x7fdf2c06ac00 2024-09-13T18:57:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.068+0000 7fdf48c00640 1 -- 172.21.15.33:0/3542488383 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261735 (secure 0 0 0) 0x7fdf400014a0 con 0x7fdf2c06ac00 2024-09-13T18:57:18.078 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:18.079 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:18.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 msgr2=0x7fdf2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 0x7fdf2c06d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000f60 tx=0x7fdf40009040 comp rx=0 tx=0).stop 2024-09-13T18:57:18.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 msgr2=0x7fdf4c142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009eb0 tx=0x7fdf44004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 shutdown_connections 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdf2c06ac00 0x7fdf2c06d0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf4c143ec0 0x7fdf4c142de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf4c071950 0x7fdf4c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 --2- 172.21.15.33:0/3542488383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdf4c071510 0x7fdf4c139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.071+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 >> 172.21.15.33:0/3542488383 conn(0x7fdf4c0b2250 msgr2=0x7fdf4c0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.072+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 shutdown_connections 2024-09-13T18:57:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.072+0000 7fdf52400640 1 -- 172.21.15.33:0/3542488383 wait complete. 2024-09-13T18:57:18.092 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:57:17.095509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":1593120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046444"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061677+0000","last_change":"2024-09-13T18:57:13.061677+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061677+0000","last_undegraded":"2024-09-13T18:57:13.061677+0000","last_fullsized":"2024-09-13T18:57:13.061677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066779+0000","last_change":"2024-09-13T18:57:13.066779+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066779+0000","last_undegraded":"2024-09-13T18:57:13.066779+0000","last_fullsized":"2024-09-13T18:57:13.066779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063644+0000","last_change":"2024-09-13T18:57:13.063644+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063644+0000","last_undegraded":"2024-09-13T18:57:13.063644+0000","last_fullsized":"2024-09-13T18:57:13.063644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069107+0000","last_change":"2024-09-13T18:57:13.069107+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069107+0000","last_undegraded":"2024-09-13T18:57:13.069107+0000","last_fullsized":"2024-09-13T18:57:13.069107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059636+0000","last_change":"2024-09-13T18:57:13.059636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059636+0000","last_undegraded":"2024-09-13T18:57:13.059636+0000","last_fullsized":"2024-09-13T18:57:13.059636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066478+0000","last_change":"2024-09-13T18:57:13.066478+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066478+0000","last_undegraded":"2024-09-13T18:57:13.066478+0000","last_fullsized":"2024-09-13T18:57:13.066478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058765+0000","last_change":"2024-09-13T18:57:13.058765+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058765+0000","last_undegraded":"2024-09-13T18:57:13.058765+0000","last_fullsized":"2024-09-13T18:57:13.058765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066907+0000","last_change":"2024-09-13T18:57:13.066907+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066907+0000","last_undegraded":"2024-09-13T18:57:13.066907+0000","last_fullsized":"2024-09-13T18:57:13.066907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059762+0000","last_change":"2024-09-13T18:57:13.059762+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059762+0000","last_undegraded":"2024-09-13T18:57:13.059762+0000","last_fullsized":"2024-09-13T18:57:13.059762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.073214+0000","last_change":"2024-09-13T18:57:13.073214+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.073214+0000","last_undegraded":"2024-09-13T18:57:13.073214+0000","last_fullsized":"2024-09-13T18:57:13.073214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065227+0000","last_change":"2024-09-13T18:57:13.065227+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065227+0000","last_undegraded":"2024-09-13T18:57:13.065227+0000","last_fullsized":"2024-09-13T18:57:13.065227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056690+0000","last_change":"2024-09-13T18:57:13.056690+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056690+0000","last_undegraded":"2024-09-13T18:57:13.056690+0000","last_fullsized":"2024-09-13T18:57:13.056690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067317+0000","last_change":"2024-09-13T18:57:13.067317+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067317+0000","last_undegraded":"2024-09-13T18:57:13.067317+0000","last_fullsized":"2024-09-13T18:57:13.067317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068510+0000","last_change":"2024-09-13T18:57:13.068510+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068510+0000","last_undegraded":"2024-09-13T18:57:13.068510+0000","last_fullsized":"2024-09-13T18:57:13.068510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064845+0000","last_change":"2024-09-13T18:57:13.064845+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064845+0000","last_undegraded":"2024-09-13T18:57:13.064845+0000","last_fullsized":"2024-09-13T18:57:13.064845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062337+0000","last_change":"2024-09-13T18:57:13.062337+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062337+0000","last_undegraded":"2024-09-13T18:57:13.062337+0000","last_fullsized":"2024-09-13T18:57:13.062337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061454+0000","last_change":"2024-09-13T18:57:13.061454+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061454+0000","last_undegraded":"2024-09-13T18:57:13.061454+0000","last_fullsized":"2024-09-13T18:57:13.061454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060760+0000","last_change":"2024-09-13T18:57:13.060760+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060760+0000","last_undegraded":"2024-09-13T18:57:13.060760+0000","last_fullsized":"2024-09-13T18:57:13.060760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061728+0000","last_change":"2024-09-13T18:57:13.061728+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061728+0000","last_undegraded":"2024-09-13T18:57:13.061728+0000","last_fullsized":"2024-09-13T18:57:13.061728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065831+0000","last_change":"2024-09-13T18:57:13.065831+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065831+0000","last_undegraded":"2024-09-13T18:57:13.065831+0000","last_fullsized":"2024-09-13T18:57:13.065831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070423+0000","last_change":"2024-09-13T18:57:13.070423+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070423+0000","last_undegraded":"2024-09-13T18:57:13.070423+0000","last_fullsized":"2024-09-13T18:57:13.070423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063447+0000","last_change":"2024-09-13T18:57:13.063447+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063447+0000","last_undegraded":"2024-09-13T18:57:13.063447+0000","last_fullsized":"2024-09-13T18:57:13.063447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062663+0000","last_change":"2024-09-13T18:57:13.062663+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062663+0000","last_undegraded":"2024-09-13T18:57:13.062663+0000","last_fullsized":"2024-09-13T18:57:13.062663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061477+0000","last_change":"2024-09-13T18:57:13.061477+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061477+0000","last_undegraded":"2024-09-13T18:57:13.061477+0000","last_fullsized":"2024-09-13T18:57:13.061477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064126+0000","last_change":"2024-09-13T18:57:13.064126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064126+0000","last_undegraded":"2024-09-13T18:57:13.064126+0000","last_fullsized":"2024-09-13T18:57:13.064126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071540+0000","last_change":"2024-09-13T18:57:13.071540+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071540+0000","last_undegraded":"2024-09-13T18:57:13.071540+0000","last_fullsized":"2024-09-13T18:57:13.071540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066627+0000","last_change":"2024-09-13T18:57:13.066627+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066627+0000","last_undegraded":"2024-09-13T18:57:13.066627+0000","last_fullsized":"2024-09-13T18:57:13.066627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062126+0000","last_change":"2024-09-13T18:57:13.062126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062126+0000","last_undegraded":"2024-09-13T18:57:13.062126+0000","last_fullsized":"2024-09-13T18:57:13.062126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069810+0000","last_change":"2024-09-13T18:57:13.069810+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069810+0000","last_undegraded":"2024-09-13T18:57:13.069810+0000","last_fullsized":"2024-09-13T18:57:13.069810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062344+0000","last_change":"2024-09-13T18:57:13.062344+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062344+0000","last_undegraded":"2024-09-13T18:57:13.062344+0000","last_fullsized":"2024-09-13T18:57:13.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060636+0000","last_change":"2024-09-13T18:57:13.060636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060636+0000","last_undegraded":"2024-09-13T18:57:13.060636+0000","last_fullsized":"2024-09-13T18:57:13.060636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070574+0000","last_change":"2024-09-13T18:57:13.070574+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070574+0000","last_undegraded":"2024-09-13T18:57:13.070574+0000","last_fullsized":"2024-09-13T18:57:13.070574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057113+0000","last_change":"2024-09-13T18:57:13.057113+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057113+0000","last_undegraded":"2024-09-13T18:57:13.057113+0000","last_fullsized":"2024-09-13T18:57:13.057113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078706+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.078706+0000","last_peered":"2024-09-13T18:57:13.078706+0000","last_clean":"2024-09-13T18:57:13.078706+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.078706+0000","last_undegraded":"2024-09-13T18:57:13.078706+0000","last_fullsized":"2024-09-13T18:57:13.078706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065219+0000","last_change":"2024-09-13T18:57:13.065219+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065219+0000","last_undegraded":"2024-09-13T18:57:13.065219+0000","last_fullsized":"2024-09-13T18:57:13.065219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088053+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.088053+0000","last_peered":"2024-09-13T18:57:13.088053+0000","last_clean":"2024-09-13T18:57:13.088053+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.088053+0000","last_undegraded":"2024-09-13T18:57:13.088053+0000","last_fullsized":"2024-09-13T18:57:13.088053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084672+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.084672+0000","last_peered":"2024-09-13T18:57:13.084672+0000","last_clean":"2024-09-13T18:57:13.084672+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.084672+0000","last_undegraded":"2024-09-13T18:57:13.084672+0000","last_fullsized":"2024-09-13T18:57:13.084672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062516+0000","last_change":"2024-09-13T18:57:13.062516+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062516+0000","last_undegraded":"2024-09-13T18:57:13.062516+0000","last_fullsized":"2024-09-13T18:57:13.062516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086429+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.086429+0000","last_peered":"2024-09-13T18:57:13.086429+0000","last_clean":"2024-09-13T18:57:13.086429+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.086429+0000","last_undegraded":"2024-09-13T18:57:13.086429+0000","last_fullsized":"2024-09-13T18:57:13.086429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067468+0000","last_change":"2024-09-13T18:57:13.067468+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067468+0000","last_undegraded":"2024-09-13T18:57:13.067468+0000","last_fullsized":"2024-09-13T18:57:13.067468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093433+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.093433+0000","last_peered":"2024-09-13T18:57:13.093433+0000","last_clean":"2024-09-13T18:57:13.093433+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.093433+0000","last_undegraded":"2024-09-13T18:57:13.093433+0000","last_fullsized":"2024-09-13T18:57:13.093433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064866+0000","last_change":"2024-09-13T18:57:13.064866+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064866+0000","last_undegraded":"2024-09-13T18:57:13.064866+0000","last_fullsized":"2024-09-13T18:57:13.064866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086518+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.086518+0000","last_peered":"2024-09-13T18:57:13.086518+0000","last_clean":"2024-09-13T18:57:13.086518+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.086518+0000","last_undegraded":"2024-09-13T18:57:13.086518+0000","last_fullsized":"2024-09-13T18:57:13.086518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068838+0000","last_change":"2024-09-13T18:57:13.068838+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068838+0000","last_undegraded":"2024-09-13T18:57:13.068838+0000","last_fullsized":"2024-09-13T18:57:13.068838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086568+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.086568+0000","last_peered":"2024-09-13T18:57:13.086568+0000","last_clean":"2024-09-13T18:57:13.086568+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.086568+0000","last_undegraded":"2024-09-13T18:57:13.086568+0000","last_fullsized":"2024-09-13T18:57:13.086568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056090+0000","last_change":"2024-09-13T18:57:13.056090+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056090+0000","last_undegraded":"2024-09-13T18:57:13.056090+0000","last_fullsized":"2024-09-13T18:57:13.056090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086135+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.086135+0000","last_peered":"2024-09-13T18:57:13.086135+0000","last_clean":"2024-09-13T18:57:13.086135+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.086135+0000","last_undegraded":"2024-09-13T18:57:13.086135+0000","last_fullsized":"2024-09-13T18:57:13.086135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057175+0000","last_change":"2024-09-13T18:57:13.057175+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057175+0000","last_undegraded":"2024-09-13T18:57:13.057175+0000","last_fullsized":"2024-09-13T18:57:13.057175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081516+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.081516+0000","last_peered":"2024-09-13T18:57:13.081516+0000","last_clean":"2024-09-13T18:57:13.081516+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.081516+0000","last_undegraded":"2024-09-13T18:57:13.081516+0000","last_fullsized":"2024-09-13T18:57:13.081516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064698+0000","last_change":"2024-09-13T18:57:13.064698+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064698+0000","last_undegraded":"2024-09-13T18:57:13.064698+0000","last_fullsized":"2024-09-13T18:57:13.064698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086471+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.086471+0000","last_peered":"2024-09-13T18:57:13.086471+0000","last_clean":"2024-09-13T18:57:13.086471+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.086471+0000","last_undegraded":"2024-09-13T18:57:13.086471+0000","last_fullsized":"2024-09-13T18:57:13.086471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055234+0000","last_change":"2024-09-13T18:57:13.055234+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055234+0000","last_undegraded":"2024-09-13T18:57:13.055234+0000","last_fullsized":"2024-09-13T18:57:13.055234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079462+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.079462+0000","last_peered":"2024-09-13T18:57:13.079462+0000","last_clean":"2024-09-13T18:57:13.079462+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.079462+0000","last_undegraded":"2024-09-13T18:57:13.079462+0000","last_fullsized":"2024-09-13T18:57:13.079462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065994+0000","last_change":"2024-09-13T18:57:13.065994+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065994+0000","last_undegraded":"2024-09-13T18:57:13.065994+0000","last_fullsized":"2024-09-13T18:57:13.065994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084298+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.084298+0000","last_peered":"2024-09-13T18:57:13.084298+0000","last_clean":"2024-09-13T18:57:13.084298+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.084298+0000","last_undegraded":"2024-09-13T18:57:13.084298+0000","last_fullsized":"2024-09-13T18:57:13.084298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055965+0000","last_change":"2024-09-13T18:57:13.055965+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055965+0000","last_undegraded":"2024-09-13T18:57:13.055965+0000","last_fullsized":"2024-09-13T18:57:13.055965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088242+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.088242+0000","last_peered":"2024-09-13T18:57:13.088242+0000","last_clean":"2024-09-13T18:57:13.088242+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.088242+0000","last_undegraded":"2024-09-13T18:57:13.088242+0000","last_fullsized":"2024-09-13T18:57:13.088242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056332+0000","last_change":"2024-09-13T18:57:13.056332+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056332+0000","last_undegraded":"2024-09-13T18:57:13.056332+0000","last_fullsized":"2024-09-13T18:57:13.056332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081348+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.081348+0000","last_peered":"2024-09-13T18:57:13.081348+0000","last_clean":"2024-09-13T18:57:13.081348+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.081348+0000","last_undegraded":"2024-09-13T18:57:13.081348+0000","last_fullsized":"2024-09-13T18:57:13.081348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056024+0000","last_change":"2024-09-13T18:57:13.056024+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056024+0000","last_undegraded":"2024-09-13T18:57:13.056024+0000","last_fullsized":"2024-09-13T18:57:13.056024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.089541+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.089541+0000","last_peered":"2024-09-13T18:57:13.089541+0000","last_clean":"2024-09-13T18:57:13.089541+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.089541+0000","last_undegraded":"2024-09-13T18:57:13.089541+0000","last_fullsized":"2024-09-13T18:57:13.089541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067544+0000","last_change":"2024-09-13T18:57:13.067544+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067544+0000","last_undegraded":"2024-09-13T18:57:13.067544+0000","last_fullsized":"2024-09-13T18:57:13.067544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075971+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.075971+0000","last_peered":"2024-09-13T18:57:13.075971+0000","last_clean":"2024-09-13T18:57:13.075971+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.075971+0000","last_undegraded":"2024-09-13T18:57:13.075971+0000","last_fullsized":"2024-09-13T18:57:13.075971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055809+0000","last_change":"2024-09-13T18:57:13.055809+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055809+0000","last_undegraded":"2024-09-13T18:57:13.055809+0000","last_fullsized":"2024-09-13T18:57:13.055809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:57:12.054851+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:12.054851+0000","last_peered":"2024-09-13T18:57:12.054851+0000","last_clean":"2024-09-13T18:57:12.054851+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:12.054851+0000","last_undegraded":"2024-09-13T18:57:12.054851+0000","last_fullsized":"2024-09-13T18:57:12.054851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086469+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.086469+0000","last_peered":"2024-09-13T18:57:13.086469+0000","last_clean":"2024-09-13T18:57:13.086469+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.086469+0000","last_undegraded":"2024-09-13T18:57:13.086469+0000","last_fullsized":"2024-09-13T18:57:13.086469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059523+0000","last_change":"2024-09-13T18:57:13.059523+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059523+0000","last_undegraded":"2024-09-13T18:57:13.059523+0000","last_fullsized":"2024-09-13T18:57:13.059523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078543+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.078543+0000","last_peered":"2024-09-13T18:57:13.078543+0000","last_clean":"2024-09-13T18:57:13.078543+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.078543+0000","last_undegraded":"2024-09-13T18:57:13.078543+0000","last_fullsized":"2024-09-13T18:57:13.078543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061667+0000","last_change":"2024-09-13T18:57:13.061667+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061667+0000","last_undegraded":"2024-09-13T18:57:13.061667+0000","last_fullsized":"2024-09-13T18:57:13.061667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075234+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.075234+0000","last_peered":"2024-09-13T18:57:13.075234+0000","last_clean":"2024-09-13T18:57:13.075234+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.075234+0000","last_undegraded":"2024-09-13T18:57:13.075234+0000","last_fullsized":"2024-09-13T18:57:13.075234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071631+0000","last_change":"2024-09-13T18:57:13.071631+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071631+0000","last_undegraded":"2024-09-13T18:57:13.071631+0000","last_fullsized":"2024-09-13T18:57:13.071631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.087967+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.087967+0000","last_peered":"2024-09-13T18:57:13.087967+0000","last_clean":"2024-09-13T18:57:13.087967+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.087967+0000","last_undegraded":"2024-09-13T18:57:13.087967+0000","last_fullsized":"2024-09-13T18:57:13.087967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058299+0000","last_change":"2024-09-13T18:57:13.058299+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058299+0000","last_undegraded":"2024-09-13T18:57:13.058299+0000","last_fullsized":"2024-09-13T18:57:13.058299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084096+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.084096+0000","last_peered":"2024-09-13T18:57:13.084096+0000","last_clean":"2024-09-13T18:57:13.084096+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.084096+0000","last_undegraded":"2024-09-13T18:57:13.084096+0000","last_fullsized":"2024-09-13T18:57:13.084096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062105+0000","last_change":"2024-09-13T18:57:13.062105+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062105+0000","last_undegraded":"2024-09-13T18:57:13.062105+0000","last_fullsized":"2024-09-13T18:57:13.062105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085954+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.085954+0000","last_peered":"2024-09-13T18:57:13.085954+0000","last_clean":"2024-09-13T18:57:13.085954+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.085954+0000","last_undegraded":"2024-09-13T18:57:13.085954+0000","last_fullsized":"2024-09-13T18:57:13.085954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069539+0000","last_change":"2024-09-13T18:57:13.069539+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069539+0000","last_undegraded":"2024-09-13T18:57:13.069539+0000","last_fullsized":"2024-09-13T18:57:13.069539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084911+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:13.084911+0000","last_peered":"2024-09-13T18:57:13.084911+0000","last_clean":"2024-09-13T18:57:13.084911+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:13.084911+0000","last_undegraded":"2024-09-13T18:57:13.084911+0000","last_fullsized":"2024-09-13T18:57:13.084911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059328+0000","last_change":"2024-09-13T18:57:13.059328+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059328+0000","last_undegraded":"2024-09-13T18:57:13.059328+0000","last_fullsized":"2024-09-13T18:57:13.059328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093412+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.093412+0000","last_peered":"2024-09-13T18:57:13.093412+0000","last_clean":"2024-09-13T18:57:13.093412+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.093412+0000","last_undegraded":"2024-09-13T18:57:13.093412+0000","last_fullsized":"2024-09-13T18:57:13.093412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068815+0000","last_change":"2024-09-13T18:57:13.068815+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068815+0000","last_undegraded":"2024-09-13T18:57:13.068815+0000","last_fullsized":"2024-09-13T18:57:13.068815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085884+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.085884+0000","last_peered":"2024-09-13T18:57:13.085884+0000","last_clean":"2024-09-13T18:57:13.085884+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.085884+0000","last_undegraded":"2024-09-13T18:57:13.085884+0000","last_fullsized":"2024-09-13T18:57:13.085884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055309+0000","last_change":"2024-09-13T18:57:13.055309+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055309+0000","last_undegraded":"2024-09-13T18:57:13.055309+0000","last_fullsized":"2024-09-13T18:57:13.055309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084892+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.084892+0000","last_peered":"2024-09-13T18:57:13.084892+0000","last_clean":"2024-09-13T18:57:13.084892+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.084892+0000","last_undegraded":"2024-09-13T18:57:13.084892+0000","last_fullsized":"2024-09-13T18:57:13.084892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060777+0000","last_change":"2024-09-13T18:57:13.060777+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060777+0000","last_undegraded":"2024-09-13T18:57:13.060777+0000","last_fullsized":"2024-09-13T18:57:13.060777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084873+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.084873+0000","last_peered":"2024-09-13T18:57:13.084873+0000","last_clean":"2024-09-13T18:57:13.084873+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.084873+0000","last_undegraded":"2024-09-13T18:57:13.084873+0000","last_fullsized":"2024-09-13T18:57:13.084873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060749+0000","last_change":"2024-09-13T18:57:13.060749+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060749+0000","last_undegraded":"2024-09-13T18:57:13.060749+0000","last_fullsized":"2024-09-13T18:57:13.060749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086047+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.086047+0000","last_peered":"2024-09-13T18:57:13.086047+0000","last_clean":"2024-09-13T18:57:13.086047+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.086047+0000","last_undegraded":"2024-09-13T18:57:13.086047+0000","last_fullsized":"2024-09-13T18:57:13.086047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066689+0000","last_change":"2024-09-13T18:57:13.066689+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066689+0000","last_undegraded":"2024-09-13T18:57:13.066689+0000","last_fullsized":"2024-09-13T18:57:13.066689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064307+0000","last_change":"2024-09-13T18:57:13.064307+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064307+0000","last_undegraded":"2024-09-13T18:57:13.064307+0000","last_fullsized":"2024-09-13T18:57:13.064307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079501+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.079501+0000","last_peered":"2024-09-13T18:57:13.079501+0000","last_clean":"2024-09-13T18:57:13.079501+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.079501+0000","last_undegraded":"2024-09-13T18:57:13.079501+0000","last_fullsized":"2024-09-13T18:57:13.079501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068047+0000","last_change":"2024-09-13T18:57:13.068047+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068047+0000","last_undegraded":"2024-09-13T18:57:13.068047+0000","last_fullsized":"2024-09-13T18:57:13.068047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085797+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.085797+0000","last_peered":"2024-09-13T18:57:13.085797+0000","last_clean":"2024-09-13T18:57:13.085797+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.085797+0000","last_undegraded":"2024-09-13T18:57:13.085797+0000","last_fullsized":"2024-09-13T18:57:13.085797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069304+0000","last_change":"2024-09-13T18:57:13.069304+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069304+0000","last_undegraded":"2024-09-13T18:57:13.069304+0000","last_fullsized":"2024-09-13T18:57:13.069304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084648+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.084648+0000","last_peered":"2024-09-13T18:57:13.084648+0000","last_clean":"2024-09-13T18:57:13.084648+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.084648+0000","last_undegraded":"2024-09-13T18:57:13.084648+0000","last_fullsized":"2024-09-13T18:57:13.084648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061006+0000","last_change":"2024-09-13T18:57:13.061006+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061006+0000","last_undegraded":"2024-09-13T18:57:13.061006+0000","last_fullsized":"2024-09-13T18:57:13.061006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086775+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.086775+0000","last_peered":"2024-09-13T18:57:13.086775+0000","last_clean":"2024-09-13T18:57:13.086775+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.086775+0000","last_undegraded":"2024-09-13T18:57:13.086775+0000","last_fullsized":"2024-09-13T18:57:13.086775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:18.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:18.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.284+0000 7f81c0400640 1 Processor -- start 2024-09-13T18:57:18.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.284+0000 7f81c0400640 1 -- start start 2024-09-13T18:57:18.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.285+0000 7f81c0400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 0x7f81b80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.285+0000 7f81c0400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81b80cde50 0x7f81b815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.285+0000 7f81c0400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b806bea0 con 0x7f81b815a520 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.285+0000 7f81c0400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b806c180 con 0x7f81b80cde50 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.285+0000 7f81c0400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b806c460 con 0x7f81b80b1b00 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81bda00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f81b815a520 0x7f81b806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36664/0 (socket says 172.21.15.33:36664) 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81bda00640 1 -- 172.21.15.33:0/309597886 learned_addr learned my addr 172.21.15.33:0/309597886 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81be400640 1 --2- 172.21.15.33:0/309597886 >> v2:172.21.15.33:3300/0 conn(0x7f81b80cde50 0x7f81b815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81b7e00640 1 -- 172.21.15.33:0/309597886 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841352608 0 0) 0x7f81b806bea0 con 0x7f81b815a520 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81b7e00640 1 -- 172.21.15.33:0/309597886 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a0003520 con 0x7f81b815a520 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81bd000640 1 --2- 172.21.15.33:0/309597886 >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 0x7f81b80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81be400640 1 -- 172.21.15.33:0/309597886 >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 msgr2=0x7f81b80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81be400640 1 --2- 172.21.15.33:0/309597886 >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 0x7f81b80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81be400640 1 -- 172.21.15.33:0/309597886 >> v1:172.21.15.33:6789/0 conn(0x7f81b815a520 legacy=0x7f81b806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81be400640 1 -- 172.21.15.33:0/309597886 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b806c740 con 0x7f81b80cde50 2024-09-13T18:57:18.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.286+0000 7f81bd000640 1 --2- 172.21.15.33:0/309597886 >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 0x7f81b80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.287+0000 7f81be400640 1 --2- 172.21.15.33:0/309597886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b815a900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f81b806bdd0 tx=0x7f81b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7a246867f2cc2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81b7e00640 1 -- 172.21.15.33:0/309597886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b002aea0 con 0x7f81b80cde50 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81b7e00640 1 -- 172.21.15.33:0/309597886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b002d050 con 0x7f81b80cde50 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81b7e00640 1 -- 172.21.15.33:0/309597886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0007940 con 0x7f81b80cde50 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 -- 172.21.15.33:0/309597886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 msgr2=0x7f81b815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 --2- 172.21.15.33:0/309597886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b815a900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f81b806bdd0 tx=0x7f81b002a680 comp rx=0 tx=0).stop 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 -- 172.21.15.33:0/309597886 shutdown_connections 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 --2- 172.21.15.33:0/309597886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b815a900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 --2- 172.21.15.33:0/309597886 >> v2:172.21.15.103:3300/0 conn(0x7f81b80b1b00 0x7f81b80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 -- 172.21.15.33:0/309597886 >> 172.21.15.33:0/309597886 conn(0x7f81b80b0510 msgr2=0x7f81b80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 -- 172.21.15.33:0/309597886 shutdown_connections 2024-09-13T18:57:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.288+0000 7f81c0400640 1 -- 172.21.15.33:0/309597886 wait complete. 2024-09-13T18:57:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.290+0000 7f81c0400640 1 Processor -- start 2024-09-13T18:57:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.290+0000 7f81c0400640 1 -- start start 2024-09-13T18:57:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81b80b1b00 0x7f81b80acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b815a520 0x7f81b81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80ac260 con 0x7f81b80cde50 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8070670 con 0x7f81b815a520 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81c0400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80700b0 con 0x7f81b80b1b00 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81bd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81bd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60750/0 (socket says 172.21.15.33:60750) 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81bd000640 1 -- 172.21.15.33:0/193858986 learned_addr learned my addr 172.21.15.33:0/193858986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81bda00640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81b80b1b00 0x7f81b80acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.291+0000 7f81be400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b815a520 0x7f81b81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 -- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81b80b1b00 msgr2=0x7f81b80acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81b80b1b00 0x7f81b80acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 -- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b815a520 msgr2=0x7f81b81592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b815a520 0x7f81b81592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 -- 172.21.15.33:0/193858986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009a70 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81bd000640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c7f0 tx=0x7f81a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4007a30 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4007b90 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400ce40 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b8070390 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.292+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b80ac770 con 0x7f81b80cde50 2024-09-13T18:57:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.294+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b80cd910 con 0x7f81b80cde50 2024-09-13T18:57:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.294+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f81a40113f0 con 0x7f81b80cde50 2024-09-13T18:57:18.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.295+0000 7f81b5600640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 0x7f819806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.295+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81a40893f0 con 0x7f81b80cde50 2024-09-13T18:57:18.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.296+0000 7f81bda00640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 0x7f819806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.296+0000 7f81bda00640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 0x7f819806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005880 tx=0x7f81ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.299+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81a4054710 con 0x7f81b80cde50 2024-09-13T18:57:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.474+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81b806cf40 con 0x7f819806ac00 2024-09-13T18:57:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.482+0000 7f81b5600640 1 -- 172.21.15.33:0/193858986 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261735 (secure 0 0 0) 0x7f81ac00f820 con 0x7f819806ac00 2024-09-13T18:57:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:18.489 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 msgr2=0x7f819806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 0x7f819806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005880 tx=0x7f81ac009040 comp rx=0 tx=0).stop 2024-09-13T18:57:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 msgr2=0x7f81b806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c7f0 tx=0x7f81a400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 shutdown_connections 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f819806ac00 0x7f819806d0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b815a520 0x7f81b81592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b80cde50 0x7f81b806f660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 --2- 172.21.15.33:0/193858986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81b80b1b00 0x7f81b80acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.485+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 >> 172.21.15.33:0/193858986 conn(0x7f81b80b0510 msgr2=0x7f81b80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.486+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 shutdown_connections 2024-09-13T18:57:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.486+0000 7f81c0400640 1 -- 172.21.15.33:0/193858986 wait complete. 2024-09-13T18:57:18.505 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:57:17.095509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":2531328,"data_stored":1593120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046444"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061677+0000","last_change":"2024-09-13T18:57:13.061677+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061677+0000","last_undegraded":"2024-09-13T18:57:13.061677+0000","last_fullsized":"2024-09-13T18:57:13.061677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066779+0000","last_change":"2024-09-13T18:57:13.066779+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066779+0000","last_undegraded":"2024-09-13T18:57:13.066779+0000","last_fullsized":"2024-09-13T18:57:13.066779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063644+0000","last_change":"2024-09-13T18:57:13.063644+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063644+0000","last_undegraded":"2024-09-13T18:57:13.063644+0000","last_fullsized":"2024-09-13T18:57:13.063644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069107+0000","last_change":"2024-09-13T18:57:13.069107+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069107+0000","last_undegraded":"2024-09-13T18:57:13.069107+0000","last_fullsized":"2024-09-13T18:57:13.069107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059636+0000","last_change":"2024-09-13T18:57:13.059636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059636+0000","last_undegraded":"2024-09-13T18:57:13.059636+0000","last_fullsized":"2024-09-13T18:57:13.059636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066478+0000","last_change":"2024-09-13T18:57:13.066478+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066478+0000","last_undegraded":"2024-09-13T18:57:13.066478+0000","last_fullsized":"2024-09-13T18:57:13.066478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058765+0000","last_change":"2024-09-13T18:57:13.058765+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058765+0000","last_undegraded":"2024-09-13T18:57:13.058765+0000","last_fullsized":"2024-09-13T18:57:13.058765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066907+0000","last_change":"2024-09-13T18:57:13.066907+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066907+0000","last_undegraded":"2024-09-13T18:57:13.066907+0000","last_fullsized":"2024-09-13T18:57:13.066907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059762+0000","last_change":"2024-09-13T18:57:13.059762+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059762+0000","last_undegraded":"2024-09-13T18:57:13.059762+0000","last_fullsized":"2024-09-13T18:57:13.059762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.073214+0000","last_change":"2024-09-13T18:57:13.073214+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.073214+0000","last_undegraded":"2024-09-13T18:57:13.073214+0000","last_fullsized":"2024-09-13T18:57:13.073214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065227+0000","last_change":"2024-09-13T18:57:13.065227+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065227+0000","last_undegraded":"2024-09-13T18:57:13.065227+0000","last_fullsized":"2024-09-13T18:57:13.065227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056690+0000","last_change":"2024-09-13T18:57:13.056690+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056690+0000","last_undegraded":"2024-09-13T18:57:13.056690+0000","last_fullsized":"2024-09-13T18:57:13.056690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067317+0000","last_change":"2024-09-13T18:57:13.067317+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067317+0000","last_undegraded":"2024-09-13T18:57:13.067317+0000","last_fullsized":"2024-09-13T18:57:13.067317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068510+0000","last_change":"2024-09-13T18:57:13.068510+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068510+0000","last_undegraded":"2024-09-13T18:57:13.068510+0000","last_fullsized":"2024-09-13T18:57:13.068510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064845+0000","last_change":"2024-09-13T18:57:13.064845+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064845+0000","last_undegraded":"2024-09-13T18:57:13.064845+0000","last_fullsized":"2024-09-13T18:57:13.064845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062337+0000","last_change":"2024-09-13T18:57:13.062337+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062337+0000","last_undegraded":"2024-09-13T18:57:13.062337+0000","last_fullsized":"2024-09-13T18:57:13.062337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061454+0000","last_change":"2024-09-13T18:57:13.061454+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061454+0000","last_undegraded":"2024-09-13T18:57:13.061454+0000","last_fullsized":"2024-09-13T18:57:13.061454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060760+0000","last_change":"2024-09-13T18:57:13.060760+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060760+0000","last_undegraded":"2024-09-13T18:57:13.060760+0000","last_fullsized":"2024-09-13T18:57:13.060760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061728+0000","last_change":"2024-09-13T18:57:13.061728+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061728+0000","last_undegraded":"2024-09-13T18:57:13.061728+0000","last_fullsized":"2024-09-13T18:57:13.061728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065831+0000","last_change":"2024-09-13T18:57:13.065831+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065831+0000","last_undegraded":"2024-09-13T18:57:13.065831+0000","last_fullsized":"2024-09-13T18:57:13.065831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070423+0000","last_change":"2024-09-13T18:57:13.070423+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070423+0000","last_undegraded":"2024-09-13T18:57:13.070423+0000","last_fullsized":"2024-09-13T18:57:13.070423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.063447+0000","last_change":"2024-09-13T18:57:13.063447+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.063447+0000","last_undegraded":"2024-09-13T18:57:13.063447+0000","last_fullsized":"2024-09-13T18:57:13.063447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062663+0000","last_change":"2024-09-13T18:57:13.062663+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062663+0000","last_undegraded":"2024-09-13T18:57:13.062663+0000","last_fullsized":"2024-09-13T18:57:13.062663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061477+0000","last_change":"2024-09-13T18:57:13.061477+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061477+0000","last_undegraded":"2024-09-13T18:57:13.061477+0000","last_fullsized":"2024-09-13T18:57:13.061477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064126+0000","last_change":"2024-09-13T18:57:13.064126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064126+0000","last_undegraded":"2024-09-13T18:57:13.064126+0000","last_fullsized":"2024-09-13T18:57:13.064126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071540+0000","last_change":"2024-09-13T18:57:13.071540+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071540+0000","last_undegraded":"2024-09-13T18:57:13.071540+0000","last_fullsized":"2024-09-13T18:57:13.071540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066627+0000","last_change":"2024-09-13T18:57:13.066627+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066627+0000","last_undegraded":"2024-09-13T18:57:13.066627+0000","last_fullsized":"2024-09-13T18:57:13.066627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062126+0000","last_change":"2024-09-13T18:57:13.062126+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062126+0000","last_undegraded":"2024-09-13T18:57:13.062126+0000","last_fullsized":"2024-09-13T18:57:13.062126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069810+0000","last_change":"2024-09-13T18:57:13.069810+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069810+0000","last_undegraded":"2024-09-13T18:57:13.069810+0000","last_fullsized":"2024-09-13T18:57:13.069810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062344+0000","last_change":"2024-09-13T18:57:13.062344+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062344+0000","last_undegraded":"2024-09-13T18:57:13.062344+0000","last_fullsized":"2024-09-13T18:57:13.062344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060636+0000","last_change":"2024-09-13T18:57:13.060636+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060636+0000","last_undegraded":"2024-09-13T18:57:13.060636+0000","last_fullsized":"2024-09-13T18:57:13.060636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.070574+0000","last_change":"2024-09-13T18:57:13.070574+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.070574+0000","last_undegraded":"2024-09-13T18:57:13.070574+0000","last_fullsized":"2024-09-13T18:57:13.070574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057113+0000","last_change":"2024-09-13T18:57:13.057113+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057113+0000","last_undegraded":"2024-09-13T18:57:13.057113+0000","last_fullsized":"2024-09-13T18:57:13.057113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078706+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.078706+0000","last_peered":"2024-09-13T18:57:13.078706+0000","last_clean":"2024-09-13T18:57:13.078706+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.078706+0000","last_undegraded":"2024-09-13T18:57:13.078706+0000","last_fullsized":"2024-09-13T18:57:13.078706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065219+0000","last_change":"2024-09-13T18:57:13.065219+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065219+0000","last_undegraded":"2024-09-13T18:57:13.065219+0000","last_fullsized":"2024-09-13T18:57:13.065219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088053+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.088053+0000","last_peered":"2024-09-13T18:57:13.088053+0000","last_clean":"2024-09-13T18:57:13.088053+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.088053+0000","last_undegraded":"2024-09-13T18:57:13.088053+0000","last_fullsized":"2024-09-13T18:57:13.088053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084672+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.084672+0000","last_peered":"2024-09-13T18:57:13.084672+0000","last_clean":"2024-09-13T18:57:13.084672+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.084672+0000","last_undegraded":"2024-09-13T18:57:13.084672+0000","last_fullsized":"2024-09-13T18:57:13.084672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062516+0000","last_change":"2024-09-13T18:57:13.062516+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062516+0000","last_undegraded":"2024-09-13T18:57:13.062516+0000","last_fullsized":"2024-09-13T18:57:13.062516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086429+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.086429+0000","last_peered":"2024-09-13T18:57:13.086429+0000","last_clean":"2024-09-13T18:57:13.086429+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.086429+0000","last_undegraded":"2024-09-13T18:57:13.086429+0000","last_fullsized":"2024-09-13T18:57:13.086429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067468+0000","last_change":"2024-09-13T18:57:13.067468+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067468+0000","last_undegraded":"2024-09-13T18:57:13.067468+0000","last_fullsized":"2024-09-13T18:57:13.067468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093433+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.093433+0000","last_peered":"2024-09-13T18:57:13.093433+0000","last_clean":"2024-09-13T18:57:13.093433+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.093433+0000","last_undegraded":"2024-09-13T18:57:13.093433+0000","last_fullsized":"2024-09-13T18:57:13.093433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064866+0000","last_change":"2024-09-13T18:57:13.064866+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064866+0000","last_undegraded":"2024-09-13T18:57:13.064866+0000","last_fullsized":"2024-09-13T18:57:13.064866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086518+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.086518+0000","last_peered":"2024-09-13T18:57:13.086518+0000","last_clean":"2024-09-13T18:57:13.086518+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.086518+0000","last_undegraded":"2024-09-13T18:57:13.086518+0000","last_fullsized":"2024-09-13T18:57:13.086518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068838+0000","last_change":"2024-09-13T18:57:13.068838+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068838+0000","last_undegraded":"2024-09-13T18:57:13.068838+0000","last_fullsized":"2024-09-13T18:57:13.068838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086568+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.086568+0000","last_peered":"2024-09-13T18:57:13.086568+0000","last_clean":"2024-09-13T18:57:13.086568+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.086568+0000","last_undegraded":"2024-09-13T18:57:13.086568+0000","last_fullsized":"2024-09-13T18:57:13.086568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056090+0000","last_change":"2024-09-13T18:57:13.056090+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056090+0000","last_undegraded":"2024-09-13T18:57:13.056090+0000","last_fullsized":"2024-09-13T18:57:13.056090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086135+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.086135+0000","last_peered":"2024-09-13T18:57:13.086135+0000","last_clean":"2024-09-13T18:57:13.086135+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.086135+0000","last_undegraded":"2024-09-13T18:57:13.086135+0000","last_fullsized":"2024-09-13T18:57:13.086135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.057175+0000","last_change":"2024-09-13T18:57:13.057175+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.057175+0000","last_undegraded":"2024-09-13T18:57:13.057175+0000","last_fullsized":"2024-09-13T18:57:13.057175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081516+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.081516+0000","last_peered":"2024-09-13T18:57:13.081516+0000","last_clean":"2024-09-13T18:57:13.081516+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.081516+0000","last_undegraded":"2024-09-13T18:57:13.081516+0000","last_fullsized":"2024-09-13T18:57:13.081516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064698+0000","last_change":"2024-09-13T18:57:13.064698+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064698+0000","last_undegraded":"2024-09-13T18:57:13.064698+0000","last_fullsized":"2024-09-13T18:57:13.064698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086471+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.086471+0000","last_peered":"2024-09-13T18:57:13.086471+0000","last_clean":"2024-09-13T18:57:13.086471+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.086471+0000","last_undegraded":"2024-09-13T18:57:13.086471+0000","last_fullsized":"2024-09-13T18:57:13.086471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055234+0000","last_change":"2024-09-13T18:57:13.055234+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055234+0000","last_undegraded":"2024-09-13T18:57:13.055234+0000","last_fullsized":"2024-09-13T18:57:13.055234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079462+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.079462+0000","last_peered":"2024-09-13T18:57:13.079462+0000","last_clean":"2024-09-13T18:57:13.079462+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.079462+0000","last_undegraded":"2024-09-13T18:57:13.079462+0000","last_fullsized":"2024-09-13T18:57:13.079462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.065994+0000","last_change":"2024-09-13T18:57:13.065994+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.065994+0000","last_undegraded":"2024-09-13T18:57:13.065994+0000","last_fullsized":"2024-09-13T18:57:13.065994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084298+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.084298+0000","last_peered":"2024-09-13T18:57:13.084298+0000","last_clean":"2024-09-13T18:57:13.084298+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.084298+0000","last_undegraded":"2024-09-13T18:57:13.084298+0000","last_fullsized":"2024-09-13T18:57:13.084298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055965+0000","last_change":"2024-09-13T18:57:13.055965+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055965+0000","last_undegraded":"2024-09-13T18:57:13.055965+0000","last_fullsized":"2024-09-13T18:57:13.055965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.088242+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.088242+0000","last_peered":"2024-09-13T18:57:13.088242+0000","last_clean":"2024-09-13T18:57:13.088242+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.088242+0000","last_undegraded":"2024-09-13T18:57:13.088242+0000","last_fullsized":"2024-09-13T18:57:13.088242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056332+0000","last_change":"2024-09-13T18:57:13.056332+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056332+0000","last_undegraded":"2024-09-13T18:57:13.056332+0000","last_fullsized":"2024-09-13T18:57:13.056332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.081348+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.081348+0000","last_peered":"2024-09-13T18:57:13.081348+0000","last_clean":"2024-09-13T18:57:13.081348+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.081348+0000","last_undegraded":"2024-09-13T18:57:13.081348+0000","last_fullsized":"2024-09-13T18:57:13.081348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.056024+0000","last_change":"2024-09-13T18:57:13.056024+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.056024+0000","last_undegraded":"2024-09-13T18:57:13.056024+0000","last_fullsized":"2024-09-13T18:57:13.056024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.089541+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.089541+0000","last_peered":"2024-09-13T18:57:13.089541+0000","last_clean":"2024-09-13T18:57:13.089541+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.089541+0000","last_undegraded":"2024-09-13T18:57:13.089541+0000","last_fullsized":"2024-09-13T18:57:13.089541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.067544+0000","last_change":"2024-09-13T18:57:13.067544+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.067544+0000","last_undegraded":"2024-09-13T18:57:13.067544+0000","last_fullsized":"2024-09-13T18:57:13.067544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075971+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.075971+0000","last_peered":"2024-09-13T18:57:13.075971+0000","last_clean":"2024-09-13T18:57:13.075971+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.075971+0000","last_undegraded":"2024-09-13T18:57:13.075971+0000","last_fullsized":"2024-09-13T18:57:13.075971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055809+0000","last_change":"2024-09-13T18:57:13.055809+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055809+0000","last_undegraded":"2024-09-13T18:57:13.055809+0000","last_fullsized":"2024-09-13T18:57:13.055809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:57:12.054851+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:12.054851+0000","last_peered":"2024-09-13T18:57:12.054851+0000","last_clean":"2024-09-13T18:57:12.054851+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:12.054851+0000","last_undegraded":"2024-09-13T18:57:12.054851+0000","last_fullsized":"2024-09-13T18:57:12.054851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086469+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.086469+0000","last_peered":"2024-09-13T18:57:13.086469+0000","last_clean":"2024-09-13T18:57:13.086469+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.086469+0000","last_undegraded":"2024-09-13T18:57:13.086469+0000","last_fullsized":"2024-09-13T18:57:13.086469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059523+0000","last_change":"2024-09-13T18:57:13.059523+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059523+0000","last_undegraded":"2024-09-13T18:57:13.059523+0000","last_fullsized":"2024-09-13T18:57:13.059523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.078543+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.078543+0000","last_peered":"2024-09-13T18:57:13.078543+0000","last_clean":"2024-09-13T18:57:13.078543+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.078543+0000","last_undegraded":"2024-09-13T18:57:13.078543+0000","last_fullsized":"2024-09-13T18:57:13.078543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061667+0000","last_change":"2024-09-13T18:57:13.061667+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061667+0000","last_undegraded":"2024-09-13T18:57:13.061667+0000","last_fullsized":"2024-09-13T18:57:13.061667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.075234+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.075234+0000","last_peered":"2024-09-13T18:57:13.075234+0000","last_clean":"2024-09-13T18:57:13.075234+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.075234+0000","last_undegraded":"2024-09-13T18:57:13.075234+0000","last_fullsized":"2024-09-13T18:57:13.075234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.071631+0000","last_change":"2024-09-13T18:57:13.071631+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.071631+0000","last_undegraded":"2024-09-13T18:57:13.071631+0000","last_fullsized":"2024-09-13T18:57:13.071631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.087967+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.087967+0000","last_peered":"2024-09-13T18:57:13.087967+0000","last_clean":"2024-09-13T18:57:13.087967+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.087967+0000","last_undegraded":"2024-09-13T18:57:13.087967+0000","last_fullsized":"2024-09-13T18:57:13.087967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.058299+0000","last_change":"2024-09-13T18:57:13.058299+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.058299+0000","last_undegraded":"2024-09-13T18:57:13.058299+0000","last_fullsized":"2024-09-13T18:57:13.058299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084096+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.084096+0000","last_peered":"2024-09-13T18:57:13.084096+0000","last_clean":"2024-09-13T18:57:13.084096+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.084096+0000","last_undegraded":"2024-09-13T18:57:13.084096+0000","last_fullsized":"2024-09-13T18:57:13.084096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.062105+0000","last_change":"2024-09-13T18:57:13.062105+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.062105+0000","last_undegraded":"2024-09-13T18:57:13.062105+0000","last_fullsized":"2024-09-13T18:57:13.062105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085954+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.085954+0000","last_peered":"2024-09-13T18:57:13.085954+0000","last_clean":"2024-09-13T18:57:13.085954+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.085954+0000","last_undegraded":"2024-09-13T18:57:13.085954+0000","last_fullsized":"2024-09-13T18:57:13.085954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069539+0000","last_change":"2024-09-13T18:57:13.069539+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069539+0000","last_undegraded":"2024-09-13T18:57:13.069539+0000","last_fullsized":"2024-09-13T18:57:13.069539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084911+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:13.084911+0000","last_peered":"2024-09-13T18:57:13.084911+0000","last_clean":"2024-09-13T18:57:13.084911+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:13.084911+0000","last_undegraded":"2024-09-13T18:57:13.084911+0000","last_fullsized":"2024-09-13T18:57:13.084911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.059328+0000","last_change":"2024-09-13T18:57:13.059328+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.059328+0000","last_undegraded":"2024-09-13T18:57:13.059328+0000","last_fullsized":"2024-09-13T18:57:13.059328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.093412+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.093412+0000","last_peered":"2024-09-13T18:57:13.093412+0000","last_clean":"2024-09-13T18:57:13.093412+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.093412+0000","last_undegraded":"2024-09-13T18:57:13.093412+0000","last_fullsized":"2024-09-13T18:57:13.093412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068815+0000","last_change":"2024-09-13T18:57:13.068815+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068815+0000","last_undegraded":"2024-09-13T18:57:13.068815+0000","last_fullsized":"2024-09-13T18:57:13.068815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085884+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.085884+0000","last_peered":"2024-09-13T18:57:13.085884+0000","last_clean":"2024-09-13T18:57:13.085884+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.085884+0000","last_undegraded":"2024-09-13T18:57:13.085884+0000","last_fullsized":"2024-09-13T18:57:13.085884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.055309+0000","last_change":"2024-09-13T18:57:13.055309+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.055309+0000","last_undegraded":"2024-09-13T18:57:13.055309+0000","last_fullsized":"2024-09-13T18:57:13.055309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084892+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.084892+0000","last_peered":"2024-09-13T18:57:13.084892+0000","last_clean":"2024-09-13T18:57:13.084892+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.084892+0000","last_undegraded":"2024-09-13T18:57:13.084892+0000","last_fullsized":"2024-09-13T18:57:13.084892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060777+0000","last_change":"2024-09-13T18:57:13.060777+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060777+0000","last_undegraded":"2024-09-13T18:57:13.060777+0000","last_fullsized":"2024-09-13T18:57:13.060777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084873+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.084873+0000","last_peered":"2024-09-13T18:57:13.084873+0000","last_clean":"2024-09-13T18:57:13.084873+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.084873+0000","last_undegraded":"2024-09-13T18:57:13.084873+0000","last_fullsized":"2024-09-13T18:57:13.084873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.060749+0000","last_change":"2024-09-13T18:57:13.060749+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.060749+0000","last_undegraded":"2024-09-13T18:57:13.060749+0000","last_fullsized":"2024-09-13T18:57:13.060749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086047+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.086047+0000","last_peered":"2024-09-13T18:57:13.086047+0000","last_clean":"2024-09-13T18:57:13.086047+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.086047+0000","last_undegraded":"2024-09-13T18:57:13.086047+0000","last_fullsized":"2024-09-13T18:57:13.086047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.066689+0000","last_change":"2024-09-13T18:57:13.066689+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.066689+0000","last_undegraded":"2024-09-13T18:57:13.066689+0000","last_fullsized":"2024-09-13T18:57:13.066689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.064307+0000","last_change":"2024-09-13T18:57:13.064307+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.064307+0000","last_undegraded":"2024-09-13T18:57:13.064307+0000","last_fullsized":"2024-09-13T18:57:13.064307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.079501+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.079501+0000","last_peered":"2024-09-13T18:57:13.079501+0000","last_clean":"2024-09-13T18:57:13.079501+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.079501+0000","last_undegraded":"2024-09-13T18:57:13.079501+0000","last_fullsized":"2024-09-13T18:57:13.079501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.068047+0000","last_change":"2024-09-13T18:57:13.068047+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.068047+0000","last_undegraded":"2024-09-13T18:57:13.068047+0000","last_fullsized":"2024-09-13T18:57:13.068047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.085797+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.085797+0000","last_peered":"2024-09-13T18:57:13.085797+0000","last_clean":"2024-09-13T18:57:13.085797+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.085797+0000","last_undegraded":"2024-09-13T18:57:13.085797+0000","last_fullsized":"2024-09-13T18:57:13.085797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.069304+0000","last_change":"2024-09-13T18:57:13.069304+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.069304+0000","last_undegraded":"2024-09-13T18:57:13.069304+0000","last_fullsized":"2024-09-13T18:57:13.069304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.084648+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.084648+0000","last_peered":"2024-09-13T18:57:13.084648+0000","last_clean":"2024-09-13T18:57:13.084648+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.084648+0000","last_undegraded":"2024-09-13T18:57:13.084648+0000","last_fullsized":"2024-09-13T18:57:13.084648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:57:13.061006+0000","last_change":"2024-09-13T18:57:13.061006+0000","last_active":"2024-09-13T18:57:13.048527+0000","last_peered":"2024-09-13T18:57:13.048527+0000","last_clean":"2024-09-13T18:57:13.048527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:57:13.061006+0000","last_undegraded":"2024-09-13T18:57:13.061006+0000","last_fullsized":"2024-09-13T18:57:13.061006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.086775+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.086775+0000","last_peered":"2024-09-13T18:57:13.086775+0000","last_clean":"2024-09-13T18:57:13.086775+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.086775+0000","last_undegraded":"2024-09-13T18:57:13.086775+0000","last_fullsized":"2024-09-13T18:57:13.086775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:18.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061677+0000', 'last_change': '2024-09-13T18:57:13.061677+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061677+0000', 'last_undegraded': '2024-09-13T18:57:13.061677+0000', 'last_fullsized': '2024-09-13T18:57:13.061677+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.066779+0000', 'last_change': '2024-09-13T18:57:13.066779+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.066779+0000', 'last_undegraded': '2024-09-13T18:57:13.066779+0000', 'last_fullsized': '2024-09-13T18:57:13.066779+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.063644+0000', 'last_change': '2024-09-13T18:57:13.063644+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.063644+0000', 'last_undegraded': '2024-09-13T18:57:13.063644+0000', 'last_fullsized': '2024-09-13T18:57:13.063644+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.069107+0000', 'last_change': '2024-09-13T18:57:13.069107+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.069107+0000', 'last_undegraded': '2024-09-13T18:57:13.069107+0000', 'last_fullsized': '2024-09-13T18:57:13.069107+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.059636+0000', 'last_change': '2024-09-13T18:57:13.059636+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.059636+0000', 'last_undegraded': '2024-09-13T18:57:13.059636+0000', 'last_fullsized': '2024-09-13T18:57:13.059636+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-09-13T18:57:18.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.066478+0000', 'last_change': '2024-09-13T18:57:13.066478+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.066478+0000', 'last_undegraded': '2024-09-13T18:57:13.066478+0000', 'last_fullsized': '2024-09-13T18:57:13.066478+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.058765+0000', 'last_change': '2024-09-13T18:57:13.058765+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.058765+0000', 'last_undegraded': '2024-09-13T18:57:13.058765+0000', 'last_fullsized': '2024-09-13T18:57:13.058765+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.066907+0000', 'last_change': '2024-09-13T18:57:13.066907+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.066907+0000', 'last_undegraded': '2024-09-13T18:57:13.066907+0000', 'last_fullsized': '2024-09-13T18:57:13.066907+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.059762+0000', 'last_change': '2024-09-13T18:57:13.059762+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.059762+0000', 'last_undegraded': '2024-09-13T18:57:13.059762+0000', 'last_fullsized': '2024-09-13T18:57:13.059762+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.073214+0000', 'last_change': '2024-09-13T18:57:13.073214+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.073214+0000', 'last_undegraded': '2024-09-13T18:57:13.073214+0000', 'last_fullsized': '2024-09-13T18:57:13.073214+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-09-13T18:57:18.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.065227+0000', 'last_change': '2024-09-13T18:57:13.065227+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.065227+0000', 'last_undegraded': '2024-09-13T18:57:13.065227+0000', 'last_fullsized': '2024-09-13T18:57:13.065227+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.056690+0000', 'last_change': '2024-09-13T18:57:13.056690+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.056690+0000', 'last_undegraded': '2024-09-13T18:57:13.056690+0000', 'last_fullsized': '2024-09-13T18:57:13.056690+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.067317+0000', 'last_change': '2024-09-13T18:57:13.067317+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.067317+0000', 'last_undegraded': '2024-09-13T18:57:13.067317+0000', 'last_fullsized': '2024-09-13T18:57:13.067317+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.068510+0000', 'last_change': '2024-09-13T18:57:13.068510+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.068510+0000', 'last_undegraded': '2024-09-13T18:57:13.068510+0000', 'last_fullsized': '2024-09-13T18:57:13.068510+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.064845+0000', 'last_change': '2024-09-13T18:57:13.064845+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.064845+0000', 'last_undegraded': '2024-09-13T18:57:13.064845+0000', 'last_fullsized': '2024-09-13T18:57:13.064845+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062337+0000', 'last_change': '2024-09-13T18:57:13.062337+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062337+0000', 'last_undegraded': '2024-09-13T18:57:13.062337+0000', 'last_fullsized': '2024-09-13T18:57:13.062337+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061454+0000', 'last_change': '2024-09-13T18:57:13.061454+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061454+0000', 'last_undegraded': '2024-09-13T18:57:13.061454+0000', 'last_fullsized': '2024-09-13T18:57:13.061454+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.060760+0000', 'last_change': '2024-09-13T18:57:13.060760+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.060760+0000', 'last_undegraded': '2024-09-13T18:57:13.060760+0000', 'last_fullsized': '2024-09-13T18:57:13.060760+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061728+0000', 'last_change': '2024-09-13T18:57:13.061728+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061728+0000', 'last_undegraded': '2024-09-13T18:57:13.061728+0000', 'last_fullsized': '2024-09-13T18:57:13.061728+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.065831+0000', 'last_change': '2024-09-13T18:57:13.065831+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.065831+0000', 'last_undegraded': '2024-09-13T18:57:13.065831+0000', 'last_fullsized': '2024-09-13T18:57:13.065831+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.070423+0000', 'last_change': '2024-09-13T18:57:13.070423+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.070423+0000', 'last_undegraded': '2024-09-13T18:57:13.070423+0000', 'last_fullsized': '2024-09-13T18:57:13.070423+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-09-13T18:57:18.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.063447+0000', 'last_change': '2024-09-13T18:57:13.063447+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.063447+0000', 'last_undegraded': '2024-09-13T18:57:13.063447+0000', 'last_fullsized': '2024-09-13T18:57:13.063447+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062663+0000', 'last_change': '2024-09-13T18:57:13.062663+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062663+0000', 'last_undegraded': '2024-09-13T18:57:13.062663+0000', 'last_fullsized': '2024-09-13T18:57:13.062663+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061477+0000', 'last_change': '2024-09-13T18:57:13.061477+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061477+0000', 'last_undegraded': '2024-09-13T18:57:13.061477+0000', 'last_fullsized': '2024-09-13T18:57:13.061477+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.064126+0000', 'last_change': '2024-09-13T18:57:13.064126+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.064126+0000', 'last_undegraded': '2024-09-13T18:57:13.064126+0000', 'last_fullsized': '2024-09-13T18:57:13.064126+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.071540+0000', 'last_change': '2024-09-13T18:57:13.071540+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.071540+0000', 'last_undegraded': '2024-09-13T18:57:13.071540+0000', 'last_fullsized': '2024-09-13T18:57:13.071540+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.066627+0000', 'last_change': '2024-09-13T18:57:13.066627+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.066627+0000', 'last_undegraded': '2024-09-13T18:57:13.066627+0000', 'last_fullsized': '2024-09-13T18:57:13.066627+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-09-13T18:57:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062126+0000', 'last_change': '2024-09-13T18:57:13.062126+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062126+0000', 'last_undegraded': '2024-09-13T18:57:13.062126+0000', 'last_fullsized': '2024-09-13T18:57:13.062126+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.069810+0000', 'last_change': '2024-09-13T18:57:13.069810+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.069810+0000', 'last_undegraded': '2024-09-13T18:57:13.069810+0000', 'last_fullsized': '2024-09-13T18:57:13.069810+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062344+0000', 'last_change': '2024-09-13T18:57:13.062344+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062344+0000', 'last_undegraded': '2024-09-13T18:57:13.062344+0000', 'last_fullsized': '2024-09-13T18:57:13.062344+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.060636+0000', 'last_change': '2024-09-13T18:57:13.060636+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.060636+0000', 'last_undegraded': '2024-09-13T18:57:13.060636+0000', 'last_fullsized': '2024-09-13T18:57:13.060636+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.070574+0000', 'last_change': '2024-09-13T18:57:13.070574+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.070574+0000', 'last_undegraded': '2024-09-13T18:57:13.070574+0000', 'last_fullsized': '2024-09-13T18:57:13.070574+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.057113+0000', 'last_change': '2024-09-13T18:57:13.057113+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.057113+0000', 'last_undegraded': '2024-09-13T18:57:13.057113+0000', 'last_fullsized': '2024-09-13T18:57:13.057113+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.065219+0000', 'last_change': '2024-09-13T18:57:13.065219+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.065219+0000', 'last_undegraded': '2024-09-13T18:57:13.065219+0000', 'last_fullsized': '2024-09-13T18:57:13.065219+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062516+0000', 'last_change': '2024-09-13T18:57:13.062516+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062516+0000', 'last_undegraded': '2024-09-13T18:57:13.062516+0000', 'last_fullsized': '2024-09-13T18:57:13.062516+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.067468+0000', 'last_change': '2024-09-13T18:57:13.067468+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.067468+0000', 'last_undegraded': '2024-09-13T18:57:13.067468+0000', 'last_fullsized': '2024-09-13T18:57:13.067468+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.064866+0000', 'last_change': '2024-09-13T18:57:13.064866+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.064866+0000', 'last_undegraded': '2024-09-13T18:57:13.064866+0000', 'last_fullsized': '2024-09-13T18:57:13.064866+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.068838+0000', 'last_change': '2024-09-13T18:57:13.068838+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.068838+0000', 'last_undegraded': '2024-09-13T18:57:13.068838+0000', 'last_fullsized': '2024-09-13T18:57:13.068838+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.056090+0000', 'last_change': '2024-09-13T18:57:13.056090+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.056090+0000', 'last_undegraded': '2024-09-13T18:57:13.056090+0000', 'last_fullsized': '2024-09-13T18:57:13.056090+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:57:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.057175+0000', 'last_change': '2024-09-13T18:57:13.057175+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.057175+0000', 'last_undegraded': '2024-09-13T18:57:13.057175+0000', 'last_fullsized': '2024-09-13T18:57:13.057175+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.064698+0000', 'last_change': '2024-09-13T18:57:13.064698+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.064698+0000', 'last_undegraded': '2024-09-13T18:57:13.064698+0000', 'last_fullsized': '2024-09-13T18:57:13.064698+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.055234+0000', 'last_change': '2024-09-13T18:57:13.055234+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.055234+0000', 'last_undegraded': '2024-09-13T18:57:13.055234+0000', 'last_fullsized': '2024-09-13T18:57:13.055234+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.065994+0000', 'last_change': '2024-09-13T18:57:13.065994+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.065994+0000', 'last_undegraded': '2024-09-13T18:57:13.065994+0000', 'last_fullsized': '2024-09-13T18:57:13.065994+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.055965+0000', 'last_change': '2024-09-13T18:57:13.055965+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.055965+0000', 'last_undegraded': '2024-09-13T18:57:13.055965+0000', 'last_fullsized': '2024-09-13T18:57:13.055965+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.056332+0000', 'last_change': '2024-09-13T18:57:13.056332+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.056332+0000', 'last_undegraded': '2024-09-13T18:57:13.056332+0000', 'last_fullsized': '2024-09-13T18:57:13.056332+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.056024+0000', 'last_change': '2024-09-13T18:57:13.056024+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.056024+0000', 'last_undegraded': '2024-09-13T18:57:13.056024+0000', 'last_fullsized': '2024-09-13T18:57:13.056024+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.067544+0000', 'last_change': '2024-09-13T18:57:13.067544+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.067544+0000', 'last_undegraded': '2024-09-13T18:57:13.067544+0000', 'last_fullsized': '2024-09-13T18:57:13.067544+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.055809+0000', 'last_change': '2024-09-13T18:57:13.055809+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.055809+0000', 'last_undegraded': '2024-09-13T18:57:13.055809+0000', 'last_fullsized': '2024-09-13T18:57:13.055809+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-09-13T18:57:18.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.059523+0000', 'last_change': '2024-09-13T18:57:13.059523+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.059523+0000', 'last_undegraded': '2024-09-13T18:57:13.059523+0000', 'last_fullsized': '2024-09-13T18:57:13.059523+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061667+0000', 'last_change': '2024-09-13T18:57:13.061667+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061667+0000', 'last_undegraded': '2024-09-13T18:57:13.061667+0000', 'last_fullsized': '2024-09-13T18:57:13.061667+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.071631+0000', 'last_change': '2024-09-13T18:57:13.071631+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.071631+0000', 'last_undegraded': '2024-09-13T18:57:13.071631+0000', 'last_fullsized': '2024-09-13T18:57:13.071631+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.058299+0000', 'last_change': '2024-09-13T18:57:13.058299+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.058299+0000', 'last_undegraded': '2024-09-13T18:57:13.058299+0000', 'last_fullsized': '2024-09-13T18:57:13.058299+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.062105+0000', 'last_change': '2024-09-13T18:57:13.062105+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.062105+0000', 'last_undegraded': '2024-09-13T18:57:13.062105+0000', 'last_fullsized': '2024-09-13T18:57:13.062105+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.069539+0000', 'last_change': '2024-09-13T18:57:13.069539+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.069539+0000', 'last_undegraded': '2024-09-13T18:57:13.069539+0000', 'last_fullsized': '2024-09-13T18:57:13.069539+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-09-13T18:57:18.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.059328+0000', 'last_change': '2024-09-13T18:57:13.059328+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.059328+0000', 'last_undegraded': '2024-09-13T18:57:13.059328+0000', 'last_fullsized': '2024-09-13T18:57:13.059328+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.068815+0000', 'last_change': '2024-09-13T18:57:13.068815+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.068815+0000', 'last_undegraded': '2024-09-13T18:57:13.068815+0000', 'last_fullsized': '2024-09-13T18:57:13.068815+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.055309+0000', 'last_change': '2024-09-13T18:57:13.055309+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.055309+0000', 'last_undegraded': '2024-09-13T18:57:13.055309+0000', 'last_fullsized': '2024-09-13T18:57:13.055309+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.060777+0000', 'last_change': '2024-09-13T18:57:13.060777+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.060777+0000', 'last_undegraded': '2024-09-13T18:57:13.060777+0000', 'last_fullsized': '2024-09-13T18:57:13.060777+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.060749+0000', 'last_change': '2024-09-13T18:57:13.060749+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.060749+0000', 'last_undegraded': '2024-09-13T18:57:13.060749+0000', 'last_fullsized': '2024-09-13T18:57:13.060749+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.066689+0000', 'last_change': '2024-09-13T18:57:13.066689+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.066689+0000', 'last_undegraded': '2024-09-13T18:57:13.066689+0000', 'last_fullsized': '2024-09-13T18:57:13.066689+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:57:18.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.064307+0000', 'last_change': '2024-09-13T18:57:13.064307+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.064307+0000', 'last_undegraded': '2024-09-13T18:57:13.064307+0000', 'last_fullsized': '2024-09-13T18:57:13.064307+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.068047+0000', 'last_change': '2024-09-13T18:57:13.068047+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.068047+0000', 'last_undegraded': '2024-09-13T18:57:13.068047+0000', 'last_fullsized': '2024-09-13T18:57:13.068047+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.069304+0000', 'last_change': '2024-09-13T18:57:13.069304+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.069304+0000', 'last_undegraded': '2024-09-13T18:57:13.069304+0000', 'last_fullsized': '2024-09-13T18:57:13.069304+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-09-13T18:57:18.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:57:13.061006+0000', 'last_change': '2024-09-13T18:57:13.061006+0000', 'last_active': '2024-09-13T18:57:13.048527+0000', 'last_peered': '2024-09-13T18:57:13.048527+0000', 'last_clean': '2024-09-13T18:57:13.048527+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:57:13.061006+0000', 'last_undegraded': '2024-09-13T18:57:13.061006+0000', 'last_fullsized': '2024-09-13T18:57:13.061006+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'last_clean_scrub_stamp': '2024-09-13T18:57:13.048527+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:57:18.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:57:18.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.696+0000 7febbd000640 1 Processor -- start 2024-09-13T18:57:18.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.696+0000 7febbd000640 1 -- start start 2024-09-13T18:57:18.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febbd000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7febb8153b20 0x7febb80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febbd000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8159a80 0x7febb80b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febbd000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb8153f00 con 0x7febb80b2410 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febbd000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80ce600 con 0x7febb8153b20 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febbd000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb8070f90 con 0x7febb8159a80 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7febb8153b20 0x7febb80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7febb8153b20 0x7febb80b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60764/0 (socket says 172.21.15.33:60764) 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 -- 172.21.15.33:0/4205896329 learned_addr learned my addr 172.21.15.33:0/4205896329 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febad400640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8159a80 0x7febb80b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 -- 172.21.15.33:0/4205896329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8159a80 msgr2=0x7febb80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8159a80 0x7febb80b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 -- 172.21.15.33:0/4205896329 >> v1:172.21.15.103:6789/0 conn(0x7febb80b2410 legacy=0x7febb806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.698+0000 7febb5e00640 1 -- 172.21.15.33:0/4205896329 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80b1a40 con 0x7febb8153b20 2024-09-13T18:57:18.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.699+0000 7febb5e00640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8153b20 0x7febb80b3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feba80098a0 tx=0x7feba802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d001e6e119bc741 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febb5400640 1 -- 172.21.15.33:0/4205896329 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8032440 con 0x7febb8153b20 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febb5400640 1 -- 172.21.15.33:0/4205896329 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba80325a0 con 0x7febb8153b20 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febb5400640 1 -- 172.21.15.33:0/4205896329 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8032930 con 0x7febb8153b20 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 -- 172.21.15.33:0/4205896329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8153b20 msgr2=0x7febb80b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8153b20 0x7febb80b3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feba80098a0 tx=0x7feba802a290 comp rx=0 tx=0).stop 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 -- 172.21.15.33:0/4205896329 shutdown_connections 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8159a80 0x7febb80b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 --2- 172.21.15.33:0/4205896329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8153b20 0x7febb80b3990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 -- 172.21.15.33:0/4205896329 >> 172.21.15.33:0/4205896329 conn(0x7febb80b0510 msgr2=0x7febb80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 -- 172.21.15.33:0/4205896329 shutdown_connections 2024-09-13T18:57:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.700+0000 7febbd000640 1 -- 172.21.15.33:0/4205896329 wait complete. 2024-09-13T18:57:18.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.702+0000 7febbd000640 1 Processor -- start 2024-09-13T18:57:18.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.702+0000 7febbd000640 1 -- start start 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb80b2410 0x7febb8150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8153b20 0x7febb815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb8151360 con 0x7febb8159a80 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb81e5980 con 0x7febb80b2410 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febbd000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815b4a0 con 0x7febb8153b20 2024-09-13T18:57:18.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febb6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febb6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60774/0 (socket says 172.21.15.33:60774) 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febb6800640 1 -- 172.21.15.33:0/1558404417 learned_addr learned my addr 172.21.15.33:0/1558404417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febb5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb80b2410 0x7febb8150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.703+0000 7febad400640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8153b20 0x7febb815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 -- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8153b20 msgr2=0x7febb815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8153b20 0x7febb815bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 -- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb80b2410 msgr2=0x7febb8150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb80b2410 0x7febb8150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 -- 172.21.15.33:0/1558404417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80094d0 con 0x7febb8159a80 2024-09-13T18:57:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febb6800640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7febb000c6b0 tx=0x7febb000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0003b70 con 0x7febb8159a80 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0003cf0 con 0x7febb8159a80 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0003ea0 con 0x7febb8159a80 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb815b780 con 0x7febb8159a80 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.704+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb815c4c0 con 0x7febb8159a80 2024-09-13T18:57:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.705+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb815bca0 con 0x7febb8159a80 2024-09-13T18:57:18.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.706+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febb0005310 con 0x7febb8159a80 2024-09-13T18:57:18.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.707+0000 7febaea00640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 0x7feb9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:18.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.707+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febb0089060 con 0x7febb8159a80 2024-09-13T18:57:18.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.707+0000 7febb5e00640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 0x7feb9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:18.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.708+0000 7febb5e00640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 0x7feb9406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:18.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.711+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7febb00bc9c0 con 0x7febb8159a80 2024-09-13T18:57:18.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.958+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7febb80b3990 con 0x7febb8159a80 2024-09-13T18:57:18.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.958+0000 7febaea00640 1 -- 172.21.15.33:0/1558404417 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1031 (secure 0 0 0) 0x7febb815bca0 con 0x7febb8159a80 2024-09-13T18:57:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:18.962 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253822,"num_in_osds":8,"osd_in_since":1726253813,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":223879168,"bytes_avail":772870234112,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4293}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-13T18:56:50.283143+0000","services":{}},"progress_events":{}} 2024-09-13T18:57:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 msgr2=0x7feb9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 0x7feb9406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 msgr2=0x7febb81e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7febb000c6b0 tx=0x7febb000cb70 comp rx=0 tx=0).stop 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 shutdown_connections 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7feb9406ac00 0x7feb9406d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb8159a80 0x7febb81e3810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febb8153b20 0x7febb815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 --2- 172.21.15.33:0/1558404417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febb80b2410 0x7febb8150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:18.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 >> 172.21.15.33:0/1558404417 conn(0x7febb80b0510 msgr2=0x7febb815d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:18.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 shutdown_connections 2024-09-13T18:57:18.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:18.961+0000 7febbd000640 1 -- 172.21.15.33:0/1558404417 wait complete. 2024-09-13T18:57:18.980 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:57:18.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:19.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.132+0000 7fef5cc00640 1 Processor -- start 2024-09-13T18:57:19.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.132+0000 7fef5cc00640 1 -- start start 2024-09-13T18:57:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef5cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef5cc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef580ce020 0x7fef5815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef5cc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5806bc00 con 0x7fef580b1b00 2024-09-13T18:57:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef5cc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5806bea0 con 0x7fef580ce020 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef5cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5806c180 con 0x7fef5815a520 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef55400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fef580b1b00 0x7fef580cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36678/0 (socket says 172.21.15.33:36678) 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.133+0000 7fef55400640 1 -- 172.21.15.33:0/3980790109 learned_addr learned my addr 172.21.15.33:0/3980790109 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef55e00640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef56800640 1 --2- 172.21.15.33:0/3980790109 >> v2:172.21.15.103:3300/0 conn(0x7fef580ce020 0x7fef5815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef54a00640 1 -- 172.21.15.33:0/3980790109 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251477143 0 0) 0x7fef5806bc00 con 0x7fef580b1b00 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef54a00640 1 -- 172.21.15.33:0/3980790109 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c003520 con 0x7fef580b1b00 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef56800640 1 -- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 msgr2=0x7fef5806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef56800640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef56800640 1 -- 172.21.15.33:0/3980790109 >> v1:172.21.15.33:6789/0 conn(0x7fef580b1b00 legacy=0x7fef580cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.134+0000 7fef56800640 1 -- 172.21.15.33:0/3980790109 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5806c460 con 0x7fef580ce020 2024-09-13T18:57:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.135+0000 7fef56800640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef5815a900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef50009d90 tx=0x7fef5002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a56828169ca1d0dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.135+0000 7fef54a00640 1 -- 172.21.15.33:0/3980790109 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50007740 con 0x7fef580ce020 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef54a00640 1 -- 172.21.15.33:0/3980790109 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5002d050 con 0x7fef580ce020 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef54a00640 1 -- 172.21.15.33:0/3980790109 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50007ac0 con 0x7fef580ce020 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 -- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 msgr2=0x7fef5815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef5815a900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef50009d90 tx=0x7fef5002a660 comp rx=0 tx=0).stop 2024-09-13T18:57:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 -- 172.21.15.33:0/3980790109 shutdown_connections 2024-09-13T18:57:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef5815a900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 --2- 172.21.15.33:0/3980790109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 -- 172.21.15.33:0/3980790109 >> 172.21.15.33:0/3980790109 conn(0x7fef580b0510 msgr2=0x7fef580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 -- 172.21.15.33:0/3980790109 shutdown_connections 2024-09-13T18:57:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.136+0000 7fef5cc00640 1 -- 172.21.15.33:0/3980790109 wait complete. 2024-09-13T18:57:19.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.138+0000 7fef5cc00640 1 Processor -- start 2024-09-13T18:57:19.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.138+0000 7fef5cc00640 1 -- start start 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef580c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814d020 con 0x7fef580b1b00 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814cd80 con 0x7fef580ce020 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef5cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580ca4e0 con 0x7fef5815a520 2024-09-13T18:57:19.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60780/0 (socket says 172.21.15.33:60780) 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 -- 172.21.15.33:0/334177528 learned_addr learned my addr 172.21.15.33:0/334177528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef56800640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55400640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef580c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 -- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 msgr2=0x7fef5814c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5814c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 -- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 msgr2=0x7fef580c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.139+0000 7fef55e00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef580c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef55e00640 1 -- 172.21.15.33:0/334177528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009a70 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef55e00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef4800e870 tx=0x7fef4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480094f0 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800c940 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580ca7c0 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800ccf0 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.140+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef580ad3e0 con 0x7fef580b1b00 2024-09-13T18:57:19.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.141+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5815a900 con 0x7fef580b1b00 2024-09-13T18:57:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.142+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef48013470 con 0x7fef580b1b00 2024-09-13T18:57:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.143+0000 7fef4e000640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 0x7fef3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.143+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef48089440 con 0x7fef580b1b00 2024-09-13T18:57:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.143+0000 7fef55400640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 0x7fef3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:19.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.144+0000 7fef55400640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 0x7fef3806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef58151600 tx=0x7fef44007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:19.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.147+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef48054630 con 0x7fef580b1b00 2024-09-13T18:57:19.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.322+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef5806cf40 con 0x7fef3806ac00 2024-09-13T18:57:19.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.330+0000 7fef4e000640 1 -- 172.21.15.33:0/334177528 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264729 (secure 0 0 0) 0x7fef44005850 con 0x7fef3806ac00 2024-09-13T18:57:19.336 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:19.337 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:19.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 msgr2=0x7fef3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 0x7fef3806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef58151600 tx=0x7fef44007d30 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 msgr2=0x7fef580c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef4800e870 tx=0x7fef4800ed30 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 shutdown_connections 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef3806ac00 0x7fef3806d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef5815a520 0x7fef5814c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef580ce020 0x7fef580c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 --2- 172.21.15.33:0/334177528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef580b1b00 0x7fef580c85a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.333+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 >> 172.21.15.33:0/334177528 conn(0x7fef580b0510 msgr2=0x7fef58157510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.334+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 shutdown_connections 2024-09-13T18:57:19.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:19.334+0000 7fef5cc00640 1 -- 172.21.15.33:0/334177528 wait complete. 2024-09-13T18:57:19.353 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:57:19.095924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.041834"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528800+0000","last_change":"2024-09-13T18:57:13.522419+0000","last_active":"2024-09-13T18:57:13.528800+0000","last_peered":"2024-09-13T18:57:13.528800+0000","last_clean":"2024-09-13T18:57:13.528800+0000","last_became_active":"2024-09-13T18:57:13.521011+0000","last_became_peered":"2024-09-13T18:57:13.521011+0000","last_unstale":"2024-09-13T18:57:13.528800+0000","last_undegraded":"2024-09-13T18:57:13.528800+0000","last_fullsized":"2024-09-13T18:57:13.528800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514821+0000","last_change":"2024-09-13T18:57:13.510107+0000","last_active":"2024-09-13T18:57:13.514821+0000","last_peered":"2024-09-13T18:57:13.514821+0000","last_clean":"2024-09-13T18:57:13.514821+0000","last_became_active":"2024-09-13T18:57:13.509853+0000","last_became_peered":"2024-09-13T18:57:13.509853+0000","last_unstale":"2024-09-13T18:57:13.514821+0000","last_undegraded":"2024-09-13T18:57:13.514821+0000","last_fullsized":"2024-09-13T18:57:13.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513869+0000","last_change":"2024-09-13T18:57:13.508765+0000","last_active":"2024-09-13T18:57:13.513869+0000","last_peered":"2024-09-13T18:57:13.513869+0000","last_clean":"2024-09-13T18:57:13.513869+0000","last_became_active":"2024-09-13T18:57:13.508499+0000","last_became_peered":"2024-09-13T18:57:13.508499+0000","last_unstale":"2024-09-13T18:57:13.513869+0000","last_undegraded":"2024-09-13T18:57:13.513869+0000","last_fullsized":"2024-09-13T18:57:13.513869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528909+0000","last_change":"2024-09-13T18:57:13.525713+0000","last_active":"2024-09-13T18:57:13.528909+0000","last_peered":"2024-09-13T18:57:13.528909+0000","last_clean":"2024-09-13T18:57:13.528909+0000","last_became_active":"2024-09-13T18:57:13.521390+0000","last_became_peered":"2024-09-13T18:57:13.521390+0000","last_unstale":"2024-09-13T18:57:13.528909+0000","last_undegraded":"2024-09-13T18:57:13.528909+0000","last_fullsized":"2024-09-13T18:57:13.528909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510856+0000","last_change":"2024-09-13T18:57:13.508469+0000","last_active":"2024-09-13T18:57:13.510856+0000","last_peered":"2024-09-13T18:57:13.510856+0000","last_clean":"2024-09-13T18:57:13.510856+0000","last_became_active":"2024-09-13T18:57:13.507301+0000","last_became_peered":"2024-09-13T18:57:13.507301+0000","last_unstale":"2024-09-13T18:57:13.510856+0000","last_undegraded":"2024-09-13T18:57:13.510856+0000","last_fullsized":"2024-09-13T18:57:13.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530319+0000","last_change":"2024-09-13T18:57:13.528886+0000","last_active":"2024-09-13T18:57:13.530319+0000","last_peered":"2024-09-13T18:57:13.530319+0000","last_clean":"2024-09-13T18:57:13.530319+0000","last_became_active":"2024-09-13T18:57:13.528181+0000","last_became_peered":"2024-09-13T18:57:13.528181+0000","last_unstale":"2024-09-13T18:57:13.530319+0000","last_undegraded":"2024-09-13T18:57:13.530319+0000","last_fullsized":"2024-09-13T18:57:13.530319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511278+0000","last_change":"2024-09-13T18:57:13.509845+0000","last_active":"2024-09-13T18:57:13.511278+0000","last_peered":"2024-09-13T18:57:13.511278+0000","last_clean":"2024-09-13T18:57:13.511278+0000","last_became_active":"2024-09-13T18:57:13.509457+0000","last_became_peered":"2024-09-13T18:57:13.509457+0000","last_unstale":"2024-09-13T18:57:13.511278+0000","last_undegraded":"2024-09-13T18:57:13.511278+0000","last_fullsized":"2024-09-13T18:57:13.511278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532810+0000","last_change":"2024-09-13T18:57:13.528197+0000","last_active":"2024-09-13T18:57:13.532810+0000","last_peered":"2024-09-13T18:57:13.532810+0000","last_clean":"2024-09-13T18:57:13.532810+0000","last_became_active":"2024-09-13T18:57:13.527837+0000","last_became_peered":"2024-09-13T18:57:13.527837+0000","last_unstale":"2024-09-13T18:57:13.532810+0000","last_undegraded":"2024-09-13T18:57:13.532810+0000","last_fullsized":"2024-09-13T18:57:13.532810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528817+0000","last_change":"2024-09-13T18:57:13.522966+0000","last_active":"2024-09-13T18:57:13.528817+0000","last_peered":"2024-09-13T18:57:13.528817+0000","last_clean":"2024-09-13T18:57:13.528817+0000","last_became_active":"2024-09-13T18:57:13.522718+0000","last_became_peered":"2024-09-13T18:57:13.522718+0000","last_unstale":"2024-09-13T18:57:13.528817+0000","last_undegraded":"2024-09-13T18:57:13.528817+0000","last_fullsized":"2024-09-13T18:57:13.528817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532479+0000","last_change":"2024-09-13T18:57:13.530108+0000","last_active":"2024-09-13T18:57:13.532479+0000","last_peered":"2024-09-13T18:57:13.532479+0000","last_clean":"2024-09-13T18:57:13.532479+0000","last_became_active":"2024-09-13T18:57:13.529856+0000","last_became_peered":"2024-09-13T18:57:13.529856+0000","last_unstale":"2024-09-13T18:57:13.532479+0000","last_undegraded":"2024-09-13T18:57:13.532479+0000","last_fullsized":"2024-09-13T18:57:13.532479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532940+0000","last_change":"2024-09-13T18:57:13.531905+0000","last_active":"2024-09-13T18:57:13.532940+0000","last_peered":"2024-09-13T18:57:13.532940+0000","last_clean":"2024-09-13T18:57:13.532940+0000","last_became_active":"2024-09-13T18:57:13.531582+0000","last_became_peered":"2024-09-13T18:57:13.531582+0000","last_unstale":"2024-09-13T18:57:13.532940+0000","last_undegraded":"2024-09-13T18:57:13.532940+0000","last_fullsized":"2024-09-13T18:57:13.532940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529009+0000","last_change":"2024-09-13T18:57:13.526125+0000","last_active":"2024-09-13T18:57:13.529009+0000","last_peered":"2024-09-13T18:57:13.529009+0000","last_clean":"2024-09-13T18:57:13.529009+0000","last_became_active":"2024-09-13T18:57:13.525706+0000","last_became_peered":"2024-09-13T18:57:13.525706+0000","last_unstale":"2024-09-13T18:57:13.529009+0000","last_undegraded":"2024-09-13T18:57:13.529009+0000","last_fullsized":"2024-09-13T18:57:13.529009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520064+0000","last_change":"2024-09-13T18:57:13.518913+0000","last_active":"2024-09-13T18:57:13.520064+0000","last_peered":"2024-09-13T18:57:13.520064+0000","last_clean":"2024-09-13T18:57:13.520064+0000","last_became_active":"2024-09-13T18:57:13.518381+0000","last_became_peered":"2024-09-13T18:57:13.518381+0000","last_unstale":"2024-09-13T18:57:13.520064+0000","last_undegraded":"2024-09-13T18:57:13.520064+0000","last_fullsized":"2024-09-13T18:57:13.520064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515917+0000","last_change":"2024-09-13T18:57:13.510462+0000","last_active":"2024-09-13T18:57:13.515917+0000","last_peered":"2024-09-13T18:57:13.515917+0000","last_clean":"2024-09-13T18:57:13.515917+0000","last_became_active":"2024-09-13T18:57:13.510058+0000","last_became_peered":"2024-09-13T18:57:13.510058+0000","last_unstale":"2024-09-13T18:57:13.515917+0000","last_undegraded":"2024-09-13T18:57:13.515917+0000","last_fullsized":"2024-09-13T18:57:13.515917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512044+0000","last_change":"2024-09-13T18:57:13.504104+0000","last_active":"2024-09-13T18:57:13.512044+0000","last_peered":"2024-09-13T18:57:13.512044+0000","last_clean":"2024-09-13T18:57:13.512044+0000","last_became_active":"2024-09-13T18:57:13.503287+0000","last_became_peered":"2024-09-13T18:57:13.503287+0000","last_unstale":"2024-09-13T18:57:13.512044+0000","last_undegraded":"2024-09-13T18:57:13.512044+0000","last_fullsized":"2024-09-13T18:57:13.512044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533192+0000","last_change":"2024-09-13T18:57:13.530559+0000","last_active":"2024-09-13T18:57:13.533192+0000","last_peered":"2024-09-13T18:57:13.533192+0000","last_clean":"2024-09-13T18:57:13.533192+0000","last_became_active":"2024-09-13T18:57:13.528317+0000","last_became_peered":"2024-09-13T18:57:13.528317+0000","last_unstale":"2024-09-13T18:57:13.533192+0000","last_undegraded":"2024-09-13T18:57:13.533192+0000","last_fullsized":"2024-09-13T18:57:13.533192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529757+0000","last_change":"2024-09-13T18:57:13.513604+0000","last_active":"2024-09-13T18:57:13.529757+0000","last_peered":"2024-09-13T18:57:13.529757+0000","last_clean":"2024-09-13T18:57:13.529757+0000","last_became_active":"2024-09-13T18:57:13.512484+0000","last_became_peered":"2024-09-13T18:57:13.512484+0000","last_unstale":"2024-09-13T18:57:13.529757+0000","last_undegraded":"2024-09-13T18:57:13.529757+0000","last_fullsized":"2024-09-13T18:57:13.529757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520879+0000","last_change":"2024-09-13T18:57:13.520180+0000","last_active":"2024-09-13T18:57:13.520879+0000","last_peered":"2024-09-13T18:57:13.520879+0000","last_clean":"2024-09-13T18:57:13.520879+0000","last_became_active":"2024-09-13T18:57:13.519896+0000","last_became_peered":"2024-09-13T18:57:13.519896+0000","last_unstale":"2024-09-13T18:57:13.520879+0000","last_undegraded":"2024-09-13T18:57:13.520879+0000","last_fullsized":"2024-09-13T18:57:13.520879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510733+0000","last_change":"2024-09-13T18:57:13.507930+0000","last_active":"2024-09-13T18:57:13.510733+0000","last_peered":"2024-09-13T18:57:13.510733+0000","last_clean":"2024-09-13T18:57:13.510733+0000","last_became_active":"2024-09-13T18:57:13.507657+0000","last_became_peered":"2024-09-13T18:57:13.507657+0000","last_unstale":"2024-09-13T18:57:13.510733+0000","last_undegraded":"2024-09-13T18:57:13.510733+0000","last_fullsized":"2024-09-13T18:57:13.510733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529867+0000","last_change":"2024-09-13T18:57:13.525532+0000","last_active":"2024-09-13T18:57:13.529867+0000","last_peered":"2024-09-13T18:57:13.529867+0000","last_clean":"2024-09-13T18:57:13.529867+0000","last_became_active":"2024-09-13T18:57:13.525230+0000","last_became_peered":"2024-09-13T18:57:13.525230+0000","last_unstale":"2024-09-13T18:57:13.529867+0000","last_undegraded":"2024-09-13T18:57:13.529867+0000","last_fullsized":"2024-09-13T18:57:13.529867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515961+0000","last_change":"2024-09-13T18:57:13.512432+0000","last_active":"2024-09-13T18:57:13.515961+0000","last_peered":"2024-09-13T18:57:13.515961+0000","last_clean":"2024-09-13T18:57:13.515961+0000","last_became_active":"2024-09-13T18:57:13.509317+0000","last_became_peered":"2024-09-13T18:57:13.509317+0000","last_unstale":"2024-09-13T18:57:13.515961+0000","last_undegraded":"2024-09-13T18:57:13.515961+0000","last_fullsized":"2024-09-13T18:57:13.515961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528774+0000","last_change":"2024-09-13T18:57:13.520560+0000","last_active":"2024-09-13T18:57:13.528774+0000","last_peered":"2024-09-13T18:57:13.528774+0000","last_clean":"2024-09-13T18:57:13.528774+0000","last_became_active":"2024-09-13T18:57:13.520315+0000","last_became_peered":"2024-09-13T18:57:13.520315+0000","last_unstale":"2024-09-13T18:57:13.528774+0000","last_undegraded":"2024-09-13T18:57:13.528774+0000","last_fullsized":"2024-09-13T18:57:13.528774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512275+0000","last_change":"2024-09-13T18:57:13.502348+0000","last_active":"2024-09-13T18:57:13.512275+0000","last_peered":"2024-09-13T18:57:13.512275+0000","last_clean":"2024-09-13T18:57:13.512275+0000","last_became_active":"2024-09-13T18:57:13.502087+0000","last_became_peered":"2024-09-13T18:57:13.502087+0000","last_unstale":"2024-09-13T18:57:13.512275+0000","last_undegraded":"2024-09-13T18:57:13.512275+0000","last_fullsized":"2024-09-13T18:57:13.512275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531361+0000","last_change":"2024-09-13T18:57:13.527672+0000","last_active":"2024-09-13T18:57:13.531361+0000","last_peered":"2024-09-13T18:57:13.531361+0000","last_clean":"2024-09-13T18:57:13.531361+0000","last_became_active":"2024-09-13T18:57:13.521290+0000","last_became_peered":"2024-09-13T18:57:13.521290+0000","last_unstale":"2024-09-13T18:57:13.531361+0000","last_undegraded":"2024-09-13T18:57:13.531361+0000","last_fullsized":"2024-09-13T18:57:13.531361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513821+0000","last_change":"2024-09-13T18:57:13.505357+0000","last_active":"2024-09-13T18:57:13.513821+0000","last_peered":"2024-09-13T18:57:13.513821+0000","last_clean":"2024-09-13T18:57:13.513821+0000","last_became_active":"2024-09-13T18:57:13.503764+0000","last_became_peered":"2024-09-13T18:57:13.503764+0000","last_unstale":"2024-09-13T18:57:13.513821+0000","last_undegraded":"2024-09-13T18:57:13.513821+0000","last_fullsized":"2024-09-13T18:57:13.513821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.525997+0000","last_change":"2024-09-13T18:57:13.520078+0000","last_active":"2024-09-13T18:57:13.525997+0000","last_peered":"2024-09-13T18:57:13.525997+0000","last_clean":"2024-09-13T18:57:13.525997+0000","last_became_active":"2024-09-13T18:57:13.519088+0000","last_became_peered":"2024-09-13T18:57:13.519088+0000","last_unstale":"2024-09-13T18:57:13.525997+0000","last_undegraded":"2024-09-13T18:57:13.525997+0000","last_fullsized":"2024-09-13T18:57:13.525997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511965+0000","last_change":"2024-09-13T18:57:13.504312+0000","last_active":"2024-09-13T18:57:13.511965+0000","last_peered":"2024-09-13T18:57:13.511965+0000","last_clean":"2024-09-13T18:57:13.511965+0000","last_became_active":"2024-09-13T18:57:13.504062+0000","last_became_peered":"2024-09-13T18:57:13.504062+0000","last_unstale":"2024-09-13T18:57:13.511965+0000","last_undegraded":"2024-09-13T18:57:13.511965+0000","last_fullsized":"2024-09-13T18:57:13.511965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.503063+0000","last_change":"2024-09-13T18:57:13.501012+0000","last_active":"2024-09-13T18:57:13.503063+0000","last_peered":"2024-09-13T18:57:13.503063+0000","last_clean":"2024-09-13T18:57:13.503063+0000","last_became_active":"2024-09-13T18:57:13.500775+0000","last_became_peered":"2024-09-13T18:57:13.500775+0000","last_unstale":"2024-09-13T18:57:13.503063+0000","last_undegraded":"2024-09-13T18:57:13.503063+0000","last_fullsized":"2024-09-13T18:57:13.503063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.518301+0000","last_change":"2024-09-13T18:57:13.514151+0000","last_active":"2024-09-13T18:57:13.518301+0000","last_peered":"2024-09-13T18:57:13.518301+0000","last_clean":"2024-09-13T18:57:13.518301+0000","last_became_active":"2024-09-13T18:57:13.512580+0000","last_became_peered":"2024-09-13T18:57:13.512580+0000","last_unstale":"2024-09-13T18:57:13.518301+0000","last_undegraded":"2024-09-13T18:57:13.518301+0000","last_fullsized":"2024-09-13T18:57:13.518301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530306+0000","last_change":"2024-09-13T18:57:13.528152+0000","last_active":"2024-09-13T18:57:13.530306+0000","last_peered":"2024-09-13T18:57:13.530306+0000","last_clean":"2024-09-13T18:57:13.530306+0000","last_became_active":"2024-09-13T18:57:13.527834+0000","last_became_peered":"2024-09-13T18:57:13.527834+0000","last_unstale":"2024-09-13T18:57:13.530306+0000","last_undegraded":"2024-09-13T18:57:13.530306+0000","last_fullsized":"2024-09-13T18:57:13.530306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531696+0000","last_change":"2024-09-13T18:57:13.531001+0000","last_active":"2024-09-13T18:57:13.531696+0000","last_peered":"2024-09-13T18:57:13.531696+0000","last_clean":"2024-09-13T18:57:13.531696+0000","last_became_active":"2024-09-13T18:57:13.530750+0000","last_became_peered":"2024-09-13T18:57:13.530750+0000","last_unstale":"2024-09-13T18:57:13.531696+0000","last_undegraded":"2024-09-13T18:57:13.531696+0000","last_fullsized":"2024-09-13T18:57:13.531696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521145+0000","last_change":"2024-09-13T18:57:13.518687+0000","last_active":"2024-09-13T18:57:13.521145+0000","last_peered":"2024-09-13T18:57:13.521145+0000","last_clean":"2024-09-13T18:57:13.521145+0000","last_became_active":"2024-09-13T18:57:13.518393+0000","last_became_peered":"2024-09-13T18:57:13.518393+0000","last_unstale":"2024-09-13T18:57:13.521145+0000","last_undegraded":"2024-09-13T18:57:13.521145+0000","last_fullsized":"2024-09-13T18:57:13.521145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519289+0000","last_change":"2024-09-13T18:57:13.517369+0000","last_active":"2024-09-13T18:57:13.519289+0000","last_peered":"2024-09-13T18:57:13.519289+0000","last_clean":"2024-09-13T18:57:13.519289+0000","last_became_active":"2024-09-13T18:57:13.516175+0000","last_became_peered":"2024-09-13T18:57:13.516175+0000","last_unstale":"2024-09-13T18:57:13.519289+0000","last_undegraded":"2024-09-13T18:57:13.519289+0000","last_fullsized":"2024-09-13T18:57:13.519289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514834+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.514834+0000","last_peered":"2024-09-13T18:57:13.514834+0000","last_clean":"2024-09-13T18:57:13.514834+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.514834+0000","last_undegraded":"2024-09-13T18:57:13.514834+0000","last_fullsized":"2024-09-13T18:57:13.514834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514757+0000","last_change":"2024-09-13T18:57:13.509552+0000","last_active":"2024-09-13T18:57:13.514757+0000","last_peered":"2024-09-13T18:57:13.514757+0000","last_clean":"2024-09-13T18:57:13.514757+0000","last_became_active":"2024-09-13T18:57:13.506301+0000","last_became_peered":"2024-09-13T18:57:13.506301+0000","last_unstale":"2024-09-13T18:57:13.514757+0000","last_undegraded":"2024-09-13T18:57:13.514757+0000","last_fullsized":"2024-09-13T18:57:13.514757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527248+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.527248+0000","last_peered":"2024-09-13T18:57:13.527248+0000","last_clean":"2024-09-13T18:57:13.527248+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.527248+0000","last_undegraded":"2024-09-13T18:57:13.527248+0000","last_fullsized":"2024-09-13T18:57:13.527248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492370+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.492370+0000","last_peered":"2024-09-13T18:57:13.492370+0000","last_clean":"2024-09-13T18:57:13.492370+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.492370+0000","last_undegraded":"2024-09-13T18:57:13.492370+0000","last_fullsized":"2024-09-13T18:57:13.492370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513971+0000","last_change":"2024-09-13T18:57:13.509463+0000","last_active":"2024-09-13T18:57:13.513971+0000","last_peered":"2024-09-13T18:57:13.513971+0000","last_clean":"2024-09-13T18:57:13.513971+0000","last_became_active":"2024-09-13T18:57:13.509205+0000","last_became_peered":"2024-09-13T18:57:13.509205+0000","last_unstale":"2024-09-13T18:57:13.513971+0000","last_undegraded":"2024-09-13T18:57:13.513971+0000","last_fullsized":"2024-09-13T18:57:13.513971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510784+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.510784+0000","last_peered":"2024-09-13T18:57:13.510784+0000","last_clean":"2024-09-13T18:57:13.510784+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.510784+0000","last_undegraded":"2024-09-13T18:57:13.510784+0000","last_fullsized":"2024-09-13T18:57:13.510784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514052+0000","last_change":"2024-09-13T18:57:13.504149+0000","last_active":"2024-09-13T18:57:13.514052+0000","last_peered":"2024-09-13T18:57:13.514052+0000","last_clean":"2024-09-13T18:57:13.514052+0000","last_became_active":"2024-09-13T18:57:13.503874+0000","last_became_peered":"2024-09-13T18:57:13.503874+0000","last_unstale":"2024-09-13T18:57:13.514052+0000","last_undegraded":"2024-09-13T18:57:13.514052+0000","last_fullsized":"2024-09-13T18:57:13.514052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515679+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.515679+0000","last_peered":"2024-09-13T18:57:13.515679+0000","last_clean":"2024-09-13T18:57:13.515679+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.515679+0000","last_undegraded":"2024-09-13T18:57:13.515679+0000","last_fullsized":"2024-09-13T18:57:13.515679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530773+0000","last_change":"2024-09-13T18:57:13.528119+0000","last_active":"2024-09-13T18:57:13.530773+0000","last_peered":"2024-09-13T18:57:13.530773+0000","last_clean":"2024-09-13T18:57:13.530773+0000","last_became_active":"2024-09-13T18:57:13.527859+0000","last_became_peered":"2024-09-13T18:57:13.527859+0000","last_unstale":"2024-09-13T18:57:13.530773+0000","last_undegraded":"2024-09-13T18:57:13.530773+0000","last_fullsized":"2024-09-13T18:57:13.530773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514102+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.514102+0000","last_peered":"2024-09-13T18:57:13.514102+0000","last_clean":"2024-09-13T18:57:13.514102+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.514102+0000","last_undegraded":"2024-09-13T18:57:13.514102+0000","last_fullsized":"2024-09-13T18:57:13.514102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528063+0000","last_change":"2024-09-13T18:57:13.526462+0000","last_active":"2024-09-13T18:57:13.528063+0000","last_peered":"2024-09-13T18:57:13.528063+0000","last_clean":"2024-09-13T18:57:13.528063+0000","last_became_active":"2024-09-13T18:57:13.526259+0000","last_became_peered":"2024-09-13T18:57:13.526259+0000","last_unstale":"2024-09-13T18:57:13.528063+0000","last_undegraded":"2024-09-13T18:57:13.528063+0000","last_fullsized":"2024-09-13T18:57:13.528063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531561+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.531561+0000","last_peered":"2024-09-13T18:57:13.531561+0000","last_clean":"2024-09-13T18:57:13.531561+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.531561+0000","last_undegraded":"2024-09-13T18:57:13.531561+0000","last_fullsized":"2024-09-13T18:57:13.531561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517426+0000","last_change":"2024-09-13T18:57:13.511843+0000","last_active":"2024-09-13T18:57:13.517426+0000","last_peered":"2024-09-13T18:57:13.517426+0000","last_clean":"2024-09-13T18:57:13.517426+0000","last_became_active":"2024-09-13T18:57:13.511537+0000","last_became_peered":"2024-09-13T18:57:13.511537+0000","last_unstale":"2024-09-13T18:57:13.517426+0000","last_undegraded":"2024-09-13T18:57:13.517426+0000","last_fullsized":"2024-09-13T18:57:13.517426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533503+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.533503+0000","last_peered":"2024-09-13T18:57:13.533503+0000","last_clean":"2024-09-13T18:57:13.533503+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.533503+0000","last_undegraded":"2024-09-13T18:57:13.533503+0000","last_fullsized":"2024-09-13T18:57:13.533503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508616+0000","last_change":"2024-09-13T18:57:13.506092+0000","last_active":"2024-09-13T18:57:13.508616+0000","last_peered":"2024-09-13T18:57:13.508616+0000","last_clean":"2024-09-13T18:57:13.508616+0000","last_became_active":"2024-09-13T18:57:13.505707+0000","last_became_peered":"2024-09-13T18:57:13.505707+0000","last_unstale":"2024-09-13T18:57:13.508616+0000","last_undegraded":"2024-09-13T18:57:13.508616+0000","last_fullsized":"2024-09-13T18:57:13.508616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514701+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.514701+0000","last_peered":"2024-09-13T18:57:13.514701+0000","last_clean":"2024-09-13T18:57:13.514701+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.514701+0000","last_undegraded":"2024-09-13T18:57:13.514701+0000","last_fullsized":"2024-09-13T18:57:13.514701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514016+0000","last_change":"2024-09-13T18:57:13.509609+0000","last_active":"2024-09-13T18:57:13.514016+0000","last_peered":"2024-09-13T18:57:13.514016+0000","last_clean":"2024-09-13T18:57:13.514016+0000","last_became_active":"2024-09-13T18:57:13.509286+0000","last_became_peered":"2024-09-13T18:57:13.509286+0000","last_unstale":"2024-09-13T18:57:13.514016+0000","last_undegraded":"2024-09-13T18:57:13.514016+0000","last_fullsized":"2024-09-13T18:57:13.514016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513159+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.513159+0000","last_peered":"2024-09-13T18:57:13.513159+0000","last_clean":"2024-09-13T18:57:13.513159+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.513159+0000","last_undegraded":"2024-09-13T18:57:13.513159+0000","last_fullsized":"2024-09-13T18:57:13.513159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508734+0000","last_change":"2024-09-13T18:57:13.506462+0000","last_active":"2024-09-13T18:57:13.508734+0000","last_peered":"2024-09-13T18:57:13.508734+0000","last_clean":"2024-09-13T18:57:13.508734+0000","last_became_active":"2024-09-13T18:57:13.506135+0000","last_became_peered":"2024-09-13T18:57:13.506135+0000","last_unstale":"2024-09-13T18:57:13.508734+0000","last_undegraded":"2024-09-13T18:57:13.508734+0000","last_fullsized":"2024-09-13T18:57:13.508734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509681+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.509681+0000","last_peered":"2024-09-13T18:57:13.509681+0000","last_clean":"2024-09-13T18:57:13.509681+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.509681+0000","last_undegraded":"2024-09-13T18:57:13.509681+0000","last_fullsized":"2024-09-13T18:57:13.509681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521125+0000","last_change":"2024-09-13T18:57:13.518635+0000","last_active":"2024-09-13T18:57:13.521125+0000","last_peered":"2024-09-13T18:57:13.521125+0000","last_clean":"2024-09-13T18:57:13.521125+0000","last_became_active":"2024-09-13T18:57:13.518274+0000","last_became_peered":"2024-09-13T18:57:13.518274+0000","last_unstale":"2024-09-13T18:57:13.521125+0000","last_undegraded":"2024-09-13T18:57:13.521125+0000","last_fullsized":"2024-09-13T18:57:13.521125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512870+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.512870+0000","last_peered":"2024-09-13T18:57:13.512870+0000","last_clean":"2024-09-13T18:57:13.512870+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.512870+0000","last_undegraded":"2024-09-13T18:57:13.512870+0000","last_fullsized":"2024-09-13T18:57:13.512870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527414+0000","last_change":"2024-09-13T18:57:13.515449+0000","last_active":"2024-09-13T18:57:13.527414+0000","last_peered":"2024-09-13T18:57:13.527414+0000","last_clean":"2024-09-13T18:57:13.527414+0000","last_became_active":"2024-09-13T18:57:13.514478+0000","last_became_peered":"2024-09-13T18:57:13.514478+0000","last_unstale":"2024-09-13T18:57:13.527414+0000","last_undegraded":"2024-09-13T18:57:13.527414+0000","last_fullsized":"2024-09-13T18:57:13.527414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514267+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.514267+0000","last_peered":"2024-09-13T18:57:13.514267+0000","last_clean":"2024-09-13T18:57:13.514267+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.514267+0000","last_undegraded":"2024-09-13T18:57:13.514267+0000","last_fullsized":"2024-09-13T18:57:13.514267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509295+0000","last_change":"2024-09-13T18:57:13.506875+0000","last_active":"2024-09-13T18:57:13.509295+0000","last_peered":"2024-09-13T18:57:13.509295+0000","last_clean":"2024-09-13T18:57:13.509295+0000","last_became_active":"2024-09-13T18:57:13.506471+0000","last_became_peered":"2024-09-13T18:57:13.506471+0000","last_unstale":"2024-09-13T18:57:13.509295+0000","last_undegraded":"2024-09-13T18:57:13.509295+0000","last_fullsized":"2024-09-13T18:57:13.509295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.505344+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.505344+0000","last_peered":"2024-09-13T18:57:13.505344+0000","last_clean":"2024-09-13T18:57:13.505344+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.505344+0000","last_undegraded":"2024-09-13T18:57:13.505344+0000","last_fullsized":"2024-09-13T18:57:13.505344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527382+0000","last_change":"2024-09-13T18:57:13.514665+0000","last_active":"2024-09-13T18:57:13.527382+0000","last_peered":"2024-09-13T18:57:13.527382+0000","last_clean":"2024-09-13T18:57:13.527382+0000","last_became_active":"2024-09-13T18:57:13.514373+0000","last_became_peered":"2024-09-13T18:57:13.514373+0000","last_unstale":"2024-09-13T18:57:13.527382+0000","last_undegraded":"2024-09-13T18:57:13.527382+0000","last_fullsized":"2024-09-13T18:57:13.527382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517258+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.517258+0000","last_peered":"2024-09-13T18:57:13.517258+0000","last_clean":"2024-09-13T18:57:13.517258+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.517258+0000","last_undegraded":"2024-09-13T18:57:13.517258+0000","last_fullsized":"2024-09-13T18:57:13.517258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528889+0000","last_change":"2024-09-13T18:57:13.521314+0000","last_active":"2024-09-13T18:57:13.528889+0000","last_peered":"2024-09-13T18:57:13.528889+0000","last_clean":"2024-09-13T18:57:13.528889+0000","last_became_active":"2024-09-13T18:57:13.519808+0000","last_became_peered":"2024-09-13T18:57:13.519808+0000","last_unstale":"2024-09-13T18:57:13.528889+0000","last_undegraded":"2024-09-13T18:57:13.528889+0000","last_fullsized":"2024-09-13T18:57:13.528889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487827+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.487827+0000","last_peered":"2024-09-13T18:57:13.487827+0000","last_clean":"2024-09-13T18:57:13.487827+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.487827+0000","last_undegraded":"2024-09-13T18:57:13.487827+0000","last_fullsized":"2024-09-13T18:57:13.487827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528931+0000","last_change":"2024-09-13T18:57:13.523066+0000","last_active":"2024-09-13T18:57:13.528931+0000","last_peered":"2024-09-13T18:57:13.528931+0000","last_clean":"2024-09-13T18:57:13.528931+0000","last_became_active":"2024-09-13T18:57:13.522829+0000","last_became_peered":"2024-09-13T18:57:13.522829+0000","last_unstale":"2024-09-13T18:57:13.528931+0000","last_undegraded":"2024-09-13T18:57:13.528931+0000","last_fullsized":"2024-09-13T18:57:13.528931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491602+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:13.491602+0000","last_peered":"2024-09-13T18:57:13.491602+0000","last_clean":"2024-09-13T18:57:13.491602+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:13.491602+0000","last_undegraded":"2024-09-13T18:57:13.491602+0000","last_fullsized":"2024-09-13T18:57:13.491602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.502901+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.502901+0000","last_peered":"2024-09-13T18:57:13.502901+0000","last_clean":"2024-09-13T18:57:13.502901+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.502901+0000","last_undegraded":"2024-09-13T18:57:13.502901+0000","last_fullsized":"2024-09-13T18:57:13.502901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533279+0000","last_change":"2024-09-13T18:57:13.531524+0000","last_active":"2024-09-13T18:57:13.533279+0000","last_peered":"2024-09-13T18:57:13.533279+0000","last_clean":"2024-09-13T18:57:13.533279+0000","last_became_active":"2024-09-13T18:57:13.530731+0000","last_became_peered":"2024-09-13T18:57:13.530731+0000","last_unstale":"2024-09-13T18:57:13.533279+0000","last_undegraded":"2024-09-13T18:57:13.533279+0000","last_fullsized":"2024-09-13T18:57:13.533279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491503+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.491503+0000","last_peered":"2024-09-13T18:57:13.491503+0000","last_clean":"2024-09-13T18:57:13.491503+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.491503+0000","last_undegraded":"2024-09-13T18:57:13.491503+0000","last_fullsized":"2024-09-13T18:57:13.491503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511770+0000","last_change":"2024-09-13T18:57:13.505735+0000","last_active":"2024-09-13T18:57:13.511770+0000","last_peered":"2024-09-13T18:57:13.511770+0000","last_clean":"2024-09-13T18:57:13.511770+0000","last_became_active":"2024-09-13T18:57:13.505442+0000","last_became_peered":"2024-09-13T18:57:13.505442+0000","last_unstale":"2024-09-13T18:57:13.511770+0000","last_undegraded":"2024-09-13T18:57:13.511770+0000","last_fullsized":"2024-09-13T18:57:13.511770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487814+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.487814+0000","last_peered":"2024-09-13T18:57:13.487814+0000","last_clean":"2024-09-13T18:57:13.487814+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.487814+0000","last_undegraded":"2024-09-13T18:57:13.487814+0000","last_fullsized":"2024-09-13T18:57:13.487814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514688+0000","last_change":"2024-09-13T18:57:13.509025+0000","last_active":"2024-09-13T18:57:13.514688+0000","last_peered":"2024-09-13T18:57:13.514688+0000","last_clean":"2024-09-13T18:57:13.514688+0000","last_became_active":"2024-09-13T18:57:13.508745+0000","last_became_peered":"2024-09-13T18:57:13.508745+0000","last_unstale":"2024-09-13T18:57:13.514688+0000","last_undegraded":"2024-09-13T18:57:13.514688+0000","last_fullsized":"2024-09-13T18:57:13.514688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513426+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.513426+0000","last_peered":"2024-09-13T18:57:13.513426+0000","last_clean":"2024-09-13T18:57:13.513426+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.513426+0000","last_undegraded":"2024-09-13T18:57:13.513426+0000","last_fullsized":"2024-09-13T18:57:13.513426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519326+0000","last_change":"2024-09-13T18:57:13.517447+0000","last_active":"2024-09-13T18:57:13.519326+0000","last_peered":"2024-09-13T18:57:13.519326+0000","last_clean":"2024-09-13T18:57:13.519326+0000","last_became_active":"2024-09-13T18:57:13.514845+0000","last_became_peered":"2024-09-13T18:57:13.514845+0000","last_unstale":"2024-09-13T18:57:13.519326+0000","last_undegraded":"2024-09-13T18:57:13.519326+0000","last_fullsized":"2024-09-13T18:57:13.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492184+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.492184+0000","last_peered":"2024-09-13T18:57:13.492184+0000","last_clean":"2024-09-13T18:57:13.492184+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.492184+0000","last_undegraded":"2024-09-13T18:57:13.492184+0000","last_fullsized":"2024-09-13T18:57:13.492184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530696+0000","last_change":"2024-09-13T18:57:13.527647+0000","last_active":"2024-09-13T18:57:13.530696+0000","last_peered":"2024-09-13T18:57:13.530696+0000","last_clean":"2024-09-13T18:57:13.530696+0000","last_became_active":"2024-09-13T18:57:13.519711+0000","last_became_peered":"2024-09-13T18:57:13.519711+0000","last_unstale":"2024-09-13T18:57:13.530696+0000","last_undegraded":"2024-09-13T18:57:13.530696+0000","last_fullsized":"2024-09-13T18:57:13.530696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492981+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.492981+0000","last_peered":"2024-09-13T18:57:13.492981+0000","last_clean":"2024-09-13T18:57:13.492981+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.492981+0000","last_undegraded":"2024-09-13T18:57:13.492981+0000","last_fullsized":"2024-09-13T18:57:13.492981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514488+0000","last_change":"2024-09-13T18:57:13.507458+0000","last_active":"2024-09-13T18:57:13.514488+0000","last_peered":"2024-09-13T18:57:13.514488+0000","last_clean":"2024-09-13T18:57:13.514488+0000","last_became_active":"2024-09-13T18:57:13.507163+0000","last_became_peered":"2024-09-13T18:57:13.507163+0000","last_unstale":"2024-09-13T18:57:13.514488+0000","last_undegraded":"2024-09-13T18:57:13.514488+0000","last_fullsized":"2024-09-13T18:57:13.514488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492111+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:13.492111+0000","last_peered":"2024-09-13T18:57:13.492111+0000","last_clean":"2024-09-13T18:57:13.492111+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:13.492111+0000","last_undegraded":"2024-09-13T18:57:13.492111+0000","last_fullsized":"2024-09-13T18:57:13.492111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513838+0000","last_change":"2024-09-13T18:57:13.508509+0000","last_active":"2024-09-13T18:57:13.513838+0000","last_peered":"2024-09-13T18:57:13.513838+0000","last_clean":"2024-09-13T18:57:13.513838+0000","last_became_active":"2024-09-13T18:57:13.508215+0000","last_became_peered":"2024-09-13T18:57:13.508215+0000","last_unstale":"2024-09-13T18:57:13.513838+0000","last_undegraded":"2024-09-13T18:57:13.513838+0000","last_fullsized":"2024-09-13T18:57:13.513838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529311+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.529311+0000","last_peered":"2024-09-13T18:57:13.529311+0000","last_clean":"2024-09-13T18:57:13.529311+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.529311+0000","last_undegraded":"2024-09-13T18:57:13.529311+0000","last_fullsized":"2024-09-13T18:57:13.529311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515857+0000","last_change":"2024-09-13T18:57:13.509453+0000","last_active":"2024-09-13T18:57:13.515857+0000","last_peered":"2024-09-13T18:57:13.515857+0000","last_clean":"2024-09-13T18:57:13.515857+0000","last_became_active":"2024-09-13T18:57:13.509188+0000","last_became_peered":"2024-09-13T18:57:13.509188+0000","last_unstale":"2024-09-13T18:57:13.515857+0000","last_undegraded":"2024-09-13T18:57:13.515857+0000","last_fullsized":"2024-09-13T18:57:13.515857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.490795+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.490795+0000","last_peered":"2024-09-13T18:57:13.490795+0000","last_clean":"2024-09-13T18:57:13.490795+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.490795+0000","last_undegraded":"2024-09-13T18:57:13.490795+0000","last_fullsized":"2024-09-13T18:57:13.490795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511536+0000","last_change":"2024-09-13T18:57:13.506172+0000","last_active":"2024-09-13T18:57:13.511536+0000","last_peered":"2024-09-13T18:57:13.511536+0000","last_clean":"2024-09-13T18:57:13.511536+0000","last_became_active":"2024-09-13T18:57:13.503964+0000","last_became_peered":"2024-09-13T18:57:13.503964+0000","last_unstale":"2024-09-13T18:57:13.511536+0000","last_undegraded":"2024-09-13T18:57:13.511536+0000","last_fullsized":"2024-09-13T18:57:13.511536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492922+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.492922+0000","last_peered":"2024-09-13T18:57:13.492922+0000","last_clean":"2024-09-13T18:57:13.492922+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.492922+0000","last_undegraded":"2024-09-13T18:57:13.492922+0000","last_fullsized":"2024-09-13T18:57:13.492922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513953+0000","last_change":"2024-09-13T18:57:13.508906+0000","last_active":"2024-09-13T18:57:13.513953+0000","last_peered":"2024-09-13T18:57:13.513953+0000","last_clean":"2024-09-13T18:57:13.513953+0000","last_became_active":"2024-09-13T18:57:13.508586+0000","last_became_peered":"2024-09-13T18:57:13.508586+0000","last_unstale":"2024-09-13T18:57:13.513953+0000","last_undegraded":"2024-09-13T18:57:13.513953+0000","last_fullsized":"2024-09-13T18:57:13.513953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492144+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.492144+0000","last_peered":"2024-09-13T18:57:13.492144+0000","last_clean":"2024-09-13T18:57:13.492144+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.492144+0000","last_undegraded":"2024-09-13T18:57:13.492144+0000","last_fullsized":"2024-09-13T18:57:13.492144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519057+0000","last_change":"2024-09-13T18:57:13.514983+0000","last_active":"2024-09-13T18:57:13.519057+0000","last_peered":"2024-09-13T18:57:13.519057+0000","last_clean":"2024-09-13T18:57:13.519057+0000","last_became_active":"2024-09-13T18:57:13.514654+0000","last_became_peered":"2024-09-13T18:57:13.514654+0000","last_unstale":"2024-09-13T18:57:13.519057+0000","last_undegraded":"2024-09-13T18:57:13.519057+0000","last_fullsized":"2024-09-13T18:57:13.519057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515394+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.515394+0000","last_peered":"2024-09-13T18:57:13.515394+0000","last_clean":"2024-09-13T18:57:13.515394+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.515394+0000","last_undegraded":"2024-09-13T18:57:13.515394+0000","last_fullsized":"2024-09-13T18:57:13.515394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521183+0000","last_change":"2024-09-13T18:57:13.518795+0000","last_active":"2024-09-13T18:57:13.521183+0000","last_peered":"2024-09-13T18:57:13.521183+0000","last_clean":"2024-09-13T18:57:13.521183+0000","last_became_active":"2024-09-13T18:57:13.518511+0000","last_became_peered":"2024-09-13T18:57:13.518511+0000","last_unstale":"2024-09-13T18:57:13.521183+0000","last_undegraded":"2024-09-13T18:57:13.521183+0000","last_fullsized":"2024-09-13T18:57:13.521183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530132+0000","last_change":"2024-09-13T18:57:13.520031+0000","last_active":"2024-09-13T18:57:13.530132+0000","last_peered":"2024-09-13T18:57:13.530132+0000","last_clean":"2024-09-13T18:57:13.530132+0000","last_became_active":"2024-09-13T18:57:13.519735+0000","last_became_peered":"2024-09-13T18:57:13.519735+0000","last_unstale":"2024-09-13T18:57:13.530132+0000","last_undegraded":"2024-09-13T18:57:13.530132+0000","last_fullsized":"2024-09-13T18:57:13.530132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527444+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.527444+0000","last_peered":"2024-09-13T18:57:13.527444+0000","last_clean":"2024-09-13T18:57:13.527444+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.527444+0000","last_undegraded":"2024-09-13T18:57:13.527444+0000","last_fullsized":"2024-09-13T18:57:13.527444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533197+0000","last_change":"2024-09-13T18:57:13.530720+0000","last_active":"2024-09-13T18:57:13.533197+0000","last_peered":"2024-09-13T18:57:13.533197+0000","last_clean":"2024-09-13T18:57:13.533197+0000","last_became_active":"2024-09-13T18:57:13.528690+0000","last_became_peered":"2024-09-13T18:57:13.528690+0000","last_unstale":"2024-09-13T18:57:13.533197+0000","last_undegraded":"2024-09-13T18:57:13.533197+0000","last_fullsized":"2024-09-13T18:57:13.533197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508167+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.508167+0000","last_peered":"2024-09-13T18:57:13.508167+0000","last_clean":"2024-09-13T18:57:13.508167+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.508167+0000","last_undegraded":"2024-09-13T18:57:13.508167+0000","last_fullsized":"2024-09-13T18:57:13.508167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528047+0000","last_change":"2024-09-13T18:57:13.526450+0000","last_active":"2024-09-13T18:57:13.528047+0000","last_peered":"2024-09-13T18:57:13.528047+0000","last_clean":"2024-09-13T18:57:13.528047+0000","last_became_active":"2024-09-13T18:57:13.526209+0000","last_became_peered":"2024-09-13T18:57:13.526209+0000","last_unstale":"2024-09-13T18:57:13.528047+0000","last_undegraded":"2024-09-13T18:57:13.528047+0000","last_fullsized":"2024-09-13T18:57:13.528047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514722+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.514722+0000","last_peered":"2024-09-13T18:57:13.514722+0000","last_clean":"2024-09-13T18:57:13.514722+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.514722+0000","last_undegraded":"2024-09-13T18:57:13.514722+0000","last_fullsized":"2024-09-13T18:57:13.514722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527482+0000","last_change":"2024-09-13T18:57:13.523510+0000","last_active":"2024-09-13T18:57:13.527482+0000","last_peered":"2024-09-13T18:57:13.527482+0000","last_clean":"2024-09-13T18:57:13.527482+0000","last_became_active":"2024-09-13T18:57:13.522734+0000","last_became_peered":"2024-09-13T18:57:13.522734+0000","last_unstale":"2024-09-13T18:57:13.527482+0000","last_undegraded":"2024-09-13T18:57:13.527482+0000","last_fullsized":"2024-09-13T18:57:13.527482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.523574+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.523574+0000","last_peered":"2024-09-13T18:57:13.523574+0000","last_clean":"2024-09-13T18:57:13.523574+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.523574+0000","last_undegraded":"2024-09-13T18:57:13.523574+0000","last_fullsized":"2024-09-13T18:57:13.523574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:22.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.520+0000 7f1b97e00640 1 Processor -- start 2024-09-13T18:57:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.521+0000 7f1b97e00640 1 -- start start 2024-09-13T18:57:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 0x7f1b9815d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 0x7f1b9815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980b1e00 con 0x7f1b9815fa70 2024-09-13T18:57:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9815dbe0 con 0x7f1b980acf80 2024-09-13T18:57:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980b3230 con 0x7f1b980afe10 2024-09-13T18:57:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b96a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1b9815fa70 0x7f1b980ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36686/0 (socket says 172.21.15.33:36686) 2024-09-13T18:57:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b96a00640 1 -- 172.21.15.33:0/3676098021 learned_addr learned my addr 172.21.15.33:0/3676098021 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b97400640 1 --2- 172.21.15.33:0/3676098021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 0x7f1b9815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.522+0000 7f1b96000640 1 --2- 172.21.15.33:0/3676098021 >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 0x7f1b9815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b95600640 1 -- 172.21.15.33:0/3676098021 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663393250 0 0) 0x7f1b980b1e00 con 0x7f1b9815fa70 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b95600640 1 -- 172.21.15.33:0/3676098021 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b7c003520 con 0x7f1b9815fa70 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b97400640 1 -- 172.21.15.33:0/3676098021 >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 msgr2=0x7f1b9815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b97400640 1 --2- 172.21.15.33:0/3676098021 >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 0x7f1b9815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b97400640 1 -- 172.21.15.33:0/3676098021 >> v1:172.21.15.33:6789/0 conn(0x7f1b9815fa70 legacy=0x7f1b980ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b97400640 1 -- 172.21.15.33:0/3676098021 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980b1840 con 0x7f1b980afe10 2024-09-13T18:57:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.523+0000 7f1b96000640 1 --2- 172.21.15.33:0/3676098021 >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 0x7f1b9815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.524+0000 7f1b97400640 1 --2- 172.21.15.33:0/3676098021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 0x7f1b9815dd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b900097a0 tx=0x7f1b9002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a14059648a80a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.524+0000 7f1b95600640 1 -- 172.21.15.33:0/3676098021 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9002ae40 con 0x7f1b980afe10 2024-09-13T18:57:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.524+0000 7f1b95600640 1 -- 172.21.15.33:0/3676098021 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90032440 con 0x7f1b980afe10 2024-09-13T18:57:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.524+0000 7f1b95600640 1 -- 172.21.15.33:0/3676098021 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900327d0 con 0x7f1b980afe10 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 -- 172.21.15.33:0/3676098021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 msgr2=0x7f1b9815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 --2- 172.21.15.33:0/3676098021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 0x7f1b9815dd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b900097a0 tx=0x7f1b9002a0f0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 -- 172.21.15.33:0/3676098021 shutdown_connections 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 --2- 172.21.15.33:0/3676098021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980afe10 0x7f1b9815dd40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 --2- 172.21.15.33:0/3676098021 >> v2:172.21.15.103:3300/0 conn(0x7f1b980acf80 0x7f1b9815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 -- 172.21.15.33:0/3676098021 >> 172.21.15.33:0/3676098021 conn(0x7f1b980ae310 msgr2=0x7f1b980ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 -- 172.21.15.33:0/3676098021 shutdown_connections 2024-09-13T18:57:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.525+0000 7f1b97e00640 1 -- 172.21.15.33:0/3676098021 wait complete. 2024-09-13T18:57:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.527+0000 7f1b97e00640 1 Processor -- start 2024-09-13T18:57:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.527+0000 7f1b97e00640 1 -- start start 2024-09-13T18:57:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980acf80 0x7f1b98157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b9815fa70 0x7f1b98144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98151f20 con 0x7f1b980afe10 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98152200 con 0x7f1b9815fa70 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b981524e0 con 0x7f1b980acf80 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60796/0 (socket says 172.21.15.33:60796) 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 -- 172.21.15.33:0/1049139976 learned_addr learned my addr 172.21.15.33:0/1049139976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96a00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980acf80 0x7f1b98157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b97400640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b9815fa70 0x7f1b98144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 -- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980acf80 msgr2=0x7f1b98157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980acf80 0x7f1b98157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 -- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b9815fa70 msgr2=0x7f1b98144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b9815fa70 0x7f1b98144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.528+0000 7f1b96000640 1 -- 172.21.15.33:0/1049139976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84009400 con 0x7f1b980afe10 2024-09-13T18:57:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b96000640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e8d0 tx=0x7f1b8400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400c940 con 0x7f1b980afe10 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400caa0 con 0x7f1b980afe10 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400ce50 con 0x7f1b980afe10 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b90009400 con 0x7f1b980afe10 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.529+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98152aa0 con 0x7f1b980afe10 2024-09-13T18:57:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.530+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98067360 con 0x7f1b980afe10 2024-09-13T18:57:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.531+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b84013470 con 0x7f1b980afe10 2024-09-13T18:57:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.532+0000 7f1b8ea00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 0x7f1b7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.532+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b84089220 con 0x7f1b980afe10 2024-09-13T18:57:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.533+0000 7f1b96a00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 0x7f1b7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.533+0000 7f1b96a00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 0x7f1b7806d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b88005c00 tx=0x7f1b88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.537+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b84054410 con 0x7f1b980afe10 2024-09-13T18:57:22.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.715+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b980ad610 con 0x7f1b7806ac00 2024-09-13T18:57:22.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.722+0000 7f1b8ea00640 1 -- 172.21.15.33:0/1049139976 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264729 (secure 0 0 0) 0x7f1b88001f60 con 0x7f1b7806ac00 2024-09-13T18:57:22.728 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:22.729 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 msgr2=0x7f1b7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 0x7f1b7806d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b88005c00 tx=0x7f1b88009040 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 msgr2=0x7f1b98154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e8d0 tx=0x7f1b8400ed90 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 shutdown_connections 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1b7806ac00 0x7f1b7806d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b9815fa70 0x7f1b98144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b980afe10 0x7f1b98154800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 --2- 172.21.15.33:0/1049139976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1b980acf80 0x7f1b98157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 >> 172.21.15.33:0/1049139976 conn(0x7f1b980ae310 msgr2=0x7f1b9806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 shutdown_connections 2024-09-13T18:57:22.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.726+0000 7f1b97e00640 1 -- 172.21.15.33:0/1049139976 wait complete. 2024-09-13T18:57:22.744 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T18:57:21.096650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001893"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528800+0000","last_change":"2024-09-13T18:57:13.522419+0000","last_active":"2024-09-13T18:57:13.528800+0000","last_peered":"2024-09-13T18:57:13.528800+0000","last_clean":"2024-09-13T18:57:13.528800+0000","last_became_active":"2024-09-13T18:57:13.521011+0000","last_became_peered":"2024-09-13T18:57:13.521011+0000","last_unstale":"2024-09-13T18:57:13.528800+0000","last_undegraded":"2024-09-13T18:57:13.528800+0000","last_fullsized":"2024-09-13T18:57:13.528800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514821+0000","last_change":"2024-09-13T18:57:13.510107+0000","last_active":"2024-09-13T18:57:13.514821+0000","last_peered":"2024-09-13T18:57:13.514821+0000","last_clean":"2024-09-13T18:57:13.514821+0000","last_became_active":"2024-09-13T18:57:13.509853+0000","last_became_peered":"2024-09-13T18:57:13.509853+0000","last_unstale":"2024-09-13T18:57:13.514821+0000","last_undegraded":"2024-09-13T18:57:13.514821+0000","last_fullsized":"2024-09-13T18:57:13.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513869+0000","last_change":"2024-09-13T18:57:13.508765+0000","last_active":"2024-09-13T18:57:13.513869+0000","last_peered":"2024-09-13T18:57:13.513869+0000","last_clean":"2024-09-13T18:57:13.513869+0000","last_became_active":"2024-09-13T18:57:13.508499+0000","last_became_peered":"2024-09-13T18:57:13.508499+0000","last_unstale":"2024-09-13T18:57:13.513869+0000","last_undegraded":"2024-09-13T18:57:13.513869+0000","last_fullsized":"2024-09-13T18:57:13.513869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528909+0000","last_change":"2024-09-13T18:57:13.525713+0000","last_active":"2024-09-13T18:57:13.528909+0000","last_peered":"2024-09-13T18:57:13.528909+0000","last_clean":"2024-09-13T18:57:13.528909+0000","last_became_active":"2024-09-13T18:57:13.521390+0000","last_became_peered":"2024-09-13T18:57:13.521390+0000","last_unstale":"2024-09-13T18:57:13.528909+0000","last_undegraded":"2024-09-13T18:57:13.528909+0000","last_fullsized":"2024-09-13T18:57:13.528909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510856+0000","last_change":"2024-09-13T18:57:13.508469+0000","last_active":"2024-09-13T18:57:13.510856+0000","last_peered":"2024-09-13T18:57:13.510856+0000","last_clean":"2024-09-13T18:57:13.510856+0000","last_became_active":"2024-09-13T18:57:13.507301+0000","last_became_peered":"2024-09-13T18:57:13.507301+0000","last_unstale":"2024-09-13T18:57:13.510856+0000","last_undegraded":"2024-09-13T18:57:13.510856+0000","last_fullsized":"2024-09-13T18:57:13.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530319+0000","last_change":"2024-09-13T18:57:13.528886+0000","last_active":"2024-09-13T18:57:13.530319+0000","last_peered":"2024-09-13T18:57:13.530319+0000","last_clean":"2024-09-13T18:57:13.530319+0000","last_became_active":"2024-09-13T18:57:13.528181+0000","last_became_peered":"2024-09-13T18:57:13.528181+0000","last_unstale":"2024-09-13T18:57:13.530319+0000","last_undegraded":"2024-09-13T18:57:13.530319+0000","last_fullsized":"2024-09-13T18:57:13.530319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511278+0000","last_change":"2024-09-13T18:57:13.509845+0000","last_active":"2024-09-13T18:57:13.511278+0000","last_peered":"2024-09-13T18:57:13.511278+0000","last_clean":"2024-09-13T18:57:13.511278+0000","last_became_active":"2024-09-13T18:57:13.509457+0000","last_became_peered":"2024-09-13T18:57:13.509457+0000","last_unstale":"2024-09-13T18:57:13.511278+0000","last_undegraded":"2024-09-13T18:57:13.511278+0000","last_fullsized":"2024-09-13T18:57:13.511278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532810+0000","last_change":"2024-09-13T18:57:13.528197+0000","last_active":"2024-09-13T18:57:13.532810+0000","last_peered":"2024-09-13T18:57:13.532810+0000","last_clean":"2024-09-13T18:57:13.532810+0000","last_became_active":"2024-09-13T18:57:13.527837+0000","last_became_peered":"2024-09-13T18:57:13.527837+0000","last_unstale":"2024-09-13T18:57:13.532810+0000","last_undegraded":"2024-09-13T18:57:13.532810+0000","last_fullsized":"2024-09-13T18:57:13.532810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528817+0000","last_change":"2024-09-13T18:57:13.522966+0000","last_active":"2024-09-13T18:57:13.528817+0000","last_peered":"2024-09-13T18:57:13.528817+0000","last_clean":"2024-09-13T18:57:13.528817+0000","last_became_active":"2024-09-13T18:57:13.522718+0000","last_became_peered":"2024-09-13T18:57:13.522718+0000","last_unstale":"2024-09-13T18:57:13.528817+0000","last_undegraded":"2024-09-13T18:57:13.528817+0000","last_fullsized":"2024-09-13T18:57:13.528817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532479+0000","last_change":"2024-09-13T18:57:13.530108+0000","last_active":"2024-09-13T18:57:13.532479+0000","last_peered":"2024-09-13T18:57:13.532479+0000","last_clean":"2024-09-13T18:57:13.532479+0000","last_became_active":"2024-09-13T18:57:13.529856+0000","last_became_peered":"2024-09-13T18:57:13.529856+0000","last_unstale":"2024-09-13T18:57:13.532479+0000","last_undegraded":"2024-09-13T18:57:13.532479+0000","last_fullsized":"2024-09-13T18:57:13.532479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532940+0000","last_change":"2024-09-13T18:57:13.531905+0000","last_active":"2024-09-13T18:57:13.532940+0000","last_peered":"2024-09-13T18:57:13.532940+0000","last_clean":"2024-09-13T18:57:13.532940+0000","last_became_active":"2024-09-13T18:57:13.531582+0000","last_became_peered":"2024-09-13T18:57:13.531582+0000","last_unstale":"2024-09-13T18:57:13.532940+0000","last_undegraded":"2024-09-13T18:57:13.532940+0000","last_fullsized":"2024-09-13T18:57:13.532940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529009+0000","last_change":"2024-09-13T18:57:13.526125+0000","last_active":"2024-09-13T18:57:13.529009+0000","last_peered":"2024-09-13T18:57:13.529009+0000","last_clean":"2024-09-13T18:57:13.529009+0000","last_became_active":"2024-09-13T18:57:13.525706+0000","last_became_peered":"2024-09-13T18:57:13.525706+0000","last_unstale":"2024-09-13T18:57:13.529009+0000","last_undegraded":"2024-09-13T18:57:13.529009+0000","last_fullsized":"2024-09-13T18:57:13.529009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520064+0000","last_change":"2024-09-13T18:57:13.518913+0000","last_active":"2024-09-13T18:57:13.520064+0000","last_peered":"2024-09-13T18:57:13.520064+0000","last_clean":"2024-09-13T18:57:13.520064+0000","last_became_active":"2024-09-13T18:57:13.518381+0000","last_became_peered":"2024-09-13T18:57:13.518381+0000","last_unstale":"2024-09-13T18:57:13.520064+0000","last_undegraded":"2024-09-13T18:57:13.520064+0000","last_fullsized":"2024-09-13T18:57:13.520064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515917+0000","last_change":"2024-09-13T18:57:13.510462+0000","last_active":"2024-09-13T18:57:13.515917+0000","last_peered":"2024-09-13T18:57:13.515917+0000","last_clean":"2024-09-13T18:57:13.515917+0000","last_became_active":"2024-09-13T18:57:13.510058+0000","last_became_peered":"2024-09-13T18:57:13.510058+0000","last_unstale":"2024-09-13T18:57:13.515917+0000","last_undegraded":"2024-09-13T18:57:13.515917+0000","last_fullsized":"2024-09-13T18:57:13.515917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512044+0000","last_change":"2024-09-13T18:57:13.504104+0000","last_active":"2024-09-13T18:57:13.512044+0000","last_peered":"2024-09-13T18:57:13.512044+0000","last_clean":"2024-09-13T18:57:13.512044+0000","last_became_active":"2024-09-13T18:57:13.503287+0000","last_became_peered":"2024-09-13T18:57:13.503287+0000","last_unstale":"2024-09-13T18:57:13.512044+0000","last_undegraded":"2024-09-13T18:57:13.512044+0000","last_fullsized":"2024-09-13T18:57:13.512044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533192+0000","last_change":"2024-09-13T18:57:13.530559+0000","last_active":"2024-09-13T18:57:13.533192+0000","last_peered":"2024-09-13T18:57:13.533192+0000","last_clean":"2024-09-13T18:57:13.533192+0000","last_became_active":"2024-09-13T18:57:13.528317+0000","last_became_peered":"2024-09-13T18:57:13.528317+0000","last_unstale":"2024-09-13T18:57:13.533192+0000","last_undegraded":"2024-09-13T18:57:13.533192+0000","last_fullsized":"2024-09-13T18:57:13.533192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529757+0000","last_change":"2024-09-13T18:57:13.513604+0000","last_active":"2024-09-13T18:57:13.529757+0000","last_peered":"2024-09-13T18:57:13.529757+0000","last_clean":"2024-09-13T18:57:13.529757+0000","last_became_active":"2024-09-13T18:57:13.512484+0000","last_became_peered":"2024-09-13T18:57:13.512484+0000","last_unstale":"2024-09-13T18:57:13.529757+0000","last_undegraded":"2024-09-13T18:57:13.529757+0000","last_fullsized":"2024-09-13T18:57:13.529757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520879+0000","last_change":"2024-09-13T18:57:13.520180+0000","last_active":"2024-09-13T18:57:13.520879+0000","last_peered":"2024-09-13T18:57:13.520879+0000","last_clean":"2024-09-13T18:57:13.520879+0000","last_became_active":"2024-09-13T18:57:13.519896+0000","last_became_peered":"2024-09-13T18:57:13.519896+0000","last_unstale":"2024-09-13T18:57:13.520879+0000","last_undegraded":"2024-09-13T18:57:13.520879+0000","last_fullsized":"2024-09-13T18:57:13.520879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510733+0000","last_change":"2024-09-13T18:57:13.507930+0000","last_active":"2024-09-13T18:57:13.510733+0000","last_peered":"2024-09-13T18:57:13.510733+0000","last_clean":"2024-09-13T18:57:13.510733+0000","last_became_active":"2024-09-13T18:57:13.507657+0000","last_became_peered":"2024-09-13T18:57:13.507657+0000","last_unstale":"2024-09-13T18:57:13.510733+0000","last_undegraded":"2024-09-13T18:57:13.510733+0000","last_fullsized":"2024-09-13T18:57:13.510733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529867+0000","last_change":"2024-09-13T18:57:13.525532+0000","last_active":"2024-09-13T18:57:13.529867+0000","last_peered":"2024-09-13T18:57:13.529867+0000","last_clean":"2024-09-13T18:57:13.529867+0000","last_became_active":"2024-09-13T18:57:13.525230+0000","last_became_peered":"2024-09-13T18:57:13.525230+0000","last_unstale":"2024-09-13T18:57:13.529867+0000","last_undegraded":"2024-09-13T18:57:13.529867+0000","last_fullsized":"2024-09-13T18:57:13.529867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515961+0000","last_change":"2024-09-13T18:57:13.512432+0000","last_active":"2024-09-13T18:57:13.515961+0000","last_peered":"2024-09-13T18:57:13.515961+0000","last_clean":"2024-09-13T18:57:13.515961+0000","last_became_active":"2024-09-13T18:57:13.509317+0000","last_became_peered":"2024-09-13T18:57:13.509317+0000","last_unstale":"2024-09-13T18:57:13.515961+0000","last_undegraded":"2024-09-13T18:57:13.515961+0000","last_fullsized":"2024-09-13T18:57:13.515961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528774+0000","last_change":"2024-09-13T18:57:13.520560+0000","last_active":"2024-09-13T18:57:13.528774+0000","last_peered":"2024-09-13T18:57:13.528774+0000","last_clean":"2024-09-13T18:57:13.528774+0000","last_became_active":"2024-09-13T18:57:13.520315+0000","last_became_peered":"2024-09-13T18:57:13.520315+0000","last_unstale":"2024-09-13T18:57:13.528774+0000","last_undegraded":"2024-09-13T18:57:13.528774+0000","last_fullsized":"2024-09-13T18:57:13.528774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512275+0000","last_change":"2024-09-13T18:57:13.502348+0000","last_active":"2024-09-13T18:57:13.512275+0000","last_peered":"2024-09-13T18:57:13.512275+0000","last_clean":"2024-09-13T18:57:13.512275+0000","last_became_active":"2024-09-13T18:57:13.502087+0000","last_became_peered":"2024-09-13T18:57:13.502087+0000","last_unstale":"2024-09-13T18:57:13.512275+0000","last_undegraded":"2024-09-13T18:57:13.512275+0000","last_fullsized":"2024-09-13T18:57:13.512275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531361+0000","last_change":"2024-09-13T18:57:13.527672+0000","last_active":"2024-09-13T18:57:13.531361+0000","last_peered":"2024-09-13T18:57:13.531361+0000","last_clean":"2024-09-13T18:57:13.531361+0000","last_became_active":"2024-09-13T18:57:13.521290+0000","last_became_peered":"2024-09-13T18:57:13.521290+0000","last_unstale":"2024-09-13T18:57:13.531361+0000","last_undegraded":"2024-09-13T18:57:13.531361+0000","last_fullsized":"2024-09-13T18:57:13.531361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513821+0000","last_change":"2024-09-13T18:57:13.505357+0000","last_active":"2024-09-13T18:57:13.513821+0000","last_peered":"2024-09-13T18:57:13.513821+0000","last_clean":"2024-09-13T18:57:13.513821+0000","last_became_active":"2024-09-13T18:57:13.503764+0000","last_became_peered":"2024-09-13T18:57:13.503764+0000","last_unstale":"2024-09-13T18:57:13.513821+0000","last_undegraded":"2024-09-13T18:57:13.513821+0000","last_fullsized":"2024-09-13T18:57:13.513821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.525997+0000","last_change":"2024-09-13T18:57:13.520078+0000","last_active":"2024-09-13T18:57:13.525997+0000","last_peered":"2024-09-13T18:57:13.525997+0000","last_clean":"2024-09-13T18:57:13.525997+0000","last_became_active":"2024-09-13T18:57:13.519088+0000","last_became_peered":"2024-09-13T18:57:13.519088+0000","last_unstale":"2024-09-13T18:57:13.525997+0000","last_undegraded":"2024-09-13T18:57:13.525997+0000","last_fullsized":"2024-09-13T18:57:13.525997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511965+0000","last_change":"2024-09-13T18:57:13.504312+0000","last_active":"2024-09-13T18:57:13.511965+0000","last_peered":"2024-09-13T18:57:13.511965+0000","last_clean":"2024-09-13T18:57:13.511965+0000","last_became_active":"2024-09-13T18:57:13.504062+0000","last_became_peered":"2024-09-13T18:57:13.504062+0000","last_unstale":"2024-09-13T18:57:13.511965+0000","last_undegraded":"2024-09-13T18:57:13.511965+0000","last_fullsized":"2024-09-13T18:57:13.511965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.503063+0000","last_change":"2024-09-13T18:57:13.501012+0000","last_active":"2024-09-13T18:57:13.503063+0000","last_peered":"2024-09-13T18:57:13.503063+0000","last_clean":"2024-09-13T18:57:13.503063+0000","last_became_active":"2024-09-13T18:57:13.500775+0000","last_became_peered":"2024-09-13T18:57:13.500775+0000","last_unstale":"2024-09-13T18:57:13.503063+0000","last_undegraded":"2024-09-13T18:57:13.503063+0000","last_fullsized":"2024-09-13T18:57:13.503063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.518301+0000","last_change":"2024-09-13T18:57:13.514151+0000","last_active":"2024-09-13T18:57:13.518301+0000","last_peered":"2024-09-13T18:57:13.518301+0000","last_clean":"2024-09-13T18:57:13.518301+0000","last_became_active":"2024-09-13T18:57:13.512580+0000","last_became_peered":"2024-09-13T18:57:13.512580+0000","last_unstale":"2024-09-13T18:57:13.518301+0000","last_undegraded":"2024-09-13T18:57:13.518301+0000","last_fullsized":"2024-09-13T18:57:13.518301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530306+0000","last_change":"2024-09-13T18:57:13.528152+0000","last_active":"2024-09-13T18:57:13.530306+0000","last_peered":"2024-09-13T18:57:13.530306+0000","last_clean":"2024-09-13T18:57:13.530306+0000","last_became_active":"2024-09-13T18:57:13.527834+0000","last_became_peered":"2024-09-13T18:57:13.527834+0000","last_unstale":"2024-09-13T18:57:13.530306+0000","last_undegraded":"2024-09-13T18:57:13.530306+0000","last_fullsized":"2024-09-13T18:57:13.530306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531696+0000","last_change":"2024-09-13T18:57:13.531001+0000","last_active":"2024-09-13T18:57:13.531696+0000","last_peered":"2024-09-13T18:57:13.531696+0000","last_clean":"2024-09-13T18:57:13.531696+0000","last_became_active":"2024-09-13T18:57:13.530750+0000","last_became_peered":"2024-09-13T18:57:13.530750+0000","last_unstale":"2024-09-13T18:57:13.531696+0000","last_undegraded":"2024-09-13T18:57:13.531696+0000","last_fullsized":"2024-09-13T18:57:13.531696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521145+0000","last_change":"2024-09-13T18:57:13.518687+0000","last_active":"2024-09-13T18:57:13.521145+0000","last_peered":"2024-09-13T18:57:13.521145+0000","last_clean":"2024-09-13T18:57:13.521145+0000","last_became_active":"2024-09-13T18:57:13.518393+0000","last_became_peered":"2024-09-13T18:57:13.518393+0000","last_unstale":"2024-09-13T18:57:13.521145+0000","last_undegraded":"2024-09-13T18:57:13.521145+0000","last_fullsized":"2024-09-13T18:57:13.521145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519289+0000","last_change":"2024-09-13T18:57:13.517369+0000","last_active":"2024-09-13T18:57:13.519289+0000","last_peered":"2024-09-13T18:57:13.519289+0000","last_clean":"2024-09-13T18:57:13.519289+0000","last_became_active":"2024-09-13T18:57:13.516175+0000","last_became_peered":"2024-09-13T18:57:13.516175+0000","last_unstale":"2024-09-13T18:57:13.519289+0000","last_undegraded":"2024-09-13T18:57:13.519289+0000","last_fullsized":"2024-09-13T18:57:13.519289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514834+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.514834+0000","last_peered":"2024-09-13T18:57:13.514834+0000","last_clean":"2024-09-13T18:57:13.514834+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.514834+0000","last_undegraded":"2024-09-13T18:57:13.514834+0000","last_fullsized":"2024-09-13T18:57:13.514834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514757+0000","last_change":"2024-09-13T18:57:13.509552+0000","last_active":"2024-09-13T18:57:13.514757+0000","last_peered":"2024-09-13T18:57:13.514757+0000","last_clean":"2024-09-13T18:57:13.514757+0000","last_became_active":"2024-09-13T18:57:13.506301+0000","last_became_peered":"2024-09-13T18:57:13.506301+0000","last_unstale":"2024-09-13T18:57:13.514757+0000","last_undegraded":"2024-09-13T18:57:13.514757+0000","last_fullsized":"2024-09-13T18:57:13.514757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527248+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.527248+0000","last_peered":"2024-09-13T18:57:13.527248+0000","last_clean":"2024-09-13T18:57:13.527248+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.527248+0000","last_undegraded":"2024-09-13T18:57:13.527248+0000","last_fullsized":"2024-09-13T18:57:13.527248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492370+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.492370+0000","last_peered":"2024-09-13T18:57:13.492370+0000","last_clean":"2024-09-13T18:57:13.492370+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.492370+0000","last_undegraded":"2024-09-13T18:57:13.492370+0000","last_fullsized":"2024-09-13T18:57:13.492370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513971+0000","last_change":"2024-09-13T18:57:13.509463+0000","last_active":"2024-09-13T18:57:13.513971+0000","last_peered":"2024-09-13T18:57:13.513971+0000","last_clean":"2024-09-13T18:57:13.513971+0000","last_became_active":"2024-09-13T18:57:13.509205+0000","last_became_peered":"2024-09-13T18:57:13.509205+0000","last_unstale":"2024-09-13T18:57:13.513971+0000","last_undegraded":"2024-09-13T18:57:13.513971+0000","last_fullsized":"2024-09-13T18:57:13.513971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510784+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.510784+0000","last_peered":"2024-09-13T18:57:13.510784+0000","last_clean":"2024-09-13T18:57:13.510784+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.510784+0000","last_undegraded":"2024-09-13T18:57:13.510784+0000","last_fullsized":"2024-09-13T18:57:13.510784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514052+0000","last_change":"2024-09-13T18:57:13.504149+0000","last_active":"2024-09-13T18:57:13.514052+0000","last_peered":"2024-09-13T18:57:13.514052+0000","last_clean":"2024-09-13T18:57:13.514052+0000","last_became_active":"2024-09-13T18:57:13.503874+0000","last_became_peered":"2024-09-13T18:57:13.503874+0000","last_unstale":"2024-09-13T18:57:13.514052+0000","last_undegraded":"2024-09-13T18:57:13.514052+0000","last_fullsized":"2024-09-13T18:57:13.514052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515679+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.515679+0000","last_peered":"2024-09-13T18:57:13.515679+0000","last_clean":"2024-09-13T18:57:13.515679+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.515679+0000","last_undegraded":"2024-09-13T18:57:13.515679+0000","last_fullsized":"2024-09-13T18:57:13.515679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530773+0000","last_change":"2024-09-13T18:57:13.528119+0000","last_active":"2024-09-13T18:57:13.530773+0000","last_peered":"2024-09-13T18:57:13.530773+0000","last_clean":"2024-09-13T18:57:13.530773+0000","last_became_active":"2024-09-13T18:57:13.527859+0000","last_became_peered":"2024-09-13T18:57:13.527859+0000","last_unstale":"2024-09-13T18:57:13.530773+0000","last_undegraded":"2024-09-13T18:57:13.530773+0000","last_fullsized":"2024-09-13T18:57:13.530773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514102+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.514102+0000","last_peered":"2024-09-13T18:57:13.514102+0000","last_clean":"2024-09-13T18:57:13.514102+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.514102+0000","last_undegraded":"2024-09-13T18:57:13.514102+0000","last_fullsized":"2024-09-13T18:57:13.514102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528063+0000","last_change":"2024-09-13T18:57:13.526462+0000","last_active":"2024-09-13T18:57:13.528063+0000","last_peered":"2024-09-13T18:57:13.528063+0000","last_clean":"2024-09-13T18:57:13.528063+0000","last_became_active":"2024-09-13T18:57:13.526259+0000","last_became_peered":"2024-09-13T18:57:13.526259+0000","last_unstale":"2024-09-13T18:57:13.528063+0000","last_undegraded":"2024-09-13T18:57:13.528063+0000","last_fullsized":"2024-09-13T18:57:13.528063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531561+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.531561+0000","last_peered":"2024-09-13T18:57:13.531561+0000","last_clean":"2024-09-13T18:57:13.531561+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.531561+0000","last_undegraded":"2024-09-13T18:57:13.531561+0000","last_fullsized":"2024-09-13T18:57:13.531561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517426+0000","last_change":"2024-09-13T18:57:13.511843+0000","last_active":"2024-09-13T18:57:13.517426+0000","last_peered":"2024-09-13T18:57:13.517426+0000","last_clean":"2024-09-13T18:57:13.517426+0000","last_became_active":"2024-09-13T18:57:13.511537+0000","last_became_peered":"2024-09-13T18:57:13.511537+0000","last_unstale":"2024-09-13T18:57:13.517426+0000","last_undegraded":"2024-09-13T18:57:13.517426+0000","last_fullsized":"2024-09-13T18:57:13.517426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533503+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.533503+0000","last_peered":"2024-09-13T18:57:13.533503+0000","last_clean":"2024-09-13T18:57:13.533503+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.533503+0000","last_undegraded":"2024-09-13T18:57:13.533503+0000","last_fullsized":"2024-09-13T18:57:13.533503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508616+0000","last_change":"2024-09-13T18:57:13.506092+0000","last_active":"2024-09-13T18:57:13.508616+0000","last_peered":"2024-09-13T18:57:13.508616+0000","last_clean":"2024-09-13T18:57:13.508616+0000","last_became_active":"2024-09-13T18:57:13.505707+0000","last_became_peered":"2024-09-13T18:57:13.505707+0000","last_unstale":"2024-09-13T18:57:13.508616+0000","last_undegraded":"2024-09-13T18:57:13.508616+0000","last_fullsized":"2024-09-13T18:57:13.508616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514701+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.514701+0000","last_peered":"2024-09-13T18:57:13.514701+0000","last_clean":"2024-09-13T18:57:13.514701+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.514701+0000","last_undegraded":"2024-09-13T18:57:13.514701+0000","last_fullsized":"2024-09-13T18:57:13.514701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514016+0000","last_change":"2024-09-13T18:57:13.509609+0000","last_active":"2024-09-13T18:57:13.514016+0000","last_peered":"2024-09-13T18:57:13.514016+0000","last_clean":"2024-09-13T18:57:13.514016+0000","last_became_active":"2024-09-13T18:57:13.509286+0000","last_became_peered":"2024-09-13T18:57:13.509286+0000","last_unstale":"2024-09-13T18:57:13.514016+0000","last_undegraded":"2024-09-13T18:57:13.514016+0000","last_fullsized":"2024-09-13T18:57:13.514016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513159+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.513159+0000","last_peered":"2024-09-13T18:57:13.513159+0000","last_clean":"2024-09-13T18:57:13.513159+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.513159+0000","last_undegraded":"2024-09-13T18:57:13.513159+0000","last_fullsized":"2024-09-13T18:57:13.513159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508734+0000","last_change":"2024-09-13T18:57:13.506462+0000","last_active":"2024-09-13T18:57:13.508734+0000","last_peered":"2024-09-13T18:57:13.508734+0000","last_clean":"2024-09-13T18:57:13.508734+0000","last_became_active":"2024-09-13T18:57:13.506135+0000","last_became_peered":"2024-09-13T18:57:13.506135+0000","last_unstale":"2024-09-13T18:57:13.508734+0000","last_undegraded":"2024-09-13T18:57:13.508734+0000","last_fullsized":"2024-09-13T18:57:13.508734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509681+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.509681+0000","last_peered":"2024-09-13T18:57:13.509681+0000","last_clean":"2024-09-13T18:57:13.509681+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.509681+0000","last_undegraded":"2024-09-13T18:57:13.509681+0000","last_fullsized":"2024-09-13T18:57:13.509681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521125+0000","last_change":"2024-09-13T18:57:13.518635+0000","last_active":"2024-09-13T18:57:13.521125+0000","last_peered":"2024-09-13T18:57:13.521125+0000","last_clean":"2024-09-13T18:57:13.521125+0000","last_became_active":"2024-09-13T18:57:13.518274+0000","last_became_peered":"2024-09-13T18:57:13.518274+0000","last_unstale":"2024-09-13T18:57:13.521125+0000","last_undegraded":"2024-09-13T18:57:13.521125+0000","last_fullsized":"2024-09-13T18:57:13.521125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512870+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.512870+0000","last_peered":"2024-09-13T18:57:13.512870+0000","last_clean":"2024-09-13T18:57:13.512870+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.512870+0000","last_undegraded":"2024-09-13T18:57:13.512870+0000","last_fullsized":"2024-09-13T18:57:13.512870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527414+0000","last_change":"2024-09-13T18:57:13.515449+0000","last_active":"2024-09-13T18:57:13.527414+0000","last_peered":"2024-09-13T18:57:13.527414+0000","last_clean":"2024-09-13T18:57:13.527414+0000","last_became_active":"2024-09-13T18:57:13.514478+0000","last_became_peered":"2024-09-13T18:57:13.514478+0000","last_unstale":"2024-09-13T18:57:13.527414+0000","last_undegraded":"2024-09-13T18:57:13.527414+0000","last_fullsized":"2024-09-13T18:57:13.527414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514267+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.514267+0000","last_peered":"2024-09-13T18:57:13.514267+0000","last_clean":"2024-09-13T18:57:13.514267+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.514267+0000","last_undegraded":"2024-09-13T18:57:13.514267+0000","last_fullsized":"2024-09-13T18:57:13.514267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509295+0000","last_change":"2024-09-13T18:57:13.506875+0000","last_active":"2024-09-13T18:57:13.509295+0000","last_peered":"2024-09-13T18:57:13.509295+0000","last_clean":"2024-09-13T18:57:13.509295+0000","last_became_active":"2024-09-13T18:57:13.506471+0000","last_became_peered":"2024-09-13T18:57:13.506471+0000","last_unstale":"2024-09-13T18:57:13.509295+0000","last_undegraded":"2024-09-13T18:57:13.509295+0000","last_fullsized":"2024-09-13T18:57:13.509295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.505344+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.505344+0000","last_peered":"2024-09-13T18:57:13.505344+0000","last_clean":"2024-09-13T18:57:13.505344+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.505344+0000","last_undegraded":"2024-09-13T18:57:13.505344+0000","last_fullsized":"2024-09-13T18:57:13.505344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527382+0000","last_change":"2024-09-13T18:57:13.514665+0000","last_active":"2024-09-13T18:57:13.527382+0000","last_peered":"2024-09-13T18:57:13.527382+0000","last_clean":"2024-09-13T18:57:13.527382+0000","last_became_active":"2024-09-13T18:57:13.514373+0000","last_became_peered":"2024-09-13T18:57:13.514373+0000","last_unstale":"2024-09-13T18:57:13.527382+0000","last_undegraded":"2024-09-13T18:57:13.527382+0000","last_fullsized":"2024-09-13T18:57:13.527382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517258+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.517258+0000","last_peered":"2024-09-13T18:57:13.517258+0000","last_clean":"2024-09-13T18:57:13.517258+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.517258+0000","last_undegraded":"2024-09-13T18:57:13.517258+0000","last_fullsized":"2024-09-13T18:57:13.517258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528889+0000","last_change":"2024-09-13T18:57:13.521314+0000","last_active":"2024-09-13T18:57:13.528889+0000","last_peered":"2024-09-13T18:57:13.528889+0000","last_clean":"2024-09-13T18:57:13.528889+0000","last_became_active":"2024-09-13T18:57:13.519808+0000","last_became_peered":"2024-09-13T18:57:13.519808+0000","last_unstale":"2024-09-13T18:57:13.528889+0000","last_undegraded":"2024-09-13T18:57:13.528889+0000","last_fullsized":"2024-09-13T18:57:13.528889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487827+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.487827+0000","last_peered":"2024-09-13T18:57:13.487827+0000","last_clean":"2024-09-13T18:57:13.487827+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.487827+0000","last_undegraded":"2024-09-13T18:57:13.487827+0000","last_fullsized":"2024-09-13T18:57:13.487827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528931+0000","last_change":"2024-09-13T18:57:13.523066+0000","last_active":"2024-09-13T18:57:13.528931+0000","last_peered":"2024-09-13T18:57:13.528931+0000","last_clean":"2024-09-13T18:57:13.528931+0000","last_became_active":"2024-09-13T18:57:13.522829+0000","last_became_peered":"2024-09-13T18:57:13.522829+0000","last_unstale":"2024-09-13T18:57:13.528931+0000","last_undegraded":"2024-09-13T18:57:13.528931+0000","last_fullsized":"2024-09-13T18:57:13.528931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491602+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:13.491602+0000","last_peered":"2024-09-13T18:57:13.491602+0000","last_clean":"2024-09-13T18:57:13.491602+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:13.491602+0000","last_undegraded":"2024-09-13T18:57:13.491602+0000","last_fullsized":"2024-09-13T18:57:13.491602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.502901+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.502901+0000","last_peered":"2024-09-13T18:57:13.502901+0000","last_clean":"2024-09-13T18:57:13.502901+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.502901+0000","last_undegraded":"2024-09-13T18:57:13.502901+0000","last_fullsized":"2024-09-13T18:57:13.502901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533279+0000","last_change":"2024-09-13T18:57:13.531524+0000","last_active":"2024-09-13T18:57:13.533279+0000","last_peered":"2024-09-13T18:57:13.533279+0000","last_clean":"2024-09-13T18:57:13.533279+0000","last_became_active":"2024-09-13T18:57:13.530731+0000","last_became_peered":"2024-09-13T18:57:13.530731+0000","last_unstale":"2024-09-13T18:57:13.533279+0000","last_undegraded":"2024-09-13T18:57:13.533279+0000","last_fullsized":"2024-09-13T18:57:13.533279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491503+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.491503+0000","last_peered":"2024-09-13T18:57:13.491503+0000","last_clean":"2024-09-13T18:57:13.491503+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.491503+0000","last_undegraded":"2024-09-13T18:57:13.491503+0000","last_fullsized":"2024-09-13T18:57:13.491503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511770+0000","last_change":"2024-09-13T18:57:13.505735+0000","last_active":"2024-09-13T18:57:13.511770+0000","last_peered":"2024-09-13T18:57:13.511770+0000","last_clean":"2024-09-13T18:57:13.511770+0000","last_became_active":"2024-09-13T18:57:13.505442+0000","last_became_peered":"2024-09-13T18:57:13.505442+0000","last_unstale":"2024-09-13T18:57:13.511770+0000","last_undegraded":"2024-09-13T18:57:13.511770+0000","last_fullsized":"2024-09-13T18:57:13.511770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487814+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.487814+0000","last_peered":"2024-09-13T18:57:13.487814+0000","last_clean":"2024-09-13T18:57:13.487814+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.487814+0000","last_undegraded":"2024-09-13T18:57:13.487814+0000","last_fullsized":"2024-09-13T18:57:13.487814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514688+0000","last_change":"2024-09-13T18:57:13.509025+0000","last_active":"2024-09-13T18:57:13.514688+0000","last_peered":"2024-09-13T18:57:13.514688+0000","last_clean":"2024-09-13T18:57:13.514688+0000","last_became_active":"2024-09-13T18:57:13.508745+0000","last_became_peered":"2024-09-13T18:57:13.508745+0000","last_unstale":"2024-09-13T18:57:13.514688+0000","last_undegraded":"2024-09-13T18:57:13.514688+0000","last_fullsized":"2024-09-13T18:57:13.514688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513426+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.513426+0000","last_peered":"2024-09-13T18:57:13.513426+0000","last_clean":"2024-09-13T18:57:13.513426+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.513426+0000","last_undegraded":"2024-09-13T18:57:13.513426+0000","last_fullsized":"2024-09-13T18:57:13.513426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519326+0000","last_change":"2024-09-13T18:57:13.517447+0000","last_active":"2024-09-13T18:57:13.519326+0000","last_peered":"2024-09-13T18:57:13.519326+0000","last_clean":"2024-09-13T18:57:13.519326+0000","last_became_active":"2024-09-13T18:57:13.514845+0000","last_became_peered":"2024-09-13T18:57:13.514845+0000","last_unstale":"2024-09-13T18:57:13.519326+0000","last_undegraded":"2024-09-13T18:57:13.519326+0000","last_fullsized":"2024-09-13T18:57:13.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492184+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.492184+0000","last_peered":"2024-09-13T18:57:13.492184+0000","last_clean":"2024-09-13T18:57:13.492184+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.492184+0000","last_undegraded":"2024-09-13T18:57:13.492184+0000","last_fullsized":"2024-09-13T18:57:13.492184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530696+0000","last_change":"2024-09-13T18:57:13.527647+0000","last_active":"2024-09-13T18:57:13.530696+0000","last_peered":"2024-09-13T18:57:13.530696+0000","last_clean":"2024-09-13T18:57:13.530696+0000","last_became_active":"2024-09-13T18:57:13.519711+0000","last_became_peered":"2024-09-13T18:57:13.519711+0000","last_unstale":"2024-09-13T18:57:13.530696+0000","last_undegraded":"2024-09-13T18:57:13.530696+0000","last_fullsized":"2024-09-13T18:57:13.530696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492981+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.492981+0000","last_peered":"2024-09-13T18:57:13.492981+0000","last_clean":"2024-09-13T18:57:13.492981+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.492981+0000","last_undegraded":"2024-09-13T18:57:13.492981+0000","last_fullsized":"2024-09-13T18:57:13.492981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514488+0000","last_change":"2024-09-13T18:57:13.507458+0000","last_active":"2024-09-13T18:57:13.514488+0000","last_peered":"2024-09-13T18:57:13.514488+0000","last_clean":"2024-09-13T18:57:13.514488+0000","last_became_active":"2024-09-13T18:57:13.507163+0000","last_became_peered":"2024-09-13T18:57:13.507163+0000","last_unstale":"2024-09-13T18:57:13.514488+0000","last_undegraded":"2024-09-13T18:57:13.514488+0000","last_fullsized":"2024-09-13T18:57:13.514488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492111+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:13.492111+0000","last_peered":"2024-09-13T18:57:13.492111+0000","last_clean":"2024-09-13T18:57:13.492111+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:13.492111+0000","last_undegraded":"2024-09-13T18:57:13.492111+0000","last_fullsized":"2024-09-13T18:57:13.492111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513838+0000","last_change":"2024-09-13T18:57:13.508509+0000","last_active":"2024-09-13T18:57:13.513838+0000","last_peered":"2024-09-13T18:57:13.513838+0000","last_clean":"2024-09-13T18:57:13.513838+0000","last_became_active":"2024-09-13T18:57:13.508215+0000","last_became_peered":"2024-09-13T18:57:13.508215+0000","last_unstale":"2024-09-13T18:57:13.513838+0000","last_undegraded":"2024-09-13T18:57:13.513838+0000","last_fullsized":"2024-09-13T18:57:13.513838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529311+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.529311+0000","last_peered":"2024-09-13T18:57:13.529311+0000","last_clean":"2024-09-13T18:57:13.529311+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.529311+0000","last_undegraded":"2024-09-13T18:57:13.529311+0000","last_fullsized":"2024-09-13T18:57:13.529311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515857+0000","last_change":"2024-09-13T18:57:13.509453+0000","last_active":"2024-09-13T18:57:13.515857+0000","last_peered":"2024-09-13T18:57:13.515857+0000","last_clean":"2024-09-13T18:57:13.515857+0000","last_became_active":"2024-09-13T18:57:13.509188+0000","last_became_peered":"2024-09-13T18:57:13.509188+0000","last_unstale":"2024-09-13T18:57:13.515857+0000","last_undegraded":"2024-09-13T18:57:13.515857+0000","last_fullsized":"2024-09-13T18:57:13.515857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.490795+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.490795+0000","last_peered":"2024-09-13T18:57:13.490795+0000","last_clean":"2024-09-13T18:57:13.490795+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.490795+0000","last_undegraded":"2024-09-13T18:57:13.490795+0000","last_fullsized":"2024-09-13T18:57:13.490795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511536+0000","last_change":"2024-09-13T18:57:13.506172+0000","last_active":"2024-09-13T18:57:13.511536+0000","last_peered":"2024-09-13T18:57:13.511536+0000","last_clean":"2024-09-13T18:57:13.511536+0000","last_became_active":"2024-09-13T18:57:13.503964+0000","last_became_peered":"2024-09-13T18:57:13.503964+0000","last_unstale":"2024-09-13T18:57:13.511536+0000","last_undegraded":"2024-09-13T18:57:13.511536+0000","last_fullsized":"2024-09-13T18:57:13.511536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492922+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.492922+0000","last_peered":"2024-09-13T18:57:13.492922+0000","last_clean":"2024-09-13T18:57:13.492922+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.492922+0000","last_undegraded":"2024-09-13T18:57:13.492922+0000","last_fullsized":"2024-09-13T18:57:13.492922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513953+0000","last_change":"2024-09-13T18:57:13.508906+0000","last_active":"2024-09-13T18:57:13.513953+0000","last_peered":"2024-09-13T18:57:13.513953+0000","last_clean":"2024-09-13T18:57:13.513953+0000","last_became_active":"2024-09-13T18:57:13.508586+0000","last_became_peered":"2024-09-13T18:57:13.508586+0000","last_unstale":"2024-09-13T18:57:13.513953+0000","last_undegraded":"2024-09-13T18:57:13.513953+0000","last_fullsized":"2024-09-13T18:57:13.513953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492144+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.492144+0000","last_peered":"2024-09-13T18:57:13.492144+0000","last_clean":"2024-09-13T18:57:13.492144+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.492144+0000","last_undegraded":"2024-09-13T18:57:13.492144+0000","last_fullsized":"2024-09-13T18:57:13.492144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519057+0000","last_change":"2024-09-13T18:57:13.514983+0000","last_active":"2024-09-13T18:57:13.519057+0000","last_peered":"2024-09-13T18:57:13.519057+0000","last_clean":"2024-09-13T18:57:13.519057+0000","last_became_active":"2024-09-13T18:57:13.514654+0000","last_became_peered":"2024-09-13T18:57:13.514654+0000","last_unstale":"2024-09-13T18:57:13.519057+0000","last_undegraded":"2024-09-13T18:57:13.519057+0000","last_fullsized":"2024-09-13T18:57:13.519057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515394+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.515394+0000","last_peered":"2024-09-13T18:57:13.515394+0000","last_clean":"2024-09-13T18:57:13.515394+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.515394+0000","last_undegraded":"2024-09-13T18:57:13.515394+0000","last_fullsized":"2024-09-13T18:57:13.515394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521183+0000","last_change":"2024-09-13T18:57:13.518795+0000","last_active":"2024-09-13T18:57:13.521183+0000","last_peered":"2024-09-13T18:57:13.521183+0000","last_clean":"2024-09-13T18:57:13.521183+0000","last_became_active":"2024-09-13T18:57:13.518511+0000","last_became_peered":"2024-09-13T18:57:13.518511+0000","last_unstale":"2024-09-13T18:57:13.521183+0000","last_undegraded":"2024-09-13T18:57:13.521183+0000","last_fullsized":"2024-09-13T18:57:13.521183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530132+0000","last_change":"2024-09-13T18:57:13.520031+0000","last_active":"2024-09-13T18:57:13.530132+0000","last_peered":"2024-09-13T18:57:13.530132+0000","last_clean":"2024-09-13T18:57:13.530132+0000","last_became_active":"2024-09-13T18:57:13.519735+0000","last_became_peered":"2024-09-13T18:57:13.519735+0000","last_unstale":"2024-09-13T18:57:13.530132+0000","last_undegraded":"2024-09-13T18:57:13.530132+0000","last_fullsized":"2024-09-13T18:57:13.530132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527444+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.527444+0000","last_peered":"2024-09-13T18:57:13.527444+0000","last_clean":"2024-09-13T18:57:13.527444+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.527444+0000","last_undegraded":"2024-09-13T18:57:13.527444+0000","last_fullsized":"2024-09-13T18:57:13.527444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533197+0000","last_change":"2024-09-13T18:57:13.530720+0000","last_active":"2024-09-13T18:57:13.533197+0000","last_peered":"2024-09-13T18:57:13.533197+0000","last_clean":"2024-09-13T18:57:13.533197+0000","last_became_active":"2024-09-13T18:57:13.528690+0000","last_became_peered":"2024-09-13T18:57:13.528690+0000","last_unstale":"2024-09-13T18:57:13.533197+0000","last_undegraded":"2024-09-13T18:57:13.533197+0000","last_fullsized":"2024-09-13T18:57:13.533197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508167+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.508167+0000","last_peered":"2024-09-13T18:57:13.508167+0000","last_clean":"2024-09-13T18:57:13.508167+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.508167+0000","last_undegraded":"2024-09-13T18:57:13.508167+0000","last_fullsized":"2024-09-13T18:57:13.508167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528047+0000","last_change":"2024-09-13T18:57:13.526450+0000","last_active":"2024-09-13T18:57:13.528047+0000","last_peered":"2024-09-13T18:57:13.528047+0000","last_clean":"2024-09-13T18:57:13.528047+0000","last_became_active":"2024-09-13T18:57:13.526209+0000","last_became_peered":"2024-09-13T18:57:13.526209+0000","last_unstale":"2024-09-13T18:57:13.528047+0000","last_undegraded":"2024-09-13T18:57:13.528047+0000","last_fullsized":"2024-09-13T18:57:13.528047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514722+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.514722+0000","last_peered":"2024-09-13T18:57:13.514722+0000","last_clean":"2024-09-13T18:57:13.514722+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.514722+0000","last_undegraded":"2024-09-13T18:57:13.514722+0000","last_fullsized":"2024-09-13T18:57:13.514722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527482+0000","last_change":"2024-09-13T18:57:13.523510+0000","last_active":"2024-09-13T18:57:13.527482+0000","last_peered":"2024-09-13T18:57:13.527482+0000","last_clean":"2024-09-13T18:57:13.527482+0000","last_became_active":"2024-09-13T18:57:13.522734+0000","last_became_peered":"2024-09-13T18:57:13.522734+0000","last_unstale":"2024-09-13T18:57:13.527482+0000","last_undegraded":"2024-09-13T18:57:13.527482+0000","last_fullsized":"2024-09-13T18:57:13.527482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.523574+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.523574+0000","last_peered":"2024-09-13T18:57:13.523574+0000","last_clean":"2024-09-13T18:57:13.523574+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.523574+0000","last_undegraded":"2024-09-13T18:57:13.523574+0000","last_fullsized":"2024-09-13T18:57:13.523574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:22.749 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:57:22.749 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:57:22.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:57:22.749 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:57:22.750 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:57:22.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.937+0000 7f3cb0a00640 1 Processor -- start 2024-09-13T18:57:22.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.937+0000 7f3cb0a00640 1 -- start start 2024-09-13T18:57:22.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3cac15a5c0 0x7f3cac0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 0x7f3cac06f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0cce20 con 0x7f3cac0cbac0 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0cbfc0 con 0x7f3cac15a5c0 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3cb0a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0707a0 con 0x7f3cac0afe10 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3ca2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3ca2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35238/0 (socket says 172.21.15.33:35238) 2024-09-13T18:57:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.938+0000 7f3ca2a00640 1 -- 172.21.15.33:0/1261723863 learned_addr learned my addr 172.21.15.33:0/1261723863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3cab400640 1 --2- 172.21.15.33:0/1261723863 >> v2:172.21.15.103:3300/0 conn(0x7f3cac15a5c0 0x7f3cac0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3cabe00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 0x7f3cac06f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3ca2a00640 1 -- 172.21.15.33:0/1261723863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 msgr2=0x7f3cac06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3ca2a00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 0x7f3cac06f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3ca2a00640 1 -- 172.21.15.33:0/1261723863 >> v2:172.21.15.103:3300/0 conn(0x7f3cac15a5c0 msgr2=0x7f3cac0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3ca2a00640 1 --2- 172.21.15.33:0/1261723863 >> v2:172.21.15.103:3300/0 conn(0x7f3cac15a5c0 0x7f3cac0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3ca2a00640 1 -- 172.21.15.33:0/1261723863 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac070a80 con 0x7f3cac0cbac0 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.939+0000 7f3cabe00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 0x7f3cac06f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3ca2a00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3cac067270 tx=0x7f3c9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e6081c82a8a797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3caaa00640 1 -- 172.21.15.33:0/1261723863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94032440 con 0x7f3cac0cbac0 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3caaa00640 1 -- 172.21.15.33:0/1261723863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940325a0 con 0x7f3cac0cbac0 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3caaa00640 1 -- 172.21.15.33:0/1261723863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94032930 con 0x7f3cac0cbac0 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3cb0a00640 1 -- 172.21.15.33:0/1261723863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac0cbac0 msgr2=0x7f3cac0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.940+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3cac067270 tx=0x7f3c9402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 -- 172.21.15.33:0/1261723863 shutdown_connections 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0afe10 0x7f3cac06f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/1261723863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac0cbac0 0x7f3cac0b3ef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/1261723863 >> v2:172.21.15.103:3300/0 conn(0x7f3cac15a5c0 0x7f3cac0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 -- 172.21.15.33:0/1261723863 >> 172.21.15.33:0/1261723863 conn(0x7f3cac0ae310 msgr2=0x7f3cac0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 -- 172.21.15.33:0/1261723863 shutdown_connections 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.941+0000 7f3cb0a00640 1 -- 172.21.15.33:0/1261723863 wait complete. 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.942+0000 7f3cb0a00640 1 Processor -- start 2024-09-13T18:57:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.942+0000 7f3cb0a00640 1 -- start start 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac0afe10 0x7f3cac0b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0cbac0 0x7f3cac151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1f2700 con 0x7f3cac15a5c0 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1f29e0 con 0x7f3cac0afe10 2024-09-13T18:57:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cb0a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1f2cc0 con 0x7f3cac0cbac0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.943+0000 7f3cabe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35252/0 (socket says 172.21.15.33:35252) 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 -- 172.21.15.33:0/2866360321 learned_addr learned my addr 172.21.15.33:0/2866360321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cab400640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac0afe10 0x7f3cac0b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3ca2a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0cbac0 0x7f3cac151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 -- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0cbac0 msgr2=0x7f3cac151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0cbac0 0x7f3cac151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 -- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac0afe10 msgr2=0x7f3cac0b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac0afe10 0x7f3cac0b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 -- 172.21.15.33:0/2866360321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940094d0 con 0x7f3cac15a5c0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cabe00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400ce20 tx=0x7f3ca400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003b90 con 0x7f3cac15a5c0 2024-09-13T18:57:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4003d10 con 0x7f3cac15a5c0 2024-09-13T18:57:22.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004260 con 0x7f3cac15a5c0 2024-09-13T18:57:22.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.944+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac1f2fa0 con 0x7f3cac15a5c0 2024-09-13T18:57:22.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.945+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac1f2380 con 0x7f3cac15a5c0 2024-09-13T18:57:22.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.946+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac067360 con 0x7f3cac15a5c0 2024-09-13T18:57:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.946+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ca40043c0 con 0x7f3cac15a5c0 2024-09-13T18:57:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.947+0000 7f3ca3e00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 0x7f3c8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.947+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ca4089be0 con 0x7f3cac15a5c0 2024-09-13T18:57:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.948+0000 7f3cab400640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 0x7f3c8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.948+0000 7f3cab400640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 0x7f3c8806d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cac156920 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:22.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:22.952+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ca4054dd0 con 0x7f3cac15a5c0 2024-09-13T18:57:23.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.178+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3cac0ac870 con 0x7f3cac15a5c0 2024-09-13T18:57:23.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.181+0000 7f3ca3e00640 1 -- 172.21.15.33:0/2866360321 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170959 (secure 0 0 0) 0x7f3cac0ac870 con 0x7f3cac15a5c0 2024-09-13T18:57:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 msgr2=0x7f3c8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 0x7f3c8806d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cac156920 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 msgr2=0x7f3cac0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400ce20 tx=0x7f3ca400a710 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 shutdown_connections 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c8806ac00 0x7f3c8806d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cac15a5c0 0x7f3cac0c3610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cac0cbac0 0x7f3cac151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 --2- 172.21.15.33:0/2866360321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cac0afe10 0x7f3cac0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 >> 172.21.15.33:0/2866360321 conn(0x7f3cac0ae310 msgr2=0x7f3cac06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 shutdown_connections 2024-09-13T18:57:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.185+0000 7f3cb0a00640 1 -- 172.21.15.33:0/2866360321 wait complete. 2024-09-13T18:57:23.203 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1814036668},{"type":"v1","addr":"172.21.15.103:6833","nonce":1814036668}]},"active_addr":"172.21.15.103:6833/1814036668","active_change":"2024-09-13T18:56:55.081846+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3684040017}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2913451985}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1829586971}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3642456203}]}]} 2024-09-13T18:57:23.208 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:57:23.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:57:23.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.361+0000 7fded9000640 1 Processor -- start 2024-09-13T18:57:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.361+0000 7fded9000640 1 -- start start 2024-09-13T18:57:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded9000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fded40b32d0 0x7fded4163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded9000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4159680 con 0x7fded40b1e40 2024-09-13T18:57:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded9000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded415a430 con 0x7fded4159210 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded9000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40b2930 con 0x7fded40b32d0 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded2800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fded40b32d0 0x7fded4163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded1e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fded40b1e40 0x7fded40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53892/0 (socket says 172.21.15.33:53892) 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.362+0000 7fded1e00640 1 -- 172.21.15.33:0/1109067761 learned_addr learned my addr 172.21.15.33:0/1109067761 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.363+0000 7fded2800640 1 -- 172.21.15.33:0/1109067761 >> v1:172.21.15.103:6789/0 conn(0x7fded4159210 legacy=0x7fded40b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:23.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.363+0000 7fded2800640 1 -- 172.21.15.33:0/1109067761 >> v1:172.21.15.33:6789/0 conn(0x7fded40b1e40 legacy=0x7fded40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.363+0000 7fded2800640 1 -- 172.21.15.33:0/1109067761 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded41598b0 con 0x7fded40b32d0 2024-09-13T18:57:23.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.363+0000 7fded0a00640 1 -- 172.21.15.33:0/1109067761 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330639483 0 0) 0x7fded4159680 con 0x7fded40b1e40 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded2800640 1 --2- 172.21.15.33:0/1109067761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b32d0 0x7fded4163990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00aea0 tx=0x7fdecc02b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66372183421769f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded0a00640 1 -- 172.21.15.33:0/1109067761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc008640 con 0x7fded40b32d0 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded0a00640 1 -- 172.21.15.33:0/1109067761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc02e050 con 0x7fded40b32d0 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded0a00640 1 -- 172.21.15.33:0/1109067761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0089c0 con 0x7fded40b32d0 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded9000640 1 -- 172.21.15.33:0/1109067761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b32d0 msgr2=0x7fded4163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.364+0000 7fded9000640 1 --2- 172.21.15.33:0/1109067761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b32d0 0x7fded4163990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00aea0 tx=0x7fdecc02b760 comp rx=0 tx=0).stop 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.365+0000 7fded9000640 1 -- 172.21.15.33:0/1109067761 shutdown_connections 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.365+0000 7fded9000640 1 --2- 172.21.15.33:0/1109067761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b32d0 0x7fded4163990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.365+0000 7fded9000640 1 -- 172.21.15.33:0/1109067761 >> 172.21.15.33:0/1109067761 conn(0x7fded40b0510 msgr2=0x7fded40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.365+0000 7fded9000640 1 -- 172.21.15.33:0/1109067761 shutdown_connections 2024-09-13T18:57:23.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.365+0000 7fded9000640 1 -- 172.21.15.33:0/1109067761 wait complete. 2024-09-13T18:57:23.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.366+0000 7fded9000640 1 Processor -- start 2024-09-13T18:57:23.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.366+0000 7fded9000640 1 -- start start 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fded40b32d0 0x7fded40aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 0x7fded40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded415d730 con 0x7fded40b1e40 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded413c0b0 con 0x7fded4159210 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded9000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded415b500 con 0x7fded40b32d0 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35266/0 (socket says 172.21.15.33:35266) 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.367+0000 7fded1e00640 1 -- 172.21.15.33:0/3553255760 learned_addr learned my addr 172.21.15.33:0/3553255760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded2800640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 0x7fded40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1400640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fded40b32d0 0x7fded40aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 -- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fded40b32d0 msgr2=0x7fded40aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fded40b32d0 0x7fded40aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 -- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 msgr2=0x7fded40af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 0x7fded40af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 -- 172.21.15.33:0/3553255760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc00ab80 con 0x7fded40b1e40 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded2800640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 0x7fded40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded1e00640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c500 tx=0x7fdec400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4007560 con 0x7fded40b1e40 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec40047e0 con 0x7fded40b1e40 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4004b90 con 0x7fded40b1e40 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.368+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded413c300 con 0x7fded40b1e40 2024-09-13T18:57:23.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.369+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded415b750 con 0x7fded40b1e40 2024-09-13T18:57:23.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.369+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded406b640 con 0x7fded40b1e40 2024-09-13T18:57:23.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.370+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdec4004cf0 con 0x7fded40b1e40 2024-09-13T18:57:23.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.371+0000 7fdeca000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 0x7fdeb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.371+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdec4088530 con 0x7fded40b1e40 2024-09-13T18:57:23.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.372+0000 7fded1400640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 0x7fdeb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.372+0000 7fded1400640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 0x7fdeb406d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdec0006fd0 tx=0x7fdec0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.376+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdec4053700 con 0x7fded40b1e40 2024-09-13T18:57:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.555+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded40b2220 con 0x7fded40b1e40 2024-09-13T18:57:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.556+0000 7fdeca000640 1 -- 172.21.15.33:0/3553255760 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fdec4056d20 con 0x7fded40b1e40 2024-09-13T18:57:23.560 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 msgr2=0x7fdeb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 0x7fdeb406d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdec0006fd0 tx=0x7fdec0008040 comp rx=0 tx=0).stop 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 msgr2=0x7fded4158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c500 tx=0x7fdec400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 shutdown_connections 2024-09-13T18:57:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdeb406ac00 0x7fdeb406d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4159210 0x7fded40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fded40b32d0 0x7fded40aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 --2- 172.21.15.33:0/3553255760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fded40b1e40 0x7fded4158640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 >> 172.21.15.33:0/3553255760 conn(0x7fded40b0510 msgr2=0x7fded40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 shutdown_connections 2024-09-13T18:57:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.559+0000 7fded9000640 1 -- 172.21.15.33:0/3553255760 wait complete. 2024-09-13T18:57:23.578 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:57:23.579 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.730+0000 7f56d3000640 1 Processor -- start 2024-09-13T18:57:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.730+0000 7f56d3000640 1 -- start start 2024-09-13T18:57:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.731+0000 7f56d3000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 0x7f56cc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.731+0000 7f56d3000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 0x7f56cc0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.731+0000 7f56d3000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc153f00 con 0x7f56cc0b2410 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.731+0000 7f56d3000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0ce600 con 0x7f56cc153b20 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.731+0000 7f56d3000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc070f90 con 0x7f56cc159a80 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56cbe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 0x7f56cc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56cb400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 0x7f56cc0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56d1000640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f56cc0b2410 0x7f56cc06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49672/0 (socket says 172.21.15.33:49672) 2024-09-13T18:57:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56d1000640 1 -- 172.21.15.33:0/1190238218 learned_addr learned my addr 172.21.15.33:0/1190238218 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56cb400640 1 -- 172.21.15.33:0/1190238218 >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 msgr2=0x7f56cc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56cb400640 1 --2- 172.21.15.33:0/1190238218 >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 0x7f56cc0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.733+0000 7f56cb400640 1 -- 172.21.15.33:0/1190238218 >> v1:172.21.15.103:6789/0 conn(0x7f56cc0b2410 legacy=0x7f56cc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.733+0000 7f56cb400640 1 -- 172.21.15.33:0/1190238218 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0b1a40 con 0x7f56cc159a80 2024-09-13T18:57:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.732+0000 7f56caa00640 1 -- 172.21.15.33:0/1190238218 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474392814 0 0) 0x7f56cc153f00 con 0x7f56cc0b2410 2024-09-13T18:57:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.733+0000 7f56cbe00640 1 --2- 172.21.15.33:0/1190238218 >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 0x7f56cc0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56cb400640 1 --2- 172.21.15.33:0/1190238218 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 0x7f56cc0b1ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56b80097a0 tx=0x7f56b802c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=459970dca31cc33a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56caa00640 1 -- 172.21.15.33:0/1190238218 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8034640 con 0x7f56cc159a80 2024-09-13T18:57:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56caa00640 1 -- 172.21.15.33:0/1190238218 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b80347a0 con 0x7f56cc159a80 2024-09-13T18:57:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56caa00640 1 -- 172.21.15.33:0/1190238218 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8034b30 con 0x7f56cc159a80 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56d3000640 1 -- 172.21.15.33:0/1190238218 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 msgr2=0x7f56cc0b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.734+0000 7f56d3000640 1 --2- 172.21.15.33:0/1190238218 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 0x7f56cc0b1ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56b80097a0 tx=0x7f56b802c390 comp rx=0 tx=0).stop 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 -- 172.21.15.33:0/1190238218 shutdown_connections 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 --2- 172.21.15.33:0/1190238218 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc159a80 0x7f56cc0b1ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 --2- 172.21.15.33:0/1190238218 >> v2:172.21.15.103:3300/0 conn(0x7f56cc153b20 0x7f56cc0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 -- 172.21.15.33:0/1190238218 >> 172.21.15.33:0/1190238218 conn(0x7f56cc0b0510 msgr2=0x7f56cc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 -- 172.21.15.33:0/1190238218 shutdown_connections 2024-09-13T18:57:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.735+0000 7f56d3000640 1 -- 172.21.15.33:0/1190238218 wait complete. 2024-09-13T18:57:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.736+0000 7f56d3000640 1 Processor -- start 2024-09-13T18:57:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.736+0000 7f56d3000640 1 -- start start 2024-09-13T18:57:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc153b20 0x7f56cc155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc159a80 0x7f56cc0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1f5d00 con 0x7f56cc0b2410 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0afe00 con 0x7f56cc159a80 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56d3000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b00e0 con 0x7f56cc153b20 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.737+0000 7f56cbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35280/0 (socket says 172.21.15.33:35280) 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 -- 172.21.15.33:0/1336288206 learned_addr learned my addr 172.21.15.33:0/1336288206 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56d1000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc159a80 0x7f56cc0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cb400640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc153b20 0x7f56cc155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 -- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc153b20 msgr2=0x7f56cc155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc153b20 0x7f56cc155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 -- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc159a80 msgr2=0x7f56cc0af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc159a80 0x7f56cc0af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 -- 172.21.15.33:0/1336288206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc009400 con 0x7f56cc0b2410 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56cbe00640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00e960 tx=0x7f56bc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.738+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc00ca00 con 0x7f56cc0b2410 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.739+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc00cb60 con 0x7f56cc0b2410 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.739+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc013470 con 0x7f56cc0b2410 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.739+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b8009400 con 0x7f56cc0b2410 2024-09-13T18:57:23.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.739+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1f6230 con 0x7f56cc0b2410 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.740+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc066e40 con 0x7f56cc0b2410 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.741+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f56bc0135d0 con 0x7f56cc0b2410 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.741+0000 7f56c3e00640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.742+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56bc0895b0 con 0x7f56cc0b2410 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.742+0000 7f56cb400640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.743+0000 7f56cb400640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 0x7f56ac06d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0707d0 tx=0x7f56b8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:23.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.746+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f56bc054830 con 0x7f56cc0b2410 2024-09-13T18:57:23.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.927+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56cc0b3990 con 0x7f56cc0b2410 2024-09-13T18:57:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.928+0000 7f56c3e00640 1 -- 172.21.15.33:0/1336288206 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f56bc057e50 con 0x7f56cc0b2410 2024-09-13T18:57:23.932 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:23.932 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 msgr2=0x7f56ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 0x7f56ac06d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0707d0 tx=0x7f56b8030000 comp rx=0 tx=0).stop 2024-09-13T18:57:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 msgr2=0x7f56cc1f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00e960 tx=0x7f56bc00ee20 comp rx=0 tx=0).stop 2024-09-13T18:57:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 shutdown_connections 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc159a80 0x7f56cc0af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56cc153b20 0x7f56cc155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 --2- 172.21.15.33:0/1336288206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56cc0b2410 0x7f56cc1f6750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 >> 172.21.15.33:0/1336288206 conn(0x7f56cc0b0510 msgr2=0x7f56cc06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 shutdown_connections 2024-09-13T18:57:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:23.931+0000 7f56d3000640 1 -- 172.21.15.33:0/1336288206 wait complete. 2024-09-13T18:57:23.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:57:23.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:57:23.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:57:23.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:57:23.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:57:23.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:57:23.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:57:23.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:57:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.224+0000 7f068cc00640 1 Processor -- start 2024-09-13T18:57:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.224+0000 7f068cc00640 1 -- start start 2024-09-13T18:57:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.226+0000 7f068cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 0x7f06880cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f068cc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f068cc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06880d1710 0x7f06880b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f068cc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880d0cc0 con 0x7f0688160400 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f068cc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880d1280 con 0x7f06880d1710 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f068cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880b3d10 con 0x7f0688160020 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f0685400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.227+0000 7f0685e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 0x7f06880cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35292/0 (socket says 172.21.15.33:35292) 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685400640 1 -- 172.21.15.33:0/3052600190 learned_addr learned my addr 172.21.15.33:0/3052600190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0686800640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.103:3300/0 conn(0x7f06880d1710 0x7f06880b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685e00640 1 -- 172.21.15.33:0/3052600190 >> v2:172.21.15.103:3300/0 conn(0x7f06880d1710 msgr2=0x7f06880b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685e00640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.103:3300/0 conn(0x7f06880d1710 0x7f06880b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685e00640 1 -- 172.21.15.33:0/3052600190 >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 msgr2=0x7f06880cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7ff1efe00640 1 Processor -- start 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7ff1efe00640 1 -- start start 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685e00640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.228+0000 7f0685e00640 1 -- 172.21.15.33:0/3052600190 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880b3fb0 con 0x7f0688160020 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.229+0000 7f0685400640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7f0685e00640 1 --2- 172.21.15.33:0/3052600190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 0x7f06880cf280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f068808b630 tx=0x7f067402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b02eb040d5a0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7ff1efe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1f00b2c70 0x7ff1f006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f00cb3d0 0x7ff1f00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7ff1efe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f00710b0 con 0x7ff1f00ce010 2024-09-13T18:57:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7ff1efe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f00ce480 con 0x7ff1f00b2c70 2024-09-13T18:57:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.230+0000 7ff1efe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00704a0 con 0x7ff1f00cb3d0 2024-09-13T18:57:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7ff1eea00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1f00b2c70 0x7ff1f006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7f0684a00640 1 -- 172.21.15.33:0/3052600190 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067402add0 con 0x7f0688160020 2024-09-13T18:57:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7f0684a00640 1 -- 172.21.15.33:0/3052600190 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674032440 con 0x7f0688160020 2024-09-13T18:57:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7f0684a00640 1 -- 172.21.15.33:0/3052600190 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740327d0 con 0x7f0688160020 2024-09-13T18:57:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7ff1ee000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff1f00ce010 0x7ff1f00b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53908/0 (socket says 172.21.15.33:53908) 2024-09-13T18:57:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.231+0000 7ff1ee000640 1 -- 172.21.15.33:0/2903309658 learned_addr learned my addr 172.21.15.33:0/2903309658 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373590076 0 0) 0x7ff1f00710b0 con 0x7ff1f00ce010 2024-09-13T18:57:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d4003520 con 0x7ff1f00ce010 2024-09-13T18:57:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ef400640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f00cb3d0 0x7ff1f00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 -- 172.21.15.33:0/3052600190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 msgr2=0x7f06880cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 --2- 172.21.15.33:0/3052600190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 0x7f06880cf280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f068808b630 tx=0x7f067402a080 comp rx=0 tx=0).stop 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 -- 172.21.15.33:0/3052600190 shutdown_connections 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681008471 0 0) 0x7ff1d4003520 con 0x7ff1f00ce010 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f00cb3d0 msgr2=0x7ff1f00cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.103:3300/0 conn(0x7f06880d1710 0x7f06880b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 --2- 172.21.15.33:0/3052600190 >> v2:172.21.15.33:3300/0 conn(0x7f0688160400 0x7f06880cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 --2- 172.21.15.33:0/3052600190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160020 0x7f06880cf280 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f068808b630 tx=0x7f067402a080 comp rx=0 tx=0).stop 2024-09-13T18:57:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7f068cc00640 1 -- 172.21.15.33:0/3052600190 >> 172.21.15.33:0/3052600190 conn(0x7f068808beb0 msgr2=0x7f06880d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f00cb3d0 0x7ff1f00cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 >> v2:172.21.15.103:3300/0 conn(0x7ff1f00b2c70 msgr2=0x7ff1f006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 --2- 172.21.15.33:0/2903309658 >> v2:172.21.15.103:3300/0 conn(0x7ff1f00b2c70 0x7ff1f006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.232+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0070780 con 0x7ff1f00ce010 2024-09-13T18:57:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7ff1e0001670 con 0x7ff1f00ce010 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 >> v1:172.21.15.33:6789/0 conn(0x7ff1f00ce010 legacy=0x7ff1f00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1d4003970 0x7ff1d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d40047c0 0x7ff1d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d4005180 0x7ff1d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00ce480 con 0x7ff1d4005180 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00704a0 con 0x7ff1d40047c0 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400bf70 con 0x7ff1d4003970 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.233+0000 7ff1eea00640 1 --2- 172.21.15.33:0/2903309658 >> v2:172.21.15.103:3300/0 conn(0x7ff1f00b2c70 0x7ff1f006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.234+0000 7ff1eea00640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1d4003970 0x7ff1d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.234+0000 7ff1ee000640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d40047c0 0x7ff1d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.234+0000 7ff1ef400640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d4005180 0x7ff1d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.234+0000 7f068cc00640 1 -- 172.21.15.33:0/3052600190 shutdown_connections 2024-09-13T18:57:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.235+0000 7ff1eea00640 1 -- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d40047c0 msgr2=0x7ff1d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.235+0000 7ff1eea00640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d40047c0 0x7ff1d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.235+0000 7ff1eea00640 1 -- 172.21.15.33:0/2903309658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d4005180 msgr2=0x7ff1d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.235+0000 7ff1eea00640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d4005180 0x7ff1d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.235+0000 7ff1eea00640 1 -- 172.21.15.33:0/2903309658 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0070780 con 0x7ff1d4003970 2024-09-13T18:57:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.234+0000 7f068cc00640 1 -- 172.21.15.33:0/3052600190 wait complete. 2024-09-13T18:57:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.237+0000 7ff1eea00640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1d4003970 0x7ff1d4003d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80073e0 tx=0x7ff1d40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2bd11a5aae7484 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.238+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e802c680 con 0x7ff1d4003970 2024-09-13T18:57:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.238+0000 7ff1ed600640 1 -- 172.21.15.33:0/2903309658 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e802c7e0 con 0x7ff1d4003970 2024-09-13T18:57:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.238+0000 7fba01000640 1 Processor -- start 2024-09-13T18:57:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7fba01000640 1 -- start start 2024-09-13T18:57:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1efe00640 1 -- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1d4003970 msgr2=0x7ff1d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1efe00640 1 --2- 172.21.15.33:0/2903309658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1d4003970 0x7ff1d4003d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80073e0 tx=0x7ff1d40057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1ef400640 1 -- 172.21.15.33:0/2903309658 reap_dead start 2024-09-13T18:57:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7f16a6a00640 1 Processor -- start 2024-09-13T18:57:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1efe00640 1 -- 172.21.15.33:0/2903309658 shutdown_connections 2024-09-13T18:57:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1efe00640 1 -- 172.21.15.33:0/2903309658 >> 172.21.15.33:0/2903309658 conn(0x7ff1f00ae310 msgr2=0x7ff1f00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.238+0000 7f068cc00640 1 Processor -- start 2024-09-13T18:57:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7f068cc00640 1 -- start start 2024-09-13T18:57:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.239+0000 7ff1efe00640 1 -- 172.21.15.33:0/2903309658 shutdown_connections 2024-09-13T18:57:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.240+0000 7f16a6a00640 1 -- start start 2024-09-13T18:57:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.240+0000 7ff1efe00640 1 -- 172.21.15.33:0/2903309658 wait complete. 2024-09-13T18:57:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.241+0000 7fba01000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9fc06f750 0x7fb9fc1675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.241+0000 7fba01000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc145bb0 con 0x7fb9fc1457d0 2024-09-13T18:57:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.241+0000 7fba01000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc06b6d0 con 0x7fb9fc0af880 2024-09-13T18:57:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.241+0000 7fba01000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0afcc0 con 0x7fb9fc06f750 2024-09-13T18:57:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.241+0000 7fb9f9e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb9fc1457d0 0x7fb9fc146090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53916/0 (socket says 172.21.15.33:53916) 2024-09-13T18:57:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7fb9f9e00640 1 -- 172.21.15.33:0/2045191970 learned_addr learned my addr 172.21.15.33:0/2045191970 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7fb9fa800640 1 --2- 172.21.15.33:0/2045191970 >> v2:172.21.15.33:3300/0 conn(0x7fb9fc06f750 0x7fb9fc1675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f068cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06880d1710 0x7f06880c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f16a6a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1698005ce0 0x7f16980539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f16a6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16980e2d80 0x7f169803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f16a6a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1698058720 con 0x7f1698053ef0 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f16a6a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1698057680 con 0x7f16980e2d80 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7f16a6a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1698057960 con 0x7f1698005ce0 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7fb9fa800640 1 -- 172.21.15.33:0/2045191970 >> v1:172.21.15.103:6789/0 conn(0x7fb9fc0af880 legacy=0x7fb9fc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7fb9fa800640 1 -- 172.21.15.33:0/2045191970 >> v1:172.21.15.33:6789/0 conn(0x7fb9fc1457d0 legacy=0x7fb9fc146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.242+0000 7fb9fa800640 1 -- 172.21.15.33:0/2045191970 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0b01f0 con 0x7fb9fc06f750 2024-09-13T18:57:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f16a6000640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1698053ef0 0x7f169803c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49692/0 (socket says 172.21.15.33:49692) 2024-09-13T18:57:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f16a6000640 1 -- 172.21.15.33:0/1747885354 learned_addr learned my addr 172.21.15.33:0/1747885354 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f16a5600640 1 --2- 172.21.15.33:0/1747885354 >> v2:172.21.15.103:3300/0 conn(0x7f1698005ce0 0x7f16980539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7ff1efe00640 1 Processor -- start 2024-09-13T18:57:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f068cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160400 0x7f06881fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7ff1efe00640 1 -- start start 2024-09-13T18:57:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f0685e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06880d1710 0x7f06880c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f169fe00640 1 -- 172.21.15.33:0/1747885354 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405776024 0 0) 0x7f1698058720 con 0x7f1698053ef0 2024-09-13T18:57:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.243+0000 7f169fe00640 1 -- 172.21.15.33:0/1747885354 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1688003520 con 0x7f1698053ef0 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f068cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06882027b0 0x7f0688202c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f068cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688203320 con 0x7f06882027b0 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f068cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688203600 con 0x7f06880d1710 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f068cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880c8630 con 0x7f0688160400 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f0685e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06880d1710 0x7f06880c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55038/0 (socket says 172.21.15.33:55038) 2024-09-13T18:57:24.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f0685400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160400 0x7f06881fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.245+0000 7f0686800640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06882027b0 0x7f0688202c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.245+0000 7f0685e00640 1 -- 172.21.15.33:0/1784029948 learned_addr learned my addr 172.21.15.33:0/1784029948 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f16a5600640 1 -- 172.21.15.33:0/1747885354 >> v2:172.21.15.33:3300/0 conn(0x7f16980e2d80 msgr2=0x7f169803bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f16a5600640 1 --2- 172.21.15.33:0/1747885354 >> v2:172.21.15.33:3300/0 conn(0x7f16980e2d80 0x7f169803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f16a5600640 1 -- 172.21.15.33:0/1747885354 >> v1:172.21.15.103:6789/0 conn(0x7f1698053ef0 legacy=0x7f169803c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.244+0000 7f16a5600640 1 -- 172.21.15.33:0/1747885354 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698057c40 con 0x7f1698005ce0 2024-09-13T18:57:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.245+0000 7fb9fa800640 1 --2- 172.21.15.33:0/2045191970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc06f750 0x7fb9fc1675c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b223427b8c5db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.245+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 0x7ff1f00a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0685400640 1 -- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06880d1710 msgr2=0x7f06880c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1f014bc70 0x7ff1f0148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f16a5600640 1 --2- 172.21.15.33:0/1747885354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980539b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1698058960 tx=0x7f169402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c4c82e8d51c77a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7fb9f8a00640 1 -- 172.21.15.33:0/2045191970 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007740 con 0x7fb9fc06f750 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7fb9f8a00640 1 -- 172.21.15.33:0/2045191970 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f402d050 con 0x7fb9fc06f750 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7fb9f8a00640 1 -- 172.21.15.33:0/2045191970 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007ac0 con 0x7fb9fc06f750 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0685400640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06880d1710 0x7f06880c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0685400640 1 -- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06882027b0 msgr2=0x7f0688202c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0685400640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06882027b0 0x7f0688202c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0685400640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06780094d0 con 0x7f0688160400 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f0686800640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06882027b0 0x7f0688202c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f014c0d0 0x7ff1f01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1efe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0149710 con 0x7ff1f014bc70 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1efe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0164340 con 0x7ff1d4003970 2024-09-13T18:57:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1efe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0149b10 con 0x7ff1f014c0d0 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1eea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 0x7ff1f00a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1eea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 0x7ff1f00a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55054/0 (socket says 172.21.15.33:55054) 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1eea00640 1 -- 172.21.15.33:0/67452034 learned_addr learned my addr 172.21.15.33:0/67452034 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f169fe00640 1 -- 172.21.15.33:0/1747885354 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694032440 con 0x7f1698005ce0 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f169fe00640 1 -- 172.21.15.33:0/1747885354 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940325a0 con 0x7f1698005ce0 2024-09-13T18:57:24.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7f169fe00640 1 -- 172.21.15.33:0/1747885354 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694032930 con 0x7f1698005ce0 2024-09-13T18:57:24.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.246+0000 7ff1ee000640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1f014bc70 0x7ff1f0148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1ef400640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f014c0d0 0x7ff1f01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7f0685400640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160400 0x7f06881fe9c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06880cf000 tx=0x7f067800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1eea00640 1 -- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f014c0d0 msgr2=0x7ff1f01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1eea00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f014c0d0 0x7ff1f01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1eea00640 1 -- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1f014bc70 msgr2=0x7ff1f0148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1eea00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1f014bc70 0x7ff1f0148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1eea00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00a89a0 con 0x7ff1d4003970 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fba01000640 1 -- 172.21.15.33:0/2045191970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc06f750 msgr2=0x7fb9fc1675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fba01000640 1 --2- 172.21.15.33:0/2045191970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc06f750 0x7fb9fc1675c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a660 comp rx=0 tx=0).stop 2024-09-13T18:57:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7ff1ef400640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1f014c0d0 0x7ff1f01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7f640b200640 1 Processor -- start 2024-09-13T18:57:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fd3c5200640 1 Processor -- start 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fba01000640 1 -- 172.21.15.33:0/2045191970 shutdown_connections 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fba01000640 1 --2- 172.21.15.33:0/2045191970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc06f750 0x7fb9fc1675c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fba01000640 1 -- 172.21.15.33:0/2045191970 >> 172.21.15.33:0/2045191970 conn(0x7fb9fc0b24b0 msgr2=0x7fb9fc0b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800c910 con 0x7f0688160400 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800ca70 con 0x7f0688160400 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800cde0 con 0x7f0688160400 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 -- 172.21.15.33:0/1747885354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 msgr2=0x7f16980539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 --2- 172.21.15.33:0/1747885354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980539b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1698058960 tx=0x7f169402a270 comp rx=0 tx=0).stop 2024-09-13T18:57:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f640b200640 1 -- start start 2024-09-13T18:57:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.247+0000 7fd3c5200640 1 -- start start 2024-09-13T18:57:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7fba01000640 1 -- 172.21.15.33:0/2045191970 shutdown_connections 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 -- 172.21.15.33:0/1747885354 shutdown_connections 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 --2- 172.21.15.33:0/1747885354 >> v2:172.21.15.33:3300/0 conn(0x7f16980e2d80 0x7f169803bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 --2- 172.21.15.33:0/1747885354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980539b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f16a6a00640 1 -- 172.21.15.33:0/1747885354 >> 172.21.15.33:0/1747885354 conn(0x7f169803a4f0 msgr2=0x7f169803a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0674009400 con 0x7f0688160400 2024-09-13T18:57:24.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06880c8bf0 con 0x7f0688160400 2024-09-13T18:57:24.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.248+0000 7fba01000640 1 -- 172.21.15.33:0/2045191970 wait complete. 2024-09-13T18:57:24.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.249+0000 7f16a6a00640 1 -- 172.21.15.33:0/1747885354 shutdown_connections 2024-09-13T18:57:24.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.249+0000 7f16a6a00640 1 -- 172.21.15.33:0/1747885354 wait complete. 2024-09-13T18:57:24.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3c01611d0 0x7fd3c0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c006d1e0 0x7fd3c006a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06880cf280 con 0x7f0688160400 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00aecf0 con 0x7fd3c0160df0 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c006d750 con 0x7fd3c01611d0 2024-09-13T18:57:24.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3c5200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c006da30 con 0x7fd3c006d1e0 2024-09-13T18:57:24.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.249+0000 7ff1eea00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 0x7ff1f00a8460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8007500 tx=0x7ff1e8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3bde00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7f640b200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f640406a9c0 0x7f64040ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7f640b200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640415c4a0 con 0x7f6404070d80 2024-09-13T18:57:24.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fd3be800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c006d1e0 0x7fd3c006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7f640b200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640415cd40 con 0x7f64041588c0 2024-09-13T18:57:24.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7f640b200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040b27b0 con 0x7f640406a9c0 2024-09-13T18:57:24.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7fd3bde00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35348/0 (socket says 172.21.15.33:35348) 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.250+0000 7fba01000640 1 Processor -- start 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7fba01000640 1 -- start start 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8043070 con 0x7ff1d4003970 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e803b040 con 0x7ff1d4003970 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f0164060 con 0x7ff1d4003970 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7f6403400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6404070d80 0x7f64040b20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53930/0 (socket says 172.21.15.33:53930) 2024-09-13T18:57:24.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7f6403400640 1 -- 172.21.15.33:0/924420667 learned_addr learned my addr 172.21.15.33:0/924420667 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7f6409200640 1 --2- 172.21.15.33:0/924420667 >> v2:172.21.15.103:3300/0 conn(0x7f640406a9c0 0x7f64040ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7fd3bde00640 1 -- 172.21.15.33:0/1724446496 learned_addr learned my addr 172.21.15.33:0/1724446496 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f014a090 con 0x7ff1d4003970 2024-09-13T18:57:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.251+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e803a070 con 0x7ff1d4003970 2024-09-13T18:57:24.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7fba01000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 0x7fb9fc133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fba01000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9fc0af880 0x7fb9fc1357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fba01000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc1457d0 0x7fb9fc141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7f16a6a00640 1 Processor -- start 2024-09-13T18:57:24.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7f6409200640 1 -- 172.21.15.33:0/924420667 >> v1:172.21.15.103:6789/0 conn(0x7f64041588c0 legacy=0x7f6404070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7fd3bd400640 1 --2- 172.21.15.33:0/1724446496 >> v2:172.21.15.103:3300/0 conn(0x7fd3c01611d0 0x7fd3c0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7fd3bd400640 1 -- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c006d1e0 msgr2=0x7fd3c006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7fd3bd400640 1 --2- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c006d1e0 0x7fd3c006a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7fd3bd400640 1 -- 172.21.15.33:0/1724446496 >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 msgr2=0x7fd3c00aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fc808600640 1 Processor -- start 2024-09-13T18:57:24.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.252+0000 7f6402a00640 1 -- 172.21.15.33:0/924420667 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788664592 0 0) 0x7f640415c4a0 con 0x7f6404070d80 2024-09-13T18:57:24.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7f6409200640 1 -- 172.21.15.33:0/924420667 >> v1:172.21.15.33:6789/0 conn(0x7f6404070d80 legacy=0x7f64040b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7f6409200640 1 -- 172.21.15.33:0/924420667 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040b32d0 con 0x7f640406a9c0 2024-09-13T18:57:24.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fc808600640 1 -- start start 2024-09-13T18:57:24.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fba01000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc134730 con 0x7fb9fc1457d0 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fba01000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc134a10 con 0x7fb9fc0af880 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fba01000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc134cf0 con 0x7fb9fc06f750 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7fb9f9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 0x7fb9fc133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7f16a6a00640 1 -- start start 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fd3bd400640 1 --2- 172.21.15.33:0/1724446496 >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7fd3bd400640 1 -- 172.21.15.33:0/1724446496 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c006dd10 con 0x7fd3c01611d0 2024-09-13T18:57:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7fd3bde00640 1 --2- 172.21.15.33:0/1724446496 >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7fb9f9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 0x7fb9fc133ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38722/0 (socket says 172.21.15.33:38722) 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7fb9f9e00640 1 -- 172.21.15.33:0/4051209667 learned_addr learned my addr 172.21.15.33:0/4051209667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698053ef0 0x7f169804d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16980e2d80 0x7f169804da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16980e60d0 con 0x7f1698053ef0 2024-09-13T18:57:24.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16980e54c0 con 0x7f1698005ce0 2024-09-13T18:57:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f16a6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980e57a0 con 0x7f16980e2d80 2024-09-13T18:57:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7fd3bd400640 1 --2- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c01611d0 0x7fd3c0069ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cc370 tx=0x7fd3a802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d9a5531e837933f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f16a5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f16a5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980dc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55092/0 (socket says 172.21.15.33:55092) 2024-09-13T18:57:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f16a5600640 1 -- 172.21.15.33:0/3297499321 learned_addr learned my addr 172.21.15.33:0/3297499321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.254+0000 7f6409200640 1 --2- 172.21.15.33:0/924420667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f64040ad6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0097a0 tx=0x7f63fc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=981f7cc495f505e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7fb9fa800640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc1457d0 0x7fb9fc141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7fb9f9400640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9fc0af880 0x7fb9fc1357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.253+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0678005990 con 0x7f0688160400 2024-09-13T18:57:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f067e000640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f066806acd0 0x7f066806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06780895d0 con 0x7f0688160400 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff1e802c950 con 0x7ff1d4003970 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1f00b00d0 con 0x7ff1d4003970 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f6402a00640 1 -- 172.21.15.33:0/924420667 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc032440 con 0x7f640406a9c0 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f6402a00640 1 -- 172.21.15.33:0/924420667 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc0325a0 con 0x7f640406a9c0 2024-09-13T18:57:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f6402a00640 1 -- 172.21.15.33:0/924420667 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc032930 con 0x7f640406a9c0 2024-09-13T18:57:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f16a6000640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16980e2d80 0x7f169804da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f067e000640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7f0668072ef0 0x7f0668075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.255+0000 7f16a4c00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698053ef0 0x7f169804d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc808600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80015a520 0x7fc80006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06680759c0 con 0x7f0668072ef0 2024-09-13T18:57:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0678089980 con 0x7f0688160400 2024-09-13T18:57:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc808600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80006bc00 con 0x7fc8000ce020 2024-09-13T18:57:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc808600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80006bea0 con 0x7fc8000b1b00 2024-09-13T18:57:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc808600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80006c180 con 0x7fc80015a520 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fd3bca00640 1 -- 172.21.15.33:0/1724446496 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8007740 con 0x7fd3c01611d0 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fd3bca00640 1 -- 172.21.15.33:0/1724446496 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a802d050 con 0x7fd3c01611d0 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fd3bca00640 1 -- 172.21.15.33:0/1724446496 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8007b00 con 0x7fd3c01611d0 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f0686800640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7f0668072ef0 0x7f0668075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f16a6000640 1 -- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 msgr2=0x7f16980dc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f16a6000640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1698005ce0 0x7f16980dc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7f16a6000640 1 -- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698053ef0 msgr2=0x7f169804d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc805c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80015a520 0x7fc80006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc805c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80015a520 0x7fc80006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35388/0 (socket says 172.21.15.33:35388) 2024-09-13T18:57:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fc805c00640 1 -- 172.21.15.33:0/2837863026 learned_addr learned my addr 172.21.15.33:0/2837863026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7f0685e00640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f066806acd0 0x7f066806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7ff1e6a00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1d006ac80 0x7ff1d006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fb9f9e00640 1 -- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9fc0af880 msgr2=0x7fb9fc1357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fb9f9e00640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9fc0af880 0x7fb9fc1357d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fb9f9e00640 1 -- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc1457d0 msgr2=0x7fb9fc141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fb9f9e00640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc1457d0 0x7fb9fc141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.256+0000 7fb9f9e00640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009a70 con 0x7fb9fc06f750 2024-09-13T18:57:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7f0686800640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7f0668072ef0 0x7f0668075310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1e80a9620 con 0x7ff1d4003970 2024-09-13T18:57:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fb9f9400640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9fc0af880 0x7fb9fc1357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fc7ffe00640 1 -- 172.21.15.33:0/2837863026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233219411 0 0) 0x7fc80006bea0 con 0x7fc8000b1b00 2024-09-13T18:57:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fc7ffe00640 1 -- 172.21.15.33:0/2837863026 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e8003520 con 0x7fc8000b1b00 2024-09-13T18:57:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fc805c00640 1 -- 172.21.15.33:0/2837863026 >> v1:172.21.15.103:6789/0 conn(0x7fc8000b1b00 legacy=0x7fc8000cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fd3c5200640 1 -- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c01611d0 msgr2=0x7fd3c0069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fd3c5200640 1 --2- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c01611d0 0x7fd3c0069ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cc370 tx=0x7fd3a802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7ff1e6a00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7ff1d0072ea0 0x7ff1d00752c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fb9f9e00640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 0x7fb9fc133ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00b430 tx=0x7fb9ec00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f16a6000640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698053ef0 0x7f169804d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f16a6000640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009400 con 0x7f16980e2d80 2024-09-13T18:57:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7ff1ee000640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1d006ac80 0x7ff1d006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f16a4c00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698053ef0 0x7f169804d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fc805c00640 1 -- 172.21.15.33:0/2837863026 >> v1:172.21.15.33:6789/0 conn(0x7fc8000ce020 legacy=0x7fc80015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.257+0000 7fc805c00640 1 -- 172.21.15.33:0/2837863026 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80006c460 con 0x7fc80015a520 2024-09-13T18:57:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1d0075970 con 0x7ff1d0072ea0 2024-09-13T18:57:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f16a6000640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16980e2d80 0x7f169804da30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16a0061a70 tx=0x7f16a0067920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec011830 con 0x7fb9fc06f750 2024-09-13T18:57:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fd3c5200640 1 -- 172.21.15.33:0/1724446496 shutdown_connections 2024-09-13T18:57:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fd3c5200640 1 --2- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c006d1e0 0x7fd3c006a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fd3c5200640 1 --2- 172.21.15.33:0/1724446496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c01611d0 0x7fd3c0069ed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fd3c5200640 1 --2- 172.21.15.33:0/1724446496 >> v2:172.21.15.33:3300/0 conn(0x7fd3c0160df0 0x7fd3c00aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fd3c5200640 1 -- 172.21.15.33:0/1724446496 >> 172.21.15.33:0/1724446496 conn(0x7fd3c006afe0 msgr2=0x7fd3c006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc134fd0 con 0x7fb9fc06f750 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc134420 con 0x7fb9fc06f750 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a00923b0 con 0x7f16980e2d80 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0092570 con 0x7f16980e2d80 2024-09-13T18:57:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0092960 con 0x7f16980e2d80 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f640b200640 1 -- 172.21.15.33:0/924420667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 msgr2=0x7f64040ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f640b200640 1 --2- 172.21.15.33:0/924420667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f64040ad6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0097a0 tx=0x7f63fc02a230 comp rx=0 tx=0).stop 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f640b200640 1 -- 172.21.15.33:0/924420667 shutdown_connections 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f640b200640 1 --2- 172.21.15.33:0/924420667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f64040ad6c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f640b200640 1 -- 172.21.15.33:0/924420667 >> 172.21.15.33:0/924420667 conn(0x7f6404069ed0 msgr2=0x7f640406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec011990 con 0x7fb9fc06f750 2024-09-13T18:57:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec011830 con 0x7fb9fc06f750 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16980e5a80 con 0x7f16980e2d80 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16980509a0 con 0x7f16980e2d80 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7f0685e00640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f066806acd0 0x7f066806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0674000c00 tx=0x7f067402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== osd.0 v2:172.21.15.33:6808/2676372550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06680759c0 con 0x7f0668072ef0 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7f640b200640 1 -- 172.21.15.33:0/924420667 shutdown_connections 2024-09-13T18:57:24.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7f640b200640 1 -- 172.21.15.33:0/924420667 wait complete. 2024-09-13T18:57:24.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7fd3c5200640 1 -- 172.21.15.33:0/1724446496 shutdown_connections 2024-09-13T18:57:24.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.258+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1e80abd30 con 0x7ff1d4003970 2024-09-13T18:57:24.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7ff1ee000640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1d006ac80 0x7ff1d006d140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0000c00 tx=0x7ff1e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.259+0000 7ff1ef400640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7ff1d0072ea0 0x7ff1d00752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.260+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16980e5910 con 0x7f16980e2d80 2024-09-13T18:57:24.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.260+0000 7fd3c5200640 1 -- 172.21.15.33:0/1724446496 wait complete. 2024-09-13T18:57:24.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.261+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9d4000fc0 con 0x7fb9fc06f750 2024-09-13T18:57:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.261+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f16a0092ac0 con 0x7f16980e2d80 2024-09-13T18:57:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.262+0000 7f169d600640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f168006ac50 0x7f168006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.262+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16a0102cc0 con 0x7f16980e2d80 2024-09-13T18:57:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.261+0000 7f640b200640 1 Processor -- start 2024-09-13T18:57:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.262+0000 7f640b200640 1 -- start start 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.261+0000 7fc805c00640 1 --2- 172.21.15.33:0/2837863026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc80006b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009870 tx=0x7fc7ec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751fd93a275f3926 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.262+0000 7fc7ffe00640 1 -- 172.21.15.33:0/2837863026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec032440 con 0x7fc80015a520 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.262+0000 7fc7ffe00640 1 -- 172.21.15.33:0/2837863026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec0325a0 con 0x7fc80015a520 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fd3c5200640 1 Processor -- start 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7f169d600640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f1680072e70 0x7f1680075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7ff1ef400640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7ff1d0072ea0 0x7ff1d00752c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1680075940 con 0x7f1680072e70 2024-09-13T18:57:24.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7f16a5600640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f168006ac50 0x7f168006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fc808600640 1 -- 172.21.15.33:0/2837863026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 msgr2=0x7fc80006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9ec011b00 con 0x7fb9fc06f750 2024-09-13T18:57:24.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fc7ffe00640 1 -- 172.21.15.33:0/2837863026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec032440 con 0x7fc80015a520 2024-09-13T18:57:24.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fc808600640 1 --2- 172.21.15.33:0/2837863026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc80006b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009870 tx=0x7fc7ec02a2a0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16a01052a0 con 0x7f16980e2d80 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f6404150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6404070d80 0x7f6404155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64041588c0 0x7f6404155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404152750 con 0x7f6404070d80 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041549e0 con 0x7f640406a9c0 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f640b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6404154cc0 con 0x7f64041588c0 2024-09-13T18:57:24.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7fb23fc00640 1 Processor -- start 2024-09-13T18:57:24.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f16a4c00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f1680072e70 0x7f1680075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7fc808600640 1 -- 172.21.15.33:0/2837863026 shutdown_connections 2024-09-13T18:57:24.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fc808600640 1 --2- 172.21.15.33:0/2837863026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc80006b6c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.263+0000 7fd3c5200640 1 -- start start 2024-09-13T18:57:24.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c006d1e0 0x7fd3c014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c0160df0 0x7fd3c00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 0x7fd3c01637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7f16a4c00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f1680072e70 0x7f1680075290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c014f4c0 con 0x7fd3c0160df0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c014e8b0 con 0x7fd3c006d1e0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3c5200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c014eb90 con 0x7fd3c01611d0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 0x7fd3c01637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 0x7fd3c01637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38742/0 (socket says 172.21.15.33:38742) 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 -- 172.21.15.33:0/883352252 learned_addr learned my addr 172.21.15.33:0/883352252 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f6403e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f6404150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f6403e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f6404150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55096/0 (socket says 172.21.15.33:55096) 2024-09-13T18:57:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f6403e00640 1 -- 172.21.15.33:0/2955429915 learned_addr learned my addr 172.21.15.33:0/2955429915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7f6403400640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6404070d80 0x7f6404155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 -- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c006d1e0 msgr2=0x7fd3c014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3bde00640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c006d1e0 0x7fd3c014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c006d1e0 0x7fd3c014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fd3be800640 1 -- 172.21.15.33:0/883352252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c0160df0 msgr2=0x7fd3c00adb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:57:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fc808600640 1 -- 172.21.15.33:0/2837863026 >> 172.21.15.33:0/2837863026 conn(0x7fc8000b0510 msgr2=0x7fc8000b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6409200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64041588c0 0x7f6404155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3bd400640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c0160df0 0x7fd3c00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 -- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64041588c0 msgr2=0x7f6404155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64041588c0 0x7f6404155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 -- 172.21.15.33:0/2955429915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6404070d80 msgr2=0x7f6404155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6404070d80 0x7f6404155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3be800640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c0160df0 0x7fd3c00adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3be800640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00094d0 con 0x7fd3c01611d0 2024-09-13T18:57:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009400 con 0x7f640406a9c0 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.265+0000 7fb9f2000640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9dc06acc0 0x7fb9dc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9ec088f90 con 0x7fb9fc06f750 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb9f2000640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7fb9dc072e60 0x7fb9dc075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9dc075930 con 0x7fb9dc072e60 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ec011830 con 0x7fb9fc06f750 2024-09-13T18:57:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3bde00640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c006d1e0 0x7fd3c014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== osd.1 v2:172.21.15.33:6816/3216118851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff1d0075970 con 0x7ff1d0072ea0 2024-09-13T18:57:24.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb9fa800640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7fb9dc072e60 0x7fb9dc075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb9f9400640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9dc06acc0 0x7fb9dc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f16a5600640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f168006ac50 0x7f168006d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f169402a2b0 tx=0x7f169402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7f6403e00640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f6404150030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c730 tx=0x7f63f400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fc808600640 1 -- 172.21.15.33:0/2837863026 shutdown_connections 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fc808600640 1 -- 172.21.15.33:0/2837863026 wait complete. 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.264+0000 7fb23fc00640 1 -- start start 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb23fc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb238070d80 0x7fb2380ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb23fc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 0x7fb2380b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb23fc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23815c4a0 con 0x7fb2381588c0 2024-09-13T18:57:24.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb23fc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23815cd40 con 0x7fb238070d80 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fb23fc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2380b32d0 con 0x7fb2380b1810 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb23dc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 0x7fb2380b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb237e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb238070d80 0x7fb2380ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb23dc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 0x7fb2380b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55114/0 (socket says 172.21.15.33:55114) 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fb23dc00640 1 -- 172.21.15.33:0/2872364424 learned_addr learned my addr 172.21.15.33:0/2872364424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3be800640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 0x7fd3c01637f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800e830 tx=0x7fd3b800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.266+0000 7fd3bd400640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c0160df0 0x7fd3c00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8009610 con 0x7fd3c01611d0 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800c940 con 0x7fd3c01611d0 2024-09-13T18:57:24.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800ccf0 con 0x7fd3c01611d0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4003b70 con 0x7f640406a9c0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4003cf0 con 0x7f640406a9c0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4003ea0 con 0x7f640406a9c0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6404154fa0 con 0x7f640406a9c0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8009a70 con 0x7fd3c01611d0 2024-09-13T18:57:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb9f9400640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9dc06acc0 0x7fb9dc06d180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001bc0 tx=0x7fb9e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.267+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== osd.3 v2:172.21.15.33:6800/2901377922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1680075940 con 0x7f1680072e70 2024-09-13T18:57:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6404155560 con 0x7f640406a9c0 2024-09-13T18:57:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c014f150 con 0x7fd3c01611d0 2024-09-13T18:57:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb237e00640 1 -- 172.21.15.33:0/2872364424 >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 msgr2=0x7fb2380b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb237e00640 1 --2- 172.21.15.33:0/2872364424 >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 0x7fb2380b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb237e00640 1 -- 172.21.15.33:0/2872364424 >> v1:172.21.15.33:6789/0 conn(0x7fb2381588c0 legacy=0x7fb238070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb237e00640 1 -- 172.21.15.33:0/2872364424 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23815c6f0 con 0x7fb238070d80 2024-09-13T18:57:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.268+0000 7fb9fa800640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7fb9dc072e60 0x7fb9dc075280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.269+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6404071410 con 0x7f640406a9c0 2024-09-13T18:57:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.270+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3c00b2900 con 0x7fd3c01611d0 2024-09-13T18:57:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.270+0000 7fb237e00640 1 --2- 172.21.15.33:0/2872364424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb2380ad6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb238068840 tx=0x7fb22402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dca30887373c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.270+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== osd.2 v2:172.21.15.33:6824/3897994756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb9dc075930 con 0x7fb9dc072e60 2024-09-13T18:57:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.270+0000 7fc808600640 1 Processor -- start 2024-09-13T18:57:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.271+0000 7fb237400640 1 -- 172.21.15.33:0/2872364424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22402ae70 con 0x7fb238070d80 2024-09-13T18:57:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.271+0000 7fb237400640 1 -- 172.21.15.33:0/2872364424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224032440 con 0x7fb238070d80 2024-09-13T18:57:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.271+0000 7fb237400640 1 -- 172.21.15.33:0/2872364424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240327d0 con 0x7fb238070d80 2024-09-13T18:57:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.271+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3b8013470 con 0x7fd3c01611d0 2024-09-13T18:57:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.272+0000 7fb23fc00640 1 -- 172.21.15.33:0/2872364424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 msgr2=0x7fb2380ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.272+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2872364424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb2380ad6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb238068840 tx=0x7fb22402a160 comp rx=0 tx=0).stop 2024-09-13T18:57:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.270+0000 7fc808600640 1 -- start start 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.272+0000 7fc808600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 0x7fc8000abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.272+0000 7fc808600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 0x7fc8000af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.272+0000 7fc808600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc800152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc805c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 0x7fc8000abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc805c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 0x7fc8000abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55128/0 (socket says 172.21.15.33:55128) 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc805200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 0x7fc8000af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc805200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 0x7fc8000af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38744/0 (socket says 172.21.15.33:38744) 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc806600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc800152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc805c00640 1 -- 172.21.15.33:0/2327186519 learned_addr learned my addr 172.21.15.33:0/2327186519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fd3b6000640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd39c06ad00 0x7fd39c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000acd80 con 0x7fc80015a520 2024-09-13T18:57:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fb23fc00640 1 -- 172.21.15.33:0/2872364424 shutdown_connections 2024-09-13T18:57:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000ac7c0 con 0x7fc8000b1b00 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000acaa0 con 0x7fc8000ce020 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.271+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f63f400aa90 con 0x7f640406a9c0 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7f63fbe00640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f63e006acd0 0x7f63e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63f4089030 con 0x7f640406a9c0 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7f63fbe00640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f63e0072e70 0x7f63e0075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63e0075940 con 0x7f63e0072e70 2024-09-13T18:57:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.273+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b8089450 con 0x7fd3c01611d0 2024-09-13T18:57:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63f4001810 con 0x7f640406a9c0 2024-09-13T18:57:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7f6403400640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f63e006acd0 0x7f63e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2872364424 >> v2:172.21.15.103:3300/0 conn(0x7fb2380b1810 0x7fb2380b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2872364424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb2380ad6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fb23fc00640 1 -- 172.21.15.33:0/2872364424 >> 172.21.15.33:0/2872364424 conn(0x7fb238069ed0 msgr2=0x7fb23806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fd3bde00640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd39c06ad00 0x7fd39c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7f6409200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f63e0072e70 0x7f63e0075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fd3b6000640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7fd39c072f20 0x7fd39c075340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805200640 1 -- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 msgr2=0x7fc8000abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805200640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 0x7fc8000abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805200640 1 -- 172.21.15.33:0/2327186519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 msgr2=0x7fc800152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805200640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80015a520 0x7fc800152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805200640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0094d0 con 0x7fc8000ce020 2024-09-13T18:57:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fb23fc00640 1 -- 172.21.15.33:0/2872364424 shutdown_connections 2024-09-13T18:57:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.274+0000 7fc805c00640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8000b1b00 0x7fc8000abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7f6403400640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f63e006acd0 0x7f63e006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6404154070 tx=0x7f63ec007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7f6409200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f63e0072e70 0x7f63e0075290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fd3bde00640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd39c06ad00 0x7fd39c06d1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009c50 tx=0x7fd3b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd39c0759f0 con 0x7fd39c072f20 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3b808ba70 con 0x7fd3c01611d0 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fd3bd400640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7fd39c072f20 0x7fd39c075340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fc805200640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 0x7fc8000af030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c7f0 tx=0x7fc7f800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fb23fc00640 1 -- 172.21.15.33:0/2872364424 wait complete. 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.275+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8003b70 con 0x7fc8000ce020 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.276+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8003cd0 con 0x7fc8000ce020 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.276+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc800152560 con 0x7fc8000ce020 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.276+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8000ac4b0 con 0x7fc8000ce020 2024-09-13T18:57:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.276+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800aa70 con 0x7fc8000ce020 2024-09-13T18:57:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.276+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== osd.4 v2:172.21.15.103:6824/3878985058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f63e0075940 con 0x7f63e0072e70 2024-09-13T18:57:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.277+0000 7fd3bd400640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7fd39c072f20 0x7fd39c075340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.277+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc80006cf40 con 0x7fc8000ce020 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.278+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== osd.5 v2:172.21.15.103:6816/1671521011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd39c0759f0 con 0x7fd39c072f20 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.279+0000 7fb23fc00640 1 Processor -- start 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.279+0000 7fb23fc00640 1 -- start start 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb23815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 0x7fb23814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2381588c0 0x7fb2381f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381f3040 con 0x7fb238070d80 2024-09-13T18:57:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23814b050 con 0x7fb2381588c0 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381f23c0 con 0x7fb2380b1810 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb23815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb237e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 0x7fb23814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb237e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 0x7fb23814ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38756/0 (socket says 172.21.15.33:38756) 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb237e00640 1 -- 172.21.15.33:0/2175891541 learned_addr learned my addr 172.21.15.33:0/2175891541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.281+0000 7fb23dc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2381588c0 0x7fb2381f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7f800abd0 con 0x7fc8000ce020 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fc7fd600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7e006ac00 0x7fc7e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7f8089200 con 0x7fc8000ce020 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.284+0000 7fc7fd600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7fc7e0072da0 0x7fc7e00751c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.284+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7e0075870 con 0x7fc7e0072da0 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.284+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7f808b820 con 0x7fc8000ce020 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fb237e00640 1 -- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2381588c0 msgr2=0x7fb2381f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fb237e00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2381588c0 0x7fb2381f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fb237e00640 1 -- 172.21.15.33:0/2175891541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 msgr2=0x7fb23815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fb237e00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb238070d80 0x7fb23815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.282+0000 7fb237e00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009400 con 0x7fb2380b1810 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fb237e00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 0x7fb23814ab10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb224000c00 tx=0x7fb2240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224030850 con 0x7fb2380b1810 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240309b0 con 0x7fb2380b1810 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224030d60 con 0x7fb2380b1810 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.283+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2381f26a0 con 0x7fb2380b1810 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.284+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2381f2c60 con 0x7fb2380b1810 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.285+0000 7fc805c00640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7e006ac00 0x7fc7e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.285+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2380b2f50 con 0x7fb2380b1810 2024-09-13T18:57:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.286+0000 7fc805c00640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7e006ac00 0x7fc7e006d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fc806600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7fc7e0072da0 0x7fc7e00751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.286+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb224039040 con 0x7fb2380b1810 2024-09-13T18:57:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb234c00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb21806ac50 0x7fb21806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2240a9ea0 con 0x7fb2380b1810 2024-09-13T18:57:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fc806600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7fc7e0072da0 0x7fc7e00751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 --> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06880c8770 con 0x7f0668072ef0 2024-09-13T18:57:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb234c00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7fb218072e70 0x7fb218075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb218075940 con 0x7fb218072e70 2024-09-13T18:57:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2240ac480 con 0x7fb2380b1810 2024-09-13T18:57:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.288+0000 7fb23d200640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb21806ac50 0x7fb21806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.289+0000 7fb23dc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7fb218072e70 0x7fb218075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.289+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== osd.6 v2:172.21.15.103:6800/1700981467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc7e0075870 con 0x7fc7e0072da0 2024-09-13T18:57:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.289+0000 7fb23dc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7fb218072e70 0x7fb218075290 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.290+0000 7fb23d200640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb21806ac50 0x7fb21806d110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00a730 tx=0x7fb22c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.290+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== osd.7 v2:172.21.15.103:6808/713706450 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb218075940 con 0x7fb218072e70 2024-09-13T18:57:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.291+0000 7f067e000640 1 -- 172.21.15.33:0/1784029948 <== osd.0 v2:172.21.15.33:6808/2676372550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06880c8770 con 0x7f0668072ef0 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.291+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7f0668072ef0 msgr2=0x7f0668075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.291+0000 7f068cc00640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7f0668072ef0 0x7f0668075310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.292+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f066806acd0 msgr2=0x7f066806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.292+0000 7f068cc00640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f066806acd0 0x7f066806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0674000c00 tx=0x7f067402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.292+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160400 msgr2=0x7f06881fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.292+0000 7f068cc00640 1 --2- 172.21.15.33:0/1784029948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0688160400 0x7f06881fe9c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06880cf000 tx=0x7f067800ecd0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.294+0000 7f0686800640 1 -- 172.21.15.33:0/1784029948 reap_dead start 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.294+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 shutdown_connections 2024-09-13T18:57:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.294+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 >> 172.21.15.33:0/1784029948 conn(0x7f068808beb0 msgr2=0x7f06880c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.294+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 shutdown_connections 2024-09-13T18:57:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.294+0000 7f068cc00640 1 -- 172.21.15.33:0/1784029948 wait complete. 2024-09-13T18:57:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.300+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 --> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9d4002cb0 con 0x7fb9dc072e60 2024-09-13T18:57:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.301+0000 7fb9f2000640 1 -- 172.21.15.33:0/4051209667 <== osd.2 v2:172.21.15.33:6824/3897994756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9d4002cb0 con 0x7fb9dc072e60 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7fb9dc072e60 msgr2=0x7fb9dc075280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7fb9dc072e60 0x7fb9dc075280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9dc06acc0 msgr2=0x7fb9dc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9dc06acc0 0x7fb9dc06d180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001bc0 tx=0x7fb9e8009040 comp rx=0 tx=0).stop 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 msgr2=0x7fb9fc133ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 --2- 172.21.15.33:0/4051209667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9fc06f750 0x7fb9fc133ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00b430 tx=0x7fb9ec00b8f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fb9fa800640 1 -- 172.21.15.33:0/4051209667 reap_dead start 2024-09-13T18:57:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 shutdown_connections 2024-09-13T18:57:24.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.302+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 >> 172.21.15.33:0/4051209667 conn(0x7fb9fc0b24b0 msgr2=0x7fb9fc145d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.303+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 shutdown_connections 2024-09-13T18:57:24.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.303+0000 7fba01000640 1 -- 172.21.15.33:0/4051209667 wait complete. 2024-09-13T18:57:24.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.303+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 --> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1f0070d40 con 0x7ff1d0072ea0 2024-09-13T18:57:24.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.304+0000 7ff1e6a00640 1 -- 172.21.15.33:0/67452034 <== osd.1 v2:172.21.15.33:6816/3216118851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1dc00b750 con 0x7ff1d0072ea0 2024-09-13T18:57:24.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.304+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 --> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1698058200 con 0x7f1680072e70 2024-09-13T18:57:24.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.305+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7ff1d0072ea0 msgr2=0x7ff1d00752c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.305+0000 7ff1efe00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7ff1d0072ea0 0x7ff1d00752c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.305+0000 7f169d600640 1 -- 172.21.15.33:0/3297499321 <== osd.3 v2:172.21.15.33:6800/2901377922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f168c00a9a0 con 0x7f1680072e70 2024-09-13T18:57:24.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.305+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 --> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f640415c9d0 con 0x7f63e0072e70 2024-09-13T18:57:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7f63fbe00640 1 -- 172.21.15.33:0/2955429915 <== osd.4 v2:172.21.15.103:6824/3878985058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63fc032950 con 0x7f63e0072e70 2024-09-13T18:57:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f1680072e70 msgr2=0x7f1680075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7f16a6a00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f1680072e70 0x7f1680075290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1d006ac80 msgr2=0x7ff1d006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7ff1efe00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1d006ac80 0x7ff1d006d140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0000c00 tx=0x7ff1e0009040 comp rx=0 tx=0).stop 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 msgr2=0x7ff1f00a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.306+0000 7ff1efe00640 1 --2- 172.21.15.33:0/67452034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d4003970 0x7ff1f00a8460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8007500 tx=0x7ff1e8004ab0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7ff1ef400640 1 -- 172.21.15.33:0/67452034 reap_dead start 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 shutdown_connections 2024-09-13T18:57:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 >> 172.21.15.33:0/67452034 conn(0x7ff1f00ae310 msgr2=0x7ff1f00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f63e0072e70 msgr2=0x7f63e0075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f63e0072e70 0x7f63e0075290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f168006ac50 msgr2=0x7f168006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f16a6a00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f168006ac50 0x7f168006d110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f169402a2b0 tx=0x7f169402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16980e2d80 msgr2=0x7f169804da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f16a6a00640 1 --2- 172.21.15.33:0/3297499321 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16980e2d80 0x7f169804da30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16a0061a70 tx=0x7f16a0067920 comp rx=0 tx=0).stop 2024-09-13T18:57:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 shutdown_connections 2024-09-13T18:57:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7ff1efe00640 1 -- 172.21.15.33:0/67452034 wait complete. 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f63e006acd0 msgr2=0x7f63e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f63e006acd0 0x7f63e006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6404154070 tx=0x7f63ec007d50 comp rx=0 tx=0).stop 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 msgr2=0x7f6404150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 --2- 172.21.15.33:0/2955429915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f640406a9c0 0x7f6404150030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c730 tx=0x7f63f400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f6409200640 1 -- 172.21.15.33:0/2955429915 reap_dead start 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 shutdown_connections 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.307+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 >> 172.21.15.33:0/2955429915 conn(0x7f6404069ed0 msgr2=0x7f640406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.308+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 shutdown_connections 2024-09-13T18:57:24.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.308+0000 7f640b200640 1 -- 172.21.15.33:0/2955429915 wait complete. 2024-09-13T18:57:24.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.308+0000 7f16a6000640 1 -- 172.21.15.33:0/3297499321 reap_dead start 2024-09-13T18:57:24.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 shutdown_connections 2024-09-13T18:57:24.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 >> 172.21.15.33:0/3297499321 conn(0x7f169803a4f0 msgr2=0x7f169803ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 shutdown_connections 2024-09-13T18:57:24.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 --> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3c014f630 con 0x7fd39c072f20 2024-09-13T18:57:24.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7f16a6a00640 1 -- 172.21.15.33:0/3297499321 wait complete. 2024-09-13T18:57:24.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.309+0000 7fd3b6000640 1 -- 172.21.15.33:0/883352252 <== osd.5 v2:172.21.15.103:6816/1671521011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3c014f630 con 0x7fd39c072f20 2024-09-13T18:57:24.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7fd39c072f20 msgr2=0x7fd39c075340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7fd39c072f20 0x7fd39c075340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd39c06ad00 msgr2=0x7fd39c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd39c06ad00 0x7fd39c06d1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009c50 tx=0x7fd3b0008040 comp rx=0 tx=0).stop 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 msgr2=0x7fd3c01637f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3c5200640 1 --2- 172.21.15.33:0/883352252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c01611d0 0x7fd3c01637f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800e830 tx=0x7fd3b800ecf0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.310+0000 7fd3be800640 1 -- 172.21.15.33:0/883352252 reap_dead start 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.311+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 shutdown_connections 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.311+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 >> 172.21.15.33:0/883352252 conn(0x7fd3c006afe0 msgr2=0x7fd3c0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.311+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 shutdown_connections 2024-09-13T18:57:24.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.311+0000 7fd3c5200640 1 -- 172.21.15.33:0/883352252 wait complete. 2024-09-13T18:57:24.346 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:24.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:57:24.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.325+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 --> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc80006ca20 con 0x7fc7e0072da0 2024-09-13T18:57:24.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.326+0000 7fc7fd600640 1 -- 172.21.15.33:0/2327186519 <== osd.6 v2:172.21.15.103:6800/1700981467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7f4001420 con 0x7fc7e0072da0 2024-09-13T18:57:24.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.326+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 --> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2381f3180 con 0x7fb218072e70 2024-09-13T18:57:24.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.327+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7fc7e0072da0 msgr2=0x7fc7e00751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.327+0000 7fc808600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7fc7e0072da0 0x7fc7e00751c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.327+0000 7fb234c00640 1 -- 172.21.15.33:0/2175891541 <== osd.7 v2:172.21.15.103:6808/713706450 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb2381f3180 con 0x7fb218072e70 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7e006ac00 msgr2=0x7fc7e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7e006ac00 0x7fc7e006d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec02e000 comp rx=0 tx=0).stop 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 msgr2=0x7fc8000af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 --2- 172.21.15.33:0/2327186519 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8000ce020 0x7fc8000af030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c7f0 tx=0x7fc7f800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc806600640 1 -- 172.21.15.33:0/2327186519 reap_dead start 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 shutdown_connections 2024-09-13T18:57:24.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 >> 172.21.15.33:0/2327186519 conn(0x7fc8000b0510 msgr2=0x7fc8000cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7fb218072e70 msgr2=0x7fb218075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7fb218072e70 0x7fb218075290 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 shutdown_connections 2024-09-13T18:57:24.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fc808600640 1 -- 172.21.15.33:0/2327186519 wait complete. 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb21806ac50 msgr2=0x7fb21806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb21806ac50 0x7fb21806d110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00a730 tx=0x7fb22c008040 comp rx=0 tx=0).stop 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 msgr2=0x7fb23814ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23fc00640 1 --2- 172.21.15.33:0/2175891541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb2380b1810 0x7fb23814ab10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb224000c00 tx=0x7fb2240046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.328+0000 7fb23dc00640 1 -- 172.21.15.33:0/2175891541 reap_dead start 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.329+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 shutdown_connections 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.329+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 >> 172.21.15.33:0/2175891541 conn(0x7fb238069ed0 msgr2=0x7fb23806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.329+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 shutdown_connections 2024-09-13T18:57:24.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.329+0000 7fb23fc00640 1 -- 172.21.15.33:0/2175891541 wait complete. 2024-09-13T18:57:24.352 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:24.352 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:57:24.353 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:24.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:57:24.354 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:24.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:57:24.355 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:24.356 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:57:24.356 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:24.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:57:24.358 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-09-13T18:57:24.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:57:24.359 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-09-13T18:57:24.360 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:57:24.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.666+0000 7fd762a00640 1 Processor -- start 2024-09-13T18:57:24.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.666+0000 7fd762a00640 1 -- start start 2024-09-13T18:57:24.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd75c0b0e90 0x7fd75c071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c1589b0 con 0x7fd75c06cc30 2024-09-13T18:57:24.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c06f9b0 con 0x7fd75c06f4b0 2024-09-13T18:57:24.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c06fc90 con 0x7fd75c0b0e90 2024-09-13T18:57:24.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7f8cc8a00640 1 Processor -- start 2024-09-13T18:57:24.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd75c06cc30 0x7fd75c0b1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53962/0 (socket says 172.21.15.33:53962) 2024-09-13T18:57:24.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.669+0000 7fd762000640 1 -- 172.21.15.33:0/1183062929 learned_addr learned my addr 172.21.15.33:0/1183062929 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.670+0000 7fd761600640 1 --2- 172.21.15.33:0/1183062929 >> v2:172.21.15.33:3300/0 conn(0x7fd75c0b0e90 0x7fd75c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.671+0000 7f8cc8a00640 1 -- start start 2024-09-13T18:57:24.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.671+0000 7fd761600640 1 -- 172.21.15.33:0/1183062929 >> v1:172.21.15.103:6789/0 conn(0x7fd75c06f4b0 legacy=0x7fd75c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.671+0000 7fd761600640 1 -- 172.21.15.33:0/1183062929 >> v1:172.21.15.33:6789/0 conn(0x7fd75c06cc30 legacy=0x7fd75c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.672+0000 7fd761600640 1 -- 172.21.15.33:0/1183062929 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c06ff70 con 0x7fd75c0b0e90 2024-09-13T18:57:24.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.673+0000 7f8cc8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8cc4146050 0x7f8cc406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.673+0000 7f8cc8a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc4146430 con 0x7f8cc406cc30 2024-09-13T18:57:24.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.673+0000 7f8cc8a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40ad420 con 0x7f8cc40b16a0 2024-09-13T18:57:24.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.673+0000 7f8cc8a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40ad700 con 0x7f8cc4146050 2024-09-13T18:57:24.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7f8cc2800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8cc4146050 0x7f8cc406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7f8cc1e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8cc40b16a0 0x7f8cc406c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49738/0 (socket says 172.21.15.33:49738) 2024-09-13T18:57:24.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7f8cc1e00640 1 -- 172.21.15.33:0/217108923 learned_addr learned my addr 172.21.15.33:0/217108923 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7fd761600640 1 --2- 172.21.15.33:0/1183062929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c071180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097a0 tx=0x7fd75002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cc4972a4a59523 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7f0d5e000640 1 Processor -- start 2024-09-13T18:57:24.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.674+0000 7f0d5e000640 1 -- start start 2024-09-13T18:57:24.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.675+0000 7f8cc2800640 1 -- 172.21.15.33:0/217108923 >> v1:172.21.15.103:6789/0 conn(0x7f8cc40b16a0 legacy=0x7f8cc406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.675+0000 7fd75be00640 1 -- 172.21.15.33:0/1183062929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750032440 con 0x7fd75c0b0e90 2024-09-13T18:57:24.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.675+0000 7fd75be00640 1 -- 172.21.15.33:0/1183062929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500325a0 con 0x7fd75c0b0e90 2024-09-13T18:57:24.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.675+0000 7fd75be00640 1 -- 172.21.15.33:0/1183062929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750032970 con 0x7fd75c0b0e90 2024-09-13T18:57:24.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.675+0000 7f8cc1400640 1 -- 172.21.15.33:0/217108923 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60913494 0 0) 0x7f8cc4146430 con 0x7f8cc406cc30 2024-09-13T18:57:24.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7f8cc2800640 1 -- 172.21.15.33:0/217108923 >> v1:172.21.15.33:6789/0 conn(0x7f8cc406cc30 legacy=0x7f8cc40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7f8cc2800640 1 -- 172.21.15.33:0/217108923 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40ad9e0 con 0x7f8cc4146050 2024-09-13T18:57:24.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7fd762a00640 1 -- 172.21.15.33:0/1183062929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 msgr2=0x7fd75c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7fd762a00640 1 --2- 172.21.15.33:0/1183062929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c071180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097a0 tx=0x7fd75002a250 comp rx=0 tx=0).stop 2024-09-13T18:57:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d580ad6c0 0x7f0d58070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7f0d5e000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d58071000 con 0x7f0d5806a9c0 2024-09-13T18:57:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7f8cc2800640 1 --2- 172.21.15.33:0/217108923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc4146050 0x7f8cc406f4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40097a0 tx=0x7f8cb402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fce07f61fa1d308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.676+0000 7f0d5e000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5815c4a0 con 0x7f0d58070bb0 2024-09-13T18:57:24.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7f0d5e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815cd40 con 0x7f0d580ad6c0 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7f0d57e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0d58070bb0 0x7f0d580b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49754/0 (socket says 172.21.15.33:49754) 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7f0d57e00640 1 -- 172.21.15.33:0/1483864315 learned_addr learned my addr 172.21.15.33:0/1483864315 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7f0d56a00640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d580ad6c0 0x7f0d58070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7f8cc1400640 1 -- 172.21.15.33:0/217108923 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4032440 con 0x7f8cc4146050 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7f8cc1400640 1 -- 172.21.15.33:0/217108923 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb40325a0 con 0x7f8cc4146050 2024-09-13T18:57:24.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7f8cc1400640 1 -- 172.21.15.33:0/217108923 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4032930 con 0x7f8cc4146050 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7fd762a00640 1 -- 172.21.15.33:0/1183062929 shutdown_connections 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7fd762a00640 1 --2- 172.21.15.33:0/1183062929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c071180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.677+0000 7fd762a00640 1 -- 172.21.15.33:0/1183062929 >> 172.21.15.33:0/1183062929 conn(0x7fd75c0b03a0 msgr2=0x7fd75c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7fd762a00640 1 -- 172.21.15.33:0/1183062929 shutdown_connections 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917953628 0 0) 0x7f0d48001110 con 0x7f0d5806a9c0 2024-09-13T18:57:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d3c003520 con 0x7f0d5806a9c0 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 -- 172.21.15.33:0/217108923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc4146050 msgr2=0x7f8cc406f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 --2- 172.21.15.33:0/217108923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc4146050 0x7f8cc406f4b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40097a0 tx=0x7f8cb402a230 comp rx=0 tx=0).stop 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 -- 172.21.15.33:0/217108923 shutdown_connections 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 --2- 172.21.15.33:0/217108923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc4146050 0x7f8cc406f4b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 -- 172.21.15.33:0/217108923 >> 172.21.15.33:0/217108923 conn(0x7f8cc40b03a0 msgr2=0x7f8cc40b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283718880 0 0) 0x7f0d3c003520 con 0x7f0d5806a9c0 2024-09-13T18:57:24.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 -- 172.21.15.33:0/217108923 shutdown_connections 2024-09-13T18:57:24.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f14c2e00640 1 Processor -- start 2024-09-13T18:57:24.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d580ad6c0 msgr2=0x7f0d58070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d580ad6c0 0x7f0d58070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 >> v1:172.21.15.103:6789/0 conn(0x7f0d58070bb0 legacy=0x7f0d580b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58158d60 con 0x7f0d5806a9c0 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f0d48001800 con 0x7f0d5806a9c0 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 >> v1:172.21.15.33:6789/0 conn(0x7f0d5806a9c0 legacy=0x7f0d58158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d3c0039a0 0x7f0d3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d3c0047c0 0x7f0d3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c005180 0x7f0d3c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815cd40 con 0x7f0d3c0039a0 2024-09-13T18:57:24.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c014790 con 0x7f0d3c005180 2024-09-13T18:57:24.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c014950 con 0x7f0d3c0047c0 2024-09-13T18:57:24.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.679+0000 7f8cc8a00640 1 -- 172.21.15.33:0/217108923 wait complete. 2024-09-13T18:57:24.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.680+0000 7f0d57400640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d3c0039a0 0x7f0d3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.678+0000 7fd762a00640 1 -- 172.21.15.33:0/1183062929 wait complete. 2024-09-13T18:57:24.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57e00640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c005180 0x7f0d3c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f3cba600640 1 Processor -- start 2024-09-13T18:57:24.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57400640 1 -- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d3c0047c0 msgr2=0x7f0d3c004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:57:24.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f3cba600640 1 -- start start 2024-09-13T18:57:24.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57400640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d3c0047c0 0x7f0d3c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7fd762a00640 1 Processor -- start 2024-09-13T18:57:24.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57400640 1 -- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c005180 msgr2=0x7f0d3c014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57400640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c005180 0x7f0d3c014190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.681+0000 7f0d57400640 1 -- 172.21.15.33:0/1483864315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58158d60 con 0x7f0d3c0039a0 2024-09-13T18:57:24.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.680+0000 7f14c2e00640 1 -- start start 2024-09-13T18:57:24.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.682+0000 7fd762a00640 1 -- start start 2024-09-13T18:57:24.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.682+0000 7f8cc8a00640 1 Processor -- start 2024-09-13T18:57:24.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f14c2e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f14bc0aec90 0x7f14bc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f0d57400640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d3c0039a0 0x7f0d3c003dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c0e0 tx=0x7f0d3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e1be4ab7cb357 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f14c2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc06a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f8cc8a00640 1 -- start start 2024-09-13T18:57:24.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f3cba600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cb406f4b0 0x7f3cb40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f3cba600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40cd850 con 0x7f3cb4071560 2024-09-13T18:57:24.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f3cba600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40cd570 con 0x7f3cb4159480 2024-09-13T18:57:24.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f3cba600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b1740 con 0x7f3cb406f4b0 2024-09-13T18:57:24.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48031600 con 0x7f0d3c0039a0 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 0x7fd75c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 0x7fd75c1ff010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0cc5f0 con 0x7fd75c0b0e90 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c14cf50 con 0x7fd75c06f4b0 2024-09-13T18:57:24.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7fd762a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0cb970 con 0x7fd75c06cc30 2024-09-13T18:57:24.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f14c2e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc06cc10 con 0x7f14bc0706a0 2024-09-13T18:57:24.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.683+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4802d050 con 0x7f0d3c0039a0 2024-09-13T18:57:24.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f14c2e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc06a850 con 0x7f14bc0aec90 2024-09-13T18:57:24.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f14c2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc06e460 con 0x7f14bc069ed0 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7fd762000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7fd762000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35442/0 (socket says 172.21.15.33:35442) 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7fd762000640 1 -- 172.21.15.33:0/285259016 learned_addr learned my addr 172.21.15.33:0/285259016 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7fd761600640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 0x7fd75c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f3cb3e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3cb4071560 0x7f3cb40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54010/0 (socket says 172.21.15.33:54010) 2024-09-13T18:57:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f3cb3e00640 1 -- 172.21.15.33:0/388118600 learned_addr learned my addr 172.21.15.33:0/388118600 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd760c00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 0x7fd75c1ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.684+0000 7f0d56000640 1 -- 172.21.15.33:0/1483864315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480319e0 con 0x7f0d3c0039a0 2024-09-13T18:57:24.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f0d5e000640 1 -- 172.21.15.33:0/1483864315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d3c0039a0 msgr2=0x7f0d3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f14bb400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc06a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f0d5e000640 1 --2- 172.21.15.33:0/1483864315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d3c0039a0 0x7f0d3c003dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c0e0 tx=0x7f0d3c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f0d57e00640 1 -- 172.21.15.33:0/1483864315 reap_dead start 2024-09-13T18:57:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd762000640 1 -- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 msgr2=0x7fd75c14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cb406f4b0 0x7f3cb40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd762000640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 0x7fd75c14ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd762000640 1 -- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 msgr2=0x7fd75c1ff010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f14c0e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f14bc0706a0 0x7f14bc162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54000/0 (socket says 172.21.15.33:54000) 2024-09-13T18:57:24.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f14c0e00640 1 -- 172.21.15.33:0/638246620 learned_addr learned my addr 172.21.15.33:0/638246620 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd762000640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 0x7fd75c1ff010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f8cc8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc406cc30 0x7f8cc41e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f8cc8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720589626 0 0) 0x7f3cb40cd850 con 0x7f3cb4071560 2024-09-13T18:57:24.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c98003520 con 0x7f3cb4071560 2024-09-13T18:57:24.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd762000640 1 -- 172.21.15.33:0/285259016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009400 con 0x7fd75c0b0e90 2024-09-13T18:57:24.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd760c00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 0x7fd75c1ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f8cc8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 0x7f8cc41e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f0d5e000640 1 -- 172.21.15.33:0/1483864315 shutdown_connections 2024-09-13T18:57:24.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7f0d5e000640 1 -- 172.21.15.33:0/1483864315 >> 172.21.15.33:0/1483864315 conn(0x7f0d58069ed0 msgr2=0x7f0d5806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154459308 0 0) 0x7f3cb40cd570 con 0x7f3cb4159480 2024-09-13T18:57:24.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb40cd850 con 0x7f3cb4159480 2024-09-13T18:57:24.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.685+0000 7fd761600640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 0x7fd75c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f14bbe00640 1 --2- 172.21.15.33:0/638246620 >> v2:172.21.15.103:3300/0 conn(0x7f14bc0aec90 0x7f14bc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41e8ea0 con 0x7f8cc40b16a0 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4144ea0 con 0x7f8cc406cc30 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41e8220 con 0x7f8cc4146050 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35456/0 (socket says 172.21.15.33:35456) 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc1e00640 1 -- 172.21.15.33:0/4207406537 learned_addr learned my addr 172.21.15.33:0/4207406537 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc3200640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 0x7f8cc41e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591323036 0 0) 0x7f3cb40cd850 con 0x7f3cb4159480 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cb406f4b0 msgr2=0x7f3cb40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cb406f4b0 0x7f3cb40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 >> v1:172.21.15.33:6789/0 conn(0x7f3cb4071560 legacy=0x7f3cb40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40b1a20 con 0x7f3cb4159480 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f3cac0019f0 con 0x7f3cb4159480 2024-09-13T18:57:24.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f0d5e000640 1 -- 172.21.15.33:0/1483864315 shutdown_connections 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f8cc2800640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc406cc30 0x7f8cc41e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 >> v1:172.21.15.103:6789/0 conn(0x7f3cb4159480 legacy=0x7f3cb4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c98004b60 0x7f3c98004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98003760 0x7f3c98003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c98004120 0x7f3c9800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b1740 con 0x7f3c98004120 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980104d0 con 0x7f3c98004b60 2024-09-13T18:57:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9800bb80 con 0x7f3c98003760 2024-09-13T18:57:24.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f14baa00640 1 -- 172.21.15.33:0/638246620 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878392418 0 0) 0x7f14bc06cc10 con 0x7f14bc0706a0 2024-09-13T18:57:24.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f14baa00640 1 -- 172.21.15.33:0/638246620 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a4003520 con 0x7f14bc0706a0 2024-09-13T18:57:24.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.686+0000 7f0d5e000640 1 -- 172.21.15.33:0/1483864315 wait complete. 2024-09-13T18:57:24.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 -- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc406cc30 msgr2=0x7f8cc41e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc406cc30 0x7f8cc41e9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 -- 172.21.15.33:0/4207406537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 msgr2=0x7f8cc41ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 -- 172.21.15.33:0/4207406537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4009400 con 0x7f8cc4146050 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc1e00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f14bbe00640 1 -- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 msgr2=0x7f14bc06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f14bbe00640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc06a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f14bbe00640 1 -- 172.21.15.33:0/638246620 >> v1:172.21.15.33:6789/0 conn(0x7f14bc0706a0 legacy=0x7f14bc162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f14bbe00640 1 -- 172.21.15.33:0/638246620 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc071280 con 0x7f14bc0aec90 2024-09-13T18:57:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c98004120 0x7f3c9800ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f14bb400640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc06a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:24.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7f8cc3200640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 0x7f8cc41e75d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc001560 tx=0x7f8cbc00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.687+0000 7fd762000640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ca80 tx=0x7fd75400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb3e00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98003760 0x7f3c98003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc003b70 con 0x7f8cc4146050 2024-09-13T18:57:24.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f39ad000640 1 Processor -- start 2024-09-13T18:57:24.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc003cf0 con 0x7f8cc4146050 2024-09-13T18:57:24.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f8cc8a00640 1 -- 172.21.15.33:0/4207406537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc41e8500 con 0x7f8cc4146050 2024-09-13T18:57:24.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb9c00640 1 -- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98003760 msgr2=0x7f3c98003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98003760 0x7f3c98003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.689+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400ac30 con 0x7fd75c0b0e90 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.689+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400ad90 con 0x7fd75c0b0e90 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.689+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754012600 con 0x7fd75c0b0e90 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb9c00640 1 -- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c98004b60 msgr2=0x7f3c98004f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:57:24.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c98004b60 0x7f3c98004f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f3cb9c00640 1 -- 172.21.15.33:0/388118600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40b1a20 con 0x7f3c98004120 2024-09-13T18:57:24.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00aa60 con 0x7f8cc4146050 2024-09-13T18:57:24.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.689+0000 7f8cc8a00640 1 -- 172.21.15.33:0/4207406537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc41e8ac0 con 0x7f8cc4146050 2024-09-13T18:57:24.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.689+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c0cbc50 con 0x7fd75c0b0e90 2024-09-13T18:57:24.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.688+0000 7f39ad000640 1 -- start start 2024-09-13T18:57:24.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.690+0000 7f0d5e000640 1 Processor -- start 2024-09-13T18:57:24.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.690+0000 7f0d5e000640 1 -- start start 2024-09-13T18:57:24.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4067360 con 0x7f8cc4146050 2024-09-13T18:57:24.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c98004120 0x7f3c9800ff90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3cb406e060 tx=0x7f3c980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ebeb6b1bad89db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f14bbe00640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0aec90 0x7f14bc06d660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14b00097d0 tx=0x7f14b002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a617f8764874c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c0cc210 con 0x7fd75c0b0e90 2024-09-13T18:57:24.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39ad000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f39a80b15b0 0x7f39a80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39ad000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80b1f60 con 0x7f39a80cdbe0 2024-09-13T18:57:24.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39ad000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80cd0b0 con 0x7f39a815cb80 2024-09-13T18:57:24.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39ad000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80b86f0 con 0x7f39a80b15b0 2024-09-13T18:57:24.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39a6a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f39a80cdbe0 0x7f39a80d08b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54014/0 (socket says 172.21.15.33:54014) 2024-09-13T18:57:24.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.691+0000 7f39a6a00640 1 -- 172.21.15.33:0/3873976145 learned_addr learned my addr 172.21.15.33:0/3873976145 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0031400 con 0x7f3c98004120 2024-09-13T18:57:24.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769634723 0 0) 0x7f39a80b1f60 con 0x7f39a80cdbe0 2024-09-13T18:57:24.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca002d050 con 0x7f3c98004120 2024-09-13T18:57:24.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f3cb3400640 1 -- 172.21.15.33:0/388118600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0031780 con 0x7f3c98004120 2024-09-13T18:57:24.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f14baa00640 1 -- 172.21.15.33:0/638246620 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b002ae70 con 0x7f14bc0aec90 2024-09-13T18:57:24.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.692+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c003520 con 0x7f39a80cdbe0 2024-09-13T18:57:24.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060577127 0 0) 0x7f39a80cd0b0 con 0x7f39a815cb80 2024-09-13T18:57:24.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a80b1f60 con 0x7f39a815cb80 2024-09-13T18:57:24.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a7e00640 1 --2- 172.21.15.33:0/3873976145 >> v2:172.21.15.33:3300/0 conn(0x7f39a80b15b0 0x7f39a80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f14baa00640 1 -- 172.21.15.33:0/638246620 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b0032440 con 0x7f14bc0aec90 2024-09-13T18:57:24.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f14baa00640 1 -- 172.21.15.33:0/638246620 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00327d0 con 0x7f14bc0aec90 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c0039a0 0x7f0d5815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 0x7f0d5814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5814e3b0 con 0x7f0d5814cab0 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815bd70 con 0x7f0d3c0039a0 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d5e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58157d00 con 0x7f0d5814e7d0 2024-09-13T18:57:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f3cba600640 1 -- 172.21.15.33:0/388118600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c98004120 msgr2=0x7f3c9800ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d56a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d56a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38828/0 (socket says 172.21.15.33:38828) 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f0d56a00640 1 -- 172.21.15.33:0/110081454 learned_addr learned my addr 172.21.15.33:0/110081454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4167937912 0 0) 0x7f39a80b1f60 con 0x7f39a815cb80 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 >> v2:172.21.15.33:3300/0 conn(0x7f39a80b15b0 msgr2=0x7f39a80d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 --2- 172.21.15.33:0/3873976145 >> v2:172.21.15.33:3300/0 conn(0x7f39a80b15b0 0x7f39a80d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 >> v1:172.21.15.33:6789/0 conn(0x7f39a80cdbe0 legacy=0x7f39a80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80b1c80 con 0x7f39a815cb80 2024-09-13T18:57:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f0d57e00640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 0x7f0d5814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 -- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0aec90 msgr2=0x7f14bc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0aec90 0x7f14bc06d660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14b00097d0 tx=0x7f14b002a160 comp rx=0 tx=0).stop 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c067360 con 0x7fd75c0b0e90 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f3998001670 con 0x7f39a815cb80 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 >> v1:172.21.15.103:6789/0 conn(0x7f39a815cb80 legacy=0x7f39a80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004bb0 0x7f398c004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398c003760 0x7f398c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 0x7f398c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80b86f0 con 0x7f398c003760 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c014860 con 0x7f398c004bb0 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c014a20 con 0x7f398c004170 2024-09-13T18:57:24.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f39a6a00640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398c003760 0x7f398c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f0d57400640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c0039a0 0x7f0d5815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f3cba600640 1 --2- 172.21.15.33:0/388118600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c98004120 0x7f3c9800ff90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3cb406e060 tx=0x7f3c980057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.693+0000 7f3cb9c00640 1 -- 172.21.15.33:0/388118600 reap_dead start 2024-09-13T18:57:24.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 -- 172.21.15.33:0/638246620 shutdown_connections 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc06a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 --2- 172.21.15.33:0/638246620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0aec90 0x7f14bc06d660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.694+0000 7f14c2e00640 1 -- 172.21.15.33:0/638246620 >> 172.21.15.33:0/638246620 conn(0x7f14bc06afe0 msgr2=0x7f14bc06b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7f14c2e00640 1 -- 172.21.15.33:0/638246620 shutdown_connections 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd754012760 con 0x7fd75c0b0e90 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7f39a7400640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004bb0 0x7f398c004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7f39a7e00640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 0x7f398c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8cbc00abc0 con 0x7f8cc4146050 2024-09-13T18:57:24.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 -- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 msgr2=0x7f0d581577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f3cba600640 1 -- 172.21.15.33:0/388118600 shutdown_connections 2024-09-13T18:57:24.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f3cba600640 1 -- 172.21.15.33:0/388118600 >> 172.21.15.33:0/388118600 conn(0x7f3cb40ae310 msgr2=0x7f3cb40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.695+0000 7f14c2e00640 1 -- 172.21.15.33:0/638246620 wait complete. 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 -- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c0039a0 msgr2=0x7f0d5815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c0039a0 0x7f0d5815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 -- 172.21.15.33:0/110081454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5814da10 con 0x7f0d5814cab0 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d56a00640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f0d57e00640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 0x7f0d5814f060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806f610 tx=0x7f0d5000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7fd759600640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 0x7fd73c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f21f7800640 1 Processor -- start 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd754088f30 con 0x7fd75c0b0e90 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f39a7e00640 1 -- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004bb0 msgr2=0x7f398c004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f39a7e00640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004bb0 0x7f398c004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f39a7e00640 1 -- 172.21.15.33:0/3873976145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398c003760 msgr2=0x7f398c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f39a7e00640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398c003760 0x7f398c003be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.696+0000 7f39a7e00640 1 -- 172.21.15.33:0/3873976145 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80b1f60 con 0x7f398c004170 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f39a7e00640 1 -- 172.21.15.33:0/3873976145 reap_dead start 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f21f7800640 1 -- start start 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f8cbaa00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 0x7f8ca406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cbc089480 con 0x7f8cc4146050 2024-09-13T18:57:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f8cc2800640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 0x7f8ca406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f39a7e00640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 0x7f398c00b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007360 tx=0x7f398c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17740c7129ea0705 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7fd761600640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 0x7fd73c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.697+0000 7f3cba600640 1 -- 172.21.15.33:0/388118600 shutdown_connections 2024-09-13T18:57:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f260f000640 1 Processor -- start 2024-09-13T18:57:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f3cba600640 1 -- 172.21.15.33:0/388118600 wait complete. 2024-09-13T18:57:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f14c2e00640 1 Processor -- start 2024-09-13T18:57:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0003b90 con 0x7f398c004170 2024-09-13T18:57:24.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f39a6000640 1 -- 172.21.15.33:0/3873976145 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0003d30 con 0x7f398c004170 2024-09-13T18:57:24.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f14c2e00640 1 -- start start 2024-09-13T18:57:24.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8cbc0546d0 con 0x7f8cc4146050 2024-09-13T18:57:24.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7f260f000640 1 -- start start 2024-09-13T18:57:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.698+0000 7fd761600640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 0x7fd73c06d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd75002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f39ad000640 1 -- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 msgr2=0x7f398c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f39ad000640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 0x7f398c00b980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007360 tx=0x7f398c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f39ad000640 1 -- 172.21.15.33:0/3873976145 shutdown_connections 2024-09-13T18:57:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f21f7800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21f015c720 0x7f21f00d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f21f7800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21f00cde70 0x7f21f00d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f39ad000640 1 --2- 172.21.15.33:0/3873976145 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f398c004170 0x7f398c00b980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f39ad000640 1 -- 172.21.15.33:0/3873976145 >> 172.21.15.33:0/3873976145 conn(0x7f39a80b41c0 msgr2=0x7f39a80b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f39ad000640 1 -- 172.21.15.33:0/3873976145 shutdown_connections 2024-09-13T18:57:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f21efe00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f21f015cb00 0x7f21f00cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49784/0 (socket says 172.21.15.33:49784) 2024-09-13T18:57:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21efe00640 1 -- 172.21.15.33:0/3562558032 learned_addr learned my addr 172.21.15.33:0/3562558032 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21f5800640 1 --2- 172.21.15.33:0/3562558032 >> v2:172.21.15.103:3300/0 conn(0x7f21f00cde70 0x7f21f00d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f39ad000640 1 -- 172.21.15.33:0/3873976145 wait complete. 2024-09-13T18:57:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f21f7800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f00d3330 con 0x7f21f015cb00 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.699+0000 7f14c2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f14c2e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 0x7f14bc0a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f14c2e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f14c2e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0a8f20 con 0x7f14bc0aec90 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f14c2e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0a9200 con 0x7f14bc0706a0 2024-09-13T18:57:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f14c2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0ac190 con 0x7f14bc069ed0 2024-09-13T18:57:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f00cece0 con 0x7f21f015c720 2024-09-13T18:57:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f00b1cf0 con 0x7f21f00cde70 2024-09-13T18:57:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f3cba600640 1 Processor -- start 2024-09-13T18:57:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21ef400640 1 -- 172.21.15.33:0/3562558032 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291801955 0 0) 0x7f21d8001110 con 0x7f21f015cb00 2024-09-13T18:57:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f8cc2800640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 0x7f8ca406d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4034000 tx=0x7f8cb402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.700+0000 7f21ef400640 1 -- 172.21.15.33:0/3562558032 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d4003520 con 0x7f21f015cb00 2024-09-13T18:57:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f21f5800640 1 -- 172.21.15.33:0/3562558032 >> v2:172.21.15.33:3300/0 conn(0x7f21f015c720 msgr2=0x7f21f00d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f21f5800640 1 --2- 172.21.15.33:0/3562558032 >> v2:172.21.15.33:3300/0 conn(0x7f21f015c720 0x7f21f00d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f21f5800640 1 -- 172.21.15.33:0/3562558032 >> v1:172.21.15.103:6789/0 conn(0x7f21f015cb00 legacy=0x7f21f00cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f21f5800640 1 -- 172.21.15.33:0/3562558032 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f00ce440 con 0x7f21f00cde70 2024-09-13T18:57:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f260f000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26080adfc0 0x7f26080b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f14bbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f260f000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f260f000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260806ceb0 con 0x7f26080b2c20 2024-09-13T18:57:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f260f000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26080b30b0 con 0x7f26080adfc0 2024-09-13T18:57:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f260f000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2608159130 con 0x7f260806bdd0 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f14c0e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f14c0e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35520/0 (socket says 172.21.15.33:35520) 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f14c0e00640 1 -- 172.21.15.33:0/883386739 learned_addr learned my addr 172.21.15.33:0/883386739 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f14bb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 0x7f14bc0a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f14c0e00640 1 -- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 msgr2=0x7f14bc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f14c0e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f14c0e00640 1 -- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 msgr2=0x7f14bc0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f21f5800640 1 --2- 172.21.15.33:0/3562558032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f00d2df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21f015cfa0 tx=0x7f21e802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aabdef8d8c7f63bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f14c0e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 0x7f14bc0a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f14c0e00640 1 -- 172.21.15.33:0/883386739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0009400 con 0x7f14bc0aec90 2024-09-13T18:57:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f21ef400640 1 -- 172.21.15.33:0/3562558032 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e802ae80 con 0x7f21f00cde70 2024-09-13T18:57:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f21ef400640 1 -- 172.21.15.33:0/3562558032 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8032440 con 0x7f21f00cde70 2024-09-13T18:57:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f21ef400640 1 -- 172.21.15.33:0/3562558032 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80327b0 con 0x7f21f00cde70 2024-09-13T18:57:24.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.702+0000 7f260d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f2607400640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26080b2c20 0x7f260806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:49788/0 (socket says 172.21.15.33:49788) 2024-09-13T18:57:24.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f260d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38848/0 (socket says 172.21.15.33:38848) 2024-09-13T18:57:24.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f2607400640 1 -- 172.21.15.33:0/3869940990 learned_addr learned my addr 172.21.15.33:0/3869940990 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:24.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.701+0000 7f3cba600640 1 -- start start 2024-09-13T18:57:24.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f39ad000640 1 Processor -- start 2024-09-13T18:57:24.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f3cba600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f14bb400640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 0x7f14bc0a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f3cba600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cb4159860 0x7f3cb415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cba600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb415bd50 0x7f3cb40acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f39ad000640 1 -- start start 2024-09-13T18:57:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cba600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b21c0 con 0x7f3cb4159860 2024-09-13T18:57:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd75408e060 con 0x7fd75c0b0e90 2024-09-13T18:57:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cba600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b24a0 con 0x7f3cb415bd50 2024-09-13T18:57:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38860/0 (socket says 172.21.15.33:38860) 2024-09-13T18:57:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 msgr2=0x7f21f00d2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 --2- 172.21.15.33:0/3562558032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f00d2df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21f015cfa0 tx=0x7f21e802a130 comp rx=0 tx=0).stop 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cb9200640 1 -- 172.21.15.33:0/3250534273 learned_addr learned my addr 172.21.15.33:0/3250534273 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b2780 con 0x7f3c98004120 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f14c0e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c810 tx=0x7f14b400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 shutdown_connections 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 --2- 172.21.15.33:0/3562558032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f00d2df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 --2- 172.21.15.33:0/3562558032 >> v2:172.21.15.33:3300/0 conn(0x7f21f015c720 0x7f21f00d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 >> 172.21.15.33:0/3562558032 conn(0x7f21f008bf90 msgr2=0x7f21f008c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cb3e00640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cb4159860 0x7f3cb415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 shutdown_connections 2024-09-13T18:57:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f3cb9c00640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb415bd50 0x7f3cb40acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000b7a0 con 0x7f0d5814cab0 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000b900 con 0x7f0d5814cab0 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000bcb0 con 0x7f0d5814cab0 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 -- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb415bd50 msgr2=0x7f3cb40acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb415bd50 0x7f3cb40acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 -- 172.21.15.33:0/3250534273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cb4159860 msgr2=0x7f3cb415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cb4159860 0x7f3cb415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40b2a60 con 0x7f3c98004120 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a80c9780 0x7f39a815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 0x7f39a8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81552b0 con 0x7f39a80c9780 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8153c50 con 0x7f398c004170 2024-09-13T18:57:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f39ad000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a815e330 con 0x7f39a815deb0 2024-09-13T18:57:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f260d000640 1 -- 172.21.15.33:0/3869940990 >> v2:172.21.15.33:3300/0 conn(0x7f26080adfc0 msgr2=0x7f26080b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5814dcf0 con 0x7f0d5814cab0 2024-09-13T18:57:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f260d000640 1 --2- 172.21.15.33:0/3869940990 >> v2:172.21.15.33:3300/0 conn(0x7f26080adfc0 0x7f26080b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400a640 con 0x7f14bc0aec90 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400a7a0 con 0x7f14bc0aec90 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400ab50 con 0x7f14bc0aec90 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb9200640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00caa0 tx=0x7f3cac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.705+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac003d80 con 0x7f3c98004120 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac005070 con 0x7f3c98004120 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac005420 con 0x7f3c98004120 2024-09-13T18:57:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb415afd0 con 0x7f3c98004120 2024-09-13T18:57:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb415c200 con 0x7f3c98004120 2024-09-13T18:57:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f39a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.703+0000 7f260d000640 1 -- 172.21.15.33:0/3869940990 >> v1:172.21.15.103:6789/0 conn(0x7f26080b2c20 legacy=0x7f260806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f260d000640 1 -- 172.21.15.33:0/3869940990 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260806c2a0 con 0x7f260806bdd0 2024-09-13T18:57:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0ac470 con 0x7f14bc0aec90 2024-09-13T18:57:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5814cf30 con 0x7f0d5814cab0 2024-09-13T18:57:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.704+0000 7f21f7800640 1 -- 172.21.15.33:0/3562558032 wait complete. 2024-09-13T18:57:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0a89a0 con 0x7f14bc0aec90 2024-09-13T18:57:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f260d000640 1 --2- 172.21.15.33:0/3869940990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f260000c2e0 tx=0x7f260002cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8ef7c06a1c84af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f2606a00640 1 -- 172.21.15.33:0/3869940990 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260002d9a0 con 0x7f260806bdd0 2024-09-13T18:57:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f2606a00640 1 -- 172.21.15.33:0/3869940990 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260002db00 con 0x7f260806bdd0 2024-09-13T18:57:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f2606a00640 1 -- 172.21.15.33:0/3869940990 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260002de90 con 0x7f260806bdd0 2024-09-13T18:57:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.708+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c005250 con 0x7f3c98004120 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.706+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 0x7f39a8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 0x7f39a8156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38870/0 (socket says 172.21.15.33:38870) 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f39a7e00640 1 -- 172.21.15.33:0/324987066 learned_addr learned my addr 172.21.15.33:0/324987066 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.708+0000 7f39a6a00640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a80c9780 0x7f39a815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f39a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:55244/0 (socket says 172.21.15.33:55244) 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f21f7800640 1 Processor -- start 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.707+0000 7f21f7800640 1 -- start start 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f01fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21f015c720 0x7f21f0152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00b8070 con 0x7f21f015cb00 2024-09-13T18:57:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01fefa0 con 0x7f21f00cde70 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f7800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00d3690 con 0x7f21f015c720 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f5800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f5800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35552/0 (socket says 172.21.15.33:35552) 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f21f5800640 1 -- 172.21.15.33:0/111261718 learned_addr learned my addr 172.21.15.33:0/111261718 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.709+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498005250 con 0x7f14bc0aec90 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.708+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5814e4f0 con 0x7f0d5814cab0 2024-09-13T18:57:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.708+0000 7f260f000640 1 -- 172.21.15.33:0/3869940990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 msgr2=0x7f2608070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.708+0000 7f260f000640 1 --2- 172.21.15.33:0/3869940990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f260000c2e0 tx=0x7f260002cc50 comp rx=0 tx=0).stop 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f39a7400640 1 -- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 msgr2=0x7f39a8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f39a7400640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 0x7f39a8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f39a7400640 1 -- 172.21.15.33:0/324987066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a80c9780 msgr2=0x7f39a815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f39a7400640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a80c9780 0x7f39a815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f21f5800640 1 -- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21f015c720 msgr2=0x7f21f0152e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f21f5800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21f015c720 0x7f21f0152e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f260f000640 1 -- 172.21.15.33:0/3869940990 shutdown_connections 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f260f000640 1 --2- 172.21.15.33:0/3869940990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608070040 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f260f000640 1 --2- 172.21.15.33:0/3869940990 >> v2:172.21.15.33:3300/0 conn(0x7f26080adfc0 0x7f26080b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f260f000640 1 -- 172.21.15.33:0/3869940990 >> 172.21.15.33:0/3869940990 conn(0x7f26080b0510 msgr2=0x7f26080b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f39a7400640 1 -- 172.21.15.33:0/324987066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a81540f0 con 0x7f398c004170 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f21f5800640 1 -- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 msgr2=0x7f21f01fea60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f21f5800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f01fea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f21f5800640 1 -- 172.21.15.33:0/111261718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009400 con 0x7f21f015cb00 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.710+0000 7f260f000640 1 -- 172.21.15.33:0/3869940990 shutdown_connections 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.711+0000 7f260f000640 1 -- 172.21.15.33:0/3869940990 wait complete. 2024-09-13T18:57:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.711+0000 7f39a7400640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f399800f780 tx=0x7f399800fb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.711+0000 7f21f5800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f21e8035040 tx=0x7f21e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.712+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14b400acb0 con 0x7f14bc0aec90 2024-09-13T18:57:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.712+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800fe90 con 0x7f398c004170 2024-09-13T18:57:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39980052e0 con 0x7f398c004170 2024-09-13T18:57:24.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800d730 con 0x7f398c004170 2024-09-13T18:57:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.711+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cac005580 con 0x7f3c98004120 2024-09-13T18:57:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.712+0000 7f3cb0c00640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 0x7f3c9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cac088b40 con 0x7f3c98004120 2024-09-13T18:57:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80cb930 con 0x7f398c004170 2024-09-13T18:57:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.712+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d50007110 con 0x7f0d5814cab0 2024-09-13T18:57:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f3cb3e00640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 0x7f3c9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f14afe00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 0x7f149c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.713+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b4088e10 con 0x7f14bc0aec90 2024-09-13T18:57:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.712+0000 7f260f000640 1 Processor -- start 2024-09-13T18:57:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.714+0000 7f14bbe00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 0x7f149c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.714+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a8154bf0 con 0x7f398c004170 2024-09-13T18:57:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.714+0000 7f260f000640 1 -- start start 2024-09-13T18:57:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f0d4f400640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 0x7f0d3806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f14bbe00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 0x7f149c06d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14b0034000 tx=0x7f14b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d500890c0 con 0x7f0d5814cab0 2024-09-13T18:57:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8068360 con 0x7f398c004170 2024-09-13T18:57:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f0d57400640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 0x7f0d3806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.715+0000 7f3cb3e00640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 0x7f3c9406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40010e0 tx=0x7f3ca4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.716+0000 7f260f000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.716+0000 7f260f000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 0x7f260815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.716+0000 7f260f000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26080b2c20 0x7f2608144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3cac053c70 con 0x7f3c98004120 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f260f000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080afde0 con 0x7f26080adfc0 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f260f000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608145960 con 0x7f26080b2c20 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f260f000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2608145180 con 0x7f260806bdd0 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.716+0000 7f2607400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 0x7f260815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 0x7f260815b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35556/0 (socket says 172.21.15.33:35556) 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607400640 1 -- 172.21.15.33:0/2916067820 learned_addr learned my addr 172.21.15.33:0/2916067820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.716+0000 7f2607e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f260d000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26080b2c20 0x7f2608144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607e00640 1 -- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26080b2c20 msgr2=0x7f2608144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607e00640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26080b2c20 0x7f2608144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607e00640 1 -- 172.21.15.33:0/2916067820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 msgr2=0x7f260815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607e00640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 0x7f260815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.717+0000 7f2607e00640 1 -- 172.21.15.33:0/2916067820 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260000c050 con 0x7f260806bdd0 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f2607e00640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608145420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25f800b3f0 tx=0x7f25f800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80327b0 con 0x7f21f015cb00 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011830 con 0x7f260806bdd0 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8011990 con 0x7f260806bdd0 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26080af860 con 0x7f260806bdd0 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011d40 con 0x7f260806bdd0 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.718+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f14b4054110 con 0x7f14bc0aec90 2024-09-13T18:57:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.719+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260815b730 con 0x7f260806bdd0 2024-09-13T18:57:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.720+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f00b7740 con 0x7f21f015cb00 2024-09-13T18:57:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.719+0000 7f0d57400640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 0x7f0d3806d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d48034000 tx=0x7f0d48033040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.721+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26080668d0 con 0x7f260806bdd0 2024-09-13T18:57:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.721+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f399800d890 con 0x7f398c004170 2024-09-13T18:57:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.720+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f00b7d00 con 0x7f21f015cb00 2024-09-13T18:57:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.722+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f00cd760 con 0x7f21f015cb00 2024-09-13T18:57:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.722+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25f801a400 con 0x7f260806bdd0 2024-09-13T18:57:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.723+0000 7f399f400640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 0x7f398806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.723+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3998089e00 con 0x7f398c004170 2024-09-13T18:57:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.723+0000 7f25ffe00640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 0x7f25e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.723+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f80892a0 con 0x7f260806bdd0 2024-09-13T18:57:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.723+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f399808a1e0 con 0x7f398c004170 2024-09-13T18:57:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.724+0000 7f2607400640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 0x7f25e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.724+0000 7f39a6a00640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 0x7f398806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.725+0000 7f2607400640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 0x7f25e806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f260814baa0 tx=0x7f25f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.725+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0d5814e4f0 con 0x7f0d5814cab0 2024-09-13T18:57:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.727+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80044c0 con 0x7f21f015cb00 2024-09-13T18:57:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.727+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8032b10 con 0x7f21f015cb00 2024-09-13T18:57:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.727+0000 7f39a6a00640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 0x7f398806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39a8159d20 tx=0x7f3994009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.728+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25f80545a0 con 0x7f260806bdd0 2024-09-13T18:57:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.731+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21e8039040 con 0x7f21f015cb00 2024-09-13T18:57:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.732+0000 7f21ecc00640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 0x7f21cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.733+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e80aa350 con 0x7f21f015cb00 2024-09-13T18:57:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.734+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21e8075630 con 0x7f21f015cb00 2024-09-13T18:57:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.735+0000 7f21f4e00640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 0x7f21cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:24.736+0000 7f21f4e00640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 0x7f21cc06d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21f00c9780 tx=0x7f21e0009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:25.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.118+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8cc41e8fe0 con 0x7f8cc4146050 2024-09-13T18:57:25.124 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-09-13T18:57:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.118+0000 7f8cbaa00640 1 -- 172.21.15.33:0/4207406537 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cbc057cf0 con 0x7f8cc4146050 2024-09-13T18:57:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.122+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 msgr2=0x7f8ca406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.122+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 0x7f8ca406d110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4034000 tx=0x7f8cb402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.122+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 msgr2=0x7f8cc41e75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.122+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 0x7f8cc41e75d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc001560 tx=0x7f8cbc00cbe0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 shutdown_connections 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ca406ac50 0x7f8ca406d110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cc4146050 0x7f8cc41e75d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc40b16a0 0x7f8cc41ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 --2- 172.21.15.33:0/4207406537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc406cc30 0x7f8cc41e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.123+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 >> 172.21.15.33:0/4207406537 conn(0x7f8cc40b03a0 msgr2=0x7f8cc406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.124+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 shutdown_connections 2024-09-13T18:57:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.124+0000 7f8cafe00640 1 -- 172.21.15.33:0/4207406537 wait complete. 2024-09-13T18:57:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.125+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd75c0cc730 con 0x7fd75c0b0e90 2024-09-13T18:57:25.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.132+0000 7fd759600640 1 -- 172.21.15.33:0/285259016 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd75c0cc730 con 0x7fd75c0b0e90 2024-09-13T18:57:25.136 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.135+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f14980057d0 con 0x7f14bc0aec90 2024-09-13T18:57:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.136+0000 7f14afe00640 1 -- 172.21.15.33:0/883386739 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14b4022090 con 0x7f14bc0aec90 2024-09-13T18:57:25.140 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:25.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.137+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f39a80cd4d0 con 0x7f398c004170 2024-09-13T18:57:25.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.137+0000 7f399f400640 1 -- 172.21.15.33:0/324987066 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3998055050 con 0x7f398c004170 2024-09-13T18:57:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.137+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 msgr2=0x7fd73c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.137+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 0x7fd73c06d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd75002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.138+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c8c0050c0 con 0x7f3c98004120 2024-09-13T18:57:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.138+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 msgr2=0x7fd75c151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.138+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ca80 tx=0x7fd75400cf40 comp rx=0 tx=0).stop 2024-09-13T18:57:25.142 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 msgr2=0x7f149c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 0x7f149c06d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14b0034000 tx=0x7f14b002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 msgr2=0x7f14bc0ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c810 tx=0x7f14b400ccd0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 shutdown_connections 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f149c06ad00 0x7f149c06d1c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14bc0aec90 0x7f14bc0ac990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14bc0706a0 0x7f14bc0a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 --2- 172.21.15.33:0/883386739 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14bc069ed0 0x7f14bc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 >> 172.21.15.33:0/883386739 conn(0x7f14bc06afe0 msgr2=0x7f14bc0cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 shutdown_connections 2024-09-13T18:57:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.141+0000 7f3cb0c00640 1 -- 172.21.15.33:0/3250534273 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cac088e60 con 0x7f3c98004120 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.140+0000 7f14c2e00640 1 -- 172.21.15.33:0/883386739 wait complete. 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 shutdown_connections 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd73c06ac50 0x7fd73c06d110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd75c0b0e90 0x7fd75c151820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd75c06f4b0 0x7fd75c1ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 --2- 172.21.15.33:0/285259016 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd75c06cc30 0x7fd75c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 >> 172.21.15.33:0/285259016 conn(0x7fd75c0b03a0 msgr2=0x7fd75c14de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d5814e4f0 con 0x7f0d5814cab0 2024-09-13T18:57:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 msgr2=0x7f398806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 0x7f398806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39a8159d20 tx=0x7f3994009040 comp rx=0 tx=0).stop 2024-09-13T18:57:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 msgr2=0x7f39a8153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f399800f780 tx=0x7f399800fb80 comp rx=0 tx=0).stop 2024-09-13T18:57:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.144+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 shutdown_connections 2024-09-13T18:57:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 shutdown_connections 2024-09-13T18:57:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f398806acd0 0x7f398806d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f39a815deb0 0x7f39a8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a80c9780 0x7f39a815d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 --2- 172.21.15.33:0/324987066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f398c004170 0x7f39a8153710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.143+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 >> 172.21.15.33:0/324987066 conn(0x7f39a80b41c0 msgr2=0x7f39a80b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.144+0000 7f0d4f400640 1 -- 172.21.15.33:0/110081454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d5814e4f0 con 0x7f0d5814cab0 2024-09-13T18:57:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.144+0000 7fd762a00640 1 -- 172.21.15.33:0/285259016 wait complete. 2024-09-13T18:57:25.150 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-09-13T18:57:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.144+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 shutdown_connections 2024-09-13T18:57:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.144+0000 7f39ad000640 1 -- 172.21.15.33:0/324987066 wait complete. 2024-09-13T18:57:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 msgr2=0x7f0d3806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 0x7f0d3806d110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d48034000 tx=0x7f0d48033040 comp rx=0 tx=0).stop 2024-09-13T18:57:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 msgr2=0x7f0d5814f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 0x7f0d5814f060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806f610 tx=0x7f0d5000df70 comp rx=0 tx=0).stop 2024-09-13T18:57:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 shutdown_connections 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0d3806ac50 0x7f0d3806d110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5814cab0 0x7f0d5814f060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5814e7d0 0x7f0d581577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.146+0000 7f0d5e000640 1 --2- 172.21.15.33:0/110081454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d3c0039a0 0x7f0d5815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 >> 172.21.15.33:0/110081454 conn(0x7f0d58069ed0 msgr2=0x7f0d5806ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 shutdown_connections 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f0d5e000640 1 -- 172.21.15.33:0/110081454 wait complete. 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 msgr2=0x7f3c9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 0x7f3c9406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40010e0 tx=0x7f3ca4009040 comp rx=0 tx=0).stop 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 msgr2=0x7f3cb41eecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.147+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00caa0 tx=0x7f3cac00cf60 comp rx=0 tx=0).stop 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f26080b26e0 con 0x7f260806bdd0 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 shutdown_connections 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c9406acd0 0x7f3c9406d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb415bd50 0x7f3cb40acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cb4159860 0x7f3cb415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 --2- 172.21.15.33:0/3250534273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c98004120 0x7f3cb41eecd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 >> 172.21.15.33:0/3250534273 conn(0x7f3cb40ae310 msgr2=0x7f3cb4155600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f21f00b7e90 con 0x7f21f015cb00 2024-09-13T18:57:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 shutdown_connections 2024-09-13T18:57:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f3cba600640 1 -- 172.21.15.33:0/3250534273 wait complete. 2024-09-13T18:57:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.148+0000 7f25ffe00640 1 -- 172.21.15.33:0/2916067820 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25f8057bc0 con 0x7f260806bdd0 2024-09-13T18:57:25.154 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-09-13T18:57:25.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.149+0000 7f21ecc00640 1 -- 172.21.15.33:0/111261718 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21e8078c50 con 0x7f21f015cb00 2024-09-13T18:57:25.155 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-09-13T18:57:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 msgr2=0x7f25e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 0x7f25e806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f260814baa0 tx=0x7f25f4009040 comp rx=0 tx=0).stop 2024-09-13T18:57:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 msgr2=0x7f2608145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608145420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25f800b3f0 tx=0x7f25f800b8b0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 shutdown_connections 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.152+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f25e806acd0 0x7f25e806d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26080b2c20 0x7f2608144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26080adfc0 0x7f260815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 --2- 172.21.15.33:0/2916067820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f260806bdd0 0x7f2608145420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 >> 172.21.15.33:0/2916067820 conn(0x7f26080b0510 msgr2=0x7f260806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 shutdown_connections 2024-09-13T18:57:25.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-09-13T18:57:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.153+0000 7f260f000640 1 -- 172.21.15.33:0/2916067820 wait complete. 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 msgr2=0x7f21cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 0x7f21cc06d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f21f00c9780 tx=0x7f21e0009250 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 msgr2=0x7f21f0153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f21e8035040 tx=0x7f21e80046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 shutdown_connections 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21cc06ac00 0x7f21cc06d0c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f015cb00 0x7f21f0153370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21f015c720 0x7f21f0152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 --2- 172.21.15.33:0/111261718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21f00cde70 0x7f21f01fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 >> 172.21.15.33:0/111261718 conn(0x7f21f008bf90 msgr2=0x7f21f00cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:25.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 shutdown_connections 2024-09-13T18:57:25.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:25.154+0000 7f21f7800640 1 -- 172.21.15.33:0/111261718 wait complete. 2024-09-13T18:57:25.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-13T18:57:25.173 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-13T18:57:25.178 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-13T18:57:25.178 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-13T18:57:25.183 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-13T18:57:25.183 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-09-13T18:57:25.189 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:25.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-09-13T18:57:25.190 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:26.160 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:57:26.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.324+0000 7f5478000640 1 Processor -- start 2024-09-13T18:57:26.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.324+0000 7f5478000640 1 -- start start 2024-09-13T18:57:26.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5478000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54700b1b00 0x7f54700cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5478000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54700cde50 0x7f547015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5478000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547006bea0 con 0x7f547015a520 2024-09-13T18:57:26.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5478000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547006c180 con 0x7f54700cde50 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5478000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547006c460 con 0x7f54700b1b00 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5476000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54700cde50 0x7f547015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5475600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f547015a520 0x7f547006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54028/0 (socket says 172.21.15.33:54028) 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5476000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54700cde50 0x7f547015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35568/0 (socket says 172.21.15.33:35568) 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5475600640 1 -- 172.21.15.33:0/3449406699 learned_addr learned my addr 172.21.15.33:0/3449406699 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:26.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5474c00640 1 --2- 172.21.15.33:0/3449406699 >> v2:172.21.15.103:3300/0 conn(0x7f54700b1b00 0x7f54700cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5476000640 1 -- 172.21.15.33:0/3449406699 >> v2:172.21.15.103:3300/0 conn(0x7f54700b1b00 msgr2=0x7f54700cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5476000640 1 --2- 172.21.15.33:0/3449406699 >> v2:172.21.15.103:3300/0 conn(0x7f54700b1b00 0x7f54700cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f5476000640 1 -- 172.21.15.33:0/3449406699 >> v1:172.21.15.33:6789/0 conn(0x7f547015a520 legacy=0x7f547006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.327+0000 7f5476000640 1 -- 172.21.15.33:0/3449406699 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547006c740 con 0x7f54700cde50 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.326+0000 7f546fe00640 1 -- 172.21.15.33:0/3449406699 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114591895 0 0) 0x7f547006bea0 con 0x7f547015a520 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.327+0000 7f5476000640 1 --2- 172.21.15.33:0/3449406699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f547015a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f547006bdd0 tx=0x7f546802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebe1c56eb7786fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f546fe00640 1 -- 172.21.15.33:0/3449406699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546802aea0 con 0x7f54700cde50 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f546fe00640 1 -- 172.21.15.33:0/3449406699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546802d050 con 0x7f54700cde50 2024-09-13T18:57:26.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f546fe00640 1 -- 172.21.15.33:0/3449406699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468007960 con 0x7f54700cde50 2024-09-13T18:57:26.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 -- 172.21.15.33:0/3449406699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 msgr2=0x7f547015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 --2- 172.21.15.33:0/3449406699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f547015a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f547006bdd0 tx=0x7f546802a680 comp rx=0 tx=0).stop 2024-09-13T18:57:26.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 -- 172.21.15.33:0/3449406699 shutdown_connections 2024-09-13T18:57:26.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 --2- 172.21.15.33:0/3449406699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f547015a900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 --2- 172.21.15.33:0/3449406699 >> v2:172.21.15.103:3300/0 conn(0x7f54700b1b00 0x7f54700cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 -- 172.21.15.33:0/3449406699 >> 172.21.15.33:0/3449406699 conn(0x7f54700b0510 msgr2=0x7f54700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 -- 172.21.15.33:0/3449406699 shutdown_connections 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.328+0000 7f5478000640 1 -- 172.21.15.33:0/3449406699 wait complete. 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.330+0000 7f5478000640 1 Processor -- start 2024-09-13T18:57:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.330+0000 7f5478000640 1 -- start start 2024-09-13T18:57:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54700b1b00 0x7f54700ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f547015a520 0x7f54700a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54701f0100 con 0x7f54700cde50 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700accc0 con 0x7f54700b1b00 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5478000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700acfa0 con 0x7f547015a520 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5474c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5474c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35578/0 (socket says 172.21.15.33:35578) 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5474c00640 1 -- 172.21.15.33:0/1863892236 learned_addr learned my addr 172.21.15.33:0/1863892236 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5475600640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54700b1b00 0x7f54700ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.331+0000 7f5476000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f547015a520 0x7f54700a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 -- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f547015a520 msgr2=0x7f54700a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f547015a520 0x7f54700a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 -- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54700b1b00 msgr2=0x7f54700ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54700b1b00 0x7f54700ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 -- 172.21.15.33:0/1863892236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468009a70 con 0x7f54700cde50 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5474c00640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d800 tx=0x7f545c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00b6c0 con 0x7f54700cde50 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00b820 con 0x7f54700cde50 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00bbb0 con 0x7f54700cde50 2024-09-13T18:57:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54700ad280 con 0x7f54700cde50 2024-09-13T18:57:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.332+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54701efe40 con 0x7f54700cde50 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.334+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54700ad470 con 0x7f54700cde50 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.334+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f545c00bd10 con 0x7f54700cde50 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.335+0000 7f546d600640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 0x7f545006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.335+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f545c089750 con 0x7f54700cde50 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.336+0000 7f5475600640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 0x7f545006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.336+0000 7f5475600640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 0x7f545006d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5464007fd0 tx=0x7f5464007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.340+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f545c0549d0 con 0x7f54700cde50 2024-09-13T18:57:26.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.519+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f54700cd910 con 0x7f54700cde50 2024-09-13T18:57:26.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.519+0000 7f546d600640 1 -- 172.21.15.33:0/1863892236 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f545c057ff0 con 0x7f54700cde50 2024-09-13T18:57:26.521 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 msgr2=0x7f545006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 0x7f545006d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5464007fd0 tx=0x7f5464007de0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 msgr2=0x7f54700a8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d800 tx=0x7f545c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 shutdown_connections 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f545006ac00 0x7f545006d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f547015a520 0x7f54700a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54700cde50 0x7f54700a8e50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.521+0000 7f5478000640 1 --2- 172.21.15.33:0/1863892236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54700b1b00 0x7f54700ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.522+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 >> 172.21.15.33:0/1863892236 conn(0x7f54700b0510 msgr2=0x7f547006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:26.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.522+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 shutdown_connections 2024-09-13T18:57:26.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.522+0000 7f5478000640 1 -- 172.21.15.33:0/1863892236 wait complete. 2024-09-13T18:57:26.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-13T18:57:26.540 DEBUG:teuthology.parallel:result is None 2024-09-13T18:57:26.540 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:57:26.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.693+0000 7f0e2a000640 1 Processor -- start 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.693+0000 7f0e2a000640 1 -- start start 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e2a000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e240b3990 0x7f0e24159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e2a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2406f660 0x7f0e2406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e2a000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e24159fc0 con 0x7f0e24153b20 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e2a000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e240ce600 con 0x7f0e2406f660 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e2a000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e24070f90 con 0x7f0e240b3990 2024-09-13T18:57:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e23e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2406f660 0x7f0e2406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e23e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2406f660 0x7f0e2406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35588/0 (socket says 172.21.15.33:35588) 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e23e00640 1 -- 172.21.15.33:0/818387082 learned_addr learned my addr 172.21.15.33:0/818387082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.694+0000 7f0e1aa00640 1 --2- 172.21.15.33:0/818387082 >> v2:172.21.15.103:3300/0 conn(0x7f0e240b3990 0x7f0e24159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.695+0000 7f0e23e00640 1 -- 172.21.15.33:0/818387082 >> v2:172.21.15.103:3300/0 conn(0x7f0e240b3990 msgr2=0x7f0e24159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.695+0000 7f0e23e00640 1 --2- 172.21.15.33:0/818387082 >> v2:172.21.15.103:3300/0 conn(0x7f0e240b3990 0x7f0e24159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.695+0000 7f0e23e00640 1 -- 172.21.15.33:0/818387082 >> v1:172.21.15.103:6789/0 conn(0x7f0e24153b20 legacy=0x7f0e240b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.695+0000 7f0e23e00640 1 -- 172.21.15.33:0/818387082 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24153f00 con 0x7f0e2406f660 2024-09-13T18:57:26.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e23e00640 1 --2- 172.21.15.33:0/818387082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2406f660 0x7f0e2406fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0e240707d0 tx=0x7f0e1c02c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891bd1a1de52d703 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e22a00640 1 -- 172.21.15.33:0/818387082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c032620 con 0x7f0e2406f660 2024-09-13T18:57:26.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e22a00640 1 -- 172.21.15.33:0/818387082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c032780 con 0x7f0e2406f660 2024-09-13T18:57:26.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e22a00640 1 -- 172.21.15.33:0/818387082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c032b10 con 0x7f0e2406f660 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e2a000640 1 -- 172.21.15.33:0/818387082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2406f660 msgr2=0x7f0e2406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.696+0000 7f0e2a000640 1 --2- 172.21.15.33:0/818387082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2406f660 0x7f0e2406fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0e240707d0 tx=0x7f0e1c02c970 comp rx=0 tx=0).stop 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 -- 172.21.15.33:0/818387082 shutdown_connections 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 --2- 172.21.15.33:0/818387082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2406f660 0x7f0e2406fa90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 --2- 172.21.15.33:0/818387082 >> v2:172.21.15.103:3300/0 conn(0x7f0e240b3990 0x7f0e24159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 -- 172.21.15.33:0/818387082 >> 172.21.15.33:0/818387082 conn(0x7f0e240b0510 msgr2=0x7f0e240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 -- 172.21.15.33:0/818387082 shutdown_connections 2024-09-13T18:57:26.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.697+0000 7f0e2a000640 1 -- 172.21.15.33:0/818387082 wait complete. 2024-09-13T18:57:26.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.698+0000 7f0e2a000640 1 Processor -- start 2024-09-13T18:57:26.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.698+0000 7f0e2a000640 1 -- start start 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e2406f660 0x7f0e24144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e24153b20 0x7f0e2414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2415c670 con 0x7f0e240b3990 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2415c950 con 0x7f0e24153b20 2024-09-13T18:57:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e2a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e241562f0 con 0x7f0e2406f660 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e1aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e1aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35600/0 (socket says 172.21.15.33:35600) 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.699+0000 7f0e1aa00640 1 -- 172.21.15.33:0/518039951 learned_addr learned my addr 172.21.15.33:0/518039951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e23e00640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e24153b20 0x7f0e2414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e23400640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e2406f660 0x7f0e24144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 -- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e2406f660 msgr2=0x7f0e24144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e2406f660 0x7f0e24144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 -- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e24153b20 msgr2=0x7f0e2414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e24153b20 0x7f0e2414efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 -- 172.21.15.33:0/518039951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c009b30 con 0x7f0e240b3990 2024-09-13T18:57:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1aa00640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00e870 tx=0x7f0e0c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0094f0 con 0x7f0e240b3990 2024-09-13T18:57:26.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c00c940 con 0x7f0e240b3990 2024-09-13T18:57:26.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00ccf0 con 0x7f0e240b3990 2024-09-13T18:57:26.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.700+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e241565d0 con 0x7f0e240b3990 2024-09-13T18:57:26.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.701+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e24144570 con 0x7f0e240b3990 2024-09-13T18:57:26.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.702+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e24159a80 con 0x7f0e240b3990 2024-09-13T18:57:26.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.703+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e0c013470 con 0x7f0e240b3990 2024-09-13T18:57:26.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.703+0000 7f0e1be00640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 0x7f0e0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.704+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e0c089430 con 0x7f0e240b3990 2024-09-13T18:57:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.704+0000 7f0e23400640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 0x7f0e0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.704+0000 7f0e23400640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 0x7f0e0006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e240cdbb0 tx=0x7f0e14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:26.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.708+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e0c054620 con 0x7f0e240b3990 2024-09-13T18:57:26.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.883+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e2415a4d0 con 0x7f0e0006ac00 2024-09-13T18:57:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.890+0000 7f0e1be00640 1 -- 172.21.15.33:0/518039951 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f0e140014c0 con 0x7f0e0006ac00 2024-09-13T18:57:26.895 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:26.897 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 msgr2=0x7f0e0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 0x7f0e0006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e240cdbb0 tx=0x7f0e14009040 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 msgr2=0x7f0e241500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00e870 tx=0x7f0e0c00ed30 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 shutdown_connections 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0e0006ac00 0x7f0e0006d0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e24153b20 0x7f0e2414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e240b3990 0x7f0e241500a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.894+0000 7f0e2a000640 1 --2- 172.21.15.33:0/518039951 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0e2406f660 0x7f0e24144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.895+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 >> 172.21.15.33:0/518039951 conn(0x7f0e240b0510 msgr2=0x7f0e240caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.895+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 shutdown_connections 2024-09-13T18:57:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:26.895+0000 7f0e2a000640 1 -- 172.21.15.33:0/518039951 wait complete. 2024-09-13T18:57:26.912 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-13T18:57:25.097538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.605355"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528800+0000","last_change":"2024-09-13T18:57:13.522419+0000","last_active":"2024-09-13T18:57:13.528800+0000","last_peered":"2024-09-13T18:57:13.528800+0000","last_clean":"2024-09-13T18:57:13.528800+0000","last_became_active":"2024-09-13T18:57:13.521011+0000","last_became_peered":"2024-09-13T18:57:13.521011+0000","last_unstale":"2024-09-13T18:57:13.528800+0000","last_undegraded":"2024-09-13T18:57:13.528800+0000","last_fullsized":"2024-09-13T18:57:13.528800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514821+0000","last_change":"2024-09-13T18:57:13.510107+0000","last_active":"2024-09-13T18:57:13.514821+0000","last_peered":"2024-09-13T18:57:13.514821+0000","last_clean":"2024-09-13T18:57:13.514821+0000","last_became_active":"2024-09-13T18:57:13.509853+0000","last_became_peered":"2024-09-13T18:57:13.509853+0000","last_unstale":"2024-09-13T18:57:13.514821+0000","last_undegraded":"2024-09-13T18:57:13.514821+0000","last_fullsized":"2024-09-13T18:57:13.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513869+0000","last_change":"2024-09-13T18:57:13.508765+0000","last_active":"2024-09-13T18:57:13.513869+0000","last_peered":"2024-09-13T18:57:13.513869+0000","last_clean":"2024-09-13T18:57:13.513869+0000","last_became_active":"2024-09-13T18:57:13.508499+0000","last_became_peered":"2024-09-13T18:57:13.508499+0000","last_unstale":"2024-09-13T18:57:13.513869+0000","last_undegraded":"2024-09-13T18:57:13.513869+0000","last_fullsized":"2024-09-13T18:57:13.513869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528909+0000","last_change":"2024-09-13T18:57:13.525713+0000","last_active":"2024-09-13T18:57:13.528909+0000","last_peered":"2024-09-13T18:57:13.528909+0000","last_clean":"2024-09-13T18:57:13.528909+0000","last_became_active":"2024-09-13T18:57:13.521390+0000","last_became_peered":"2024-09-13T18:57:13.521390+0000","last_unstale":"2024-09-13T18:57:13.528909+0000","last_undegraded":"2024-09-13T18:57:13.528909+0000","last_fullsized":"2024-09-13T18:57:13.528909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510856+0000","last_change":"2024-09-13T18:57:13.508469+0000","last_active":"2024-09-13T18:57:13.510856+0000","last_peered":"2024-09-13T18:57:13.510856+0000","last_clean":"2024-09-13T18:57:13.510856+0000","last_became_active":"2024-09-13T18:57:13.507301+0000","last_became_peered":"2024-09-13T18:57:13.507301+0000","last_unstale":"2024-09-13T18:57:13.510856+0000","last_undegraded":"2024-09-13T18:57:13.510856+0000","last_fullsized":"2024-09-13T18:57:13.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530319+0000","last_change":"2024-09-13T18:57:13.528886+0000","last_active":"2024-09-13T18:57:13.530319+0000","last_peered":"2024-09-13T18:57:13.530319+0000","last_clean":"2024-09-13T18:57:13.530319+0000","last_became_active":"2024-09-13T18:57:13.528181+0000","last_became_peered":"2024-09-13T18:57:13.528181+0000","last_unstale":"2024-09-13T18:57:13.530319+0000","last_undegraded":"2024-09-13T18:57:13.530319+0000","last_fullsized":"2024-09-13T18:57:13.530319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511278+0000","last_change":"2024-09-13T18:57:13.509845+0000","last_active":"2024-09-13T18:57:13.511278+0000","last_peered":"2024-09-13T18:57:13.511278+0000","last_clean":"2024-09-13T18:57:13.511278+0000","last_became_active":"2024-09-13T18:57:13.509457+0000","last_became_peered":"2024-09-13T18:57:13.509457+0000","last_unstale":"2024-09-13T18:57:13.511278+0000","last_undegraded":"2024-09-13T18:57:13.511278+0000","last_fullsized":"2024-09-13T18:57:13.511278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532810+0000","last_change":"2024-09-13T18:57:13.528197+0000","last_active":"2024-09-13T18:57:13.532810+0000","last_peered":"2024-09-13T18:57:13.532810+0000","last_clean":"2024-09-13T18:57:13.532810+0000","last_became_active":"2024-09-13T18:57:13.527837+0000","last_became_peered":"2024-09-13T18:57:13.527837+0000","last_unstale":"2024-09-13T18:57:13.532810+0000","last_undegraded":"2024-09-13T18:57:13.532810+0000","last_fullsized":"2024-09-13T18:57:13.532810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528817+0000","last_change":"2024-09-13T18:57:13.522966+0000","last_active":"2024-09-13T18:57:13.528817+0000","last_peered":"2024-09-13T18:57:13.528817+0000","last_clean":"2024-09-13T18:57:13.528817+0000","last_became_active":"2024-09-13T18:57:13.522718+0000","last_became_peered":"2024-09-13T18:57:13.522718+0000","last_unstale":"2024-09-13T18:57:13.528817+0000","last_undegraded":"2024-09-13T18:57:13.528817+0000","last_fullsized":"2024-09-13T18:57:13.528817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532479+0000","last_change":"2024-09-13T18:57:13.530108+0000","last_active":"2024-09-13T18:57:13.532479+0000","last_peered":"2024-09-13T18:57:13.532479+0000","last_clean":"2024-09-13T18:57:13.532479+0000","last_became_active":"2024-09-13T18:57:13.529856+0000","last_became_peered":"2024-09-13T18:57:13.529856+0000","last_unstale":"2024-09-13T18:57:13.532479+0000","last_undegraded":"2024-09-13T18:57:13.532479+0000","last_fullsized":"2024-09-13T18:57:13.532479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532940+0000","last_change":"2024-09-13T18:57:13.531905+0000","last_active":"2024-09-13T18:57:13.532940+0000","last_peered":"2024-09-13T18:57:13.532940+0000","last_clean":"2024-09-13T18:57:13.532940+0000","last_became_active":"2024-09-13T18:57:13.531582+0000","last_became_peered":"2024-09-13T18:57:13.531582+0000","last_unstale":"2024-09-13T18:57:13.532940+0000","last_undegraded":"2024-09-13T18:57:13.532940+0000","last_fullsized":"2024-09-13T18:57:13.532940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529009+0000","last_change":"2024-09-13T18:57:13.526125+0000","last_active":"2024-09-13T18:57:13.529009+0000","last_peered":"2024-09-13T18:57:13.529009+0000","last_clean":"2024-09-13T18:57:13.529009+0000","last_became_active":"2024-09-13T18:57:13.525706+0000","last_became_peered":"2024-09-13T18:57:13.525706+0000","last_unstale":"2024-09-13T18:57:13.529009+0000","last_undegraded":"2024-09-13T18:57:13.529009+0000","last_fullsized":"2024-09-13T18:57:13.529009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520064+0000","last_change":"2024-09-13T18:57:13.518913+0000","last_active":"2024-09-13T18:57:13.520064+0000","last_peered":"2024-09-13T18:57:13.520064+0000","last_clean":"2024-09-13T18:57:13.520064+0000","last_became_active":"2024-09-13T18:57:13.518381+0000","last_became_peered":"2024-09-13T18:57:13.518381+0000","last_unstale":"2024-09-13T18:57:13.520064+0000","last_undegraded":"2024-09-13T18:57:13.520064+0000","last_fullsized":"2024-09-13T18:57:13.520064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515917+0000","last_change":"2024-09-13T18:57:13.510462+0000","last_active":"2024-09-13T18:57:13.515917+0000","last_peered":"2024-09-13T18:57:13.515917+0000","last_clean":"2024-09-13T18:57:13.515917+0000","last_became_active":"2024-09-13T18:57:13.510058+0000","last_became_peered":"2024-09-13T18:57:13.510058+0000","last_unstale":"2024-09-13T18:57:13.515917+0000","last_undegraded":"2024-09-13T18:57:13.515917+0000","last_fullsized":"2024-09-13T18:57:13.515917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512044+0000","last_change":"2024-09-13T18:57:13.504104+0000","last_active":"2024-09-13T18:57:13.512044+0000","last_peered":"2024-09-13T18:57:13.512044+0000","last_clean":"2024-09-13T18:57:13.512044+0000","last_became_active":"2024-09-13T18:57:13.503287+0000","last_became_peered":"2024-09-13T18:57:13.503287+0000","last_unstale":"2024-09-13T18:57:13.512044+0000","last_undegraded":"2024-09-13T18:57:13.512044+0000","last_fullsized":"2024-09-13T18:57:13.512044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533192+0000","last_change":"2024-09-13T18:57:13.530559+0000","last_active":"2024-09-13T18:57:13.533192+0000","last_peered":"2024-09-13T18:57:13.533192+0000","last_clean":"2024-09-13T18:57:13.533192+0000","last_became_active":"2024-09-13T18:57:13.528317+0000","last_became_peered":"2024-09-13T18:57:13.528317+0000","last_unstale":"2024-09-13T18:57:13.533192+0000","last_undegraded":"2024-09-13T18:57:13.533192+0000","last_fullsized":"2024-09-13T18:57:13.533192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529757+0000","last_change":"2024-09-13T18:57:13.513604+0000","last_active":"2024-09-13T18:57:13.529757+0000","last_peered":"2024-09-13T18:57:13.529757+0000","last_clean":"2024-09-13T18:57:13.529757+0000","last_became_active":"2024-09-13T18:57:13.512484+0000","last_became_peered":"2024-09-13T18:57:13.512484+0000","last_unstale":"2024-09-13T18:57:13.529757+0000","last_undegraded":"2024-09-13T18:57:13.529757+0000","last_fullsized":"2024-09-13T18:57:13.529757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520879+0000","last_change":"2024-09-13T18:57:13.520180+0000","last_active":"2024-09-13T18:57:13.520879+0000","last_peered":"2024-09-13T18:57:13.520879+0000","last_clean":"2024-09-13T18:57:13.520879+0000","last_became_active":"2024-09-13T18:57:13.519896+0000","last_became_peered":"2024-09-13T18:57:13.519896+0000","last_unstale":"2024-09-13T18:57:13.520879+0000","last_undegraded":"2024-09-13T18:57:13.520879+0000","last_fullsized":"2024-09-13T18:57:13.520879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510733+0000","last_change":"2024-09-13T18:57:13.507930+0000","last_active":"2024-09-13T18:57:13.510733+0000","last_peered":"2024-09-13T18:57:13.510733+0000","last_clean":"2024-09-13T18:57:13.510733+0000","last_became_active":"2024-09-13T18:57:13.507657+0000","last_became_peered":"2024-09-13T18:57:13.507657+0000","last_unstale":"2024-09-13T18:57:13.510733+0000","last_undegraded":"2024-09-13T18:57:13.510733+0000","last_fullsized":"2024-09-13T18:57:13.510733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529867+0000","last_change":"2024-09-13T18:57:13.525532+0000","last_active":"2024-09-13T18:57:13.529867+0000","last_peered":"2024-09-13T18:57:13.529867+0000","last_clean":"2024-09-13T18:57:13.529867+0000","last_became_active":"2024-09-13T18:57:13.525230+0000","last_became_peered":"2024-09-13T18:57:13.525230+0000","last_unstale":"2024-09-13T18:57:13.529867+0000","last_undegraded":"2024-09-13T18:57:13.529867+0000","last_fullsized":"2024-09-13T18:57:13.529867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515961+0000","last_change":"2024-09-13T18:57:13.512432+0000","last_active":"2024-09-13T18:57:13.515961+0000","last_peered":"2024-09-13T18:57:13.515961+0000","last_clean":"2024-09-13T18:57:13.515961+0000","last_became_active":"2024-09-13T18:57:13.509317+0000","last_became_peered":"2024-09-13T18:57:13.509317+0000","last_unstale":"2024-09-13T18:57:13.515961+0000","last_undegraded":"2024-09-13T18:57:13.515961+0000","last_fullsized":"2024-09-13T18:57:13.515961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528774+0000","last_change":"2024-09-13T18:57:13.520560+0000","last_active":"2024-09-13T18:57:13.528774+0000","last_peered":"2024-09-13T18:57:13.528774+0000","last_clean":"2024-09-13T18:57:13.528774+0000","last_became_active":"2024-09-13T18:57:13.520315+0000","last_became_peered":"2024-09-13T18:57:13.520315+0000","last_unstale":"2024-09-13T18:57:13.528774+0000","last_undegraded":"2024-09-13T18:57:13.528774+0000","last_fullsized":"2024-09-13T18:57:13.528774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512275+0000","last_change":"2024-09-13T18:57:13.502348+0000","last_active":"2024-09-13T18:57:13.512275+0000","last_peered":"2024-09-13T18:57:13.512275+0000","last_clean":"2024-09-13T18:57:13.512275+0000","last_became_active":"2024-09-13T18:57:13.502087+0000","last_became_peered":"2024-09-13T18:57:13.502087+0000","last_unstale":"2024-09-13T18:57:13.512275+0000","last_undegraded":"2024-09-13T18:57:13.512275+0000","last_fullsized":"2024-09-13T18:57:13.512275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531361+0000","last_change":"2024-09-13T18:57:13.527672+0000","last_active":"2024-09-13T18:57:13.531361+0000","last_peered":"2024-09-13T18:57:13.531361+0000","last_clean":"2024-09-13T18:57:13.531361+0000","last_became_active":"2024-09-13T18:57:13.521290+0000","last_became_peered":"2024-09-13T18:57:13.521290+0000","last_unstale":"2024-09-13T18:57:13.531361+0000","last_undegraded":"2024-09-13T18:57:13.531361+0000","last_fullsized":"2024-09-13T18:57:13.531361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513821+0000","last_change":"2024-09-13T18:57:13.505357+0000","last_active":"2024-09-13T18:57:13.513821+0000","last_peered":"2024-09-13T18:57:13.513821+0000","last_clean":"2024-09-13T18:57:13.513821+0000","last_became_active":"2024-09-13T18:57:13.503764+0000","last_became_peered":"2024-09-13T18:57:13.503764+0000","last_unstale":"2024-09-13T18:57:13.513821+0000","last_undegraded":"2024-09-13T18:57:13.513821+0000","last_fullsized":"2024-09-13T18:57:13.513821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.525997+0000","last_change":"2024-09-13T18:57:13.520078+0000","last_active":"2024-09-13T18:57:13.525997+0000","last_peered":"2024-09-13T18:57:13.525997+0000","last_clean":"2024-09-13T18:57:13.525997+0000","last_became_active":"2024-09-13T18:57:13.519088+0000","last_became_peered":"2024-09-13T18:57:13.519088+0000","last_unstale":"2024-09-13T18:57:13.525997+0000","last_undegraded":"2024-09-13T18:57:13.525997+0000","last_fullsized":"2024-09-13T18:57:13.525997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511965+0000","last_change":"2024-09-13T18:57:13.504312+0000","last_active":"2024-09-13T18:57:13.511965+0000","last_peered":"2024-09-13T18:57:13.511965+0000","last_clean":"2024-09-13T18:57:13.511965+0000","last_became_active":"2024-09-13T18:57:13.504062+0000","last_became_peered":"2024-09-13T18:57:13.504062+0000","last_unstale":"2024-09-13T18:57:13.511965+0000","last_undegraded":"2024-09-13T18:57:13.511965+0000","last_fullsized":"2024-09-13T18:57:13.511965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.503063+0000","last_change":"2024-09-13T18:57:13.501012+0000","last_active":"2024-09-13T18:57:13.503063+0000","last_peered":"2024-09-13T18:57:13.503063+0000","last_clean":"2024-09-13T18:57:13.503063+0000","last_became_active":"2024-09-13T18:57:13.500775+0000","last_became_peered":"2024-09-13T18:57:13.500775+0000","last_unstale":"2024-09-13T18:57:13.503063+0000","last_undegraded":"2024-09-13T18:57:13.503063+0000","last_fullsized":"2024-09-13T18:57:13.503063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.518301+0000","last_change":"2024-09-13T18:57:13.514151+0000","last_active":"2024-09-13T18:57:13.518301+0000","last_peered":"2024-09-13T18:57:13.518301+0000","last_clean":"2024-09-13T18:57:13.518301+0000","last_became_active":"2024-09-13T18:57:13.512580+0000","last_became_peered":"2024-09-13T18:57:13.512580+0000","last_unstale":"2024-09-13T18:57:13.518301+0000","last_undegraded":"2024-09-13T18:57:13.518301+0000","last_fullsized":"2024-09-13T18:57:13.518301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530306+0000","last_change":"2024-09-13T18:57:13.528152+0000","last_active":"2024-09-13T18:57:13.530306+0000","last_peered":"2024-09-13T18:57:13.530306+0000","last_clean":"2024-09-13T18:57:13.530306+0000","last_became_active":"2024-09-13T18:57:13.527834+0000","last_became_peered":"2024-09-13T18:57:13.527834+0000","last_unstale":"2024-09-13T18:57:13.530306+0000","last_undegraded":"2024-09-13T18:57:13.530306+0000","last_fullsized":"2024-09-13T18:57:13.530306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531696+0000","last_change":"2024-09-13T18:57:13.531001+0000","last_active":"2024-09-13T18:57:13.531696+0000","last_peered":"2024-09-13T18:57:13.531696+0000","last_clean":"2024-09-13T18:57:13.531696+0000","last_became_active":"2024-09-13T18:57:13.530750+0000","last_became_peered":"2024-09-13T18:57:13.530750+0000","last_unstale":"2024-09-13T18:57:13.531696+0000","last_undegraded":"2024-09-13T18:57:13.531696+0000","last_fullsized":"2024-09-13T18:57:13.531696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521145+0000","last_change":"2024-09-13T18:57:13.518687+0000","last_active":"2024-09-13T18:57:13.521145+0000","last_peered":"2024-09-13T18:57:13.521145+0000","last_clean":"2024-09-13T18:57:13.521145+0000","last_became_active":"2024-09-13T18:57:13.518393+0000","last_became_peered":"2024-09-13T18:57:13.518393+0000","last_unstale":"2024-09-13T18:57:13.521145+0000","last_undegraded":"2024-09-13T18:57:13.521145+0000","last_fullsized":"2024-09-13T18:57:13.521145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519289+0000","last_change":"2024-09-13T18:57:13.517369+0000","last_active":"2024-09-13T18:57:13.519289+0000","last_peered":"2024-09-13T18:57:13.519289+0000","last_clean":"2024-09-13T18:57:13.519289+0000","last_became_active":"2024-09-13T18:57:13.516175+0000","last_became_peered":"2024-09-13T18:57:13.516175+0000","last_unstale":"2024-09-13T18:57:13.519289+0000","last_undegraded":"2024-09-13T18:57:13.519289+0000","last_fullsized":"2024-09-13T18:57:13.519289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514834+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.514834+0000","last_peered":"2024-09-13T18:57:13.514834+0000","last_clean":"2024-09-13T18:57:13.514834+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.514834+0000","last_undegraded":"2024-09-13T18:57:13.514834+0000","last_fullsized":"2024-09-13T18:57:13.514834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514757+0000","last_change":"2024-09-13T18:57:13.509552+0000","last_active":"2024-09-13T18:57:13.514757+0000","last_peered":"2024-09-13T18:57:13.514757+0000","last_clean":"2024-09-13T18:57:13.514757+0000","last_became_active":"2024-09-13T18:57:13.506301+0000","last_became_peered":"2024-09-13T18:57:13.506301+0000","last_unstale":"2024-09-13T18:57:13.514757+0000","last_undegraded":"2024-09-13T18:57:13.514757+0000","last_fullsized":"2024-09-13T18:57:13.514757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527248+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.527248+0000","last_peered":"2024-09-13T18:57:13.527248+0000","last_clean":"2024-09-13T18:57:13.527248+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.527248+0000","last_undegraded":"2024-09-13T18:57:13.527248+0000","last_fullsized":"2024-09-13T18:57:13.527248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492370+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.492370+0000","last_peered":"2024-09-13T18:57:13.492370+0000","last_clean":"2024-09-13T18:57:13.492370+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.492370+0000","last_undegraded":"2024-09-13T18:57:13.492370+0000","last_fullsized":"2024-09-13T18:57:13.492370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513971+0000","last_change":"2024-09-13T18:57:13.509463+0000","last_active":"2024-09-13T18:57:13.513971+0000","last_peered":"2024-09-13T18:57:13.513971+0000","last_clean":"2024-09-13T18:57:13.513971+0000","last_became_active":"2024-09-13T18:57:13.509205+0000","last_became_peered":"2024-09-13T18:57:13.509205+0000","last_unstale":"2024-09-13T18:57:13.513971+0000","last_undegraded":"2024-09-13T18:57:13.513971+0000","last_fullsized":"2024-09-13T18:57:13.513971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510784+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.510784+0000","last_peered":"2024-09-13T18:57:13.510784+0000","last_clean":"2024-09-13T18:57:13.510784+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.510784+0000","last_undegraded":"2024-09-13T18:57:13.510784+0000","last_fullsized":"2024-09-13T18:57:13.510784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514052+0000","last_change":"2024-09-13T18:57:13.504149+0000","last_active":"2024-09-13T18:57:13.514052+0000","last_peered":"2024-09-13T18:57:13.514052+0000","last_clean":"2024-09-13T18:57:13.514052+0000","last_became_active":"2024-09-13T18:57:13.503874+0000","last_became_peered":"2024-09-13T18:57:13.503874+0000","last_unstale":"2024-09-13T18:57:13.514052+0000","last_undegraded":"2024-09-13T18:57:13.514052+0000","last_fullsized":"2024-09-13T18:57:13.514052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515679+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.515679+0000","last_peered":"2024-09-13T18:57:13.515679+0000","last_clean":"2024-09-13T18:57:13.515679+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.515679+0000","last_undegraded":"2024-09-13T18:57:13.515679+0000","last_fullsized":"2024-09-13T18:57:13.515679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530773+0000","last_change":"2024-09-13T18:57:13.528119+0000","last_active":"2024-09-13T18:57:13.530773+0000","last_peered":"2024-09-13T18:57:13.530773+0000","last_clean":"2024-09-13T18:57:13.530773+0000","last_became_active":"2024-09-13T18:57:13.527859+0000","last_became_peered":"2024-09-13T18:57:13.527859+0000","last_unstale":"2024-09-13T18:57:13.530773+0000","last_undegraded":"2024-09-13T18:57:13.530773+0000","last_fullsized":"2024-09-13T18:57:13.530773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514102+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.514102+0000","last_peered":"2024-09-13T18:57:13.514102+0000","last_clean":"2024-09-13T18:57:13.514102+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.514102+0000","last_undegraded":"2024-09-13T18:57:13.514102+0000","last_fullsized":"2024-09-13T18:57:13.514102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528063+0000","last_change":"2024-09-13T18:57:13.526462+0000","last_active":"2024-09-13T18:57:13.528063+0000","last_peered":"2024-09-13T18:57:13.528063+0000","last_clean":"2024-09-13T18:57:13.528063+0000","last_became_active":"2024-09-13T18:57:13.526259+0000","last_became_peered":"2024-09-13T18:57:13.526259+0000","last_unstale":"2024-09-13T18:57:13.528063+0000","last_undegraded":"2024-09-13T18:57:13.528063+0000","last_fullsized":"2024-09-13T18:57:13.528063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531561+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.531561+0000","last_peered":"2024-09-13T18:57:13.531561+0000","last_clean":"2024-09-13T18:57:13.531561+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.531561+0000","last_undegraded":"2024-09-13T18:57:13.531561+0000","last_fullsized":"2024-09-13T18:57:13.531561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517426+0000","last_change":"2024-09-13T18:57:13.511843+0000","last_active":"2024-09-13T18:57:13.517426+0000","last_peered":"2024-09-13T18:57:13.517426+0000","last_clean":"2024-09-13T18:57:13.517426+0000","last_became_active":"2024-09-13T18:57:13.511537+0000","last_became_peered":"2024-09-13T18:57:13.511537+0000","last_unstale":"2024-09-13T18:57:13.517426+0000","last_undegraded":"2024-09-13T18:57:13.517426+0000","last_fullsized":"2024-09-13T18:57:13.517426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533503+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.533503+0000","last_peered":"2024-09-13T18:57:13.533503+0000","last_clean":"2024-09-13T18:57:13.533503+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.533503+0000","last_undegraded":"2024-09-13T18:57:13.533503+0000","last_fullsized":"2024-09-13T18:57:13.533503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508616+0000","last_change":"2024-09-13T18:57:13.506092+0000","last_active":"2024-09-13T18:57:13.508616+0000","last_peered":"2024-09-13T18:57:13.508616+0000","last_clean":"2024-09-13T18:57:13.508616+0000","last_became_active":"2024-09-13T18:57:13.505707+0000","last_became_peered":"2024-09-13T18:57:13.505707+0000","last_unstale":"2024-09-13T18:57:13.508616+0000","last_undegraded":"2024-09-13T18:57:13.508616+0000","last_fullsized":"2024-09-13T18:57:13.508616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514701+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.514701+0000","last_peered":"2024-09-13T18:57:13.514701+0000","last_clean":"2024-09-13T18:57:13.514701+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.514701+0000","last_undegraded":"2024-09-13T18:57:13.514701+0000","last_fullsized":"2024-09-13T18:57:13.514701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514016+0000","last_change":"2024-09-13T18:57:13.509609+0000","last_active":"2024-09-13T18:57:13.514016+0000","last_peered":"2024-09-13T18:57:13.514016+0000","last_clean":"2024-09-13T18:57:13.514016+0000","last_became_active":"2024-09-13T18:57:13.509286+0000","last_became_peered":"2024-09-13T18:57:13.509286+0000","last_unstale":"2024-09-13T18:57:13.514016+0000","last_undegraded":"2024-09-13T18:57:13.514016+0000","last_fullsized":"2024-09-13T18:57:13.514016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513159+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.513159+0000","last_peered":"2024-09-13T18:57:13.513159+0000","last_clean":"2024-09-13T18:57:13.513159+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.513159+0000","last_undegraded":"2024-09-13T18:57:13.513159+0000","last_fullsized":"2024-09-13T18:57:13.513159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508734+0000","last_change":"2024-09-13T18:57:13.506462+0000","last_active":"2024-09-13T18:57:13.508734+0000","last_peered":"2024-09-13T18:57:13.508734+0000","last_clean":"2024-09-13T18:57:13.508734+0000","last_became_active":"2024-09-13T18:57:13.506135+0000","last_became_peered":"2024-09-13T18:57:13.506135+0000","last_unstale":"2024-09-13T18:57:13.508734+0000","last_undegraded":"2024-09-13T18:57:13.508734+0000","last_fullsized":"2024-09-13T18:57:13.508734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509681+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.509681+0000","last_peered":"2024-09-13T18:57:13.509681+0000","last_clean":"2024-09-13T18:57:13.509681+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.509681+0000","last_undegraded":"2024-09-13T18:57:13.509681+0000","last_fullsized":"2024-09-13T18:57:13.509681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521125+0000","last_change":"2024-09-13T18:57:13.518635+0000","last_active":"2024-09-13T18:57:13.521125+0000","last_peered":"2024-09-13T18:57:13.521125+0000","last_clean":"2024-09-13T18:57:13.521125+0000","last_became_active":"2024-09-13T18:57:13.518274+0000","last_became_peered":"2024-09-13T18:57:13.518274+0000","last_unstale":"2024-09-13T18:57:13.521125+0000","last_undegraded":"2024-09-13T18:57:13.521125+0000","last_fullsized":"2024-09-13T18:57:13.521125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512870+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.512870+0000","last_peered":"2024-09-13T18:57:13.512870+0000","last_clean":"2024-09-13T18:57:13.512870+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.512870+0000","last_undegraded":"2024-09-13T18:57:13.512870+0000","last_fullsized":"2024-09-13T18:57:13.512870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527414+0000","last_change":"2024-09-13T18:57:13.515449+0000","last_active":"2024-09-13T18:57:13.527414+0000","last_peered":"2024-09-13T18:57:13.527414+0000","last_clean":"2024-09-13T18:57:13.527414+0000","last_became_active":"2024-09-13T18:57:13.514478+0000","last_became_peered":"2024-09-13T18:57:13.514478+0000","last_unstale":"2024-09-13T18:57:13.527414+0000","last_undegraded":"2024-09-13T18:57:13.527414+0000","last_fullsized":"2024-09-13T18:57:13.527414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514267+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.514267+0000","last_peered":"2024-09-13T18:57:13.514267+0000","last_clean":"2024-09-13T18:57:13.514267+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.514267+0000","last_undegraded":"2024-09-13T18:57:13.514267+0000","last_fullsized":"2024-09-13T18:57:13.514267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509295+0000","last_change":"2024-09-13T18:57:13.506875+0000","last_active":"2024-09-13T18:57:13.509295+0000","last_peered":"2024-09-13T18:57:13.509295+0000","last_clean":"2024-09-13T18:57:13.509295+0000","last_became_active":"2024-09-13T18:57:13.506471+0000","last_became_peered":"2024-09-13T18:57:13.506471+0000","last_unstale":"2024-09-13T18:57:13.509295+0000","last_undegraded":"2024-09-13T18:57:13.509295+0000","last_fullsized":"2024-09-13T18:57:13.509295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.505344+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.505344+0000","last_peered":"2024-09-13T18:57:13.505344+0000","last_clean":"2024-09-13T18:57:13.505344+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.505344+0000","last_undegraded":"2024-09-13T18:57:13.505344+0000","last_fullsized":"2024-09-13T18:57:13.505344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527382+0000","last_change":"2024-09-13T18:57:13.514665+0000","last_active":"2024-09-13T18:57:13.527382+0000","last_peered":"2024-09-13T18:57:13.527382+0000","last_clean":"2024-09-13T18:57:13.527382+0000","last_became_active":"2024-09-13T18:57:13.514373+0000","last_became_peered":"2024-09-13T18:57:13.514373+0000","last_unstale":"2024-09-13T18:57:13.527382+0000","last_undegraded":"2024-09-13T18:57:13.527382+0000","last_fullsized":"2024-09-13T18:57:13.527382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517258+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.517258+0000","last_peered":"2024-09-13T18:57:13.517258+0000","last_clean":"2024-09-13T18:57:13.517258+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.517258+0000","last_undegraded":"2024-09-13T18:57:13.517258+0000","last_fullsized":"2024-09-13T18:57:13.517258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528889+0000","last_change":"2024-09-13T18:57:13.521314+0000","last_active":"2024-09-13T18:57:13.528889+0000","last_peered":"2024-09-13T18:57:13.528889+0000","last_clean":"2024-09-13T18:57:13.528889+0000","last_became_active":"2024-09-13T18:57:13.519808+0000","last_became_peered":"2024-09-13T18:57:13.519808+0000","last_unstale":"2024-09-13T18:57:13.528889+0000","last_undegraded":"2024-09-13T18:57:13.528889+0000","last_fullsized":"2024-09-13T18:57:13.528889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487827+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.487827+0000","last_peered":"2024-09-13T18:57:13.487827+0000","last_clean":"2024-09-13T18:57:13.487827+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.487827+0000","last_undegraded":"2024-09-13T18:57:13.487827+0000","last_fullsized":"2024-09-13T18:57:13.487827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528931+0000","last_change":"2024-09-13T18:57:13.523066+0000","last_active":"2024-09-13T18:57:13.528931+0000","last_peered":"2024-09-13T18:57:13.528931+0000","last_clean":"2024-09-13T18:57:13.528931+0000","last_became_active":"2024-09-13T18:57:13.522829+0000","last_became_peered":"2024-09-13T18:57:13.522829+0000","last_unstale":"2024-09-13T18:57:13.528931+0000","last_undegraded":"2024-09-13T18:57:13.528931+0000","last_fullsized":"2024-09-13T18:57:13.528931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491602+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:13.491602+0000","last_peered":"2024-09-13T18:57:13.491602+0000","last_clean":"2024-09-13T18:57:13.491602+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:13.491602+0000","last_undegraded":"2024-09-13T18:57:13.491602+0000","last_fullsized":"2024-09-13T18:57:13.491602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.502901+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.502901+0000","last_peered":"2024-09-13T18:57:13.502901+0000","last_clean":"2024-09-13T18:57:13.502901+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.502901+0000","last_undegraded":"2024-09-13T18:57:13.502901+0000","last_fullsized":"2024-09-13T18:57:13.502901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533279+0000","last_change":"2024-09-13T18:57:13.531524+0000","last_active":"2024-09-13T18:57:13.533279+0000","last_peered":"2024-09-13T18:57:13.533279+0000","last_clean":"2024-09-13T18:57:13.533279+0000","last_became_active":"2024-09-13T18:57:13.530731+0000","last_became_peered":"2024-09-13T18:57:13.530731+0000","last_unstale":"2024-09-13T18:57:13.533279+0000","last_undegraded":"2024-09-13T18:57:13.533279+0000","last_fullsized":"2024-09-13T18:57:13.533279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491503+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.491503+0000","last_peered":"2024-09-13T18:57:13.491503+0000","last_clean":"2024-09-13T18:57:13.491503+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.491503+0000","last_undegraded":"2024-09-13T18:57:13.491503+0000","last_fullsized":"2024-09-13T18:57:13.491503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511770+0000","last_change":"2024-09-13T18:57:13.505735+0000","last_active":"2024-09-13T18:57:13.511770+0000","last_peered":"2024-09-13T18:57:13.511770+0000","last_clean":"2024-09-13T18:57:13.511770+0000","last_became_active":"2024-09-13T18:57:13.505442+0000","last_became_peered":"2024-09-13T18:57:13.505442+0000","last_unstale":"2024-09-13T18:57:13.511770+0000","last_undegraded":"2024-09-13T18:57:13.511770+0000","last_fullsized":"2024-09-13T18:57:13.511770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487814+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.487814+0000","last_peered":"2024-09-13T18:57:13.487814+0000","last_clean":"2024-09-13T18:57:13.487814+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.487814+0000","last_undegraded":"2024-09-13T18:57:13.487814+0000","last_fullsized":"2024-09-13T18:57:13.487814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514688+0000","last_change":"2024-09-13T18:57:13.509025+0000","last_active":"2024-09-13T18:57:13.514688+0000","last_peered":"2024-09-13T18:57:13.514688+0000","last_clean":"2024-09-13T18:57:13.514688+0000","last_became_active":"2024-09-13T18:57:13.508745+0000","last_became_peered":"2024-09-13T18:57:13.508745+0000","last_unstale":"2024-09-13T18:57:13.514688+0000","last_undegraded":"2024-09-13T18:57:13.514688+0000","last_fullsized":"2024-09-13T18:57:13.514688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513426+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.513426+0000","last_peered":"2024-09-13T18:57:13.513426+0000","last_clean":"2024-09-13T18:57:13.513426+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.513426+0000","last_undegraded":"2024-09-13T18:57:13.513426+0000","last_fullsized":"2024-09-13T18:57:13.513426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519326+0000","last_change":"2024-09-13T18:57:13.517447+0000","last_active":"2024-09-13T18:57:13.519326+0000","last_peered":"2024-09-13T18:57:13.519326+0000","last_clean":"2024-09-13T18:57:13.519326+0000","last_became_active":"2024-09-13T18:57:13.514845+0000","last_became_peered":"2024-09-13T18:57:13.514845+0000","last_unstale":"2024-09-13T18:57:13.519326+0000","last_undegraded":"2024-09-13T18:57:13.519326+0000","last_fullsized":"2024-09-13T18:57:13.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492184+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.492184+0000","last_peered":"2024-09-13T18:57:13.492184+0000","last_clean":"2024-09-13T18:57:13.492184+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.492184+0000","last_undegraded":"2024-09-13T18:57:13.492184+0000","last_fullsized":"2024-09-13T18:57:13.492184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530696+0000","last_change":"2024-09-13T18:57:13.527647+0000","last_active":"2024-09-13T18:57:13.530696+0000","last_peered":"2024-09-13T18:57:13.530696+0000","last_clean":"2024-09-13T18:57:13.530696+0000","last_became_active":"2024-09-13T18:57:13.519711+0000","last_became_peered":"2024-09-13T18:57:13.519711+0000","last_unstale":"2024-09-13T18:57:13.530696+0000","last_undegraded":"2024-09-13T18:57:13.530696+0000","last_fullsized":"2024-09-13T18:57:13.530696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492981+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.492981+0000","last_peered":"2024-09-13T18:57:13.492981+0000","last_clean":"2024-09-13T18:57:13.492981+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.492981+0000","last_undegraded":"2024-09-13T18:57:13.492981+0000","last_fullsized":"2024-09-13T18:57:13.492981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514488+0000","last_change":"2024-09-13T18:57:13.507458+0000","last_active":"2024-09-13T18:57:13.514488+0000","last_peered":"2024-09-13T18:57:13.514488+0000","last_clean":"2024-09-13T18:57:13.514488+0000","last_became_active":"2024-09-13T18:57:13.507163+0000","last_became_peered":"2024-09-13T18:57:13.507163+0000","last_unstale":"2024-09-13T18:57:13.514488+0000","last_undegraded":"2024-09-13T18:57:13.514488+0000","last_fullsized":"2024-09-13T18:57:13.514488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:57:14.494149+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:14.494149+0000","last_peered":"2024-09-13T18:57:14.494149+0000","last_clean":"2024-09-13T18:57:14.494149+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:14.494149+0000","last_undegraded":"2024-09-13T18:57:14.494149+0000","last_fullsized":"2024-09-13T18:57:14.494149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513838+0000","last_change":"2024-09-13T18:57:13.508509+0000","last_active":"2024-09-13T18:57:13.513838+0000","last_peered":"2024-09-13T18:57:13.513838+0000","last_clean":"2024-09-13T18:57:13.513838+0000","last_became_active":"2024-09-13T18:57:13.508215+0000","last_became_peered":"2024-09-13T18:57:13.508215+0000","last_unstale":"2024-09-13T18:57:13.513838+0000","last_undegraded":"2024-09-13T18:57:13.513838+0000","last_fullsized":"2024-09-13T18:57:13.513838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529311+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.529311+0000","last_peered":"2024-09-13T18:57:13.529311+0000","last_clean":"2024-09-13T18:57:13.529311+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.529311+0000","last_undegraded":"2024-09-13T18:57:13.529311+0000","last_fullsized":"2024-09-13T18:57:13.529311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515857+0000","last_change":"2024-09-13T18:57:13.509453+0000","last_active":"2024-09-13T18:57:13.515857+0000","last_peered":"2024-09-13T18:57:13.515857+0000","last_clean":"2024-09-13T18:57:13.515857+0000","last_became_active":"2024-09-13T18:57:13.509188+0000","last_became_peered":"2024-09-13T18:57:13.509188+0000","last_unstale":"2024-09-13T18:57:13.515857+0000","last_undegraded":"2024-09-13T18:57:13.515857+0000","last_fullsized":"2024-09-13T18:57:13.515857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.490795+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.490795+0000","last_peered":"2024-09-13T18:57:13.490795+0000","last_clean":"2024-09-13T18:57:13.490795+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.490795+0000","last_undegraded":"2024-09-13T18:57:13.490795+0000","last_fullsized":"2024-09-13T18:57:13.490795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511536+0000","last_change":"2024-09-13T18:57:13.506172+0000","last_active":"2024-09-13T18:57:13.511536+0000","last_peered":"2024-09-13T18:57:13.511536+0000","last_clean":"2024-09-13T18:57:13.511536+0000","last_became_active":"2024-09-13T18:57:13.503964+0000","last_became_peered":"2024-09-13T18:57:13.503964+0000","last_unstale":"2024-09-13T18:57:13.511536+0000","last_undegraded":"2024-09-13T18:57:13.511536+0000","last_fullsized":"2024-09-13T18:57:13.511536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492922+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.492922+0000","last_peered":"2024-09-13T18:57:13.492922+0000","last_clean":"2024-09-13T18:57:13.492922+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.492922+0000","last_undegraded":"2024-09-13T18:57:13.492922+0000","last_fullsized":"2024-09-13T18:57:13.492922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513953+0000","last_change":"2024-09-13T18:57:13.508906+0000","last_active":"2024-09-13T18:57:13.513953+0000","last_peered":"2024-09-13T18:57:13.513953+0000","last_clean":"2024-09-13T18:57:13.513953+0000","last_became_active":"2024-09-13T18:57:13.508586+0000","last_became_peered":"2024-09-13T18:57:13.508586+0000","last_unstale":"2024-09-13T18:57:13.513953+0000","last_undegraded":"2024-09-13T18:57:13.513953+0000","last_fullsized":"2024-09-13T18:57:13.513953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492144+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.492144+0000","last_peered":"2024-09-13T18:57:13.492144+0000","last_clean":"2024-09-13T18:57:13.492144+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.492144+0000","last_undegraded":"2024-09-13T18:57:13.492144+0000","last_fullsized":"2024-09-13T18:57:13.492144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519057+0000","last_change":"2024-09-13T18:57:13.514983+0000","last_active":"2024-09-13T18:57:13.519057+0000","last_peered":"2024-09-13T18:57:13.519057+0000","last_clean":"2024-09-13T18:57:13.519057+0000","last_became_active":"2024-09-13T18:57:13.514654+0000","last_became_peered":"2024-09-13T18:57:13.514654+0000","last_unstale":"2024-09-13T18:57:13.519057+0000","last_undegraded":"2024-09-13T18:57:13.519057+0000","last_fullsized":"2024-09-13T18:57:13.519057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515394+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.515394+0000","last_peered":"2024-09-13T18:57:13.515394+0000","last_clean":"2024-09-13T18:57:13.515394+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.515394+0000","last_undegraded":"2024-09-13T18:57:13.515394+0000","last_fullsized":"2024-09-13T18:57:13.515394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521183+0000","last_change":"2024-09-13T18:57:13.518795+0000","last_active":"2024-09-13T18:57:13.521183+0000","last_peered":"2024-09-13T18:57:13.521183+0000","last_clean":"2024-09-13T18:57:13.521183+0000","last_became_active":"2024-09-13T18:57:13.518511+0000","last_became_peered":"2024-09-13T18:57:13.518511+0000","last_unstale":"2024-09-13T18:57:13.521183+0000","last_undegraded":"2024-09-13T18:57:13.521183+0000","last_fullsized":"2024-09-13T18:57:13.521183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530132+0000","last_change":"2024-09-13T18:57:13.520031+0000","last_active":"2024-09-13T18:57:13.530132+0000","last_peered":"2024-09-13T18:57:13.530132+0000","last_clean":"2024-09-13T18:57:13.530132+0000","last_became_active":"2024-09-13T18:57:13.519735+0000","last_became_peered":"2024-09-13T18:57:13.519735+0000","last_unstale":"2024-09-13T18:57:13.530132+0000","last_undegraded":"2024-09-13T18:57:13.530132+0000","last_fullsized":"2024-09-13T18:57:13.530132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527444+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.527444+0000","last_peered":"2024-09-13T18:57:13.527444+0000","last_clean":"2024-09-13T18:57:13.527444+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.527444+0000","last_undegraded":"2024-09-13T18:57:13.527444+0000","last_fullsized":"2024-09-13T18:57:13.527444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533197+0000","last_change":"2024-09-13T18:57:13.530720+0000","last_active":"2024-09-13T18:57:13.533197+0000","last_peered":"2024-09-13T18:57:13.533197+0000","last_clean":"2024-09-13T18:57:13.533197+0000","last_became_active":"2024-09-13T18:57:13.528690+0000","last_became_peered":"2024-09-13T18:57:13.528690+0000","last_unstale":"2024-09-13T18:57:13.533197+0000","last_undegraded":"2024-09-13T18:57:13.533197+0000","last_fullsized":"2024-09-13T18:57:13.533197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508167+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.508167+0000","last_peered":"2024-09-13T18:57:13.508167+0000","last_clean":"2024-09-13T18:57:13.508167+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.508167+0000","last_undegraded":"2024-09-13T18:57:13.508167+0000","last_fullsized":"2024-09-13T18:57:13.508167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528047+0000","last_change":"2024-09-13T18:57:13.526450+0000","last_active":"2024-09-13T18:57:13.528047+0000","last_peered":"2024-09-13T18:57:13.528047+0000","last_clean":"2024-09-13T18:57:13.528047+0000","last_became_active":"2024-09-13T18:57:13.526209+0000","last_became_peered":"2024-09-13T18:57:13.526209+0000","last_unstale":"2024-09-13T18:57:13.528047+0000","last_undegraded":"2024-09-13T18:57:13.528047+0000","last_fullsized":"2024-09-13T18:57:13.528047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514722+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.514722+0000","last_peered":"2024-09-13T18:57:13.514722+0000","last_clean":"2024-09-13T18:57:13.514722+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.514722+0000","last_undegraded":"2024-09-13T18:57:13.514722+0000","last_fullsized":"2024-09-13T18:57:13.514722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527482+0000","last_change":"2024-09-13T18:57:13.523510+0000","last_active":"2024-09-13T18:57:13.527482+0000","last_peered":"2024-09-13T18:57:13.527482+0000","last_clean":"2024-09-13T18:57:13.527482+0000","last_became_active":"2024-09-13T18:57:13.522734+0000","last_became_peered":"2024-09-13T18:57:13.522734+0000","last_unstale":"2024-09-13T18:57:13.527482+0000","last_undegraded":"2024-09-13T18:57:13.527482+0000","last_fullsized":"2024-09-13T18:57:13.527482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.523574+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.523574+0000","last_peered":"2024-09-13T18:57:13.523574+0000","last_clean":"2024-09-13T18:57:13.523574+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.523574+0000","last_undegraded":"2024-09-13T18:57:13.523574+0000","last_fullsized":"2024-09-13T18:57:13.523574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:26.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:57:27.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.106+0000 7f1961e00640 1 Processor -- start 2024-09-13T18:57:27.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.106+0000 7f1961e00640 1 -- start start 2024-09-13T18:57:27.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1961e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1961e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f195c06f4b0 0x7f195c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1961e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0717c0 con 0x7f195c071390 2024-09-13T18:57:27.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1961e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0cd850 con 0x7f195c06f4b0 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1961e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0cd570 con 0x7f195c159480 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1960a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f195be00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f195c06f4b0 0x7f195c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1960a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:38912/0 (socket says 172.21.15.33:38912) 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.108+0000 7f1960a00640 1 -- 172.21.15.33:0/2296861446 learned_addr learned my addr 172.21.15.33:0/2296861446 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.109+0000 7f1960a00640 1 -- 172.21.15.33:0/2296861446 >> v2:172.21.15.103:3300/0 conn(0x7f195c06f4b0 msgr2=0x7f195c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:27.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.109+0000 7f1960a00640 1 --2- 172.21.15.33:0/2296861446 >> v2:172.21.15.103:3300/0 conn(0x7f195c06f4b0 0x7f195c070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.109+0000 7f1960a00640 1 -- 172.21.15.33:0/2296861446 >> v1:172.21.15.103:6789/0 conn(0x7f195c071390 legacy=0x7f195c15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.109+0000 7f1960a00640 1 -- 172.21.15.33:0/2296861446 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0b1740 con 0x7f195c159480 2024-09-13T18:57:27.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f1960a00640 1 --2- 172.21.15.33:0/2296861446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1950009870 tx=0x7f195002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c7d452b76ae68c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f195b400640 1 -- 172.21.15.33:0/2296861446 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950032440 con 0x7f195c159480 2024-09-13T18:57:27.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f195b400640 1 -- 172.21.15.33:0/2296861446 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19500325a0 con 0x7f195c159480 2024-09-13T18:57:27.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f195b400640 1 -- 172.21.15.33:0/2296861446 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950032930 con 0x7f195c159480 2024-09-13T18:57:27.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f1961e00640 1 -- 172.21.15.33:0/2296861446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 msgr2=0x7f195c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.110+0000 7f1961e00640 1 --2- 172.21.15.33:0/2296861446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1950009870 tx=0x7f195002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 -- 172.21.15.33:0/2296861446 shutdown_connections 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 --2- 172.21.15.33:0/2296861446 >> v2:172.21.15.103:3300/0 conn(0x7f195c06f4b0 0x7f195c070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 --2- 172.21.15.33:0/2296861446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c159480 0x7f195c0ccf90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 -- 172.21.15.33:0/2296861446 >> 172.21.15.33:0/2296861446 conn(0x7f195c0ae310 msgr2=0x7f195c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 -- 172.21.15.33:0/2296861446 shutdown_connections 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.111+0000 7f1961e00640 1 -- 172.21.15.33:0/2296861446 wait complete. 2024-09-13T18:57:27.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.112+0000 7f1961e00640 1 Processor -- start 2024-09-13T18:57:27.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.112+0000 7f1961e00640 1 -- start start 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 0x7f195c1f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 0x7f195c1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15e2c0 con 0x7f195c159480 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0ab990 con 0x7f195c06f4b0 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0abc70 con 0x7f195c071390 2024-09-13T18:57:27.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35616/0 (socket says 172.21.15.33:35616) 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.113+0000 7f1961400640 1 -- 172.21.15.33:0/1402183683 learned_addr learned my addr 172.21.15.33:0/1402183683 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1960a00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 0x7f195c1f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f195be00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 0x7f195c1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 -- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 msgr2=0x7f195c1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 0x7f195c1f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 -- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 msgr2=0x7f195c1f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 0x7f195c1f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 -- 172.21.15.33:0/1402183683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500094d0 con 0x7f195c159480 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1960a00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 0x7f195c1f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f195be00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 0x7f195c1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961400640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f195400c7a0 tx=0x7f195400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954003b70 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954003cf0 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400aa90 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.114+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0abf50 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.115+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0ac510 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.116+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c067360 con 0x7f195c159480 2024-09-13T18:57:27.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.116+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f195400abf0 con 0x7f195c159480 2024-09-13T18:57:27.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.118+0000 7f1958c00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 0x7f193c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.118+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19540891a0 con 0x7f195c159480 2024-09-13T18:57:27.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.118+0000 7f1960a00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 0x7f193c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.119+0000 7f1960a00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 0x7f193c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1950034000 tx=0x7f195002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.122+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1954054370 con 0x7f195c159480 2024-09-13T18:57:27.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.299+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f195c0ce280 con 0x7f193c06ac00 2024-09-13T18:57:27.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.306+0000 7f1958c00640 1 -- 172.21.15.33:0/1402183683 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f1950042090 con 0x7f193c06ac00 2024-09-13T18:57:27.312 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:27.313 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:57:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 msgr2=0x7f193c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 0x7f193c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1950034000 tx=0x7f195002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 msgr2=0x7f195c1f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f195400c7a0 tx=0x7f195400cc60 comp rx=0 tx=0).stop 2024-09-13T18:57:27.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 shutdown_connections 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f193c06ac00 0x7f193c06d0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f195c159480 0x7f195c1f3e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.310+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f195c071390 0x7f195c1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.311+0000 7f1961e00640 1 --2- 172.21.15.33:0/1402183683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f195c06f4b0 0x7f195c1f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.311+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 >> 172.21.15.33:0/1402183683 conn(0x7f195c0ae310 msgr2=0x7f195c15cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.311+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 shutdown_connections 2024-09-13T18:57:27.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.311+0000 7f1961e00640 1 -- 172.21.15.33:0/1402183683 wait complete. 2024-09-13T18:57:27.330 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:57:27.098222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528800+0000","last_change":"2024-09-13T18:57:13.522419+0000","last_active":"2024-09-13T18:57:13.528800+0000","last_peered":"2024-09-13T18:57:13.528800+0000","last_clean":"2024-09-13T18:57:13.528800+0000","last_became_active":"2024-09-13T18:57:13.521011+0000","last_became_peered":"2024-09-13T18:57:13.521011+0000","last_unstale":"2024-09-13T18:57:13.528800+0000","last_undegraded":"2024-09-13T18:57:13.528800+0000","last_fullsized":"2024-09-13T18:57:13.528800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:04.582889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514821+0000","last_change":"2024-09-13T18:57:13.510107+0000","last_active":"2024-09-13T18:57:13.514821+0000","last_peered":"2024-09-13T18:57:13.514821+0000","last_clean":"2024-09-13T18:57:13.514821+0000","last_became_active":"2024-09-13T18:57:13.509853+0000","last_became_peered":"2024-09-13T18:57:13.509853+0000","last_unstale":"2024-09-13T18:57:13.514821+0000","last_undegraded":"2024-09-13T18:57:13.514821+0000","last_fullsized":"2024-09-13T18:57:13.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513869+0000","last_change":"2024-09-13T18:57:13.508765+0000","last_active":"2024-09-13T18:57:13.513869+0000","last_peered":"2024-09-13T18:57:13.513869+0000","last_clean":"2024-09-13T18:57:13.513869+0000","last_became_active":"2024-09-13T18:57:13.508499+0000","last_became_peered":"2024-09-13T18:57:13.508499+0000","last_unstale":"2024-09-13T18:57:13.513869+0000","last_undegraded":"2024-09-13T18:57:13.513869+0000","last_fullsized":"2024-09-13T18:57:13.513869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528909+0000","last_change":"2024-09-13T18:57:13.525713+0000","last_active":"2024-09-13T18:57:13.528909+0000","last_peered":"2024-09-13T18:57:13.528909+0000","last_clean":"2024-09-13T18:57:13.528909+0000","last_became_active":"2024-09-13T18:57:13.521390+0000","last_became_peered":"2024-09-13T18:57:13.521390+0000","last_unstale":"2024-09-13T18:57:13.528909+0000","last_undegraded":"2024-09-13T18:57:13.528909+0000","last_fullsized":"2024-09-13T18:57:13.528909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510856+0000","last_change":"2024-09-13T18:57:13.508469+0000","last_active":"2024-09-13T18:57:13.510856+0000","last_peered":"2024-09-13T18:57:13.510856+0000","last_clean":"2024-09-13T18:57:13.510856+0000","last_became_active":"2024-09-13T18:57:13.507301+0000","last_became_peered":"2024-09-13T18:57:13.507301+0000","last_unstale":"2024-09-13T18:57:13.510856+0000","last_undegraded":"2024-09-13T18:57:13.510856+0000","last_fullsized":"2024-09-13T18:57:13.510856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530319+0000","last_change":"2024-09-13T18:57:13.528886+0000","last_active":"2024-09-13T18:57:13.530319+0000","last_peered":"2024-09-13T18:57:13.530319+0000","last_clean":"2024-09-13T18:57:13.530319+0000","last_became_active":"2024-09-13T18:57:13.528181+0000","last_became_peered":"2024-09-13T18:57:13.528181+0000","last_unstale":"2024-09-13T18:57:13.530319+0000","last_undegraded":"2024-09-13T18:57:13.530319+0000","last_fullsized":"2024-09-13T18:57:13.530319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511278+0000","last_change":"2024-09-13T18:57:13.509845+0000","last_active":"2024-09-13T18:57:13.511278+0000","last_peered":"2024-09-13T18:57:13.511278+0000","last_clean":"2024-09-13T18:57:13.511278+0000","last_became_active":"2024-09-13T18:57:13.509457+0000","last_became_peered":"2024-09-13T18:57:13.509457+0000","last_unstale":"2024-09-13T18:57:13.511278+0000","last_undegraded":"2024-09-13T18:57:13.511278+0000","last_fullsized":"2024-09-13T18:57:13.511278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532810+0000","last_change":"2024-09-13T18:57:13.528197+0000","last_active":"2024-09-13T18:57:13.532810+0000","last_peered":"2024-09-13T18:57:13.532810+0000","last_clean":"2024-09-13T18:57:13.532810+0000","last_became_active":"2024-09-13T18:57:13.527837+0000","last_became_peered":"2024-09-13T18:57:13.527837+0000","last_unstale":"2024-09-13T18:57:13.532810+0000","last_undegraded":"2024-09-13T18:57:13.532810+0000","last_fullsized":"2024-09-13T18:57:13.532810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528817+0000","last_change":"2024-09-13T18:57:13.522966+0000","last_active":"2024-09-13T18:57:13.528817+0000","last_peered":"2024-09-13T18:57:13.528817+0000","last_clean":"2024-09-13T18:57:13.528817+0000","last_became_active":"2024-09-13T18:57:13.522718+0000","last_became_peered":"2024-09-13T18:57:13.522718+0000","last_unstale":"2024-09-13T18:57:13.528817+0000","last_undegraded":"2024-09-13T18:57:13.528817+0000","last_fullsized":"2024-09-13T18:57:13.528817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532479+0000","last_change":"2024-09-13T18:57:13.530108+0000","last_active":"2024-09-13T18:57:13.532479+0000","last_peered":"2024-09-13T18:57:13.532479+0000","last_clean":"2024-09-13T18:57:13.532479+0000","last_became_active":"2024-09-13T18:57:13.529856+0000","last_became_peered":"2024-09-13T18:57:13.529856+0000","last_unstale":"2024-09-13T18:57:13.532479+0000","last_undegraded":"2024-09-13T18:57:13.532479+0000","last_fullsized":"2024-09-13T18:57:13.532479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.532940+0000","last_change":"2024-09-13T18:57:13.531905+0000","last_active":"2024-09-13T18:57:13.532940+0000","last_peered":"2024-09-13T18:57:13.532940+0000","last_clean":"2024-09-13T18:57:13.532940+0000","last_became_active":"2024-09-13T18:57:13.531582+0000","last_became_peered":"2024-09-13T18:57:13.531582+0000","last_unstale":"2024-09-13T18:57:13.532940+0000","last_undegraded":"2024-09-13T18:57:13.532940+0000","last_fullsized":"2024-09-13T18:57:13.532940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529009+0000","last_change":"2024-09-13T18:57:13.526125+0000","last_active":"2024-09-13T18:57:13.529009+0000","last_peered":"2024-09-13T18:57:13.529009+0000","last_clean":"2024-09-13T18:57:13.529009+0000","last_became_active":"2024-09-13T18:57:13.525706+0000","last_became_peered":"2024-09-13T18:57:13.525706+0000","last_unstale":"2024-09-13T18:57:13.529009+0000","last_undegraded":"2024-09-13T18:57:13.529009+0000","last_fullsized":"2024-09-13T18:57:13.529009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520064+0000","last_change":"2024-09-13T18:57:13.518913+0000","last_active":"2024-09-13T18:57:13.520064+0000","last_peered":"2024-09-13T18:57:13.520064+0000","last_clean":"2024-09-13T18:57:13.520064+0000","last_became_active":"2024-09-13T18:57:13.518381+0000","last_became_peered":"2024-09-13T18:57:13.518381+0000","last_unstale":"2024-09-13T18:57:13.520064+0000","last_undegraded":"2024-09-13T18:57:13.520064+0000","last_fullsized":"2024-09-13T18:57:13.520064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515917+0000","last_change":"2024-09-13T18:57:13.510462+0000","last_active":"2024-09-13T18:57:13.515917+0000","last_peered":"2024-09-13T18:57:13.515917+0000","last_clean":"2024-09-13T18:57:13.515917+0000","last_became_active":"2024-09-13T18:57:13.510058+0000","last_became_peered":"2024-09-13T18:57:13.510058+0000","last_unstale":"2024-09-13T18:57:13.515917+0000","last_undegraded":"2024-09-13T18:57:13.515917+0000","last_fullsized":"2024-09-13T18:57:13.515917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512044+0000","last_change":"2024-09-13T18:57:13.504104+0000","last_active":"2024-09-13T18:57:13.512044+0000","last_peered":"2024-09-13T18:57:13.512044+0000","last_clean":"2024-09-13T18:57:13.512044+0000","last_became_active":"2024-09-13T18:57:13.503287+0000","last_became_peered":"2024-09-13T18:57:13.503287+0000","last_unstale":"2024-09-13T18:57:13.512044+0000","last_undegraded":"2024-09-13T18:57:13.512044+0000","last_fullsized":"2024-09-13T18:57:13.512044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533192+0000","last_change":"2024-09-13T18:57:13.530559+0000","last_active":"2024-09-13T18:57:13.533192+0000","last_peered":"2024-09-13T18:57:13.533192+0000","last_clean":"2024-09-13T18:57:13.533192+0000","last_became_active":"2024-09-13T18:57:13.528317+0000","last_became_peered":"2024-09-13T18:57:13.528317+0000","last_unstale":"2024-09-13T18:57:13.533192+0000","last_undegraded":"2024-09-13T18:57:13.533192+0000","last_fullsized":"2024-09-13T18:57:13.533192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:06.658709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529757+0000","last_change":"2024-09-13T18:57:13.513604+0000","last_active":"2024-09-13T18:57:13.529757+0000","last_peered":"2024-09-13T18:57:13.529757+0000","last_clean":"2024-09-13T18:57:13.529757+0000","last_became_active":"2024-09-13T18:57:13.512484+0000","last_became_peered":"2024-09-13T18:57:13.512484+0000","last_unstale":"2024-09-13T18:57:13.529757+0000","last_undegraded":"2024-09-13T18:57:13.529757+0000","last_fullsized":"2024-09-13T18:57:13.529757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.520879+0000","last_change":"2024-09-13T18:57:13.520180+0000","last_active":"2024-09-13T18:57:13.520879+0000","last_peered":"2024-09-13T18:57:13.520879+0000","last_clean":"2024-09-13T18:57:13.520879+0000","last_became_active":"2024-09-13T18:57:13.519896+0000","last_became_peered":"2024-09-13T18:57:13.519896+0000","last_unstale":"2024-09-13T18:57:13.520879+0000","last_undegraded":"2024-09-13T18:57:13.520879+0000","last_fullsized":"2024-09-13T18:57:13.520879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:29.743234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510733+0000","last_change":"2024-09-13T18:57:13.507930+0000","last_active":"2024-09-13T18:57:13.510733+0000","last_peered":"2024-09-13T18:57:13.510733+0000","last_clean":"2024-09-13T18:57:13.510733+0000","last_became_active":"2024-09-13T18:57:13.507657+0000","last_became_peered":"2024-09-13T18:57:13.507657+0000","last_unstale":"2024-09-13T18:57:13.510733+0000","last_undegraded":"2024-09-13T18:57:13.510733+0000","last_fullsized":"2024-09-13T18:57:13.510733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529867+0000","last_change":"2024-09-13T18:57:13.525532+0000","last_active":"2024-09-13T18:57:13.529867+0000","last_peered":"2024-09-13T18:57:13.529867+0000","last_clean":"2024-09-13T18:57:13.529867+0000","last_became_active":"2024-09-13T18:57:13.525230+0000","last_became_peered":"2024-09-13T18:57:13.525230+0000","last_unstale":"2024-09-13T18:57:13.529867+0000","last_undegraded":"2024-09-13T18:57:13.529867+0000","last_fullsized":"2024-09-13T18:57:13.529867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515961+0000","last_change":"2024-09-13T18:57:13.512432+0000","last_active":"2024-09-13T18:57:13.515961+0000","last_peered":"2024-09-13T18:57:13.515961+0000","last_clean":"2024-09-13T18:57:13.515961+0000","last_became_active":"2024-09-13T18:57:13.509317+0000","last_became_peered":"2024-09-13T18:57:13.509317+0000","last_unstale":"2024-09-13T18:57:13.515961+0000","last_undegraded":"2024-09-13T18:57:13.515961+0000","last_fullsized":"2024-09-13T18:57:13.515961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528774+0000","last_change":"2024-09-13T18:57:13.520560+0000","last_active":"2024-09-13T18:57:13.528774+0000","last_peered":"2024-09-13T18:57:13.528774+0000","last_clean":"2024-09-13T18:57:13.528774+0000","last_became_active":"2024-09-13T18:57:13.520315+0000","last_became_peered":"2024-09-13T18:57:13.520315+0000","last_unstale":"2024-09-13T18:57:13.528774+0000","last_undegraded":"2024-09-13T18:57:13.528774+0000","last_fullsized":"2024-09-13T18:57:13.528774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512275+0000","last_change":"2024-09-13T18:57:13.502348+0000","last_active":"2024-09-13T18:57:13.512275+0000","last_peered":"2024-09-13T18:57:13.512275+0000","last_clean":"2024-09-13T18:57:13.512275+0000","last_became_active":"2024-09-13T18:57:13.502087+0000","last_became_peered":"2024-09-13T18:57:13.502087+0000","last_unstale":"2024-09-13T18:57:13.512275+0000","last_undegraded":"2024-09-13T18:57:13.512275+0000","last_fullsized":"2024-09-13T18:57:13.512275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:34.871402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531361+0000","last_change":"2024-09-13T18:57:13.527672+0000","last_active":"2024-09-13T18:57:13.531361+0000","last_peered":"2024-09-13T18:57:13.531361+0000","last_clean":"2024-09-13T18:57:13.531361+0000","last_became_active":"2024-09-13T18:57:13.521290+0000","last_became_peered":"2024-09-13T18:57:13.521290+0000","last_unstale":"2024-09-13T18:57:13.531361+0000","last_undegraded":"2024-09-13T18:57:13.531361+0000","last_fullsized":"2024-09-13T18:57:13.531361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513821+0000","last_change":"2024-09-13T18:57:13.505357+0000","last_active":"2024-09-13T18:57:13.513821+0000","last_peered":"2024-09-13T18:57:13.513821+0000","last_clean":"2024-09-13T18:57:13.513821+0000","last_became_active":"2024-09-13T18:57:13.503764+0000","last_became_peered":"2024-09-13T18:57:13.503764+0000","last_unstale":"2024-09-13T18:57:13.513821+0000","last_undegraded":"2024-09-13T18:57:13.513821+0000","last_fullsized":"2024-09-13T18:57:13.513821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.525997+0000","last_change":"2024-09-13T18:57:13.520078+0000","last_active":"2024-09-13T18:57:13.525997+0000","last_peered":"2024-09-13T18:57:13.525997+0000","last_clean":"2024-09-13T18:57:13.525997+0000","last_became_active":"2024-09-13T18:57:13.519088+0000","last_became_peered":"2024-09-13T18:57:13.519088+0000","last_unstale":"2024-09-13T18:57:13.525997+0000","last_undegraded":"2024-09-13T18:57:13.525997+0000","last_fullsized":"2024-09-13T18:57:13.525997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511965+0000","last_change":"2024-09-13T18:57:13.504312+0000","last_active":"2024-09-13T18:57:13.511965+0000","last_peered":"2024-09-13T18:57:13.511965+0000","last_clean":"2024-09-13T18:57:13.511965+0000","last_became_active":"2024-09-13T18:57:13.504062+0000","last_became_peered":"2024-09-13T18:57:13.504062+0000","last_unstale":"2024-09-13T18:57:13.511965+0000","last_undegraded":"2024-09-13T18:57:13.511965+0000","last_fullsized":"2024-09-13T18:57:13.511965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.503063+0000","last_change":"2024-09-13T18:57:13.501012+0000","last_active":"2024-09-13T18:57:13.503063+0000","last_peered":"2024-09-13T18:57:13.503063+0000","last_clean":"2024-09-13T18:57:13.503063+0000","last_became_active":"2024-09-13T18:57:13.500775+0000","last_became_peered":"2024-09-13T18:57:13.500775+0000","last_unstale":"2024-09-13T18:57:13.503063+0000","last_undegraded":"2024-09-13T18:57:13.503063+0000","last_fullsized":"2024-09-13T18:57:13.503063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:56.271521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.518301+0000","last_change":"2024-09-13T18:57:13.514151+0000","last_active":"2024-09-13T18:57:13.518301+0000","last_peered":"2024-09-13T18:57:13.518301+0000","last_clean":"2024-09-13T18:57:13.518301+0000","last_became_active":"2024-09-13T18:57:13.512580+0000","last_became_peered":"2024-09-13T18:57:13.512580+0000","last_unstale":"2024-09-13T18:57:13.518301+0000","last_undegraded":"2024-09-13T18:57:13.518301+0000","last_fullsized":"2024-09-13T18:57:13.518301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530306+0000","last_change":"2024-09-13T18:57:13.528152+0000","last_active":"2024-09-13T18:57:13.530306+0000","last_peered":"2024-09-13T18:57:13.530306+0000","last_clean":"2024-09-13T18:57:13.530306+0000","last_became_active":"2024-09-13T18:57:13.527834+0000","last_became_peered":"2024-09-13T18:57:13.527834+0000","last_unstale":"2024-09-13T18:57:13.530306+0000","last_undegraded":"2024-09-13T18:57:13.530306+0000","last_fullsized":"2024-09-13T18:57:13.530306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:56.539269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531696+0000","last_change":"2024-09-13T18:57:13.531001+0000","last_active":"2024-09-13T18:57:13.531696+0000","last_peered":"2024-09-13T18:57:13.531696+0000","last_clean":"2024-09-13T18:57:13.531696+0000","last_became_active":"2024-09-13T18:57:13.530750+0000","last_became_peered":"2024-09-13T18:57:13.530750+0000","last_unstale":"2024-09-13T18:57:13.531696+0000","last_undegraded":"2024-09-13T18:57:13.531696+0000","last_fullsized":"2024-09-13T18:57:13.531696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521145+0000","last_change":"2024-09-13T18:57:13.518687+0000","last_active":"2024-09-13T18:57:13.521145+0000","last_peered":"2024-09-13T18:57:13.521145+0000","last_clean":"2024-09-13T18:57:13.521145+0000","last_became_active":"2024-09-13T18:57:13.518393+0000","last_became_peered":"2024-09-13T18:57:13.518393+0000","last_unstale":"2024-09-13T18:57:13.521145+0000","last_undegraded":"2024-09-13T18:57:13.521145+0000","last_fullsized":"2024-09-13T18:57:13.521145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519289+0000","last_change":"2024-09-13T18:57:13.517369+0000","last_active":"2024-09-13T18:57:13.519289+0000","last_peered":"2024-09-13T18:57:13.519289+0000","last_clean":"2024-09-13T18:57:13.519289+0000","last_became_active":"2024-09-13T18:57:13.516175+0000","last_became_peered":"2024-09-13T18:57:13.516175+0000","last_unstale":"2024-09-13T18:57:13.519289+0000","last_undegraded":"2024-09-13T18:57:13.519289+0000","last_fullsized":"2024-09-13T18:57:13.519289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:16.260690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514834+0000","last_change":"2024-09-13T18:57:13.076057+0000","last_active":"2024-09-13T18:57:13.514834+0000","last_peered":"2024-09-13T18:57:13.514834+0000","last_clean":"2024-09-13T18:57:13.514834+0000","last_became_active":"2024-09-13T18:57:13.075716+0000","last_became_peered":"2024-09-13T18:57:13.075716+0000","last_unstale":"2024-09-13T18:57:13.514834+0000","last_undegraded":"2024-09-13T18:57:13.514834+0000","last_fullsized":"2024-09-13T18:57:13.514834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514757+0000","last_change":"2024-09-13T18:57:13.509552+0000","last_active":"2024-09-13T18:57:13.514757+0000","last_peered":"2024-09-13T18:57:13.514757+0000","last_clean":"2024-09-13T18:57:13.514757+0000","last_became_active":"2024-09-13T18:57:13.506301+0000","last_became_peered":"2024-09-13T18:57:13.506301+0000","last_unstale":"2024-09-13T18:57:13.514757+0000","last_undegraded":"2024-09-13T18:57:13.514757+0000","last_fullsized":"2024-09-13T18:57:13.514757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:59.182354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527248+0000","last_change":"2024-09-13T18:57:13.085808+0000","last_active":"2024-09-13T18:57:13.527248+0000","last_peered":"2024-09-13T18:57:13.527248+0000","last_clean":"2024-09-13T18:57:13.527248+0000","last_became_active":"2024-09-13T18:57:13.085491+0000","last_became_peered":"2024-09-13T18:57:13.085491+0000","last_unstale":"2024-09-13T18:57:13.527248+0000","last_undegraded":"2024-09-13T18:57:13.527248+0000","last_fullsized":"2024-09-13T18:57:13.527248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492370+0000","last_change":"2024-09-13T18:57:13.079361+0000","last_active":"2024-09-13T18:57:13.492370+0000","last_peered":"2024-09-13T18:57:13.492370+0000","last_clean":"2024-09-13T18:57:13.492370+0000","last_became_active":"2024-09-13T18:57:13.079151+0000","last_became_peered":"2024-09-13T18:57:13.079151+0000","last_unstale":"2024-09-13T18:57:13.492370+0000","last_undegraded":"2024-09-13T18:57:13.492370+0000","last_fullsized":"2024-09-13T18:57:13.492370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513971+0000","last_change":"2024-09-13T18:57:13.509463+0000","last_active":"2024-09-13T18:57:13.513971+0000","last_peered":"2024-09-13T18:57:13.513971+0000","last_clean":"2024-09-13T18:57:13.513971+0000","last_became_active":"2024-09-13T18:57:13.509205+0000","last_became_peered":"2024-09-13T18:57:13.509205+0000","last_unstale":"2024-09-13T18:57:13.513971+0000","last_undegraded":"2024-09-13T18:57:13.513971+0000","last_fullsized":"2024-09-13T18:57:13.513971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.510784+0000","last_change":"2024-09-13T18:57:13.076469+0000","last_active":"2024-09-13T18:57:13.510784+0000","last_peered":"2024-09-13T18:57:13.510784+0000","last_clean":"2024-09-13T18:57:13.510784+0000","last_became_active":"2024-09-13T18:57:13.073964+0000","last_became_peered":"2024-09-13T18:57:13.073964+0000","last_unstale":"2024-09-13T18:57:13.510784+0000","last_undegraded":"2024-09-13T18:57:13.510784+0000","last_fullsized":"2024-09-13T18:57:13.510784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514052+0000","last_change":"2024-09-13T18:57:13.504149+0000","last_active":"2024-09-13T18:57:13.514052+0000","last_peered":"2024-09-13T18:57:13.514052+0000","last_clean":"2024-09-13T18:57:13.514052+0000","last_became_active":"2024-09-13T18:57:13.503874+0000","last_became_peered":"2024-09-13T18:57:13.503874+0000","last_unstale":"2024-09-13T18:57:13.514052+0000","last_undegraded":"2024-09-13T18:57:13.514052+0000","last_fullsized":"2024-09-13T18:57:13.514052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515679+0000","last_change":"2024-09-13T18:57:13.087295+0000","last_active":"2024-09-13T18:57:13.515679+0000","last_peered":"2024-09-13T18:57:13.515679+0000","last_clean":"2024-09-13T18:57:13.515679+0000","last_became_active":"2024-09-13T18:57:13.086965+0000","last_became_peered":"2024-09-13T18:57:13.086965+0000","last_unstale":"2024-09-13T18:57:13.515679+0000","last_undegraded":"2024-09-13T18:57:13.515679+0000","last_fullsized":"2024-09-13T18:57:13.515679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530773+0000","last_change":"2024-09-13T18:57:13.528119+0000","last_active":"2024-09-13T18:57:13.530773+0000","last_peered":"2024-09-13T18:57:13.530773+0000","last_clean":"2024-09-13T18:57:13.530773+0000","last_became_active":"2024-09-13T18:57:13.527859+0000","last_became_peered":"2024-09-13T18:57:13.527859+0000","last_unstale":"2024-09-13T18:57:13.530773+0000","last_undegraded":"2024-09-13T18:57:13.530773+0000","last_fullsized":"2024-09-13T18:57:13.530773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:42.596394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514102+0000","last_change":"2024-09-13T18:57:13.080168+0000","last_active":"2024-09-13T18:57:13.514102+0000","last_peered":"2024-09-13T18:57:13.514102+0000","last_clean":"2024-09-13T18:57:13.514102+0000","last_became_active":"2024-09-13T18:57:13.079835+0000","last_became_peered":"2024-09-13T18:57:13.079835+0000","last_unstale":"2024-09-13T18:57:13.514102+0000","last_undegraded":"2024-09-13T18:57:13.514102+0000","last_fullsized":"2024-09-13T18:57:13.514102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528063+0000","last_change":"2024-09-13T18:57:13.526462+0000","last_active":"2024-09-13T18:57:13.528063+0000","last_peered":"2024-09-13T18:57:13.528063+0000","last_clean":"2024-09-13T18:57:13.528063+0000","last_became_active":"2024-09-13T18:57:13.526259+0000","last_became_peered":"2024-09-13T18:57:13.526259+0000","last_unstale":"2024-09-13T18:57:13.528063+0000","last_undegraded":"2024-09-13T18:57:13.528063+0000","last_fullsized":"2024-09-13T18:57:13.528063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.531561+0000","last_change":"2024-09-13T18:57:13.084343+0000","last_active":"2024-09-13T18:57:13.531561+0000","last_peered":"2024-09-13T18:57:13.531561+0000","last_clean":"2024-09-13T18:57:13.531561+0000","last_became_active":"2024-09-13T18:57:13.083529+0000","last_became_peered":"2024-09-13T18:57:13.083529+0000","last_unstale":"2024-09-13T18:57:13.531561+0000","last_undegraded":"2024-09-13T18:57:13.531561+0000","last_fullsized":"2024-09-13T18:57:13.531561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517426+0000","last_change":"2024-09-13T18:57:13.511843+0000","last_active":"2024-09-13T18:57:13.517426+0000","last_peered":"2024-09-13T18:57:13.517426+0000","last_clean":"2024-09-13T18:57:13.517426+0000","last_became_active":"2024-09-13T18:57:13.511537+0000","last_became_peered":"2024-09-13T18:57:13.511537+0000","last_unstale":"2024-09-13T18:57:13.517426+0000","last_undegraded":"2024-09-13T18:57:13.517426+0000","last_fullsized":"2024-09-13T18:57:13.517426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533503+0000","last_change":"2024-09-13T18:57:13.079366+0000","last_active":"2024-09-13T18:57:13.533503+0000","last_peered":"2024-09-13T18:57:13.533503+0000","last_clean":"2024-09-13T18:57:13.533503+0000","last_became_active":"2024-09-13T18:57:13.078937+0000","last_became_peered":"2024-09-13T18:57:13.078937+0000","last_unstale":"2024-09-13T18:57:13.533503+0000","last_undegraded":"2024-09-13T18:57:13.533503+0000","last_fullsized":"2024-09-13T18:57:13.533503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508616+0000","last_change":"2024-09-13T18:57:13.506092+0000","last_active":"2024-09-13T18:57:13.508616+0000","last_peered":"2024-09-13T18:57:13.508616+0000","last_clean":"2024-09-13T18:57:13.508616+0000","last_became_active":"2024-09-13T18:57:13.505707+0000","last_became_peered":"2024-09-13T18:57:13.505707+0000","last_unstale":"2024-09-13T18:57:13.508616+0000","last_undegraded":"2024-09-13T18:57:13.508616+0000","last_fullsized":"2024-09-13T18:57:13.508616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514701+0000","last_change":"2024-09-13T18:57:13.078174+0000","last_active":"2024-09-13T18:57:13.514701+0000","last_peered":"2024-09-13T18:57:13.514701+0000","last_clean":"2024-09-13T18:57:13.514701+0000","last_became_active":"2024-09-13T18:57:13.077859+0000","last_became_peered":"2024-09-13T18:57:13.077859+0000","last_unstale":"2024-09-13T18:57:13.514701+0000","last_undegraded":"2024-09-13T18:57:13.514701+0000","last_fullsized":"2024-09-13T18:57:13.514701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514016+0000","last_change":"2024-09-13T18:57:13.509609+0000","last_active":"2024-09-13T18:57:13.514016+0000","last_peered":"2024-09-13T18:57:13.514016+0000","last_clean":"2024-09-13T18:57:13.514016+0000","last_became_active":"2024-09-13T18:57:13.509286+0000","last_became_peered":"2024-09-13T18:57:13.509286+0000","last_unstale":"2024-09-13T18:57:13.514016+0000","last_undegraded":"2024-09-13T18:57:13.514016+0000","last_fullsized":"2024-09-13T18:57:13.514016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513159+0000","last_change":"2024-09-13T18:57:13.077925+0000","last_active":"2024-09-13T18:57:13.513159+0000","last_peered":"2024-09-13T18:57:13.513159+0000","last_clean":"2024-09-13T18:57:13.513159+0000","last_became_active":"2024-09-13T18:57:13.077540+0000","last_became_peered":"2024-09-13T18:57:13.077540+0000","last_unstale":"2024-09-13T18:57:13.513159+0000","last_undegraded":"2024-09-13T18:57:13.513159+0000","last_fullsized":"2024-09-13T18:57:13.513159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508734+0000","last_change":"2024-09-13T18:57:13.506462+0000","last_active":"2024-09-13T18:57:13.508734+0000","last_peered":"2024-09-13T18:57:13.508734+0000","last_clean":"2024-09-13T18:57:13.508734+0000","last_became_active":"2024-09-13T18:57:13.506135+0000","last_became_peered":"2024-09-13T18:57:13.506135+0000","last_unstale":"2024-09-13T18:57:13.508734+0000","last_undegraded":"2024-09-13T18:57:13.508734+0000","last_fullsized":"2024-09-13T18:57:13.508734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509681+0000","last_change":"2024-09-13T18:57:13.077117+0000","last_active":"2024-09-13T18:57:13.509681+0000","last_peered":"2024-09-13T18:57:13.509681+0000","last_clean":"2024-09-13T18:57:13.509681+0000","last_became_active":"2024-09-13T18:57:13.076118+0000","last_became_peered":"2024-09-13T18:57:13.076118+0000","last_unstale":"2024-09-13T18:57:13.509681+0000","last_undegraded":"2024-09-13T18:57:13.509681+0000","last_fullsized":"2024-09-13T18:57:13.509681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521125+0000","last_change":"2024-09-13T18:57:13.518635+0000","last_active":"2024-09-13T18:57:13.521125+0000","last_peered":"2024-09-13T18:57:13.521125+0000","last_clean":"2024-09-13T18:57:13.521125+0000","last_became_active":"2024-09-13T18:57:13.518274+0000","last_became_peered":"2024-09-13T18:57:13.518274+0000","last_unstale":"2024-09-13T18:57:13.521125+0000","last_undegraded":"2024-09-13T18:57:13.521125+0000","last_fullsized":"2024-09-13T18:57:13.521125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.512870+0000","last_change":"2024-09-13T18:57:13.080524+0000","last_active":"2024-09-13T18:57:13.512870+0000","last_peered":"2024-09-13T18:57:13.512870+0000","last_clean":"2024-09-13T18:57:13.512870+0000","last_became_active":"2024-09-13T18:57:13.079467+0000","last_became_peered":"2024-09-13T18:57:13.079467+0000","last_unstale":"2024-09-13T18:57:13.512870+0000","last_undegraded":"2024-09-13T18:57:13.512870+0000","last_fullsized":"2024-09-13T18:57:13.512870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527414+0000","last_change":"2024-09-13T18:57:13.515449+0000","last_active":"2024-09-13T18:57:13.527414+0000","last_peered":"2024-09-13T18:57:13.527414+0000","last_clean":"2024-09-13T18:57:13.527414+0000","last_became_active":"2024-09-13T18:57:13.514478+0000","last_became_peered":"2024-09-13T18:57:13.514478+0000","last_unstale":"2024-09-13T18:57:13.527414+0000","last_undegraded":"2024-09-13T18:57:13.527414+0000","last_fullsized":"2024-09-13T18:57:13.527414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514267+0000","last_change":"2024-09-13T18:57:13.079342+0000","last_active":"2024-09-13T18:57:13.514267+0000","last_peered":"2024-09-13T18:57:13.514267+0000","last_clean":"2024-09-13T18:57:13.514267+0000","last_became_active":"2024-09-13T18:57:13.076896+0000","last_became_peered":"2024-09-13T18:57:13.076896+0000","last_unstale":"2024-09-13T18:57:13.514267+0000","last_undegraded":"2024-09-13T18:57:13.514267+0000","last_fullsized":"2024-09-13T18:57:13.514267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:20.107253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.509295+0000","last_change":"2024-09-13T18:57:13.506875+0000","last_active":"2024-09-13T18:57:13.509295+0000","last_peered":"2024-09-13T18:57:13.509295+0000","last_clean":"2024-09-13T18:57:13.509295+0000","last_became_active":"2024-09-13T18:57:13.506471+0000","last_became_peered":"2024-09-13T18:57:13.506471+0000","last_unstale":"2024-09-13T18:57:13.509295+0000","last_undegraded":"2024-09-13T18:57:13.509295+0000","last_fullsized":"2024-09-13T18:57:13.509295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:24.505511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.505344+0000","last_change":"2024-09-13T18:57:13.076594+0000","last_active":"2024-09-13T18:57:13.505344+0000","last_peered":"2024-09-13T18:57:13.505344+0000","last_clean":"2024-09-13T18:57:13.505344+0000","last_became_active":"2024-09-13T18:57:13.076294+0000","last_became_peered":"2024-09-13T18:57:13.076294+0000","last_unstale":"2024-09-13T18:57:13.505344+0000","last_undegraded":"2024-09-13T18:57:13.505344+0000","last_fullsized":"2024-09-13T18:57:13.505344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527382+0000","last_change":"2024-09-13T18:57:13.514665+0000","last_active":"2024-09-13T18:57:13.527382+0000","last_peered":"2024-09-13T18:57:13.527382+0000","last_clean":"2024-09-13T18:57:13.527382+0000","last_became_active":"2024-09-13T18:57:13.514373+0000","last_became_peered":"2024-09-13T18:57:13.514373+0000","last_unstale":"2024-09-13T18:57:13.527382+0000","last_undegraded":"2024-09-13T18:57:13.527382+0000","last_fullsized":"2024-09-13T18:57:13.527382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:14.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.517258+0000","last_change":"2024-09-13T18:57:13.085608+0000","last_active":"2024-09-13T18:57:13.517258+0000","last_peered":"2024-09-13T18:57:13.517258+0000","last_clean":"2024-09-13T18:57:13.517258+0000","last_became_active":"2024-09-13T18:57:13.085358+0000","last_became_peered":"2024-09-13T18:57:13.085358+0000","last_unstale":"2024-09-13T18:57:13.517258+0000","last_undegraded":"2024-09-13T18:57:13.517258+0000","last_fullsized":"2024-09-13T18:57:13.517258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528889+0000","last_change":"2024-09-13T18:57:13.521314+0000","last_active":"2024-09-13T18:57:13.528889+0000","last_peered":"2024-09-13T18:57:13.528889+0000","last_clean":"2024-09-13T18:57:13.528889+0000","last_became_active":"2024-09-13T18:57:13.519808+0000","last_became_peered":"2024-09-13T18:57:13.519808+0000","last_unstale":"2024-09-13T18:57:13.528889+0000","last_undegraded":"2024-09-13T18:57:13.528889+0000","last_fullsized":"2024-09-13T18:57:13.528889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487827+0000","last_change":"2024-09-13T18:57:13.072108+0000","last_active":"2024-09-13T18:57:13.487827+0000","last_peered":"2024-09-13T18:57:13.487827+0000","last_clean":"2024-09-13T18:57:13.487827+0000","last_became_active":"2024-09-13T18:57:13.071831+0000","last_became_peered":"2024-09-13T18:57:13.071831+0000","last_unstale":"2024-09-13T18:57:13.487827+0000","last_undegraded":"2024-09-13T18:57:13.487827+0000","last_fullsized":"2024-09-13T18:57:13.487827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528931+0000","last_change":"2024-09-13T18:57:13.523066+0000","last_active":"2024-09-13T18:57:13.528931+0000","last_peered":"2024-09-13T18:57:13.528931+0000","last_clean":"2024-09-13T18:57:13.528931+0000","last_became_active":"2024-09-13T18:57:13.522829+0000","last_became_peered":"2024-09-13T18:57:13.522829+0000","last_unstale":"2024-09-13T18:57:13.528931+0000","last_undegraded":"2024-09-13T18:57:13.528931+0000","last_fullsized":"2024-09-13T18:57:13.528931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:55.517294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491602+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:57:13.491602+0000","last_peered":"2024-09-13T18:57:13.491602+0000","last_clean":"2024-09-13T18:57:13.491602+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:57:13.491602+0000","last_undegraded":"2024-09-13T18:57:13.491602+0000","last_fullsized":"2024-09-13T18:57:13.491602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.502901+0000","last_change":"2024-09-13T18:57:13.075757+0000","last_active":"2024-09-13T18:57:13.502901+0000","last_peered":"2024-09-13T18:57:13.502901+0000","last_clean":"2024-09-13T18:57:13.502901+0000","last_became_active":"2024-09-13T18:57:13.072340+0000","last_became_peered":"2024-09-13T18:57:13.072340+0000","last_unstale":"2024-09-13T18:57:13.502901+0000","last_undegraded":"2024-09-13T18:57:13.502901+0000","last_fullsized":"2024-09-13T18:57:13.502901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533279+0000","last_change":"2024-09-13T18:57:13.531524+0000","last_active":"2024-09-13T18:57:13.533279+0000","last_peered":"2024-09-13T18:57:13.533279+0000","last_clean":"2024-09-13T18:57:13.533279+0000","last_became_active":"2024-09-13T18:57:13.530731+0000","last_became_peered":"2024-09-13T18:57:13.530731+0000","last_unstale":"2024-09-13T18:57:13.533279+0000","last_undegraded":"2024-09-13T18:57:13.533279+0000","last_fullsized":"2024-09-13T18:57:13.533279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:03.314007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.491503+0000","last_change":"2024-09-13T18:57:13.077303+0000","last_active":"2024-09-13T18:57:13.491503+0000","last_peered":"2024-09-13T18:57:13.491503+0000","last_clean":"2024-09-13T18:57:13.491503+0000","last_became_active":"2024-09-13T18:57:13.077030+0000","last_became_peered":"2024-09-13T18:57:13.077030+0000","last_unstale":"2024-09-13T18:57:13.491503+0000","last_undegraded":"2024-09-13T18:57:13.491503+0000","last_fullsized":"2024-09-13T18:57:13.491503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:28.737321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511770+0000","last_change":"2024-09-13T18:57:13.505735+0000","last_active":"2024-09-13T18:57:13.511770+0000","last_peered":"2024-09-13T18:57:13.511770+0000","last_clean":"2024-09-13T18:57:13.511770+0000","last_became_active":"2024-09-13T18:57:13.505442+0000","last_became_peered":"2024-09-13T18:57:13.505442+0000","last_unstale":"2024-09-13T18:57:13.511770+0000","last_undegraded":"2024-09-13T18:57:13.511770+0000","last_fullsized":"2024-09-13T18:57:13.511770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:17.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.487814+0000","last_change":"2024-09-13T18:57:13.067441+0000","last_active":"2024-09-13T18:57:13.487814+0000","last_peered":"2024-09-13T18:57:13.487814+0000","last_clean":"2024-09-13T18:57:13.487814+0000","last_became_active":"2024-09-13T18:57:13.067128+0000","last_became_peered":"2024-09-13T18:57:13.067128+0000","last_unstale":"2024-09-13T18:57:13.487814+0000","last_undegraded":"2024-09-13T18:57:13.487814+0000","last_fullsized":"2024-09-13T18:57:13.487814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514688+0000","last_change":"2024-09-13T18:57:13.509025+0000","last_active":"2024-09-13T18:57:13.514688+0000","last_peered":"2024-09-13T18:57:13.514688+0000","last_clean":"2024-09-13T18:57:13.514688+0000","last_became_active":"2024-09-13T18:57:13.508745+0000","last_became_peered":"2024-09-13T18:57:13.508745+0000","last_unstale":"2024-09-13T18:57:13.514688+0000","last_undegraded":"2024-09-13T18:57:13.514688+0000","last_fullsized":"2024-09-13T18:57:13.514688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:01.771501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513426+0000","last_change":"2024-09-13T18:57:13.083675+0000","last_active":"2024-09-13T18:57:13.513426+0000","last_peered":"2024-09-13T18:57:13.513426+0000","last_clean":"2024-09-13T18:57:13.513426+0000","last_became_active":"2024-09-13T18:57:13.083344+0000","last_became_peered":"2024-09-13T18:57:13.083344+0000","last_unstale":"2024-09-13T18:57:13.513426+0000","last_undegraded":"2024-09-13T18:57:13.513426+0000","last_fullsized":"2024-09-13T18:57:13.513426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519326+0000","last_change":"2024-09-13T18:57:13.517447+0000","last_active":"2024-09-13T18:57:13.519326+0000","last_peered":"2024-09-13T18:57:13.519326+0000","last_clean":"2024-09-13T18:57:13.519326+0000","last_became_active":"2024-09-13T18:57:13.514845+0000","last_became_peered":"2024-09-13T18:57:13.514845+0000","last_unstale":"2024-09-13T18:57:13.519326+0000","last_undegraded":"2024-09-13T18:57:13.519326+0000","last_fullsized":"2024-09-13T18:57:13.519326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:57.645646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492184+0000","last_change":"2024-09-13T18:57:13.077768+0000","last_active":"2024-09-13T18:57:13.492184+0000","last_peered":"2024-09-13T18:57:13.492184+0000","last_clean":"2024-09-13T18:57:13.492184+0000","last_became_active":"2024-09-13T18:57:13.077541+0000","last_became_peered":"2024-09-13T18:57:13.077541+0000","last_unstale":"2024-09-13T18:57:13.492184+0000","last_undegraded":"2024-09-13T18:57:13.492184+0000","last_fullsized":"2024-09-13T18:57:13.492184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.902156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530696+0000","last_change":"2024-09-13T18:57:13.527647+0000","last_active":"2024-09-13T18:57:13.530696+0000","last_peered":"2024-09-13T18:57:13.530696+0000","last_clean":"2024-09-13T18:57:13.530696+0000","last_became_active":"2024-09-13T18:57:13.519711+0000","last_became_peered":"2024-09-13T18:57:13.519711+0000","last_unstale":"2024-09-13T18:57:13.530696+0000","last_undegraded":"2024-09-13T18:57:13.530696+0000","last_fullsized":"2024-09-13T18:57:13.530696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492981+0000","last_change":"2024-09-13T18:57:13.081750+0000","last_active":"2024-09-13T18:57:13.492981+0000","last_peered":"2024-09-13T18:57:13.492981+0000","last_clean":"2024-09-13T18:57:13.492981+0000","last_became_active":"2024-09-13T18:57:13.081277+0000","last_became_peered":"2024-09-13T18:57:13.081277+0000","last_unstale":"2024-09-13T18:57:13.492981+0000","last_undegraded":"2024-09-13T18:57:13.492981+0000","last_fullsized":"2024-09-13T18:57:13.492981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.515583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514488+0000","last_change":"2024-09-13T18:57:13.507458+0000","last_active":"2024-09-13T18:57:13.514488+0000","last_peered":"2024-09-13T18:57:13.514488+0000","last_clean":"2024-09-13T18:57:13.514488+0000","last_became_active":"2024-09-13T18:57:13.507163+0000","last_became_peered":"2024-09-13T18:57:13.507163+0000","last_unstale":"2024-09-13T18:57:13.514488+0000","last_undegraded":"2024-09-13T18:57:13.514488+0000","last_fullsized":"2024-09-13T18:57:13.514488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:57:14.494149+0000","last_change":"2024-09-13T18:57:13.082068+0000","last_active":"2024-09-13T18:57:14.494149+0000","last_peered":"2024-09-13T18:57:14.494149+0000","last_clean":"2024-09-13T18:57:14.494149+0000","last_became_active":"2024-09-13T18:57:13.081389+0000","last_became_peered":"2024-09-13T18:57:13.081389+0000","last_unstale":"2024-09-13T18:57:14.494149+0000","last_undegraded":"2024-09-13T18:57:14.494149+0000","last_fullsized":"2024-09-13T18:57:14.494149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513838+0000","last_change":"2024-09-13T18:57:13.508509+0000","last_active":"2024-09-13T18:57:13.513838+0000","last_peered":"2024-09-13T18:57:13.513838+0000","last_clean":"2024-09-13T18:57:13.513838+0000","last_became_active":"2024-09-13T18:57:13.508215+0000","last_became_peered":"2024-09-13T18:57:13.508215+0000","last_unstale":"2024-09-13T18:57:13.513838+0000","last_undegraded":"2024-09-13T18:57:13.513838+0000","last_fullsized":"2024-09-13T18:57:13.513838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.825267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.529311+0000","last_change":"2024-09-13T18:57:13.086907+0000","last_active":"2024-09-13T18:57:13.529311+0000","last_peered":"2024-09-13T18:57:13.529311+0000","last_clean":"2024-09-13T18:57:13.529311+0000","last_became_active":"2024-09-13T18:57:13.086673+0000","last_became_peered":"2024-09-13T18:57:13.086673+0000","last_unstale":"2024-09-13T18:57:13.529311+0000","last_undegraded":"2024-09-13T18:57:13.529311+0000","last_fullsized":"2024-09-13T18:57:13.529311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:31.410502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515857+0000","last_change":"2024-09-13T18:57:13.509453+0000","last_active":"2024-09-13T18:57:13.515857+0000","last_peered":"2024-09-13T18:57:13.515857+0000","last_clean":"2024-09-13T18:57:13.515857+0000","last_became_active":"2024-09-13T18:57:13.509188+0000","last_became_peered":"2024-09-13T18:57:13.509188+0000","last_unstale":"2024-09-13T18:57:13.515857+0000","last_undegraded":"2024-09-13T18:57:13.515857+0000","last_fullsized":"2024-09-13T18:57:13.515857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:15.333062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.490795+0000","last_change":"2024-09-13T18:57:13.081437+0000","last_active":"2024-09-13T18:57:13.490795+0000","last_peered":"2024-09-13T18:57:13.490795+0000","last_clean":"2024-09-13T18:57:13.490795+0000","last_became_active":"2024-09-13T18:57:13.081164+0000","last_became_peered":"2024-09-13T18:57:13.081164+0000","last_unstale":"2024-09-13T18:57:13.490795+0000","last_undegraded":"2024-09-13T18:57:13.490795+0000","last_fullsized":"2024-09-13T18:57:13.490795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:18.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.511536+0000","last_change":"2024-09-13T18:57:13.506172+0000","last_active":"2024-09-13T18:57:13.511536+0000","last_peered":"2024-09-13T18:57:13.511536+0000","last_clean":"2024-09-13T18:57:13.511536+0000","last_became_active":"2024-09-13T18:57:13.503964+0000","last_became_peered":"2024-09-13T18:57:13.503964+0000","last_unstale":"2024-09-13T18:57:13.511536+0000","last_undegraded":"2024-09-13T18:57:13.511536+0000","last_fullsized":"2024-09-13T18:57:13.511536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:19.932807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492922+0000","last_change":"2024-09-13T18:57:13.081934+0000","last_active":"2024-09-13T18:57:13.492922+0000","last_peered":"2024-09-13T18:57:13.492922+0000","last_clean":"2024-09-13T18:57:13.492922+0000","last_became_active":"2024-09-13T18:57:13.081594+0000","last_became_peered":"2024-09-13T18:57:13.081594+0000","last_unstale":"2024-09-13T18:57:13.492922+0000","last_undegraded":"2024-09-13T18:57:13.492922+0000","last_fullsized":"2024-09-13T18:57:13.492922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.513953+0000","last_change":"2024-09-13T18:57:13.508906+0000","last_active":"2024-09-13T18:57:13.513953+0000","last_peered":"2024-09-13T18:57:13.513953+0000","last_clean":"2024-09-13T18:57:13.513953+0000","last_became_active":"2024-09-13T18:57:13.508586+0000","last_became_peered":"2024-09-13T18:57:13.508586+0000","last_unstale":"2024-09-13T18:57:13.513953+0000","last_undegraded":"2024-09-13T18:57:13.513953+0000","last_fullsized":"2024-09-13T18:57:13.513953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.492144+0000","last_change":"2024-09-13T18:57:13.081591+0000","last_active":"2024-09-13T18:57:13.492144+0000","last_peered":"2024-09-13T18:57:13.492144+0000","last_clean":"2024-09-13T18:57:13.492144+0000","last_became_active":"2024-09-13T18:57:13.079871+0000","last_became_peered":"2024-09-13T18:57:13.079871+0000","last_unstale":"2024-09-13T18:57:13.492144+0000","last_undegraded":"2024-09-13T18:57:13.492144+0000","last_fullsized":"2024-09-13T18:57:13.492144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.519057+0000","last_change":"2024-09-13T18:57:13.514983+0000","last_active":"2024-09-13T18:57:13.519057+0000","last_peered":"2024-09-13T18:57:13.519057+0000","last_clean":"2024-09-13T18:57:13.519057+0000","last_became_active":"2024-09-13T18:57:13.514654+0000","last_became_peered":"2024-09-13T18:57:13.514654+0000","last_unstale":"2024-09-13T18:57:13.519057+0000","last_undegraded":"2024-09-13T18:57:13.519057+0000","last_fullsized":"2024-09-13T18:57:13.519057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.515394+0000","last_change":"2024-09-13T18:57:13.080417+0000","last_active":"2024-09-13T18:57:13.515394+0000","last_peered":"2024-09-13T18:57:13.515394+0000","last_clean":"2024-09-13T18:57:13.515394+0000","last_became_active":"2024-09-13T18:57:13.076658+0000","last_became_peered":"2024-09-13T18:57:13.076658+0000","last_unstale":"2024-09-13T18:57:13.515394+0000","last_undegraded":"2024-09-13T18:57:13.515394+0000","last_fullsized":"2024-09-13T18:57:13.515394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:25.404505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.521183+0000","last_change":"2024-09-13T18:57:13.518795+0000","last_active":"2024-09-13T18:57:13.521183+0000","last_peered":"2024-09-13T18:57:13.521183+0000","last_clean":"2024-09-13T18:57:13.521183+0000","last_became_active":"2024-09-13T18:57:13.518511+0000","last_became_peered":"2024-09-13T18:57:13.518511+0000","last_unstale":"2024-09-13T18:57:13.521183+0000","last_undegraded":"2024-09-13T18:57:13.521183+0000","last_fullsized":"2024-09-13T18:57:13.521183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.704033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.530132+0000","last_change":"2024-09-13T18:57:13.520031+0000","last_active":"2024-09-13T18:57:13.530132+0000","last_peered":"2024-09-13T18:57:13.530132+0000","last_clean":"2024-09-13T18:57:13.530132+0000","last_became_active":"2024-09-13T18:57:13.519735+0000","last_became_peered":"2024-09-13T18:57:13.519735+0000","last_unstale":"2024-09-13T18:57:13.530132+0000","last_undegraded":"2024-09-13T18:57:13.530132+0000","last_fullsized":"2024-09-13T18:57:13.530132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527444+0000","last_change":"2024-09-13T18:57:13.072420+0000","last_active":"2024-09-13T18:57:13.527444+0000","last_peered":"2024-09-13T18:57:13.527444+0000","last_clean":"2024-09-13T18:57:13.527444+0000","last_became_active":"2024-09-13T18:57:13.072149+0000","last_became_peered":"2024-09-13T18:57:13.072149+0000","last_unstale":"2024-09-13T18:57:13.527444+0000","last_undegraded":"2024-09-13T18:57:13.527444+0000","last_fullsized":"2024-09-13T18:57:13.527444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:15.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.533197+0000","last_change":"2024-09-13T18:57:13.530720+0000","last_active":"2024-09-13T18:57:13.533197+0000","last_peered":"2024-09-13T18:57:13.533197+0000","last_clean":"2024-09-13T18:57:13.533197+0000","last_became_active":"2024-09-13T18:57:13.528690+0000","last_became_peered":"2024-09-13T18:57:13.528690+0000","last_unstale":"2024-09-13T18:57:13.533197+0000","last_undegraded":"2024-09-13T18:57:13.533197+0000","last_fullsized":"2024-09-13T18:57:13.533197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:37.145193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.508167+0000","last_change":"2024-09-13T18:57:13.080934+0000","last_active":"2024-09-13T18:57:13.508167+0000","last_peered":"2024-09-13T18:57:13.508167+0000","last_clean":"2024-09-13T18:57:13.508167+0000","last_became_active":"2024-09-13T18:57:13.080617+0000","last_became_peered":"2024-09-13T18:57:13.080617+0000","last_unstale":"2024-09-13T18:57:13.508167+0000","last_undegraded":"2024-09-13T18:57:13.508167+0000","last_fullsized":"2024-09-13T18:57:13.508167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:56.639732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.528047+0000","last_change":"2024-09-13T18:57:13.526450+0000","last_active":"2024-09-13T18:57:13.528047+0000","last_peered":"2024-09-13T18:57:13.528047+0000","last_clean":"2024-09-13T18:57:13.528047+0000","last_became_active":"2024-09-13T18:57:13.526209+0000","last_became_peered":"2024-09-13T18:57:13.526209+0000","last_unstale":"2024-09-13T18:57:13.528047+0000","last_undegraded":"2024-09-13T18:57:13.528047+0000","last_fullsized":"2024-09-13T18:57:13.528047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:17.514216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.514722+0000","last_change":"2024-09-13T18:57:13.078756+0000","last_active":"2024-09-13T18:57:13.514722+0000","last_peered":"2024-09-13T18:57:13.514722+0000","last_clean":"2024-09-13T18:57:13.514722+0000","last_became_active":"2024-09-13T18:57:13.077880+0000","last_became_peered":"2024-09-13T18:57:13.077880+0000","last_unstale":"2024-09-13T18:57:13.514722+0000","last_undegraded":"2024-09-13T18:57:13.514722+0000","last_fullsized":"2024-09-13T18:57:13.514722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:59.012020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.527482+0000","last_change":"2024-09-13T18:57:13.523510+0000","last_active":"2024-09-13T18:57:13.527482+0000","last_peered":"2024-09-13T18:57:13.527482+0000","last_clean":"2024-09-13T18:57:13.527482+0000","last_became_active":"2024-09-13T18:57:13.522734+0000","last_became_peered":"2024-09-13T18:57:13.522734+0000","last_unstale":"2024-09-13T18:57:13.527482+0000","last_undegraded":"2024-09-13T18:57:13.527482+0000","last_fullsized":"2024-09-13T18:57:13.527482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:13.048527+0000","last_clean_scrub_stamp":"2024-09-13T18:57:13.048527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:37.888302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:57:13.523574+0000","last_change":"2024-09-13T18:57:13.082166+0000","last_active":"2024-09-13T18:57:13.523574+0000","last_peered":"2024-09-13T18:57:13.523574+0000","last_clean":"2024-09-13T18:57:13.523574+0000","last_became_active":"2024-09-13T18:57:13.081874+0000","last_became_peered":"2024-09-13T18:57:13.081874+0000","last_unstale":"2024-09-13T18:57:13.523574+0000","last_undegraded":"2024-09-13T18:57:13.523574+0000","last_fullsized":"2024-09-13T18:57:13.523574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:12.042614+0000","last_clean_scrub_stamp":"2024-09-13T18:57:12.042614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:17.493835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:57:27.335 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:57:27.335 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:57:27.335 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:57:27.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:57:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.521+0000 7fab8a000640 1 Processor -- start 2024-09-13T18:57:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.521+0000 7fab8a000640 1 -- start start 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.522+0000 7fab8a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab8415d8f0 0x7fab8406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.522+0000 7fab8a000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8415dcd0 con 0x7fab8406b440 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.522+0000 7fab8a000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab84142f50 con 0x7fab84070080 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.522+0000 7fab8a000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8406b8d0 con 0x7fab8415d8f0 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab8415d8f0 0x7fab8406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fab8415d8f0 0x7fab8406bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35622/0 (socket says 172.21.15.33:35622) 2024-09-13T18:57:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 -- 172.21.15.33:0/3321716986 learned_addr learned my addr 172.21.15.33:0/3321716986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 -- 172.21.15.33:0/3321716986 >> v1:172.21.15.103:6789/0 conn(0x7fab84070080 legacy=0x7fab8406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 -- 172.21.15.33:0/3321716986 >> v1:172.21.15.33:6789/0 conn(0x7fab8406b440 legacy=0x7fab841421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.523+0000 7fab83400640 1 -- 172.21.15.33:0/3321716986 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84069f70 con 0x7fab8415d8f0 2024-09-13T18:57:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.524+0000 7fab83400640 1 --2- 172.21.15.33:0/3321716986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8415d8f0 0x7fab8406bdd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab740098a0 tx=0x7fab7402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e251d25eca50e519 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.524+0000 7fab82a00640 1 -- 172.21.15.33:0/3321716986 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74032440 con 0x7fab8415d8f0 2024-09-13T18:57:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.524+0000 7fab82a00640 1 -- 172.21.15.33:0/3321716986 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740325a0 con 0x7fab8415d8f0 2024-09-13T18:57:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.524+0000 7fab82a00640 1 -- 172.21.15.33:0/3321716986 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74032930 con 0x7fab8415d8f0 2024-09-13T18:57:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 -- 172.21.15.33:0/3321716986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8415d8f0 msgr2=0x7fab8406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 --2- 172.21.15.33:0/3321716986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8415d8f0 0x7fab8406bdd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab740098a0 tx=0x7fab7402a2e0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 -- 172.21.15.33:0/3321716986 shutdown_connections 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 --2- 172.21.15.33:0/3321716986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8415d8f0 0x7fab8406bdd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 -- 172.21.15.33:0/3321716986 >> 172.21.15.33:0/3321716986 conn(0x7fab840ae480 msgr2=0x7fab840b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 -- 172.21.15.33:0/3321716986 shutdown_connections 2024-09-13T18:57:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.525+0000 7fab8a000640 1 -- 172.21.15.33:0/3321716986 wait complete. 2024-09-13T18:57:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.527+0000 7fab8a000640 1 Processor -- start 2024-09-13T18:57:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.527+0000 7fab8a000640 1 -- start start 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 0x7fab8415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fab8415d8f0 0x7fab8409bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409aff0 con 0x7fab8406b440 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409b410 con 0x7fab84070080 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab8a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409a370 con 0x7fab8415d8f0 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab83400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab83400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35638/0 (socket says 172.21.15.33:35638) 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab83400640 1 -- 172.21.15.33:0/4109452075 learned_addr learned my addr 172.21.15.33:0/4109452075 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab7be00640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 0x7fab8415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.528+0000 7fab83e00640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fab8415d8f0 0x7fab8409bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 -- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fab8415d8f0 msgr2=0x7fab8409bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fab8415d8f0 0x7fab8409bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 -- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 msgr2=0x7fab8415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 0x7fab8415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 -- 172.21.15.33:0/4109452075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094d0 con 0x7fab8406b440 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab7be00640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 0x7fab8415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab83400640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab740098a0 tx=0x7fab740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74004230 con 0x7fab8406b440 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74004390 con 0x7fab8406b440 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7403d930 con 0x7fab8406b440 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8409a650 con 0x7fab8406b440 2024-09-13T18:57:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.529+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8409ac10 con 0x7fab8406b440 2024-09-13T18:57:27.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.530+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8406bdd0 con 0x7fab8406b440 2024-09-13T18:57:27.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.531+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab74039040 con 0x7fab8406b440 2024-09-13T18:57:27.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.532+0000 7fab7b400640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.532+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab740a9d00 con 0x7fab8406b440 2024-09-13T18:57:27.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.533+0000 7fab7be00640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.533+0000 7fab7be00640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 0x7fab6006d0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab6c006fd0 tx=0x7fab6c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.536+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab74074e40 con 0x7fab8406b440 2024-09-13T18:57:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.751+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fab8406bdd0 con 0x7fab8406b440 2024-09-13T18:57:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.752+0000 7fab7b400640 1 -- 172.21.15.33:0/4109452075 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fab74078460 con 0x7fab8406b440 2024-09-13T18:57:27.754 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:27.754 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:57:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 msgr2=0x7fab6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 0x7fab6006d0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab6c006fd0 tx=0x7fab6c008040 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 msgr2=0x7fab84099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab740098a0 tx=0x7fab740046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 shutdown_connections 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fab8415d8f0 0x7fab8409bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab84070080 0x7fab8415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 --2- 172.21.15.33:0/4109452075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab8406b440 0x7fab84099a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 >> 172.21.15.33:0/4109452075 conn(0x7fab840ae480 msgr2=0x7fab840b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 shutdown_connections 2024-09-13T18:57:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.754+0000 7fab8a000640 1 -- 172.21.15.33:0/4109452075 wait complete. 2024-09-13T18:57:27.772 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:57:27.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:27.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.925+0000 7fe8b5a00640 1 Processor -- start 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.925+0000 7fe8b5a00640 1 -- start start 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8b5a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b015a520 0x7fe8b006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8b5a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe8b00b1b00 0x7fe8b00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8b5a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b006bc00 con 0x7fe8b00cde50 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8b5a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b006bea0 con 0x7fe8b015a520 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8b5a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b006c180 con 0x7fe8b00b1b00 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b015a520 0x7fe8b006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b015a520 0x7fe8b006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35654/0 (socket says 172.21.15.33:35654) 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8af400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe8b00cde50 0x7fe8b00b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54052/0 (socket says 172.21.15.33:54052) 2024-09-13T18:57:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 -- 172.21.15.33:0/3782734126 learned_addr learned my addr 172.21.15.33:0/3782734126 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8a7e00640 1 --2- 172.21.15.33:0/3782734126 >> v2:172.21.15.103:3300/0 conn(0x7fe8b00b1b00 0x7fe8b00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 -- 172.21.15.33:0/3782734126 >> v2:172.21.15.103:3300/0 conn(0x7fe8b00b1b00 msgr2=0x7fe8b00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 --2- 172.21.15.33:0/3782734126 >> v2:172.21.15.103:3300/0 conn(0x7fe8b00b1b00 0x7fe8b00cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 -- 172.21.15.33:0/3782734126 >> v1:172.21.15.33:6789/0 conn(0x7fe8b00cde50 legacy=0x7fe8b00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8aea00640 1 -- 172.21.15.33:0/3782734126 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b006c460 con 0x7fe8b015a520 2024-09-13T18:57:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.927+0000 7fe8ae000640 1 -- 172.21.15.33:0/3782734126 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205132652 0 0) 0x7fe8b006bc00 con 0x7fe8b00cde50 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8aea00640 1 --2- 172.21.15.33:0/3782734126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b006b6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8b006dad0 tx=0x7fe8a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937d60eb4ad8e968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8ae000640 1 -- 172.21.15.33:0/3782734126 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0032440 con 0x7fe8b015a520 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8ae000640 1 -- 172.21.15.33:0/3782734126 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a00325a0 con 0x7fe8b015a520 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8ae000640 1 -- 172.21.15.33:0/3782734126 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0032930 con 0x7fe8b015a520 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 -- 172.21.15.33:0/3782734126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 msgr2=0x7fe8b006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/3782734126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b006b6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8b006dad0 tx=0x7fe8a002a270 comp rx=0 tx=0).stop 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 -- 172.21.15.33:0/3782734126 shutdown_connections 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/3782734126 >> v2:172.21.15.103:3300/0 conn(0x7fe8b00b1b00 0x7fe8b00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/3782734126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b006b6c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.929+0000 7fe8b5a00640 1 -- 172.21.15.33:0/3782734126 >> 172.21.15.33:0/3782734126 conn(0x7fe8b00b0510 msgr2=0x7fe8b00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.930+0000 7fe8b5a00640 1 -- 172.21.15.33:0/3782734126 shutdown_connections 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.930+0000 7fe8b5a00640 1 -- 172.21.15.33:0/3782734126 wait complete. 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.931+0000 7fe8b5a00640 1 Processor -- start 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.931+0000 7fe8b5a00640 1 -- start start 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8b00b1b00 0x7fe8b015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8b00cde50 0x7fe8b0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b015d750 con 0x7fe8b015a520 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0156780 con 0x7fe8b00cde50 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.932+0000 7fe8b5a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b015cb40 con 0x7fe8b00b1b00 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35658/0 (socket says 172.21.15.33:35658) 2024-09-13T18:57:27.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 -- 172.21.15.33:0/4219144517 learned_addr learned my addr 172.21.15.33:0/4219144517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8a7e00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8b00cde50 0x7fe8b0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8aea00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8b00b1b00 0x7fe8b015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 -- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8b00b1b00 msgr2=0x7fe8b015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8b00b1b00 0x7fe8b015c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 -- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8b00cde50 msgr2=0x7fe8b0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8b00cde50 0x7fe8b0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 -- 172.21.15.33:0/4219144517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00094d0 con 0x7fe8b015a520 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8af400640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c7d0 tx=0x7fe8a800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.933+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800a640 con 0x7fe8b015a520 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.934+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800a7a0 con 0x7fe8b015a520 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.934+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800ab90 con 0x7fe8b015a520 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.934+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b015ce20 con 0x7fe8b015a520 2024-09-13T18:57:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.934+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b015d3e0 con 0x7fe8b015a520 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.935+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b015d900 con 0x7fe8b015a520 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.936+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8a800acf0 con 0x7fe8b015a520 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.936+0000 7fe8a6a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 0x7fe88c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.936+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8a80888d0 con 0x7fe8b015a520 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.937+0000 7fe8aea00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 0x7fe88c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.937+0000 7fe8aea00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 0x7fe88c06d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0034000 tx=0x7fe8a002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:27.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:27.941+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8b015d900 con 0x7fe8b015a520 2024-09-13T18:57:28.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.118+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8b015d900 con 0x7fe8b015a520 2024-09-13T18:57:28.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.120+0000 7fe8a6a00640 1 -- 172.21.15.33:0/4219144517 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fe8b015d900 con 0x7fe8b015a520 2024-09-13T18:57:28.122 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:28.123 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 msgr2=0x7fe88c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 0x7fe88c06d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0034000 tx=0x7fe8a002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 msgr2=0x7fe8b014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c7d0 tx=0x7fe8a800cc90 comp rx=0 tx=0).stop 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 shutdown_connections 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88c06ac00 0x7fe88c06d0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b015a520 0x7fe8b014d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8b00cde50 0x7fe8b0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 --2- 172.21.15.33:0/4219144517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8b00b1b00 0x7fe8b015c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 >> 172.21.15.33:0/4219144517 conn(0x7fe8b00b0510 msgr2=0x7fe8b00ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 shutdown_connections 2024-09-13T18:57:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.122+0000 7fe8b5a00640 1 -- 172.21.15.33:0/4219144517 wait complete. 2024-09-13T18:57:28.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:28.140 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:28.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.296+0000 7facc5200640 1 Processor -- start 2024-09-13T18:57:28.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.296+0000 7facc5200640 1 -- start start 2024-09-13T18:57:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.297+0000 7facc5200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facc0071690 0x7facc015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.297+0000 7facc5200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7facc00cafa0 0x7facc00cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.297+0000 7facc5200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc006f5f0 con 0x7facc0156f60 2024-09-13T18:57:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.297+0000 7facc5200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc015aa30 con 0x7facc0071690 2024-09-13T18:57:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.297+0000 7facc5200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc0070450 con 0x7facc00cafa0 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facc0071690 0x7facc015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facc0071690 0x7facc015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35674/0 (socket says 172.21.15.33:35674) 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 -- 172.21.15.33:0/2532363971 learned_addr learned my addr 172.21.15.33:0/2532363971 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbe800640 1 --2- 172.21.15.33:0/2532363971 >> v2:172.21.15.103:3300/0 conn(0x7facc00cafa0 0x7facc00cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 -- 172.21.15.33:0/2532363971 >> v2:172.21.15.103:3300/0 conn(0x7facc00cafa0 msgr2=0x7facc00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 --2- 172.21.15.33:0/2532363971 >> v2:172.21.15.103:3300/0 conn(0x7facc00cafa0 0x7facc00cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 -- 172.21.15.33:0/2532363971 >> v1:172.21.15.103:6789/0 conn(0x7facc0156f60 legacy=0x7facc0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.298+0000 7facbd400640 1 -- 172.21.15.33:0/2532363971 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc006f840 con 0x7facc0071690 2024-09-13T18:57:28.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.299+0000 7facbd400640 1 --2- 172.21.15.33:0/2532363971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0071690 0x7facc015a4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facc0159a70 tx=0x7facac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86feae92d8f5c3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.299+0000 7facbca00640 1 -- 172.21.15.33:0/2532363971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac032440 con 0x7facc0071690 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.299+0000 7facbca00640 1 -- 172.21.15.33:0/2532363971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac0325a0 con 0x7facc0071690 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.299+0000 7facbca00640 1 -- 172.21.15.33:0/2532363971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac032930 con 0x7facc0071690 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 -- 172.21.15.33:0/2532363971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0071690 msgr2=0x7facc015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 --2- 172.21.15.33:0/2532363971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0071690 0x7facc015a4f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facc0159a70 tx=0x7facac02a230 comp rx=0 tx=0).stop 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 -- 172.21.15.33:0/2532363971 shutdown_connections 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 --2- 172.21.15.33:0/2532363971 >> v2:172.21.15.103:3300/0 conn(0x7facc00cafa0 0x7facc00cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 --2- 172.21.15.33:0/2532363971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0071690 0x7facc015a4f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 -- 172.21.15.33:0/2532363971 >> 172.21.15.33:0/2532363971 conn(0x7facc00b0580 msgr2=0x7facc00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 -- 172.21.15.33:0/2532363971 shutdown_connections 2024-09-13T18:57:28.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.300+0000 7facc5200640 1 -- 172.21.15.33:0/2532363971 wait complete. 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.302+0000 7facc5200640 1 Processor -- start 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.302+0000 7facc5200640 1 -- start start 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 0x7facc014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 0x7facc015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc014bb60 con 0x7facc0156f60 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc014be00 con 0x7facc00cafa0 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facc5200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc014c0e0 con 0x7facc0071690 2024-09-13T18:57:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35690/0 (socket says 172.21.15.33:35690) 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 -- 172.21.15.33:0/4151754890 learned_addr learned my addr 172.21.15.33:0/4151754890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbd400640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 0x7facc015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbde00640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 0x7facc014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 -- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 msgr2=0x7facc014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 0x7facc014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 -- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 msgr2=0x7facc015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 0x7facc015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbe800640 1 -- 172.21.15.33:0/4151754890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0094d0 con 0x7facc0156f60 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbd400640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 0x7facc015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.303+0000 7facbde00640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 0x7facc014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facbe800640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb8007de0 tx=0x7facb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8014620 con 0x7facc0156f60 2024-09-13T18:57:28.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb800ee90 con 0x7facc0156f60 2024-09-13T18:57:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb80149e0 con 0x7facc0156f60 2024-09-13T18:57:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc014c3c0 con 0x7facc0156f60 2024-09-13T18:57:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.304+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc015dc90 con 0x7facc0156f60 2024-09-13T18:57:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.305+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc0157340 con 0x7facc0156f60 2024-09-13T18:57:28.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.306+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7facb8014b40 con 0x7facc0156f60 2024-09-13T18:57:28.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.307+0000 7facb6000640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 0x7faca006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.307+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb8089e30 con 0x7facc0156f60 2024-09-13T18:57:28.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.307+0000 7facbde00640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 0x7faca006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.308+0000 7facbde00640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 0x7faca006d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facb000a830 tx=0x7facb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.311+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7facb8054f70 con 0x7facc0156f60 2024-09-13T18:57:28.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.487+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facc00708c0 con 0x7facc0156f60 2024-09-13T18:57:28.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.487+0000 7facb6000640 1 -- 172.21.15.33:0/4151754890 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7facc00708c0 con 0x7facc0156f60 2024-09-13T18:57:28.489 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 msgr2=0x7faca006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 0x7faca006d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facb000a830 tx=0x7facb0008040 comp rx=0 tx=0).stop 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 msgr2=0x7facc01f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb8007de0 tx=0x7facb800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 shutdown_connections 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faca006ac00 0x7faca006d0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc0156f60 0x7facc01f0520 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facc00cafa0 0x7facc015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 --2- 172.21.15.33:0/4151754890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facc0071690 0x7facc014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.489+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 >> 172.21.15.33:0/4151754890 conn(0x7facc00b0580 msgr2=0x7facc00aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:28.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.490+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 shutdown_connections 2024-09-13T18:57:28.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.490+0000 7facc5200640 1 -- 172.21.15.33:0/4151754890 wait complete. 2024-09-13T18:57:28.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:28.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.662+0000 7fad9aa00640 1 Processor -- start 2024-09-13T18:57:28.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.662+0000 7fad9aa00640 1 -- start start 2024-09-13T18:57:28.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 0x7fad940cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad9aa00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940ce490 con 0x7fad94154ad0 2024-09-13T18:57:28.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad9aa00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9406b7c0 con 0x7fad9406f830 2024-09-13T18:57:28.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad9aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940cc4b0 con 0x7fad940cbac0 2024-09-13T18:57:28.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad93e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fad94154ad0 0x7fad940cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54062/0 (socket says 172.21.15.33:54062) 2024-09-13T18:57:28.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.663+0000 7fad93e00640 1 -- 172.21.15.33:0/3706068097 learned_addr learned my addr 172.21.15.33:0/3706068097 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad98a00640 1 --2- 172.21.15.33:0/3706068097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 0x7fad940cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838473998 0 0) 0x7fad940ce490 con 0x7fad94154ad0 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad78003520 con 0x7fad94154ad0 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279506526 0 0) 0x7fad9406b7c0 con 0x7fad9406f830 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad940ce490 con 0x7fad9406f830 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203193883 0 0) 0x7fad78003520 con 0x7fad94154ad0 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad98a00640 1 -- 172.21.15.33:0/3706068097 >> v1:172.21.15.103:6789/0 conn(0x7fad9406f830 legacy=0x7fad9406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad98a00640 1 -- 172.21.15.33:0/3706068097 >> v1:172.21.15.33:6789/0 conn(0x7fad94154ad0 legacy=0x7fad940cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.664+0000 7fad98a00640 1 -- 172.21.15.33:0/3706068097 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9406baa0 con 0x7fad940cbac0 2024-09-13T18:57:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.665+0000 7fad98a00640 1 --2- 172.21.15.33:0/3706068097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 0x7fad940cbf70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009dc0 tx=0x7fad8c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9959087663137e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84001670 con 0x7fad940cbac0 2024-09-13T18:57:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c02d050 con 0x7fad940cbac0 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad92a00640 1 -- 172.21.15.33:0/3706068097 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c007740 con 0x7fad940cbac0 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 -- 172.21.15.33:0/3706068097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 msgr2=0x7fad940cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 --2- 172.21.15.33:0/3706068097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 0x7fad940cbf70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009dc0 tx=0x7fad8c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 -- 172.21.15.33:0/3706068097 shutdown_connections 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 --2- 172.21.15.33:0/3706068097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad940cbac0 0x7fad940cbf70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 -- 172.21.15.33:0/3706068097 >> 172.21.15.33:0/3706068097 conn(0x7fad940b0580 msgr2=0x7fad940b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 -- 172.21.15.33:0/3706068097 shutdown_connections 2024-09-13T18:57:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.666+0000 7fad9aa00640 1 -- 172.21.15.33:0/3706068097 wait complete. 2024-09-13T18:57:28.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.668+0000 7fad9aa00640 1 Processor -- start 2024-09-13T18:57:28.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.668+0000 7fad9aa00640 1 -- start start 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad94154ad0 0x7fad940b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad940b23d0 0x7fad941595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b39b0 con 0x7fad940cbac0 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b2910 con 0x7fad940b23d0 2024-09-13T18:57:28.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad9aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b2bf0 con 0x7fad94154ad0 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad93e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad93e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35692/0 (socket says 172.21.15.33:35692) 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad93e00640 1 -- 172.21.15.33:0/2526168386 learned_addr learned my addr 172.21.15.33:0/2526168386 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad93400640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad94154ad0 0x7fad940b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.669+0000 7fad98a00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad940b23d0 0x7fad941595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 -- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad94154ad0 msgr2=0x7fad940b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad94154ad0 0x7fad940b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 -- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad940b23d0 msgr2=0x7fad941595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad940b23d0 0x7fad941595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 -- 172.21.15.33:0/2526168386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009a70 con 0x7fad940cbac0 2024-09-13T18:57:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad93e00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad84001eb0 tx=0x7fad8400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84005ad0 con 0x7fad940cbac0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84005c30 con 0x7fad940cbac0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84007070 con 0x7fad940cbac0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.670+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad940b2ed0 con 0x7fad940cbac0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.671+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940b3490 con 0x7fad940cbac0 2024-09-13T18:57:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.672+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad941523a0 con 0x7fad940cbac0 2024-09-13T18:57:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.672+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad840071d0 con 0x7fad940cbac0 2024-09-13T18:57:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.673+0000 7fad8be00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 0x7fad7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.673+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad84088fb0 con 0x7fad940cbac0 2024-09-13T18:57:28.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.674+0000 7fad93400640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 0x7fad7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:28.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.675+0000 7fad93400640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 0x7fad7406d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad940cc230 tx=0x7fad80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.677+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fad840541a0 con 0x7fad940cbac0 2024-09-13T18:57:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.854+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad940b36b0 con 0x7fad940cbac0 2024-09-13T18:57:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.855+0000 7fad8be00640 1 -- 172.21.15.33:0/2526168386 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad840577c0 con 0x7fad940cbac0 2024-09-13T18:57:28.857 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 msgr2=0x7fad7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 0x7fad7406d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad940cc230 tx=0x7fad80009040 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 msgr2=0x7fad9415cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad84001eb0 tx=0x7fad8400cbe0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 shutdown_connections 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad7406ac00 0x7fad7406d0c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad940b23d0 0x7fad941595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad94154ad0 0x7fad940b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 --2- 172.21.15.33:0/2526168386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad940cbac0 0x7fad9415cf50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 >> 172.21.15.33:0/2526168386 conn(0x7fad940b0580 msgr2=0x7fad94151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 shutdown_connections 2024-09-13T18:57:28.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:28.857+0000 7fad9aa00640 1 -- 172.21.15.33:0/2526168386 wait complete. 2024-09-13T18:57:28.875 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:29.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.030+0000 7fac08800640 1 Processor -- start 2024-09-13T18:57:29.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.030+0000 7fac08800640 1 -- start start 2024-09-13T18:57:29.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.031+0000 7fac08800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fac0015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.031+0000 7fac08800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0006f5f0 con 0x7fac00071690 2024-09-13T18:57:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.031+0000 7fac08800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac00070450 con 0x7fac000cafa0 2024-09-13T18:57:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.031+0000 7fac08800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0015aa30 con 0x7fac00156f60 2024-09-13T18:57:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.031+0000 7fac06800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fac00071690 0x7fac000cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54070/0 (socket says 172.21.15.33:54070) 2024-09-13T18:57:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac06800640 1 -- 172.21.15.33:0/2026116899 learned_addr learned my addr 172.21.15.33:0/2026116899 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac05e00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fac0015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266574585 0 0) 0x7fac0006f5f0 con 0x7fac00071690 2024-09-13T18:57:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe8003420 con 0x7fac00071690 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310054300 0 0) 0x7fac00070450 con 0x7fac000cafa0 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0006f5f0 con 0x7fac000cafa0 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168823606 0 0) 0x7fabe8003420 con 0x7fac00071690 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 msgr2=0x7fac0015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fac0015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 >> v1:172.21.15.103:6789/0 conn(0x7fac000cafa0 legacy=0x7fac00070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0006f840 con 0x7fac00071690 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fabfc0019f0 con 0x7fac00071690 2024-09-13T18:57:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 >> v1:172.21.15.33:6789/0 conn(0x7fac00071690 legacy=0x7fac000cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8004c10 0x7fabe8005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fabe8003710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe8003ce0 0x7fabe800fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0015aa30 con 0x7fabe8003ce0 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8004400 con 0x7fabe8004c10 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.032+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80100b0 con 0x7fac00156f60 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe8003ce0 0x7fabe800fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac05e00640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8004c10 0x7fabe8005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac05400640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fabe8003710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 -- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 msgr2=0x7fabe8003710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac00156f60 0x7fabe8003710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 -- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8004c10 msgr2=0x7fabe8005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8004c10 0x7fabe8005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.033+0000 7fac06800640 1 -- 172.21.15.33:0/2026116899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8003420 con 0x7fabe8003ce0 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.034+0000 7fac06800640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe8003ce0 0x7fabe800fb70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00a710 tx=0x7fabe80046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4f9a554afd7071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.034+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc02b900 con 0x7fabe8003ce0 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.034+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc02ba60 con 0x7fabe8003ce0 2024-09-13T18:57:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.034+0000 7fac04a00640 1 -- 172.21.15.33:0/2026116899 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc02be50 con 0x7fabe8003ce0 2024-09-13T18:57:29.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 -- 172.21.15.33:0/2026116899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe8003ce0 msgr2=0x7fabe800fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 --2- 172.21.15.33:0/2026116899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe8003ce0 0x7fabe800fb70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00a710 tx=0x7fabe80046e0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac06800640 1 -- 172.21.15.33:0/2026116899 reap_dead start 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 -- 172.21.15.33:0/2026116899 shutdown_connections 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 -- 172.21.15.33:0/2026116899 >> 172.21.15.33:0/2026116899 conn(0x7fac000b0580 msgr2=0x7fac000b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 -- 172.21.15.33:0/2026116899 shutdown_connections 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.035+0000 7fac08800640 1 -- 172.21.15.33:0/2026116899 wait complete. 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.037+0000 7fac08800640 1 Processor -- start 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.037+0000 7fac08800640 1 -- start start 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8003ce0 0x7fac00156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 0x7fac001ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000c3b40 con 0x7fac001543d0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac00156860 con 0x7fabe8003ce0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac08800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac00154940 con 0x7fac001ee0f0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35706/0 (socket says 172.21.15.33:35706) 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 -- 172.21.15.33:0/2065960989 learned_addr learned my addr 172.21.15.33:0/2065960989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05e00640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8003ce0 0x7fac00156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac06800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 0x7fac001ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 -- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 msgr2=0x7fac001ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 0x7fac001ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 -- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8003ce0 msgr2=0x7fac00156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8003ce0 0x7fac00156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac05400640 1 -- 172.21.15.33:0/2065960989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00154c20 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.038+0000 7fac06800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 0x7fac001ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fac05400640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabf000f770 tx=0x7fabf000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00050d0 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0005270 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000d730 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac00154f00 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.039+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac001554c0 con 0x7fac001543d0 2024-09-13T18:57:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.040+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00157340 con 0x7fac001543d0 2024-09-13T18:57:29.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.041+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabf000d890 con 0x7fac001543d0 2024-09-13T18:57:29.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.042+0000 7fabfa000640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 0x7fabe406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.042+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf00893b0 con 0x7fac001543d0 2024-09-13T18:57:29.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.043+0000 7fac05e00640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 0x7fabe406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.043+0000 7fac05e00640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 0x7fabe406d0f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009bc0 tx=0x7fabf4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.047+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabf00544f0 con 0x7fac001543d0 2024-09-13T18:57:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.229+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac001518e0 con 0x7fac001543d0 2024-09-13T18:57:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.229+0000 7fabfa000640 1 -- 172.21.15.33:0/2065960989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabf0057b10 con 0x7fac001543d0 2024-09-13T18:57:29.232 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 msgr2=0x7fabe406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 0x7fabe406d0f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009bc0 tx=0x7fabf4009190 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 msgr2=0x7fac00143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fabf000f770 tx=0x7fabf000fb70 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 shutdown_connections 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabe406ac30 0x7fabe406d0f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac001ee0f0 0x7fac001ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac001543d0 0x7fac00143fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 --2- 172.21.15.33:0/2065960989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabe8003ce0 0x7fac00156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 >> 172.21.15.33:0/2065960989 conn(0x7fac000b0580 msgr2=0x7fac000b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:29.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.231+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 shutdown_connections 2024-09-13T18:57:29.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.232+0000 7fac08800640 1 -- 172.21.15.33:0/2065960989 wait complete. 2024-09-13T18:57:29.250 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:57:29.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.402+0000 7f5a8ee00640 1 Processor -- start 2024-09-13T18:57:29.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.403+0000 7f5a8ee00640 1 -- start start 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8ee00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a880b40c0 0x7f5a8815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8ee00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a880cbac0 0x7f5a8815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8ee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a880cbfc0 con 0x7f5a8815a5c0 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8ee00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a880cce20 con 0x7f5a880cbac0 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8ee00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a880707a0 con 0x7f5a880b40c0 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8e400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a880cbac0 0x7f5a8815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8e400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a880cbac0 0x7f5a8815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35716/0 (socket says 172.21.15.33:35716) 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8e400640 1 -- 172.21.15.33:0/3576735219 learned_addr learned my addr 172.21.15.33:0/3576735219 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8d000640 1 --2- 172.21.15.33:0/3576735219 >> v2:172.21.15.103:3300/0 conn(0x7f5a880b40c0 0x7f5a8815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8e400640 1 -- 172.21.15.33:0/3576735219 >> v2:172.21.15.103:3300/0 conn(0x7f5a880b40c0 msgr2=0x7f5a8815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.404+0000 7f5a8e400640 1 --2- 172.21.15.33:0/3576735219 >> v2:172.21.15.103:3300/0 conn(0x7f5a880b40c0 0x7f5a8815a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.405+0000 7f5a8e400640 1 -- 172.21.15.33:0/3576735219 >> v1:172.21.15.103:6789/0 conn(0x7f5a8815a5c0 legacy=0x7f5a880b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.405+0000 7f5a8e400640 1 -- 172.21.15.33:0/3576735219 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88070a80 con 0x7f5a880cbac0 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.405+0000 7f5a8e400640 1 --2- 172.21.15.33:0/3576735219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a8815aee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a88061c10 tx=0x7f5a8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815f57acaf6eed9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a87e00640 1 -- 172.21.15.33:0/3576735219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80031600 con 0x7f5a880cbac0 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a87e00640 1 -- 172.21.15.33:0/3576735219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8002d050 con 0x7f5a880cbac0 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a87e00640 1 -- 172.21.15.33:0/3576735219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80031980 con 0x7f5a880cbac0 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 -- 172.21.15.33:0/3576735219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 msgr2=0x7f5a8815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/3576735219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a8815aee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a88061c10 tx=0x7f5a8002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 -- 172.21.15.33:0/3576735219 shutdown_connections 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/3576735219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a8815aee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/3576735219 >> v2:172.21.15.103:3300/0 conn(0x7f5a880b40c0 0x7f5a8815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 -- 172.21.15.33:0/3576735219 >> 172.21.15.33:0/3576735219 conn(0x7f5a880ae310 msgr2=0x7f5a880ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:29.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.406+0000 7f5a8ee00640 1 -- 172.21.15.33:0/3576735219 shutdown_connections 2024-09-13T18:57:29.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.407+0000 7f5a8ee00640 1 -- 172.21.15.33:0/3576735219 wait complete. 2024-09-13T18:57:29.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.408+0000 7f5a8ee00640 1 Processor -- start 2024-09-13T18:57:29.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.408+0000 7f5a8ee00640 1 -- start start 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a880b40c0 0x7f5a88144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8815a5c0 0x7f5a88147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88144790 con 0x7f5a880cbac0 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88145970 con 0x7f5a8815a5c0 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88144d60 con 0x7f5a880b40c0 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35730/0 (socket says 172.21.15.33:35730) 2024-09-13T18:57:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.409+0000 7f5a8d000640 1 -- 172.21.15.33:0/4258757205 learned_addr learned my addr 172.21.15.33:0/4258757205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8da00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a880b40c0 0x7f5a88144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8e400640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8815a5c0 0x7f5a88147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 -- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a880b40c0 msgr2=0x7f5a88144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a880b40c0 0x7f5a88144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 -- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8815a5c0 msgr2=0x7f5a88147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8815a5c0 0x7f5a88147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 -- 172.21.15.33:0/4258757205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80009b30 con 0x7f5a880cbac0 2024-09-13T18:57:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8d000640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d800 tx=0x7f5a7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400b660 con 0x7f5a880cbac0 2024-09-13T18:57:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400b7e0 con 0x7f5a880cbac0 2024-09-13T18:57:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a88145040 con 0x7f5a880cbac0 2024-09-13T18:57:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400bb90 con 0x7f5a880cbac0 2024-09-13T18:57:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.410+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a88145600 con 0x7f5a880cbac0 2024-09-13T18:57:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.411+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88067360 con 0x7f5a880cbac0 2024-09-13T18:57:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.412+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a7400bcf0 con 0x7f5a880cbac0 2024-09-13T18:57:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.413+0000 7f5a85600640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 0x7f5a6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.413+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a74089940 con 0x7f5a880cbac0 2024-09-13T18:57:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.413+0000 7f5a8da00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 0x7f5a6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.414+0000 7f5a8da00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 0x7f5a6806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a881f3660 tx=0x7f5a7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.417+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a74054b10 con 0x7f5a880cbac0 2024-09-13T18:57:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.642+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a8806ef90 con 0x7f5a880cbac0 2024-09-13T18:57:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.642+0000 7f5a85600640 1 -- 172.21.15.33:0/4258757205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f5a74058130 con 0x7f5a880cbac0 2024-09-13T18:57:29.645 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:29.645 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:57:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:57:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.644+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 msgr2=0x7f5a6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.644+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 0x7f5a6806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a881f3660 tx=0x7f5a7c009040 comp rx=0 tx=0).stop 2024-09-13T18:57:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 msgr2=0x7f5a880a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d800 tx=0x7f5a7400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 shutdown_connections 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5a6806ac00 0x7f5a6806d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8815a5c0 0x7f5a88147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a880cbac0 0x7f5a880a8e70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 --2- 172.21.15.33:0/4258757205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a880b40c0 0x7f5a88144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 >> 172.21.15.33:0/4258757205 conn(0x7f5a880ae310 msgr2=0x7f5a8806b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 shutdown_connections 2024-09-13T18:57:29.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.645+0000 7f5a8ee00640 1 -- 172.21.15.33:0/4258757205 wait complete. 2024-09-13T18:57:29.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.815+0000 7faa34200640 1 Processor -- start 2024-09-13T18:57:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.815+0000 7faa34200640 1 -- start start 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa34200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faa2c0b1e40 0x7faa2c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa34200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa2c0b32d0 0x7faa2c070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa34200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c15a430 con 0x7faa2c0b2220 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa34200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c1598b0 con 0x7faa2c0b32d0 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa34200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c159b90 con 0x7faa2c0b1e40 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa32200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa2c0b32d0 0x7faa2c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa30e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faa2c0b2220 0x7faa2c0b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54084/0 (socket says 172.21.15.33:54084) 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.816+0000 7faa30e00640 1 -- 172.21.15.33:0/64250465 learned_addr learned my addr 172.21.15.33:0/64250465 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.817+0000 7faa31800640 1 --2- 172.21.15.33:0/64250465 >> v2:172.21.15.103:3300/0 conn(0x7faa2c0b1e40 0x7faa2c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.817+0000 7faa32200640 1 -- 172.21.15.33:0/64250465 >> v2:172.21.15.103:3300/0 conn(0x7faa2c0b1e40 msgr2=0x7faa2c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.817+0000 7faa32200640 1 --2- 172.21.15.33:0/64250465 >> v2:172.21.15.103:3300/0 conn(0x7faa2c0b1e40 0x7faa2c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.817+0000 7faa32200640 1 -- 172.21.15.33:0/64250465 >> v1:172.21.15.33:6789/0 conn(0x7faa2c0b2220 legacy=0x7faa2c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.817+0000 7faa32200640 1 -- 172.21.15.33:0/64250465 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c159e70 con 0x7faa2c0b32d0 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa32200640 1 --2- 172.21.15.33:0/64250465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b32d0 0x7faa2c070720 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa2c06daf0 tx=0x7faa2402b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae34cf50e15d204c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa2be00640 1 -- 172.21.15.33:0/64250465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24008640 con 0x7faa2c0b32d0 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa2be00640 1 -- 172.21.15.33:0/64250465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2402e050 con 0x7faa2c0b32d0 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa2be00640 1 -- 172.21.15.33:0/64250465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa240089c0 con 0x7faa2c0b32d0 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa34200640 1 -- 172.21.15.33:0/64250465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b32d0 msgr2=0x7faa2c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.818+0000 7faa34200640 1 --2- 172.21.15.33:0/64250465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b32d0 0x7faa2c070720 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa2c06daf0 tx=0x7faa2402b6f0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 -- 172.21.15.33:0/64250465 shutdown_connections 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 --2- 172.21.15.33:0/64250465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b32d0 0x7faa2c070720 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 --2- 172.21.15.33:0/64250465 >> v2:172.21.15.103:3300/0 conn(0x7faa2c0b1e40 0x7faa2c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 -- 172.21.15.33:0/64250465 >> 172.21.15.33:0/64250465 conn(0x7faa2c0b0510 msgr2=0x7faa2c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 -- 172.21.15.33:0/64250465 shutdown_connections 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.819+0000 7faa34200640 1 -- 172.21.15.33:0/64250465 wait complete. 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.820+0000 7faa34200640 1 Processor -- start 2024-09-13T18:57:29.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.820+0000 7faa34200640 1 -- start start 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa2c0b1e40 0x7faa2c13d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 0x7faa2c13df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c158ca0 con 0x7faa2c0b2220 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c13cb90 con 0x7faa2c0b32d0 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa34200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c06d440 con 0x7faa2c0b1e40 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.821+0000 7faa30e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35750/0 (socket says 172.21.15.33:35750) 2024-09-13T18:57:29.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 -- 172.21.15.33:0/3332680710 learned_addr learned my addr 172.21.15.33:0/3332680710 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa31800640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa2c0b1e40 0x7faa2c13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa32200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 0x7faa2c13df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 -- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa2c0b1e40 msgr2=0x7faa2c13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa2c0b1e40 0x7faa2c13d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 -- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 msgr2=0x7faa2c13df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 0x7faa2c13df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 -- 172.21.15.33:0/3332680710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2400ab80 con 0x7faa2c0b2220 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa32200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 0x7faa2c13df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa30e00640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c4a0 tx=0x7faa1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18005ce0 con 0x7faa2c0b2220 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18005e40 con 0x7faa2c0b2220 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c13eb00 con 0x7faa2c0b2220 2024-09-13T18:57:29.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.822+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18007270 con 0x7faa2c0b2220 2024-09-13T18:57:29.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.823+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c13d110 con 0x7faa2c0b2220 2024-09-13T18:57:29.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.824+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c0ca840 con 0x7faa2c0b2220 2024-09-13T18:57:29.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.824+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa18007490 con 0x7faa2c0b2220 2024-09-13T18:57:29.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.825+0000 7faa29600640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 0x7faa0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:29.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.825+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa18088930 con 0x7faa2c0b2220 2024-09-13T18:57:29.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.826+0000 7faa31800640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 0x7faa0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:29.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.827+0000 7faa31800640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 0x7faa0c06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa20006fd0 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:29.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:29.830+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faa18053a90 con 0x7faa2c0b2220 2024-09-13T18:57:30.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.008+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa2c070720 con 0x7faa2c0b2220 2024-09-13T18:57:30.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.009+0000 7faa29600640 1 -- 172.21.15.33:0/3332680710 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7faa18017070 con 0x7faa2c0b2220 2024-09-13T18:57:30.011 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:30.012 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:30.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 msgr2=0x7faa0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 0x7faa0c06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa20006fd0 tx=0x7faa20008040 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 msgr2=0x7faa2c158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c4a0 tx=0x7faa1800c960 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 shutdown_connections 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faa0c06ac00 0x7faa0c06d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa2c0b32d0 0x7faa2c13df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c0b2220 0x7faa2c158760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 --2- 172.21.15.33:0/3332680710 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa2c0b1e40 0x7faa2c13d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 >> 172.21.15.33:0/3332680710 conn(0x7faa2c0b0510 msgr2=0x7faa2c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 shutdown_connections 2024-09-13T18:57:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.011+0000 7faa34200640 1 -- 172.21.15.33:0/3332680710 wait complete. 2024-09-13T18:57:30.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:30.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.187+0000 7fcc96c00640 1 Processor -- start 2024-09-13T18:57:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.187+0000 7fcc96c00640 1 -- start start 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc96c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc90154ad0 0x7fcc900cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc96c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc9006f830 0x7fcc9006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc96c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9006b7c0 con 0x7fcc900ce2c0 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc96c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9006b5b0 con 0x7fcc90154ad0 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc96c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9006baa0 con 0x7fcc9006f830 2024-09-13T18:57:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc8fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc90154ad0 0x7fcc900cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc94c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcc900ce2c0 0x7fcc900cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54094/0 (socket says 172.21.15.33:54094) 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc94c00640 1 -- 172.21.15.33:0/3673384174 learned_addr learned my addr 172.21.15.33:0/3673384174 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.188+0000 7fcc87400640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc9006f830 0x7fcc9006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.189+0000 7fcc8fe00640 1 -- 172.21.15.33:0/3673384174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc9006f830 msgr2=0x7fcc9006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.189+0000 7fcc8fe00640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc9006f830 0x7fcc9006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.189+0000 7fcc8fe00640 1 -- 172.21.15.33:0/3673384174 >> v1:172.21.15.33:6789/0 conn(0x7fcc900ce2c0 legacy=0x7fcc900cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.189+0000 7fcc8fe00640 1 -- 172.21.15.33:0/3673384174 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9006bd80 con 0x7fcc90154ad0 2024-09-13T18:57:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc8fe00640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90154ad0 0x7fcc900cdd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcc800097a0 tx=0x7fcc8002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe7ad0f468bb37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc8f400640 1 -- 172.21.15.33:0/3673384174 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8002ac90 con 0x7fcc90154ad0 2024-09-13T18:57:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc8f400640 1 -- 172.21.15.33:0/3673384174 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8002adf0 con 0x7fcc90154ad0 2024-09-13T18:57:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc8f400640 1 -- 172.21.15.33:0/3673384174 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80032660 con 0x7fcc90154ad0 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 -- 172.21.15.33:0/3673384174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90154ad0 msgr2=0x7fcc900cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90154ad0 0x7fcc900cdd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcc800097a0 tx=0x7fcc8002a000 comp rx=0 tx=0).stop 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 -- 172.21.15.33:0/3673384174 shutdown_connections 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc9006f830 0x7fcc9006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 --2- 172.21.15.33:0/3673384174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90154ad0 0x7fcc900cdd80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.190+0000 7fcc96c00640 1 -- 172.21.15.33:0/3673384174 >> 172.21.15.33:0/3673384174 conn(0x7fcc900b0580 msgr2=0x7fcc900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.191+0000 7fcc96c00640 1 -- 172.21.15.33:0/3673384174 shutdown_connections 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.191+0000 7fcc96c00640 1 -- 172.21.15.33:0/3673384174 wait complete. 2024-09-13T18:57:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.192+0000 7fcc96c00640 1 Processor -- start 2024-09-13T18:57:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.192+0000 7fcc96c00640 1 -- start start 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc90154ad0 0x7fcc901484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 0x7fcc9014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900b3780 con 0x7fcc901595f0 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc90159fb0 con 0x7fcc900b2390 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc96c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9014c790 con 0x7fcc90154ad0 2024-09-13T18:57:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc94c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc94c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35770/0 (socket says 172.21.15.33:35770) 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc94c00640 1 -- 172.21.15.33:0/2445897345 learned_addr learned my addr 172.21.15.33:0/2445897345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.193+0000 7fcc8fe00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc90154ad0 0x7fcc901484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc87400640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 0x7fcc9014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 -- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc90154ad0 msgr2=0x7fcc901484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc90154ad0 0x7fcc901484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 -- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 msgr2=0x7fcc9014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 0x7fcc9014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 -- 172.21.15.33:0/2445897345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009400 con 0x7fcc901595f0 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc87400640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 0x7fcc9014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc94c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800caf0 tx=0x7fcc880020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800a6e0 con 0x7fcc901595f0 2024-09-13T18:57:30.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800a840 con 0x7fcc901595f0 2024-09-13T18:57:30.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800abf0 con 0x7fcc901595f0 2024-09-13T18:57:30.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.194+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900b2b00 con 0x7fcc901595f0 2024-09-13T18:57:30.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.195+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc900b30c0 con 0x7fcc901595f0 2024-09-13T18:57:30.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.195+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc900cdd80 con 0x7fcc901595f0 2024-09-13T18:57:30.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.196+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc8800ad50 con 0x7fcc901595f0 2024-09-13T18:57:30.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.197+0000 7fcc8cc00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 0x7fcc6c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.197+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc880889a0 con 0x7fcc901595f0 2024-09-13T18:57:30.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.198+0000 7fcc8fe00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 0x7fcc6c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.198+0000 7fcc8fe00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 0x7fcc6c06d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc80034000 tx=0x7fcc8002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.202+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc88053b90 con 0x7fcc901595f0 2024-09-13T18:57:30.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.378+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc900cae10 con 0x7fcc901595f0 2024-09-13T18:57:30.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.379+0000 7fcc8cc00640 1 -- 172.21.15.33:0/2445897345 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc88018020 con 0x7fcc901595f0 2024-09-13T18:57:30.381 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 msgr2=0x7fcc6c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 0x7fcc6c06d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc80034000 tx=0x7fcc8002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 msgr2=0x7fcc90159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800caf0 tx=0x7fcc880020b0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 shutdown_connections 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc6c06ac30 0x7fcc6c06d0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc901595f0 0x7fcc90159a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc900b2390 0x7fcc9014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 --2- 172.21.15.33:0/2445897345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc90154ad0 0x7fcc901484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 >> 172.21.15.33:0/2445897345 conn(0x7fcc900b0580 msgr2=0x7fcc900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 shutdown_connections 2024-09-13T18:57:30.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.381+0000 7fcc96c00640 1 -- 172.21.15.33:0/2445897345 wait complete. 2024-09-13T18:57:30.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:30.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.554+0000 7f6397e00640 1 Processor -- start 2024-09-13T18:57:30.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.554+0000 7f6397e00640 1 -- start start 2024-09-13T18:57:30.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.555+0000 7f6397e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6390071690 0x7f639015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.555+0000 7f6397e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63900cafa0 0x7f63900cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.555+0000 7f6397e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639006f5f0 con 0x7f6390156f60 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.555+0000 7f6397e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639015aa30 con 0x7f63900cafa0 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.555+0000 7f6397e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6390070450 con 0x7f6390071690 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63900cafa0 0x7f63900cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63900cafa0 0x7f63900cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35786/0 (socket says 172.21.15.33:35786) 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 -- 172.21.15.33:0/3596201288 learned_addr learned my addr 172.21.15.33:0/3596201288 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6394a00640 1 --2- 172.21.15.33:0/3596201288 >> v2:172.21.15.103:3300/0 conn(0x7f6390071690 0x7f639015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 -- 172.21.15.33:0/3596201288 >> v2:172.21.15.103:3300/0 conn(0x7f6390071690 msgr2=0x7f639015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 --2- 172.21.15.33:0/3596201288 >> v2:172.21.15.103:3300/0 conn(0x7f6390071690 0x7f639015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 -- 172.21.15.33:0/3596201288 >> v1:172.21.15.103:6789/0 conn(0x7f6390156f60 legacy=0x7f6390070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.556+0000 7f6395e00640 1 -- 172.21.15.33:0/3596201288 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639006f840 con 0x7f63900cafa0 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.557+0000 7f6395e00640 1 --2- 172.21.15.33:0/3596201288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f63900cc8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63900b12e0 tx=0x7f638802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ec73d3aba06567 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.557+0000 7f638fe00640 1 -- 172.21.15.33:0/3596201288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388031600 con 0x7f63900cafa0 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.557+0000 7f638fe00640 1 -- 172.21.15.33:0/3596201288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638802d050 con 0x7f63900cafa0 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.557+0000 7f638fe00640 1 -- 172.21.15.33:0/3596201288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388031980 con 0x7f63900cafa0 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 -- 172.21.15.33:0/3596201288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 msgr2=0x7f63900cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 --2- 172.21.15.33:0/3596201288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f63900cc8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63900b12e0 tx=0x7f638802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 -- 172.21.15.33:0/3596201288 shutdown_connections 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 --2- 172.21.15.33:0/3596201288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f63900cc8b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 --2- 172.21.15.33:0/3596201288 >> v2:172.21.15.103:3300/0 conn(0x7f6390071690 0x7f639015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 -- 172.21.15.33:0/3596201288 >> 172.21.15.33:0/3596201288 conn(0x7f63900b0580 msgr2=0x7f63900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 -- 172.21.15.33:0/3596201288 shutdown_connections 2024-09-13T18:57:30.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.558+0000 7f6397e00640 1 -- 172.21.15.33:0/3596201288 wait complete. 2024-09-13T18:57:30.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.560+0000 7f6397e00640 1 Processor -- start 2024-09-13T18:57:30.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.560+0000 7f6397e00640 1 -- start start 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6390071690 0x7f639015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390156f60 0x7f639012c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639015c050 con 0x7f63900cafa0 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639015c330 con 0x7f6390156f60 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6397e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639015c610 con 0x7f6390071690 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35792/0 (socket says 172.21.15.33:35792) 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 -- 172.21.15.33:0/1691235772 learned_addr learned my addr 172.21.15.33:0/1691235772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6395e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390156f60 0x7f639012c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6395400640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6390071690 0x7f639015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 -- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6390071690 msgr2=0x7f639015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6390071690 0x7f639015d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 -- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390156f60 msgr2=0x7f639012c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390156f60 0x7f639012c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.561+0000 7f6394a00640 1 -- 172.21.15.33:0/1691235772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388009b30 con 0x7f63900cafa0 2024-09-13T18:57:30.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f6394a00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d800 tx=0x7f637c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00b6c0 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00b820 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00bbb0 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639015c8f0 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.562+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6390146400 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.563+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63900708c0 con 0x7f63900cafa0 2024-09-13T18:57:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.564+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f637c00bd10 con 0x7f63900cafa0 2024-09-13T18:57:30.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.565+0000 7f638d600640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 0x7f637006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.565+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f637c089820 con 0x7f63900cafa0 2024-09-13T18:57:30.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.566+0000 7f6395400640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 0x7f637006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.567+0000 7f6395400640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 0x7f637006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6384006fd0 tx=0x7f6384009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.570+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f63900708c0 con 0x7f63900cafa0 2024-09-13T18:57:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.747+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63900708c0 con 0x7f63900cafa0 2024-09-13T18:57:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.747+0000 7f638d600640 1 -- 172.21.15.33:0/1691235772 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63900708c0 con 0x7f63900cafa0 2024-09-13T18:57:30.750 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 msgr2=0x7f637006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 0x7f637006d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6384006fd0 tx=0x7f6384009060 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 msgr2=0x7f639012bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d800 tx=0x7f637c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 shutdown_connections 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f637006ac00 0x7f637006d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390156f60 0x7f639012c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63900cafa0 0x7f639012bbd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 --2- 172.21.15.33:0/1691235772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6390071690 0x7f639015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 >> 172.21.15.33:0/1691235772 conn(0x7f63900b0580 msgr2=0x7f63900af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 shutdown_connections 2024-09-13T18:57:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.749+0000 7f6397e00640 1 -- 172.21.15.33:0/1691235772 wait complete. 2024-09-13T18:57:30.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.922+0000 7f5b06800640 1 Processor -- start 2024-09-13T18:57:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.922+0000 7f5b06800640 1 -- start start 2024-09-13T18:57:30.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.923+0000 7f5b06800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b00154ad0 0x7f5b000cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.923+0000 7f5b06800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b000ce2c0 0x7f5b000cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.923+0000 7f5b06800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0006b7c0 con 0x7f5b0006f830 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.923+0000 7f5b06800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0006b5b0 con 0x7f5b000ce2c0 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.923+0000 7f5b06800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0006baa0 con 0x7f5b00154ad0 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b000ce2c0 0x7f5b000cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b000ce2c0 0x7f5b000cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35800/0 (socket says 172.21.15.33:35800) 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 -- 172.21.15.33:0/1463122695 learned_addr learned my addr 172.21.15.33:0/1463122695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5aff400640 1 --2- 172.21.15.33:0/1463122695 >> v2:172.21.15.103:3300/0 conn(0x7f5b00154ad0 0x7f5b000cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 -- 172.21.15.33:0/1463122695 >> v2:172.21.15.103:3300/0 conn(0x7f5b00154ad0 msgr2=0x7f5b000cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:30.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 --2- 172.21.15.33:0/1463122695 >> v2:172.21.15.103:3300/0 conn(0x7f5b00154ad0 0x7f5b000cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 -- 172.21.15.33:0/1463122695 >> v1:172.21.15.103:6789/0 conn(0x7f5b0006f830 legacy=0x7f5b0006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.924+0000 7f5affe00640 1 -- 172.21.15.33:0/1463122695 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0006bd80 con 0x7f5b000ce2c0 2024-09-13T18:57:30.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.925+0000 7f5affe00640 1 --2- 172.21.15.33:0/1463122695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000ce2c0 0x7f5b000cbac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b000b1340 tx=0x7f5af802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6406474d204eb21a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.925+0000 7f5afea00640 1 -- 172.21.15.33:0/1463122695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8031600 con 0x7f5b000ce2c0 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.925+0000 7f5afea00640 1 -- 172.21.15.33:0/1463122695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af802d050 con 0x7f5b000ce2c0 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.925+0000 7f5afea00640 1 -- 172.21.15.33:0/1463122695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8031980 con 0x7f5b000ce2c0 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 -- 172.21.15.33:0/1463122695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000ce2c0 msgr2=0x7f5b000cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 --2- 172.21.15.33:0/1463122695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000ce2c0 0x7f5b000cbac0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b000b1340 tx=0x7f5af802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 -- 172.21.15.33:0/1463122695 shutdown_connections 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 --2- 172.21.15.33:0/1463122695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000ce2c0 0x7f5b000cbac0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 --2- 172.21.15.33:0/1463122695 >> v2:172.21.15.103:3300/0 conn(0x7f5b00154ad0 0x7f5b000cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 -- 172.21.15.33:0/1463122695 >> 172.21.15.33:0/1463122695 conn(0x7f5b000b0580 msgr2=0x7f5b000b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 -- 172.21.15.33:0/1463122695 shutdown_connections 2024-09-13T18:57:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.926+0000 7f5b06800640 1 -- 172.21.15.33:0/1463122695 wait complete. 2024-09-13T18:57:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.927+0000 7f5b06800640 1 Processor -- start 2024-09-13T18:57:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 -- start start 2024-09-13T18:57:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 0x7f5b00147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b000afb30 0x7f5b001f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000affb0 con 0x7f5b000b32a0 2024-09-13T18:57:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b001464d0 con 0x7f5b00154ad0 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.928+0000 7f5b06800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b001f3330 con 0x7f5b000afb30 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35812/0 (socket says 172.21.15.33:35812) 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 -- 172.21.15.33:0/165577603 learned_addr learned my addr 172.21.15.33:0/165577603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5affe00640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b000afb30 0x7f5b001f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5aff400640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 0x7f5b00147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 -- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b000afb30 msgr2=0x7f5b001f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b000afb30 0x7f5b001f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 -- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 msgr2=0x7f5b00147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 0x7f5b00147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 -- 172.21.15.33:0/165577603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8009b30 con 0x7f5b000b32a0 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5aff400640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 0x7f5b00147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:30.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.929+0000 7f5af7e00640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c450 tx=0x7f5ae800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.930+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80052d0 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.930+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8005430 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.930+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8012870 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.930+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b00146790 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.930+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00146d50 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.931+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b000703d0 con 0x7f5b000b32a0 2024-09-13T18:57:30.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.932+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ae80129d0 con 0x7f5b000b32a0 2024-09-13T18:57:30.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.933+0000 7f5af7400640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 0x7f5adc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:30.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.933+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ae8088e10 con 0x7f5b000b32a0 2024-09-13T18:57:30.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.933+0000 7f5aff400640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 0x7f5adc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:30.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.934+0000 7f5aff400640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 0x7f5adc06d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b0015ede0 tx=0x7f5af0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:30.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:30.937+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5ae8053ff0 con 0x7f5b000b32a0 2024-09-13T18:57:31.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.114+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b000cdd80 con 0x7f5b000b32a0 2024-09-13T18:57:31.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.115+0000 7f5af7400640 1 -- 172.21.15.33:0/165577603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ae8057610 con 0x7f5b000b32a0 2024-09-13T18:57:31.117 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 msgr2=0x7f5adc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 0x7f5adc06d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b0015ede0 tx=0x7f5af0008040 comp rx=0 tx=0).stop 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 msgr2=0x7f5b000af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c450 tx=0x7f5ae800c910 comp rx=0 tx=0).stop 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 shutdown_connections 2024-09-13T18:57:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5adc06ac30 0x7f5adc06d0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b000afb30 0x7f5b001f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b000b32a0 0x7f5b000af5f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 --2- 172.21.15.33:0/165577603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b00154ad0 0x7f5b00147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 >> 172.21.15.33:0/165577603 conn(0x7f5b000b0580 msgr2=0x7f5b000ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 shutdown_connections 2024-09-13T18:57:31.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.117+0000 7f5b06800640 1 -- 172.21.15.33:0/165577603 wait complete. 2024-09-13T18:57:31.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:57:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.290+0000 7f01cbe00640 1 Processor -- start 2024-09-13T18:57:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.290+0000 7f01cbe00640 1 -- start start 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01cbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01cbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f01cc06f4b0 0x7f01cc070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01cbe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc0717c0 con 0x7f01cc071390 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01cbe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0cd850 con 0x7f01cc06f4b0 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01cbe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0cd570 con 0x7f01cc159480 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01c2000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f01cc06f4b0 0x7f01cc070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01c2000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f01cc06f4b0 0x7f01cc070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35814/0 (socket says 172.21.15.33:35814) 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01c2000640 1 -- 172.21.15.33:0/484930856 learned_addr learned my addr 172.21.15.33:0/484930856 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.291+0000 7f01caa00640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.292+0000 7f01c2000640 1 -- 172.21.15.33:0/484930856 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 msgr2=0x7f01cc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.292+0000 7f01c2000640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.292+0000 7f01c2000640 1 -- 172.21.15.33:0/484930856 >> v1:172.21.15.103:6789/0 conn(0x7f01cc071390 legacy=0x7f01cc15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.292+0000 7f01c2000640 1 -- 172.21.15.33:0/484930856 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0b1740 con 0x7f01cc06f4b0 2024-09-13T18:57:31.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01c2000640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc070e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009870 tx=0x7f01b402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6d152fd3600fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01ca000640 1 -- 172.21.15.33:0/484930856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4032440 con 0x7f01cc06f4b0 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01ca000640 1 -- 172.21.15.33:0/484930856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b40325a0 con 0x7f01cc06f4b0 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01ca000640 1 -- 172.21.15.33:0/484930856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4032930 con 0x7f01cc06f4b0 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 -- 172.21.15.33:0/484930856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 msgr2=0x7f01cc070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc070e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009870 tx=0x7f01b402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 -- 172.21.15.33:0/484930856 shutdown_connections 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc070e50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 --2- 172.21.15.33:0/484930856 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.293+0000 7f01cbe00640 1 -- 172.21.15.33:0/484930856 >> 172.21.15.33:0/484930856 conn(0x7f01cc0ae310 msgr2=0x7f01cc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:31.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.294+0000 7f01cbe00640 1 -- 172.21.15.33:0/484930856 shutdown_connections 2024-09-13T18:57:31.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.294+0000 7f01cbe00640 1 -- 172.21.15.33:0/484930856 wait complete. 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.295+0000 7f01cbe00640 1 Processor -- start 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.295+0000 7f01cbe00640 1 -- start start 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01cc071390 0x7f01cc147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc14d740 con 0x7f01cc06f4b0 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc14e0a0 con 0x7f01cc071390 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01cbe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc14cac0 con 0x7f01cc159480 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01caa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01caa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35820/0 (socket says 172.21.15.33:35820) 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.296+0000 7f01caa00640 1 -- 172.21.15.33:0/1666144854 learned_addr learned my addr 172.21.15.33:0/1666144854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01c2000640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01cc071390 0x7f01cc147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01cb400640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 -- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 msgr2=0x7f01cc1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc1507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 -- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01cc071390 msgr2=0x7f01cc147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01cc071390 0x7f01cc147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 -- 172.21.15.33:0/1666144854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40094d0 con 0x7f01cc06f4b0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01caa00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d5f0 tx=0x7f01bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0125f0 con 0x7f01cc06f4b0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc012750 con 0x7f01cc06f4b0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012b00 con 0x7f01cc06f4b0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc14cda0 con 0x7f01cc06f4b0 2024-09-13T18:57:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.297+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc14d360 con 0x7f01cc06f4b0 2024-09-13T18:57:31.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.298+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc067360 con 0x7f01cc06f4b0 2024-09-13T18:57:31.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.299+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f01bc012c60 con 0x7f01cc06f4b0 2024-09-13T18:57:31.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.300+0000 7f01c3e00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.300+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01bc089970 con 0x7f01cc06f4b0 2024-09-13T18:57:31.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.301+0000 7f01c2000640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.301+0000 7f01c2000640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f01b4034000 tx=0x7f01b402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.304+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01bc054a20 con 0x7f01cc06f4b0 2024-09-13T18:57:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.523+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01cc14d4f0 con 0x7f01cc06f4b0 2024-09-13T18:57:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.523+0000 7f01c3e00640 1 -- 172.21.15.33:0/1666144854 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f01bc058040 con 0x7f01cc06f4b0 2024-09-13T18:57:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:31.526 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:57:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.525+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 msgr2=0x7f01a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.525+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f01b4034000 tx=0x7f01b402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 msgr2=0x7f01cc14db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d5f0 tx=0x7f01bc00dab0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 shutdown_connections 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01cc159480 0x7f01cc1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01cc071390 0x7f01cc147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 --2- 172.21.15.33:0/1666144854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01cc06f4b0 0x7f01cc14db60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 >> 172.21.15.33:0/1666144854 conn(0x7f01cc0ae310 msgr2=0x7f01cc156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 shutdown_connections 2024-09-13T18:57:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.526+0000 7f01cbe00640 1 -- 172.21.15.33:0/1666144854 wait complete. 2024-09-13T18:57:31.544 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:31.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.696+0000 7f2178000640 1 Processor -- start 2024-09-13T18:57:31.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.696+0000 7f2178000640 1 -- start start 2024-09-13T18:57:31.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2178000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f217015a520 0x7f217006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2178000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 0x7f21700cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2178000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217006bc00 con 0x7f21700cde50 2024-09-13T18:57:31.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2178000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217006bea0 con 0x7f217015a520 2024-09-13T18:57:31.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2178000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217006c180 con 0x7f21700b1b00 2024-09-13T18:57:31.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2175600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f217015a520 0x7f217006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2176000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21700cde50 0x7f21700b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54100/0 (socket says 172.21.15.33:54100) 2024-09-13T18:57:31.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2176000640 1 -- 172.21.15.33:0/1368661418 learned_addr learned my addr 172.21.15.33:0/1368661418 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:31.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.697+0000 7f2174c00640 1 --2- 172.21.15.33:0/1368661418 >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 0x7f21700cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f2175600640 1 -- 172.21.15.33:0/1368661418 >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 msgr2=0x7f21700cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:31.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f2175600640 1 --2- 172.21.15.33:0/1368661418 >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 0x7f21700cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f2175600640 1 -- 172.21.15.33:0/1368661418 >> v1:172.21.15.33:6789/0 conn(0x7f21700cde50 legacy=0x7f21700b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f2175600640 1 -- 172.21.15.33:0/1368661418 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217006c460 con 0x7f217015a520 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f216fe00640 1 -- 172.21.15.33:0/1368661418 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476860633 0 0) 0x7f217006bc00 con 0x7f21700cde50 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.698+0000 7f2174c00640 1 --2- 172.21.15.33:0/1368661418 >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 0x7f21700cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.699+0000 7f2175600640 1 --2- 172.21.15.33:0/1368661418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f217015a520 0x7f217006b6c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f217006dad0 tx=0x7f216402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae25f385c2c3cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.699+0000 7f216fe00640 1 -- 172.21.15.33:0/1368661418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164032440 con 0x7f217015a520 2024-09-13T18:57:31.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.699+0000 7f216fe00640 1 -- 172.21.15.33:0/1368661418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21640325a0 con 0x7f217015a520 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.699+0000 7f216fe00640 1 -- 172.21.15.33:0/1368661418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164032930 con 0x7f217015a520 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 -- 172.21.15.33:0/1368661418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f217015a520 msgr2=0x7f217006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 --2- 172.21.15.33:0/1368661418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f217015a520 0x7f217006b6c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f217006dad0 tx=0x7f216402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 -- 172.21.15.33:0/1368661418 shutdown_connections 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 --2- 172.21.15.33:0/1368661418 >> v2:172.21.15.103:3300/0 conn(0x7f21700b1b00 0x7f21700cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 --2- 172.21.15.33:0/1368661418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f217015a520 0x7f217006b6c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 -- 172.21.15.33:0/1368661418 >> 172.21.15.33:0/1368661418 conn(0x7f21700b0510 msgr2=0x7f21700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:31.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 -- 172.21.15.33:0/1368661418 shutdown_connections 2024-09-13T18:57:31.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.700+0000 7f2178000640 1 -- 172.21.15.33:0/1368661418 wait complete. 2024-09-13T18:57:31.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.702+0000 7f2178000640 1 Processor -- start 2024-09-13T18:57:31.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.702+0000 7f2178000640 1 -- start start 2024-09-13T18:57:31.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 0x7f2170150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f217015a520 0x7f2170158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2170150340 con 0x7f21700cde50 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2170150ca0 con 0x7f21700b1b00 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2178000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2170148480 con 0x7f217015a520 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35846/0 (socket says 172.21.15.33:35846) 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 -- 172.21.15.33:0/2507719378 learned_addr learned my addr 172.21.15.33:0/2507719378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2175600640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 0x7f2170150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2176000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f217015a520 0x7f2170158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 -- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f217015a520 msgr2=0x7f2170158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f217015a520 0x7f2170158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 -- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 msgr2=0x7f2170150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 0x7f2170150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2174c00640 1 -- 172.21.15.33:0/2507719378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009400 con 0x7f21700cde50 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.703+0000 7f2175600640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 0x7f2170150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f2174c00640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e7e0 tx=0x7f215c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004030 con 0x7f21700cde50 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c004190 con 0x7f21700cde50 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004520 con 0x7f21700cde50 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217014f9a0 con 0x7f21700cde50 2024-09-13T18:57:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.704+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217014ff60 con 0x7f21700cde50 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.705+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700cd910 con 0x7f21700cde50 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.706+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f215c00c6d0 con 0x7f21700cde50 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.707+0000 7f216d600640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 0x7f215006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.707+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f215c089090 con 0x7f21700cde50 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.708+0000 7f2175600640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 0x7f215006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.708+0000 7f2175600640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 0x7f215006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2164034000 tx=0x7f216402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.711+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f215c054260 con 0x7f21700cde50 2024-09-13T18:57:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.890+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21700cbe60 con 0x7f21700cde50 2024-09-13T18:57:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.891+0000 7f216d600640 1 -- 172.21.15.33:0/2507719378 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f215c057880 con 0x7f21700cde50 2024-09-13T18:57:31.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:31.894 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 msgr2=0x7f215006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 0x7f215006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2164034000 tx=0x7f216402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 msgr2=0x7f2170147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e7e0 tx=0x7f215c00eca0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 shutdown_connections 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f215006ac00 0x7f215006d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f217015a520 0x7f2170158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21700cde50 0x7f2170147f40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 --2- 172.21.15.33:0/2507719378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21700b1b00 0x7f2170150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:31.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.893+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 >> 172.21.15.33:0/2507719378 conn(0x7f21700b0510 msgr2=0x7f2170157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:31.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.894+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 shutdown_connections 2024-09-13T18:57:31.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:31.894+0000 7f2178000640 1 -- 172.21.15.33:0/2507719378 wait complete. 2024-09-13T18:57:31.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:57:32.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.065+0000 7fe749400640 1 Processor -- start 2024-09-13T18:57:32.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.065+0000 7fe749400640 1 -- start start 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74415a520 0x7fe74406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7440b1b00 0x7fe7440cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 0x7fe7440b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74406bc00 con 0x7fe7440b1b00 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74406bea0 con 0x7fe74415a520 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe749400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74406c180 con 0x7fe7440cde50 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe73be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7440b1b00 0x7fe7440cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe73be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7440b1b00 0x7fe7440cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35856/0 (socket says 172.21.15.33:35856) 2024-09-13T18:57:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe73be00640 1 -- 172.21.15.33:0/352956269 learned_addr learned my addr 172.21.15.33:0/352956269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe743200640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 0x7fe7440b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.066+0000 7fe742800640 1 --2- 172.21.15.33:0/352956269 >> v2:172.21.15.103:3300/0 conn(0x7fe74415a520 0x7fe74406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe73be00640 1 -- 172.21.15.33:0/352956269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 msgr2=0x7fe7440b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe73be00640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 0x7fe7440b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe73be00640 1 -- 172.21.15.33:0/352956269 >> v2:172.21.15.103:3300/0 conn(0x7fe74415a520 msgr2=0x7fe74406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe73be00640 1 --2- 172.21.15.33:0/352956269 >> v2:172.21.15.103:3300/0 conn(0x7fe74415a520 0x7fe74406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe73be00640 1 -- 172.21.15.33:0/352956269 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74406c460 con 0x7fe7440b1b00 2024-09-13T18:57:32.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.067+0000 7fe743200640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 0x7fe7440b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:32.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe73be00640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7440cd910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7440b14f0 tx=0x7fe72c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3af070ea137cee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe741e00640 1 -- 172.21.15.33:0/352956269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c032440 con 0x7fe7440b1b00 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe741e00640 1 -- 172.21.15.33:0/352956269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0325a0 con 0x7fe7440b1b00 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe741e00640 1 -- 172.21.15.33:0/352956269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c032930 con 0x7fe7440b1b00 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 -- 172.21.15.33:0/352956269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 msgr2=0x7fe7440cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7440cd910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7440b14f0 tx=0x7fe72c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 -- 172.21.15.33:0/352956269 shutdown_connections 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe7440cde50 0x7fe7440b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 --2- 172.21.15.33:0/352956269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7440cd910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 --2- 172.21.15.33:0/352956269 >> v2:172.21.15.103:3300/0 conn(0x7fe74415a520 0x7fe74406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.068+0000 7fe749400640 1 -- 172.21.15.33:0/352956269 >> 172.21.15.33:0/352956269 conn(0x7fe7440b0510 msgr2=0x7fe7440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.069+0000 7fe749400640 1 -- 172.21.15.33:0/352956269 shutdown_connections 2024-09-13T18:57:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.069+0000 7fe749400640 1 -- 172.21.15.33:0/352956269 wait complete. 2024-09-13T18:57:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.070+0000 7fe749400640 1 Processor -- start 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.070+0000 7fe749400640 1 -- start start 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7440cde50 0x7fe7440ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe74415a520 0x7fe74415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74415c0e0 con 0x7fe7440b1b00 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74415cf00 con 0x7fe7440cde50 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe749400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74415d390 con 0x7fe74415a520 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe742800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe742800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35862/0 (socket says 172.21.15.33:35862) 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.071+0000 7fe742800640 1 -- 172.21.15.33:0/3345895326 learned_addr learned my addr 172.21.15.33:0/3345895326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe743200640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe74415a520 0x7fe74415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe73be00640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7440cde50 0x7fe7440ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 -- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe74415a520 msgr2=0x7fe74415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe74415a520 0x7fe74415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 -- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7440cde50 msgr2=0x7fe7440ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7440cde50 0x7fe7440ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 -- 172.21.15.33:0/3345895326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0094d0 con 0x7fe7440b1b00 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe742800640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe73400d5f0 tx=0x7fe73400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7340125f0 con 0x7fe7440b1b00 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734012750 con 0x7fe7440b1b00 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734012b00 con 0x7fe7440b1b00 2024-09-13T18:57:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74415c2f0 con 0x7fe7440b1b00 2024-09-13T18:57:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.072+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74415c8b0 con 0x7fe7440b1b00 2024-09-13T18:57:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.073+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74406aa40 con 0x7fe7440b1b00 2024-09-13T18:57:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.074+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe734012c60 con 0x7fe7440b1b00 2024-09-13T18:57:32.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.075+0000 7fe73aa00640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.075+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7340898e0 con 0x7fe7440b1b00 2024-09-13T18:57:32.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.075+0000 7fe73be00640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.076+0000 7fe73be00640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 0x7fe72006d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe72c034000 tx=0x7fe72c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.080+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe734054a20 con 0x7fe7440b1b00 2024-09-13T18:57:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.294+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7440cd910 con 0x7fe7440b1b00 2024-09-13T18:57:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.295+0000 7fe73aa00640 1 -- 172.21.15.33:0/3345895326 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fe734058040 con 0x7fe7440b1b00 2024-09-13T18:57:32.297 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:32.297 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:57:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.296+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 msgr2=0x7fe72006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.296+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 0x7fe72006d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe72c034000 tx=0x7fe72c02e000 comp rx=0 tx=0).stop 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.296+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 msgr2=0x7fe7441e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.296+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe73400d5f0 tx=0x7fe73400dab0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 shutdown_connections 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe74415a520 0x7fe74415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7440cde50 0x7fe7440ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 --2- 172.21.15.33:0/3345895326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440b1b00 0x7fe7441e2dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 >> 172.21.15.33:0/3345895326 conn(0x7fe7440b0510 msgr2=0x7fe744159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 shutdown_connections 2024-09-13T18:57:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.297+0000 7fe749400640 1 -- 172.21.15.33:0/3345895326 wait complete. 2024-09-13T18:57:32.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:57:13.481646+0000', 'modified': '2024-09-13T18:57:16.493197+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6837/2996407679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 2996407679}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 2996407679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:57:32.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:57:32.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:57:32.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.871+0000 7f70bc000640 1 Processor -- start 2024-09-13T18:57:32.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.871+0000 7f70bc000640 1 -- start start 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70bc000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40b2850 0x7f70b40b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70bc000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b40d26d0 0x7f70b40d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70bc000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b40d0a10 con 0x7f70b415ca90 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70bc000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40b31d0 con 0x7f70b40d26d0 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70bc000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40d30c0 con 0x7f70b40b2850 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70ba000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b40d26d0 0x7f70b40d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70b9600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f70b415ca90 0x7f70b40cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58936/0 (socket says 172.21.15.33:58936) 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70b9600640 1 -- 172.21.15.33:0/2764741211 learned_addr learned my addr 172.21.15.33:0/2764741211 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.872+0000 7f70b8c00640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40b2850 0x7f70b40b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.873+0000 7f70ba000640 1 -- 172.21.15.33:0/2764741211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40b2850 msgr2=0x7f70b40b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.873+0000 7f70ba000640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40b2850 0x7f70b40b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.873+0000 7f70ba000640 1 -- 172.21.15.33:0/2764741211 >> v1:172.21.15.33:6789/0 conn(0x7f70b415ca90 legacy=0x7f70b40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.873+0000 7f70ba000640 1 -- 172.21.15.33:0/2764741211 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40b3980 con 0x7f70b40d26d0 2024-09-13T18:57:32.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.873+0000 7f70b3e00640 1 -- 172.21.15.33:0/2764741211 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656295006 0 0) 0x7f70b40d0a10 con 0x7f70b415ca90 2024-09-13T18:57:32.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.874+0000 7f70ba000640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40d26d0 0x7f70b40d2b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009d90 tx=0x7f70ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f842336fbd058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.874+0000 7f70b3e00640 1 -- 172.21.15.33:0/2764741211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac031600 con 0x7f70b40d26d0 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.874+0000 7f70b3e00640 1 -- 172.21.15.33:0/2764741211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac02d050 con 0x7f70b40d26d0 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.874+0000 7f70b3e00640 1 -- 172.21.15.33:0/2764741211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac031980 con 0x7f70b40d26d0 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 -- 172.21.15.33:0/2764741211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40d26d0 msgr2=0x7f70b40d2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40d26d0 0x7f70b40d2b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009d90 tx=0x7f70ac02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 -- 172.21.15.33:0/2764741211 shutdown_connections 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40b2850 0x7f70b40b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 --2- 172.21.15.33:0/2764741211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40d26d0 0x7f70b40d2b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 -- 172.21.15.33:0/2764741211 >> 172.21.15.33:0/2764741211 conn(0x7f70b408bf90 msgr2=0x7f70b408c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 -- 172.21.15.33:0/2764741211 shutdown_connections 2024-09-13T18:57:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.875+0000 7f70bc000640 1 -- 172.21.15.33:0/2764741211 wait complete. 2024-09-13T18:57:32.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.876+0000 7f70bc000640 1 Processor -- start 2024-09-13T18:57:32.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.876+0000 7f70bc000640 1 -- start start 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 0x7f70b415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 0x7f70b415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41f4c90 con 0x7f70b40b2850 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41f4080 con 0x7f70b415ca90 2024-09-13T18:57:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70bc000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41f4360 con 0x7f70b40d26d0 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.877+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45108/0 (socket says 172.21.15.33:45108) 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 -- 172.21.15.33:0/4273297927 learned_addr learned my addr 172.21.15.33:0/4273297927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70ba000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 0x7f70b415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 0x7f70b415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 -- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 msgr2=0x7f70b415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 0x7f70b415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 -- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 msgr2=0x7f70b415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 0x7f70b415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 -- 172.21.15.33:0/4273297927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009a70 con 0x7f70b40b2850 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 0x7f70b415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70ba000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 0x7f70b415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:32.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b9600640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c4d0 tx=0x7f70a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b1600640 1 -- 172.21.15.33:0/4273297927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80074e0 con 0x7f70b40b2850 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b1600640 1 -- 172.21.15.33:0/4273297927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8007660 con 0x7f70b40b2850 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.878+0000 7f70b1600640 1 -- 172.21.15.33:0/4273297927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8004a20 con 0x7f70b40b2850 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.879+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b41f4640 con 0x7f70b40b2850 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.879+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b41f3be0 con 0x7f70b40b2850 2024-09-13T18:57:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.881+0000 7f70b1600640 1 -- 172.21.15.33:0/4273297927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f70a8004b80 con 0x7f70b40b2850 2024-09-13T18:57:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.881+0000 7f70b1600640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 0x7f709406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.882+0000 7f70b1600640 1 -- 172.21.15.33:0/4273297927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a8088490 con 0x7f70b40b2850 2024-09-13T18:57:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.882+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 0x7f709406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.882+0000 7f70bee29740 1 Processor -- start 2024-09-13T18:57:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.882+0000 7f70bee29740 1 -- start start 2024-09-13T18:57:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 0x7f709406d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b7e70 tx=0x7f70a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfa7e90 0x55807bff7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bff80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807bf13ab0 con 0x55807bfaa6d0 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807bf11240 con 0x55807bfd1b80 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55807bf0cb30 con 0x55807bfa7e90 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45118/0 (socket says 172.21.15.33:45118) 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70b9600640 1 -- 172.21.15.33:0/3062699911 learned_addr learned my addr 172.21.15.33:0/3062699911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70b8c00640 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfa7e90 0x55807bff7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.883+0000 7f70ba000640 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bff80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 -- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfa7e90 msgr2=0x55807bff7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfa7e90 0x55807bff7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 -- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 msgr2=0x55807bff80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bff80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 -- 172.21.15.33:0/3062699911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55807bed7bd0 con 0x55807bfaa6d0 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70b9600640 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70a805f280 tx=0x7f70a80010e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5102f60df282ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70a6000640 1 -- 172.21.15.33:0/3062699911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a805f7b0 con 0x55807bfaa6d0 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70a6000640 1 -- 172.21.15.33:0/3062699911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8055760 con 0x55807bfaa6d0 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.884+0000 7f70a6000640 1 -- 172.21.15.33:0/3062699911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80880e0 con 0x55807bfaa6d0 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 -- 172.21.15.33:0/3062699911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 msgr2=0x55807bfaaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70a805f280 tx=0x7f70a80010e0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 -- 172.21.15.33:0/3062699911 shutdown_connections 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bff80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfa7e90 0x55807bff7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 --2- 172.21.15.33:0/3062699911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfaaab0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 -- 172.21.15.33:0/3062699911 >> 172.21.15.33:0/3062699911 conn(0x55807bfa6e00 msgr2=0x55807bfef2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 -- 172.21.15.33:0/3062699911 shutdown_connections 2024-09-13T18:57:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.885+0000 7f70bee29740 1 -- 172.21.15.33:0/3062699911 wait complete. 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.886+0000 7f70bee29740 1 -- start start 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.886+0000 7f70bee29740 1 Processor -- start 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bfd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807bff4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807beae260 con 0x55807bfaa6d0 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807beadf00 con 0x55807bfd1b80 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55807bc73f20 con 0x55807bfd3800 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70bee29740 10 client.0 _ll_register_callbacks cb 0x55807bf061a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45130/0 (socket says 172.21.15.33:45130) 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 -- 172.21.15.33:0/4029958975 learned_addr learned my addr 172.21.15.33:0/4029958975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bfd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70ba000640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807bff4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 -- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 msgr2=0x55807bff4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807bff4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 -- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 msgr2=0x55807bfd32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bfd32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.887+0000 7f70b9600640 1 -- 172.21.15.33:0/4029958975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b41f3be0 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70b9600640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ce90 tx=0x7f70a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bafed8f276b8872 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8072070 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a805f7b0 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55807bf36cd0 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70a8085070 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70bee29740 10 client.4653 fetch_fsmap learned FSMap version 8 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55807bf0b1b0 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55807bf36cd0 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f70a805f320 con 0x55807bfaa6d0 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70bee29740 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.888+0000 7f70bee29740 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:57:32.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70bee29740 20 client.4653 populate_metadata read hostname 'smithi033' 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bfd0480 0x55807c00c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70bee29740 4 client.4653 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 --> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55807bc003c0 con 0x55807bfd0480 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bfd0480 0x55807c00c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f70b8c00640 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bfd0480 0x55807c00c200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c169fe9425eca9aa server_cookie=8d9e2a545f63d6bc in_seq=0 out_seq=0 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.889+0000 7f709aa00640 10 client.4653 ms_handle_connect on v2:172.21.15.103:6835/2996407679 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.890+0000 7f709aa00640 1 -- 172.21.15.33:0/4029958975 <== mds.0 v2:172.21.15.103:6835/2996407679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55807bc003c0 con 0x55807bfd0480 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.890+0000 7f709aa00640 10 client.4653 handle_command_reply: tid=0 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.890+0000 7f70bee29740 1 client.4653 shutdown 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 msgr2=0x55807bfd5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ce90 tx=0x7f70a8000ed0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 shutdown_connections 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bfd0480 0x55807c00c200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807bff4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd1b80 0x55807bfd32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 --2- 172.21.15.33:0/4029958975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfaa6d0 0x55807bfd5660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 >> 172.21.15.33:0/4029958975 conn(0x55807bfa7e90 msgr2=0x55807bfee8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f709aa00640 0 client.4653 ms_handle_reset on v2:172.21.15.103:6835/2996407679 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 shutdown_connections 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 1 -- 172.21.15.33:0/4029958975 wait complete. 2024-09-13T18:57:32.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.891+0000 7f70bee29740 20 client.4653 trim_cache size 0 max 16384 2024-09-13T18:57:32.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.907+0000 7f70bee29740 1 Processor -- start 2024-09-13T18:57:32.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.907+0000 7f70bee29740 1 -- start start 2024-09-13T18:57:32.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfaa6d0 0x55807bfec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807c00e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807bfd4330 con 0x55807bfd1b80 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807bfec5d0 con 0x55807bfaa6d0 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55807bfa7cd0 con 0x55807bfd3800 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45142/0 (socket says 172.21.15.33:45142) 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 -- 172.21.15.33:0/3422087274 learned_addr learned my addr 172.21.15.33:0/3422087274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 -- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 msgr2=0x55807c00e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807c00e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 -- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfaa6d0 msgr2=0x55807bfec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfaa6d0 0x55807bfec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 -- 172.21.15.33:0/3422087274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55807bead470 con 0x55807bfd1b80 2024-09-13T18:57:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.908+0000 7f70b8c00640 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70b41efc30 tx=0x7f70a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8cbcc6bb4926e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70a6a00640 1 -- 172.21.15.33:0/3422087274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0029070 con 0x55807bfd1b80 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70a6a00640 1 -- 172.21.15.33:0/3422087274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0015840 con 0x55807bfd1b80 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70a6a00640 1 -- 172.21.15.33:0/3422087274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0015bb0 con 0x55807bfd1b80 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 -- 172.21.15.33:0/3422087274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 msgr2=0x55807bfec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70b41efc30 tx=0x7f70a0013000 comp rx=0 tx=0).stop 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 -- 172.21.15.33:0/3422087274 shutdown_connections 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfd3800 0x55807c00e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807bfec090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 --2- 172.21.15.33:0/3422087274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfaa6d0 0x55807bfec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 -- 172.21.15.33:0/3422087274 >> 172.21.15.33:0/3422087274 conn(0x55807bfa7e90 msgr2=0x55807bfd6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 -- 172.21.15.33:0/3422087274 shutdown_connections 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.909+0000 7f70bee29740 1 -- 172.21.15.33:0/3422087274 wait complete. 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.910+0000 7f70bee29740 1 -- start start 2024-09-13T18:57:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.910+0000 7f70bee29740 1 Processor -- start 2024-09-13T18:57:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfaa6d0 0x55807bfeaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 0x55807bff01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807bff3300 con 0x55807bfd1b80 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807c001b10 con 0x55807bfd3800 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55807bff0ba0 con 0x55807bfaa6d0 2024-09-13T18:57:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70bee29740 10 client.0 _ll_register_callbacks cb 0x7f70a0009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70b8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70b8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45146/0 (socket says 172.21.15.33:45146) 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.911+0000 7f70b8c00640 1 -- 172.21.15.33:0/393051984 learned_addr learned my addr 172.21.15.33:0/393051984 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b9600640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfaa6d0 0x55807bfeaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70ba000640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 0x55807bff01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 -- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfaa6d0 msgr2=0x55807bfeaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfaa6d0 0x55807bfeaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 -- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 msgr2=0x55807bff01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 0x55807bff01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 -- 172.21.15.33:0/393051984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a000e050 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70ba000640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 0x55807bff01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70b8c00640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70a0008010 tx=0x7f70a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9b73aeef25d5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f709aa00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0029040 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a002a250 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70a8055760 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70a002a410 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70bee29740 10 client.4659 fetch_fsmap learned FSMap version 8 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.912+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55807bed2980 con 0x55807bfd1b80 2024-09-13T18:57:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8055760 con 0x55807bfd1b80 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f70a0032050 con 0x55807bfd1b80 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 20 client.4659 populate_metadata read hostname 'smithi033' 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bff06f0 0x55807bfcc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 4 client.4659 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 --> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55807bc116c0 con 0x55807bff06f0 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.913+0000 7f70b9600640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bff06f0 0x55807bfcc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f709aa00640 10 client.4659 ms_handle_connect on v2:172.21.15.103:6835/2996407679 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70b9600640 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bff06f0 0x55807bfcc5a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eafc1bceef3716a server_cookie=bf6edbb2107aaaa7 in_seq=0 out_seq=0 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f709aa00640 1 -- 172.21.15.33:0/393051984 <== mds.0 v2:172.21.15.103:6835/2996407679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55807bc116c0 con 0x55807bff06f0 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f709aa00640 10 client.4659 handle_command_reply: tid=0 2024-09-13T18:57:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 client.4659 shutdown 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 msgr2=0x55807c05b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70a0008010 tx=0x7f70a00046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 shutdown_connections 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:6835/2996407679,v1:172.21.15.103:6837/2996407679] conn(0x55807bff06f0 0x55807bfcc5a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55807bfd3800 0x55807bff01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55807bfd1b80 0x55807c05b8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 --2- 172.21.15.33:0/393051984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55807bfaa6d0 0x55807bfeaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f709aa00640 0 client.4659 ms_handle_reset on v2:172.21.15.103:6835/2996407679 2024-09-13T18:57:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 >> 172.21.15.33:0/393051984 conn(0x55807bfa7e90 msgr2=0x55807bff3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 shutdown_connections 2024-09-13T18:57:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 1 -- 172.21.15.33:0/393051984 wait complete. 2024-09-13T18:57:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.914+0000 7f70bee29740 20 client.4659 trim_cache size 0 max 16384 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4293, 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 19.429830424999999, 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 8, 2024-09-13T18:57:32.925 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 20, 2024-09-13T18:57:32.926 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:57:32.926 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 23.866004268000001 2024-09-13T18:57:32.926 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:57:32.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 msgr2=0x7f709406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 0x7f709406d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b7e70 tx=0x7f70a0008040 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 msgr2=0x7f70b415e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c4d0 tx=0x7f70a800c990 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 shutdown_connections 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f709406ac30 0x7f709406d0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b415ca90 0x7f70b415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70b40d26d0 0x7f70b415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 --2- 172.21.15.33:0/4273297927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b40b2850 0x7f70b415e3a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 >> 172.21.15.33:0/4273297927 conn(0x7f70b408bf90 msgr2=0x7f70b408c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 shutdown_connections 2024-09-13T18:57:32.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:32.915+0000 7f70bc000640 1 -- 172.21.15.33:0/4273297927 wait complete. 2024-09-13T18:57:32.933 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:57:32.944 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:57:32.944 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:57:32.945 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:57:32.945 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:57:32.968 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:57:32.968 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:57:32.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:32.968 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:57:33.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-13T18:57:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-09-13T18:57:33.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:33.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.108 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:57:33.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-13T18:57:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-09-13T18:57:33.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:33.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.246 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:57:33.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-13T18:57:33.390 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-13T18:57:33.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:33.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.393 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:57:33.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-13T18:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-13T18:57:33.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:33.534 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T18:57:33.534 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:57:33.534 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:57:33.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:57:33.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.688+0000 7f3d9fa00640 1 Processor -- start 2024-09-13T18:57:33.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.688+0000 7f3d9fa00640 1 -- start start 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.689+0000 7f3d9fa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 0x7f3d980b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.689+0000 7f3d9fa00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9813fbc0 con 0x7f3d980b3a40 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d9fa00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9815ce80 con 0x7f3d980b2e90 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d9fa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9806cca0 con 0x7f3d98160370 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d9d000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3d980b3a40 0x7f3d981428a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58946/0 (socket says 172.21.15.33:58946) 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d9d000640 1 -- 172.21.15.33:0/3223156604 learned_addr learned my addr 172.21.15.33:0/3223156604 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:33.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d8fe00640 1 --2- 172.21.15.33:0/3223156604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 0x7f3d980b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158954103 0 0) 0x7f3d9813fbc0 con 0x7f3d980b3a40 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d7c003520 con 0x7f3d980b3a40 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117668684 0 0) 0x7f3d9815ce80 con 0x7f3d980b2e90 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d9813fbc0 con 0x7f3d980b2e90 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d8fe00640 1 -- 172.21.15.33:0/3223156604 >> v1:172.21.15.103:6789/0 conn(0x7f3d980b2e90 legacy=0x7f3d980ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d8fe00640 1 -- 172.21.15.33:0/3223156604 >> v1:172.21.15.33:6789/0 conn(0x7f3d980b3a40 legacy=0x7f3d981428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65472074 0 0) 0x7f3d7c003520 con 0x7f3d980b3a40 2024-09-13T18:57:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.690+0000 7f3d8fe00640 1 -- 172.21.15.33:0/3223156604 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98160910 con 0x7f3d98160370 2024-09-13T18:57:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d8fe00640 1 --2- 172.21.15.33:0/3223156604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 0x7f3d980b2950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097d0 tx=0x7f3d8002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d13e0ba1bbe6a9f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88001670 con 0x7f3d98160370 2024-09-13T18:57:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8002ab90 con 0x7f3d98160370 2024-09-13T18:57:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d97e00640 1 -- 172.21.15.33:0/3223156604 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80032440 con 0x7f3d98160370 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d9fa00640 1 -- 172.21.15.33:0/3223156604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 msgr2=0x7f3d980b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/3223156604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 0x7f3d980b2950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097d0 tx=0x7f3d8002a100 comp rx=0 tx=0).stop 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d9fa00640 1 -- 172.21.15.33:0/3223156604 shutdown_connections 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/3223156604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d98160370 0x7f3d980b2950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.692+0000 7f3d9fa00640 1 -- 172.21.15.33:0/3223156604 >> 172.21.15.33:0/3223156604 conn(0x7f3d980b0510 msgr2=0x7f3d980b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.693+0000 7f3d9fa00640 1 -- 172.21.15.33:0/3223156604 shutdown_connections 2024-09-13T18:57:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.693+0000 7f3d9fa00640 1 -- 172.21.15.33:0/3223156604 wait complete. 2024-09-13T18:57:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.694+0000 7f3d9fa00640 1 Processor -- start 2024-09-13T18:57:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.694+0000 7f3d9fa00640 1 -- start start 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d980b2e90 0x7f3d981440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d980b3a40 0x7f3d981457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d98143070 con 0x7f3d98160370 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981432e0 con 0x7f3d980b2e90 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9fa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981435c0 con 0x7f3d980b3a40 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45148/0 (socket says 172.21.15.33:45148) 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9da00640 1 -- 172.21.15.33:0/2589063292 learned_addr learned my addr 172.21.15.33:0/2589063292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d8fe00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d980b3a40 0x7f3d981457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:33.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.695+0000 7f3d9d000640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d980b2e90 0x7f3d981440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 -- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d980b3a40 msgr2=0x7f3d981457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d980b3a40 0x7f3d981457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 -- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d980b2e90 msgr2=0x7f3d981440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d980b2e90 0x7f3d981440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 -- 172.21.15.33:0/2589063292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009400 con 0x7f3d98160370 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9da00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c6b0 tx=0x7f3d9000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90003b70 con 0x7f3d98160370 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90003cd0 con 0x7f3d98160370 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90005310 con 0x7f3d98160370 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d981438a0 con 0x7f3d98160370 2024-09-13T18:57:33.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.696+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d981445e0 con 0x7f3d98160370 2024-09-13T18:57:33.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.698+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d98143dc0 con 0x7f3d98160370 2024-09-13T18:57:33.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.698+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3d90005470 con 0x7f3d98160370 2024-09-13T18:57:33.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.699+0000 7f3d95600640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 0x7f3d7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:33.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.699+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d90088ff0 con 0x7f3d98160370 2024-09-13T18:57:33.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.700+0000 7f3d9d000640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 0x7f3d7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:33.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.700+0000 7f3d9d000640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 0x7f3d7406d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d880011e0 tx=0x7f3d88001610 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:33.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.703+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3d900bc9c0 con 0x7f3d98160370 2024-09-13T18:57:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.918+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d980b2950 con 0x7f3d98160370 2024-09-13T18:57:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.918+0000 7f3d95600640 1 -- 172.21.15.33:0/2589063292 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d98143dc0 con 0x7f3d98160370 2024-09-13T18:57:33.921 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.920+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 msgr2=0x7f3d7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.920+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 0x7f3d7406d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d880011e0 tx=0x7f3d88001610 comp rx=0 tx=0).stop 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.920+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 msgr2=0x7f3d980ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.920+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c6b0 tx=0x7f3d9000cb70 comp rx=0 tx=0).stop 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 shutdown_connections 2024-09-13T18:57:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d7406ac00 0x7f3d7406d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d98160370 0x7f3d980ae5b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d980b3a40 0x7f3d981457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 --2- 172.21.15.33:0/2589063292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d980b2e90 0x7f3d981440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 >> 172.21.15.33:0/2589063292 conn(0x7f3d980b0510 msgr2=0x7f3d980af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 shutdown_connections 2024-09-13T18:57:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:33.921+0000 7f3d9fa00640 1 -- 172.21.15.33:0/2589063292 wait complete. 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:57:33.939 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:57:33.940 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:57:33.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.940 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T18:57:33.975 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:33.975 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:33.975 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:57:33.976 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42678sec preferred_lft 42678sec 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:33.977 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T18:57:33.978 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:57:33.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:57:33.978 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:34.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:34.376 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:57:34.433 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T18:57:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:34.436 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T18:57:34.483 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T18:57:34.484 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:57:34.484 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:57:34.484 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:57:34.484 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:57:34.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:57:34.485 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:35.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.060 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:57:35.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.096 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-13T18:57:35.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.173 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:35.173 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:35.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:57:35.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:57:35.173 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:35.299 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:57:35.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.299 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:35.299 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:35.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:57:35.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:57:35.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:57:35.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:57:35.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:57:35.300 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:35.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.492 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:35.492 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:35.492 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T18:57:35.492 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:57:35.492 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:35.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:35.607 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:57:35.642 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:57:35.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:35.642 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:57:35.717 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:57:35.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:35.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:57:35.855 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:57:35.855 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:57:35.856 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:57:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:57:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:57:36.515 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:57:36.518 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:57:36.518 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:57:36.518 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:57:36.518 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:57:36.518 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:57:36.521 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:57:36.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:36.521 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:57:36.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:36.578 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:36.626 INFO:teuthology.orchestra.run.smithi033.stdout:client4630 2024-09-13T18:57:36.626 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:36.626 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:36.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:36.662 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:36.747 INFO:teuthology.orchestra.run.smithi033.stdout:client4630 2024-09-13T18:57:36.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:36.748 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:36.835 INFO:teuthology.orchestra.run.smithi033.stdout:client4630 2024-09-13T18:57:36.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:36.836 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d8de347-8986-4090-a81e-548bd7528fe4.client4630/status') 2024-09-13T18:57:36.896 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.4630 (3)172.21.15.33:0/1862384591 2024-09-13T18:57:36.896 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-09-13T18:57:36.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-09-13T18:57:36.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-09-13T18:57:36.897 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 5.9749e-05 s, 1.2 MB/s 2024-09-13T18:57:36.899 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-13T18:57:36.900 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:57:36.900 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:57:36.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:57:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.052+0000 7fa352200640 1 Processor -- start 2024-09-13T18:57:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.053+0000 7fa352200640 1 -- start start 2024-09-13T18:57:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa352200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa34c0cbac0 0x7fa34c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa352200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c0cbfc0 con 0x7fa34c0b40c0 2024-09-13T18:57:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa352200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c0707a0 con 0x7fa34c15a5c0 2024-09-13T18:57:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa352200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34c0cce20 con 0x7fa34c0cbac0 2024-09-13T18:57:37.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa351800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa34c0cbac0 0x7fa34c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa34be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa34c0b40c0 0x7fa34c15a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58960/0 (socket says 172.21.15.33:58960) 2024-09-13T18:57:37.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa34be00640 1 -- 172.21.15.33:0/1912247581 learned_addr learned my addr 172.21.15.33:0/1912247581 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa351800640 1 -- 172.21.15.33:0/1912247581 >> v1:172.21.15.103:6789/0 conn(0x7fa34c15a5c0 legacy=0x7fa34c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa351800640 1 -- 172.21.15.33:0/1912247581 >> v1:172.21.15.33:6789/0 conn(0x7fa34c0b40c0 legacy=0x7fa34c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa351800640 1 -- 172.21.15.33:0/1912247581 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c070a80 con 0x7fa34c0cbac0 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.054+0000 7fa34b400640 1 -- 172.21.15.33:0/1912247581 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980002335 0 0) 0x7fa34c0cbfc0 con 0x7fa34c0b40c0 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.055+0000 7fa351800640 1 --2- 172.21.15.33:0/1912247581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0cbac0 0x7fa34c15b0b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa344009d90 tx=0x7fa34402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe2441980443202 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa34b400640 1 -- 172.21.15.33:0/1912247581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344007740 con 0x7fa34c0cbac0 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa34b400640 1 -- 172.21.15.33:0/1912247581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34402d050 con 0x7fa34c0cbac0 2024-09-13T18:57:37.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa34b400640 1 -- 172.21.15.33:0/1912247581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344007ac0 con 0x7fa34c0cbac0 2024-09-13T18:57:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 -- 172.21.15.33:0/1912247581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0cbac0 msgr2=0x7fa34c15b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 --2- 172.21.15.33:0/1912247581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0cbac0 0x7fa34c15b0b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa344009d90 tx=0x7fa34402a660 comp rx=0 tx=0).stop 2024-09-13T18:57:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 -- 172.21.15.33:0/1912247581 shutdown_connections 2024-09-13T18:57:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 --2- 172.21.15.33:0/1912247581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0cbac0 0x7fa34c15b0b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 -- 172.21.15.33:0/1912247581 >> 172.21.15.33:0/1912247581 conn(0x7fa34c0ae310 msgr2=0x7fa34c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 -- 172.21.15.33:0/1912247581 shutdown_connections 2024-09-13T18:57:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.056+0000 7fa352200640 1 -- 172.21.15.33:0/1912247581 wait complete. 2024-09-13T18:57:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.058+0000 7fa352200640 1 Processor -- start 2024-09-13T18:57:37.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.058+0000 7fa352200640 1 -- start start 2024-09-13T18:57:37.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cbac0 0x7fa34c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa34c15a5c0 0x7fa34c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0b3950 con 0x7fa34c0b40c0 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0b30b0 con 0x7fa34c0cbac0 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa352200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0b3390 con 0x7fa34c15a5c0 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa350e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa350e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45160/0 (socket says 172.21.15.33:45160) 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa350e00640 1 -- 172.21.15.33:0/4562714 learned_addr learned my addr 172.21.15.33:0/4562714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa34be00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cbac0 0x7fa34c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:37.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.059+0000 7fa351800640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa34c15a5c0 0x7fa34c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:37.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 -- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa34c15a5c0 msgr2=0x7fa34c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa34c15a5c0 0x7fa34c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 -- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cbac0 msgr2=0x7fa34c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cbac0 0x7fa34c155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 -- 172.21.15.33:0/4562714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344009a70 con 0x7fa34c0b40c0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa350e00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa34000c450 tx=0x7fa34000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400052d0 con 0x7fa34c0b40c0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340005430 con 0x7fa34c0b40c0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c0b3670 con 0x7fa34c0b40c0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.060+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340012870 con 0x7fa34c0b40c0 2024-09-13T18:57:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.061+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c155fb0 con 0x7fa34c0b40c0 2024-09-13T18:57:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.062+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34c067360 con 0x7fa34c0b40c0 2024-09-13T18:57:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.062+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3400129d0 con 0x7fa34c0b40c0 2024-09-13T18:57:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.063+0000 7fa348c00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 0x7fa32c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.063+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa340088d80 con 0x7fa34c0b40c0 2024-09-13T18:57:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.064+0000 7fa34be00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 0x7fa32c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.064+0000 7fa34be00640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 0x7fa32c06d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa34c150aa0 tx=0x7fa338007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:37.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.068+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa340054000 con 0x7fa34c0b40c0 2024-09-13T18:57:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.287+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa34c0b1b60 con 0x7fa34c0b40c0 2024-09-13T18:57:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.287+0000 7fa348c00640 1 -- 172.21.15.33:0/4562714 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa34c0b1b60 con 0x7fa34c0b40c0 2024-09-13T18:57:37.289 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:57:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.289+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 msgr2=0x7fa32c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.289+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 0x7fa32c06d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa34c150aa0 tx=0x7fa338007e40 comp rx=0 tx=0).stop 2024-09-13T18:57:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.289+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 msgr2=0x7fa34c1504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.289+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa34000c450 tx=0x7fa34000c910 comp rx=0 tx=0).stop 2024-09-13T18:57:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 shutdown_connections 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa32c06ac00 0x7fa32c06d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa34c15a5c0 0x7fa34c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34c0cbac0 0x7fa34c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 --2- 172.21.15.33:0/4562714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0b40c0 0x7fa34c1504b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 >> 172.21.15.33:0/4562714 conn(0x7fa34c0ae310 msgr2=0x7fa34c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 shutdown_connections 2024-09-13T18:57:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:37.290+0000 7fa352200640 1 -- 172.21.15.33:0/4562714 wait complete. 2024-09-13T18:57:37.307 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:57:37.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:57:37.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.308 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T18:57:37.344 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T18:57:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42674sec preferred_lft 42674sec 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.346 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:57:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:57:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T18:57:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.347 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:57:37.438 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T18:57:37.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.441 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T18:57:37.477 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T18:57:37.478 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:57:37.478 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:57:37.478 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:57:37.478 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:57:37.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.478 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:37.478 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:37.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:57:37.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:57:37.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:57:37.479 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:37.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.625 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:57:37.660 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:57:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.661 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-13T18:57:37.735 INFO:teuthology.orchestra.run.smithi033.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:57:37.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:57:37.736 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:37.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:57:37.916 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2a:df:36:8c:b6:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::28df:36ff:fe8c:b636/64 scope link 2024-09-13T18:57:37.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.920 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:57:37.975 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2a:df:36:8c:b6:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::28df:36ff:fe8c:b636/64 scope link 2024-09-13T18:57:37.976 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:37.978 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:57:37.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:37.978 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:57:37.979 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:38.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.144 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:57:38.144 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:57:38.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.1 up 2024-09-13T18:57:38.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:57:38.144 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:57:38.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:38.259 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:57:38.295 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:57:38.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:38.296 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:57:38.369 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:57:38.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T18:57:38.497 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T18:57:38.497 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T18:57:38.497 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:38.512 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T18:57:38.512 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T18:57:38.513 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:38.513 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:38.513 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:38.535 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-13T18:57:38.535 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:57:38.536 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:57:38.537 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-13T18:57:38.537 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:57:38.537 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:57:38.537 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:57:38.537 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:57:38.540 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:57:38.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:57:38.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.597 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:38.635 INFO:teuthology.orchestra.run.smithi033.stdout:client4639 2024-09-13T18:57:38.635 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:38.635 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:38.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.710 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:38.788 INFO:teuthology.orchestra.run.smithi033.stdout:client4639 2024-09-13T18:57:38.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.788 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:38.866 INFO:teuthology.orchestra.run.smithi033.stdout:client4639 2024-09-13T18:57:38.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:38.867 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d8de347-8986-4090-a81e-548bd7528fe4.client4639/status') 2024-09-13T18:57:38.962 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.4639 (3)172.21.15.33:0/3796276198 2024-09-13T18:57:38.962 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-09-13T18:57:38.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-09-13T18:57:38.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-09-13T18:57:38.963 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 5.922e-05 s, 1.2 MB/s 2024-09-13T18:57:38.965 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T18:57:38.965 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:57:38.965 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:57:38.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:57:39.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.118+0000 7f06eaa00640 1 Processor -- start 2024-09-13T18:57:39.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.118+0000 7f06eaa00640 1 -- start start 2024-09-13T18:57:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06eaa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06e4159f90 0x7f06e406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06eaa00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 0x7f06e406b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06eaa00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e415cdd0 con 0x7f06e415a370 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06eaa00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e415cbc0 con 0x7f06e4159f90 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06eaa00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e406e660 con 0x7f06e406e210 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06e4159f90 0x7f06e406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06e4159f90 0x7f06e406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45172/0 (socket says 172.21.15.33:45172) 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 -- 172.21.15.33:0/2153382628 learned_addr learned my addr 172.21.15.33:0/2153382628 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e8c00640 1 --1- 172.21.15.33:0/2153382628 >> v1:172.21.15.33:6789/0 conn(0x7f06e415a370 0x7f06e406db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58968/0 (socket says 172.21.15.33:58968) 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06ea000640 1 --2- 172.21.15.33:0/2153382628 >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 0x7f06e406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 -- 172.21.15.33:0/2153382628 >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 msgr2=0x7f06e406b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 --2- 172.21.15.33:0/2153382628 >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 0x7f06e406b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 -- 172.21.15.33:0/2153382628 >> v1:172.21.15.33:6789/0 conn(0x7f06e415a370 legacy=0x7f06e406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06e9600640 1 -- 172.21.15.33:0/2153382628 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e415db50 con 0x7f06e4159f90 2024-09-13T18:57:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.120+0000 7f06ea000640 1 --2- 172.21.15.33:0/2153382628 >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 0x7f06e406b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.121+0000 7f06e9600640 1 --2- 172.21.15.33:0/2153382628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4159f90 0x7f06e406aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06e40b4220 tx=0x7f06d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565fe6760aa85f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06e3e00640 1 -- 172.21.15.33:0/2153382628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8032440 con 0x7f06e4159f90 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06e3e00640 1 -- 172.21.15.33:0/2153382628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80325a0 con 0x7f06e4159f90 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06e3e00640 1 -- 172.21.15.33:0/2153382628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8032930 con 0x7f06e4159f90 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 -- 172.21.15.33:0/2153382628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4159f90 msgr2=0x7f06e406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 --2- 172.21.15.33:0/2153382628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4159f90 0x7f06e406aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06e40b4220 tx=0x7f06d802a270 comp rx=0 tx=0).stop 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 -- 172.21.15.33:0/2153382628 shutdown_connections 2024-09-13T18:57:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 --2- 172.21.15.33:0/2153382628 >> v2:172.21.15.103:3300/0 conn(0x7f06e406e210 0x7f06e406b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 --2- 172.21.15.33:0/2153382628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4159f90 0x7f06e406aee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 -- 172.21.15.33:0/2153382628 >> 172.21.15.33:0/2153382628 conn(0x7f06e406cc70 msgr2=0x7f06e406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 -- 172.21.15.33:0/2153382628 shutdown_connections 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.122+0000 7f06eaa00640 1 -- 172.21.15.33:0/2153382628 wait complete. 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.124+0000 7f06eaa00640 1 Processor -- start 2024-09-13T18:57:39.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.124+0000 7f06eaa00640 1 -- start start 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 0x7f06e41f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 0x7f06e414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4156430 con 0x7f06e415a370 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4156710 con 0x7f06e4159f90 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06eaa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41569f0 con 0x7f06e406e210 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06ea000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06ea000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45188/0 (socket says 172.21.15.33:45188) 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.125+0000 7f06ea000640 1 -- 172.21.15.33:0/1896387327 learned_addr learned my addr 172.21.15.33:0/1896387327 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:39.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e8c00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 0x7f06e414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e9600640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 0x7f06e41f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 -- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 msgr2=0x7f06e41f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 0x7f06e41f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 -- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 msgr2=0x7f06e414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 0x7f06e414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 -- 172.21.15.33:0/1896387327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80094d0 con 0x7f06e415a370 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e9600640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 0x7f06e41f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e8c00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 0x7f06e414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06ea000640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06dc007e60 tx=0x7f06dc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc003b90 con 0x7f06e415a370 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00f040 con 0x7f06e415a370 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e4156cd0 con 0x7f06e415a370 2024-09-13T18:57:39.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00de80 con 0x7f06e415a370 2024-09-13T18:57:39.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.126+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e41f25d0 con 0x7f06e415a370 2024-09-13T18:57:39.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.127+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e41571f0 con 0x7f06e415a370 2024-09-13T18:57:39.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.128+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06dc004030 con 0x7f06e415a370 2024-09-13T18:57:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.129+0000 7f06e1600640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 0x7f06c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.129+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06dc0896a0 con 0x7f06e415a370 2024-09-13T18:57:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.130+0000 7f06e9600640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 0x7f06c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.130+0000 7f06e9600640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 0x7f06c406d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06d8034000 tx=0x7f06d802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:39.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.133+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06e41571f0 con 0x7f06e415a370 2024-09-13T18:57:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.348+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06e41571f0 con 0x7f06e415a370 2024-09-13T18:57:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.348+0000 7f06e1600640 1 -- 172.21.15.33:0/1896387327 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f06e41571f0 con 0x7f06e415a370 2024-09-13T18:57:39.351 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:57:39.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 msgr2=0x7f06c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 0x7f06c406d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06d8034000 tx=0x7f06d802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:39.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 msgr2=0x7f06e40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06dc007e60 tx=0x7f06dc00d4a0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 shutdown_connections 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06c406ac00 0x7f06c406d0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e415a370 0x7f06e40ad200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4159f90 0x7f06e414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 --2- 172.21.15.33:0/1896387327 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06e406e210 0x7f06e41f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 >> 172.21.15.33:0/1896387327 conn(0x7f06e406cc70 msgr2=0x7f06e415aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 shutdown_connections 2024-09-13T18:57:39.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:39.351+0000 7f06eaa00640 1 -- 172.21.15.33:0/1896387327 wait complete. 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:57:39.369 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:57:39.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:39.369 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:39.410 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42690sec preferred_lft 42690sec 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T18:57:39.411 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:39.411 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:57:39.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:57:39.412 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:39.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:39.777 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:57:39.837 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:57:39.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:39.841 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T18:57:39.888 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T18:57:39.888 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:57:39.888 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:57:39.889 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:57:39.889 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:57:39.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:39.889 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:39.890 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:39.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:57:39.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:57:39.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:57:39.890 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:40.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:40.490 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:57:40.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:40.526 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-13T18:57:40.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:40.602 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:40.602 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:40.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:57:40.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:57:40.603 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:40.731 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:57:40.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:40.731 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:40.731 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:40.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:57:40.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:57:40.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:57:40.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:57:40.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:57:40.732 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:40.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:40.917 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:40.917 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:40.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T18:57:40.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:57:40.917 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:41.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:41.033 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:57:41.067 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:57:41.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:41.068 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:57:41.143 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:57:41.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:41.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:57:41.290 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:57:41.290 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:57:41.290 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:41.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:57:41.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:57:41.971 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:57:41.972 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:57:41.972 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:41.972 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:41.972 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:57:41.998 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:57:41.999 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:57:41.999 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:57:42.000 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:57:42.000 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:57:42.000 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:57:42.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:57:42.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:57:42.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.058 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:42.096 INFO:teuthology.orchestra.run.smithi103.stdout:client4686 2024-09-13T18:57:42.096 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:57:42.096 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:42.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.171 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:42.249 INFO:teuthology.orchestra.run.smithi103.stdout:client4686 2024-09-13T18:57:42.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.249 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:42.326 INFO:teuthology.orchestra.run.smithi103.stdout:client4686 2024-09-13T18:57:42.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.327 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d8de347-8986-4090-a81e-548bd7528fe4.client4686/status') 2024-09-13T18:57:42.421 INFO:teuthology.orchestra.run.smithi103.stdout:instance: client.4686 (3)172.21.15.103:0/2008632625 2024-09-13T18:57:42.422 INFO:teuthology.orchestra.run.smithi103.stdout:blocklisted: false 2024-09-13T18:57:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records in 2024-09-13T18:57:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records out 2024-09-13T18:57:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:71 bytes copied, 5.6706e-05 s, 1.3 MB/s 2024-09-13T18:57:42.424 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-13T18:57:42.425 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:57:42.425 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:57:42.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:57:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.589+0000 7fa25a000640 1 Processor -- start 2024-09-13T18:57:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.589+0000 7fa25a000640 1 -- start start 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.590+0000 7fa25a000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa25415a5c0 0x7fa2540b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.590+0000 7fa25a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 0x7fa2540b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.590+0000 7fa25a000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540cbfc0 con 0x7fa2540afe10 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.590+0000 7fa25a000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540cce20 con 0x7fa25415a5c0 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.590+0000 7fa25a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540707a0 con 0x7fa2540cbac0 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa259600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa2540afe10 0x7fa25406f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58976/0 (socket says 172.21.15.33:58976) 2024-09-13T18:57:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa259600640 1 -- 172.21.15.33:0/3359019056 learned_addr learned my addr 172.21.15.33:0/3359019056 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa258c00640 1 --2- 172.21.15.33:0/3359019056 >> v2:172.21.15.103:3300/0 conn(0x7fa25415a5c0 0x7fa2540b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa253e00640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 0x7fa2540b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225955914 0 0) 0x7fa2540cbfc0 con 0x7fa2540afe10 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.591+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c003520 con 0x7fa2540afe10 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2299469564 0 0) 0x7fa23c003520 con 0x7fa2540afe10 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa258c00640 1 -- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 msgr2=0x7fa2540b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa258c00640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 0x7fa2540b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa258c00640 1 -- 172.21.15.33:0/3359019056 >> v1:172.21.15.33:6789/0 conn(0x7fa2540afe10 legacy=0x7fa25406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa258c00640 1 -- 172.21.15.33:0/3359019056 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254070a80 con 0x7fa25415a5c0 2024-09-13T18:57:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.592+0000 7fa253e00640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 0x7fa2540b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.593+0000 7fa258c00640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25415a5c0 0x7fa2540b39b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2480097a0 tx=0x7fa24802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96916571ecf30ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.593+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0019f0 con 0x7fa25415a5c0 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.593+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24802aba0 con 0x7fa25415a5c0 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.593+0000 7fa253400640 1 -- 172.21.15.33:0/3359019056 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248032440 con 0x7fa25415a5c0 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 -- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25415a5c0 msgr2=0x7fa2540b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25415a5c0 0x7fa2540b39b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2480097a0 tx=0x7fa24802a110 comp rx=0 tx=0).stop 2024-09-13T18:57:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 -- 172.21.15.33:0/3359019056 shutdown_connections 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2540cbac0 0x7fa2540b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 --2- 172.21.15.33:0/3359019056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25415a5c0 0x7fa2540b39b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 -- 172.21.15.33:0/3359019056 >> 172.21.15.33:0/3359019056 conn(0x7fa2540ae310 msgr2=0x7fa2540ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 -- 172.21.15.33:0/3359019056 shutdown_connections 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.594+0000 7fa25a000640 1 -- 172.21.15.33:0/3359019056 wait complete. 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.595+0000 7fa25a000640 1 Processor -- start 2024-09-13T18:57:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.595+0000 7fa25a000640 1 -- start start 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 0x7fa254150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 0x7fa25406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540ad9e0 con 0x7fa2540afe10 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25414c6a0 con 0x7fa2540cbac0 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.596+0000 7fa25a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540b2380 con 0x7fa25415a5c0 2024-09-13T18:57:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45200/0 (socket says 172.21.15.33:45200) 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 -- 172.21.15.33:0/1576374391 learned_addr learned my addr 172.21.15.33:0/1576374391 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa259600640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 0x7fa25406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa253e00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 0x7fa254150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 -- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 msgr2=0x7fa25406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 0x7fa25406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 -- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 msgr2=0x7fa254150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 0x7fa254150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 -- 172.21.15.33:0/1576374391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009400 con 0x7fa2540afe10 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa259600640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 0x7fa25406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa253e00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 0x7fa254150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.597+0000 7fa258c00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098c0 tx=0x7fa2480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.598+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24803c820 con 0x7fa2540afe10 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.598+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24803c980 con 0x7fa2540afe10 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.598+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24803ccf0 con 0x7fa2540afe10 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.598+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248009400 con 0x7fa2540afe10 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.598+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2540b2940 con 0x7fa2540afe10 2024-09-13T18:57:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.599+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254067360 con 0x7fa2540afe10 2024-09-13T18:57:42.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.600+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa248039050 con 0x7fa2540afe10 2024-09-13T18:57:42.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.600+0000 7fa250c00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 0x7fa23406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:42.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.601+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2480a9e00 con 0x7fa2540afe10 2024-09-13T18:57:42.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.601+0000 7fa253e00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 0x7fa23406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:42.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.601+0000 7fa253e00640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 0x7fa23406d0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa25406c370 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:42.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.605+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa248074fd0 con 0x7fa2540afe10 2024-09-13T18:57:42.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.819+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2540b39b0 con 0x7fa2540afe10 2024-09-13T18:57:42.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.820+0000 7fa250c00640 1 -- 172.21.15.33:0/1576374391 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa248037070 con 0x7fa2540afe10 2024-09-13T18:57:42.822 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:57:42.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 msgr2=0x7fa23406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 0x7fa23406d0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa25406c370 tx=0x7fa240008040 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 msgr2=0x7fa2540b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098c0 tx=0x7fa2480046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 shutdown_connections 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa23406ac30 0x7fa23406d0f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa25415a5c0 0x7fa25406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2540cbac0 0x7fa254150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 --2- 172.21.15.33:0/1576374391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2540afe10 0x7fa2540b3420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 >> 172.21.15.33:0/1576374391 conn(0x7fa2540ae310 msgr2=0x7fa2540af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 shutdown_connections 2024-09-13T18:57:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:42.822+0000 7fa25a000640 1 -- 172.21.15.33:0/1576374391 wait complete. 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:57:42.840 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:57:42.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.841 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:42.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42686sec preferred_lft 42686sec 2024-09-13T18:57:42.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T18:57:42.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.880 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:57:42.970 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:57:42.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:42.977 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:57:43.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:57:43.014 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:43.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.159 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:57:43.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:57:43.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.195 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-13T18:57:43.270 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:57:43.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.271 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:43.271 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:43.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:57:43.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:57:43.271 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:43.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:be:0f:85:87:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::e0be:fff:fe85:87cb/64 scope link 2024-09-13T18:57:43.450 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:57:43.507 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:be:0f:85:87:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::e0be:fff:fe85:87cb/64 scope link 2024-09-13T18:57:43.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:57:43.510 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:57:43.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.510 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:57:43.511 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:43.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.1 up 2024-09-13T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:57:43.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:43.788 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:57:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:57:43.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:57:43.823 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:57:43.897 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:57:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:43.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T18:57:44.027 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T18:57:44.027 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T18:57:44.027 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T18:57:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T18:57:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:44.066 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-13T18:57:44.066 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-13T18:57:44.066 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:57:44.067 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:57:44.067 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:57:44.067 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:57:44.067 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:57:44.067 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:57:44.068 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-13T18:57:44.069 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:57:44.069 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:57:44.069 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:57:44.069 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:57:44.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:57:44.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:44.072 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:57:44.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:44.128 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:44.167 INFO:teuthology.orchestra.run.smithi103.stdout:client4499 2024-09-13T18:57:44.167 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:57:44.167 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:44.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:44.242 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:44.320 INFO:teuthology.orchestra.run.smithi103.stdout:client4499 2024-09-13T18:57:44.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:44.320 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:57:44.398 INFO:teuthology.orchestra.run.smithi103.stdout:client4499 2024-09-13T18:57:44.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:44.398 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d8de347-8986-4090-a81e-548bd7528fe4.client4499/status') 2024-09-13T18:57:44.493 INFO:teuthology.orchestra.run.smithi103.stdout:instance: client.4499 (3)192.168.0.2:0/2850374543 2024-09-13T18:57:44.493 INFO:teuthology.orchestra.run.smithi103.stdout:blocklisted: false 2024-09-13T18:57:44.493 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records in 2024-09-13T18:57:44.494 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records out 2024-09-13T18:57:44.494 INFO:teuthology.orchestra.run.smithi103.stderr:69 bytes copied, 5.6771e-05 s, 1.2 MB/s 2024-09-13T18:57:44.496 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T18:57:44.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:44.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.677+0000 7fe8c5600640 1 Processor -- start 2024-09-13T18:57:44.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.677+0000 7fe8c5600640 1 -- start start 2024-09-13T18:57:44.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:44.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8c5600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c0159fc0 con 0x7fe8c006f660 2024-09-13T18:57:44.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8c5600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c0153f00 con 0x7fe8c0153b20 2024-09-13T18:57:44.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8c5600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00b3df0 con 0x7fe8c00b3990 2024-09-13T18:57:44.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8bf400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe8c006f660 0x7fe8c006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52692/0 (socket says 172.21.15.33:52692) 2024-09-13T18:57:44.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8bf400640 1 -- 172.21.15.33:0/2603027118 learned_addr learned my addr 172.21.15.33:0/2603027118 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:44.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.678+0000 7fe8b6000640 1 --2- 172.21.15.33:0/2603027118 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607927638 0 0) 0x7fe8c0159fc0 con 0x7fe8c006f660 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a4003520 con 0x7fe8c006f660 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096431345 0 0) 0x7fe8c0153f00 con 0x7fe8c0153b20 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c0159fc0 con 0x7fe8c0153b20 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8b6000640 1 -- 172.21.15.33:0/2603027118 >> v1:172.21.15.103:6789/0 conn(0x7fe8c0153b20 legacy=0x7fe8c00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8b6000640 1 -- 172.21.15.33:0/2603027118 >> v1:172.21.15.33:6789/0 conn(0x7fe8c006f660 legacy=0x7fe8c006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.679+0000 7fe8b6000640 1 -- 172.21.15.33:0/2603027118 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00b1a40 con 0x7fe8c00b3990 2024-09-13T18:57:44.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.680+0000 7fe8b6000640 1 --2- 172.21.15.33:0/2603027118 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c0159a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80097d0 tx=0x7fe8a802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2d86d6452c945d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:44.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.680+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8032440 con 0x7fe8c00b3990 2024-09-13T18:57:44.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.680+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80325a0 con 0x7fe8c00b3990 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8be000640 1 -- 172.21.15.33:0/2603027118 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8032930 con 0x7fe8c00b3990 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 -- 172.21.15.33:0/2603027118 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 msgr2=0x7fe8c0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 --2- 172.21.15.33:0/2603027118 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c0159a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80097d0 tx=0x7fe8a802a210 comp rx=0 tx=0).stop 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 -- 172.21.15.33:0/2603027118 shutdown_connections 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 --2- 172.21.15.33:0/2603027118 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c0159a80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 -- 172.21.15.33:0/2603027118 >> 172.21.15.33:0/2603027118 conn(0x7fe8c00b0510 msgr2=0x7fe8c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 -- 172.21.15.33:0/2603027118 shutdown_connections 2024-09-13T18:57:44.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.681+0000 7fe8c5600640 1 -- 172.21.15.33:0/2603027118 wait complete. 2024-09-13T18:57:44.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.683+0000 7fe8c5600640 1 Processor -- start 2024-09-13T18:57:44.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.683+0000 7fe8c5600640 1 -- start start 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8c006f660 0x7fe8c0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c00af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c0153040 con 0x7fe8c0153b20 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c0150c80 con 0x7fe8c006f660 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8c5600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c0151830 con 0x7fe8c00b3990 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8bf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8bf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58976/0 (socket says 172.21.15.33:58976) 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8bf400640 1 -- 172.21.15.33:0/3581118257 learned_addr learned my addr 172.21.15.33:0/3581118257 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8bea00640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8c006f660 0x7fe8c0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.684+0000 7fe8b6000640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c00af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 -- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 msgr2=0x7fe8c00af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c00af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 -- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8c006f660 msgr2=0x7fe8c0152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8c006f660 0x7fe8c0152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 -- 172.21.15.33:0/3581118257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009400 con 0x7fe8c0153b20 2024-09-13T18:57:44.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8bf400640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800cad0 tx=0x7fe8b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800ac30 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b800adb0 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c0150f40 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8012640 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.685+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c01514c0 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.686+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c01519e0 con 0x7fe8c0153b20 2024-09-13T18:57:44.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.687+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8b8007070 con 0x7fe8c0153b20 2024-09-13T18:57:44.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.688+0000 7fe8b7400640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 0x7fe89c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:44.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.688+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b8089340 con 0x7fe8c0153b20 2024-09-13T18:57:44.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.688+0000 7fe8bea00640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 0x7fe89c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:44.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.689+0000 7fe8bea00640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 0x7fe89c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00011e0 tx=0x7fe8b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:44.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.692+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8c01519e0 con 0x7fe8c0153b20 2024-09-13T18:57:44.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.871+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8c01519e0 con 0x7fe8c0153b20 2024-09-13T18:57:44.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.872+0000 7fe8b7400640 1 -- 172.21.15.33:0/3581118257 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fe8c01519e0 con 0x7fe8c0153b20 2024-09-13T18:57:44.875 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:44.875 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.874+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 msgr2=0x7fe89c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.874+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 0x7fe89c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00011e0 tx=0x7fe8b0009040 comp rx=0 tx=0).stop 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.874+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 msgr2=0x7fe8c0151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.874+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800cad0 tx=0x7fe8b800cf90 comp rx=0 tx=0).stop 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 shutdown_connections 2024-09-13T18:57:44.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe89c06ac00 0x7fe89c06d0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8c0153b20 0x7fe8c0151cc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8c00b3990 0x7fe8c00af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 --2- 172.21.15.33:0/3581118257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8c006f660 0x7fe8c0152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 >> 172.21.15.33:0/3581118257 conn(0x7fe8c00b0510 msgr2=0x7fe8c00cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 shutdown_connections 2024-09-13T18:57:44.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:44.875+0000 7fe8c5600640 1 -- 172.21.15.33:0/3581118257 wait complete. 2024-09-13T18:57:44.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:44.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:45.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.049+0000 7f732ea00640 1 Processor -- start 2024-09-13T18:57:45.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.049+0000 7f732ea00640 1 -- start start 2024-09-13T18:57:45.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732ea00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 0x7f73280cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732ea00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280cc370 con 0x7f732815d980 2024-09-13T18:57:45.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732ea00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280cd1b0 con 0x7f73281594a0 2024-09-13T18:57:45.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732ea00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328159880 con 0x7f73280b2e20 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732d600640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73281594a0 0x7f73280b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:54890/0 (socket says 172.21.15.33:54890) 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732e000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f732815d980 0x7f732806f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52700/0 (socket says 172.21.15.33:52700) 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732d600640 1 -- 172.21.15.33:0/898986097 learned_addr learned my addr 172.21.15.33:0/898986097 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732cc00640 1 --2- 172.21.15.33:0/898986097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 0x7f73280cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f7327e00640 1 -- 172.21.15.33:0/898986097 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93346707 0 0) 0x7f73280cd1b0 con 0x7f73281594a0 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732cc00640 1 -- 172.21.15.33:0/898986097 >> v1:172.21.15.103:6789/0 conn(0x7f73281594a0 legacy=0x7f73280b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.051+0000 7f732cc00640 1 -- 172.21.15.33:0/898986097 >> v1:172.21.15.33:6789/0 conn(0x7f732815d980 legacy=0x7f732806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.052+0000 7f732cc00640 1 -- 172.21.15.33:0/898986097 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732815de10 con 0x7f73280b2e20 2024-09-13T18:57:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.053+0000 7f732cc00640 1 --2- 172.21.15.33:0/898986097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 0x7f73280cdf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f73140097d0 tx=0x7f731402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a0e098117274b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.053+0000 7f7327e00640 1 -- 172.21.15.33:0/898986097 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314032440 con 0x7f73280b2e20 2024-09-13T18:57:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.053+0000 7f7327e00640 1 -- 172.21.15.33:0/898986097 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73140325a0 con 0x7f73280b2e20 2024-09-13T18:57:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.053+0000 7f7327e00640 1 -- 172.21.15.33:0/898986097 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314032930 con 0x7f73280b2e20 2024-09-13T18:57:45.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 -- 172.21.15.33:0/898986097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 msgr2=0x7f73280cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 --2- 172.21.15.33:0/898986097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 0x7f73280cdf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f73140097d0 tx=0x7f731402a200 comp rx=0 tx=0).stop 2024-09-13T18:57:45.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 -- 172.21.15.33:0/898986097 shutdown_connections 2024-09-13T18:57:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 --2- 172.21.15.33:0/898986097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73280b2e20 0x7f73280cdf10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 -- 172.21.15.33:0/898986097 >> 172.21.15.33:0/898986097 conn(0x7f73280b0200 msgr2=0x7f73280b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 -- 172.21.15.33:0/898986097 shutdown_connections 2024-09-13T18:57:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.054+0000 7f732ea00640 1 -- 172.21.15.33:0/898986097 wait complete. 2024-09-13T18:57:45.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.055+0000 7f732ea00640 1 Processor -- start 2024-09-13T18:57:45.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.055+0000 7f732ea00640 1 -- start start 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73280b2e20 0x7f732814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73281594a0 0x7f73280c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73281f3550 con 0x7f732815d980 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73281f0e50 con 0x7f73280b2e20 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.056+0000 7f732ea00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c4c50 con 0x7f73281594a0 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58982/0 (socket says 172.21.15.33:58982) 2024-09-13T18:57:45.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 -- 172.21.15.33:0/1539606356 learned_addr learned my addr 172.21.15.33:0/1539606356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:45.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732d600640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73280b2e20 0x7f732814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732cc00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73281594a0 0x7f73280c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 -- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73281594a0 msgr2=0x7f73280c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73281594a0 0x7f73280c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 -- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73280b2e20 msgr2=0x7f732814ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73280b2e20 0x7f732814ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.057+0000 7f732e000640 1 -- 172.21.15.33:0/1539606356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009400 con 0x7f732815d980 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f732e000640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f732000c730 tx=0x7f732000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000ce40 con 0x7f732815d980 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000a640 con 0x7f732815d980 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000a9f0 con 0x7f732815d980 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73281f3810 con 0x7f732815d980 2024-09-13T18:57:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.058+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73281f3dd0 con 0x7f732815d980 2024-09-13T18:57:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.059+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73280cd120 con 0x7f732815d980 2024-09-13T18:57:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.060+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f732000ab50 con 0x7f732815d980 2024-09-13T18:57:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.061+0000 7f7325600640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 0x7f730806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.061+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73200889f0 con 0x7f732815d980 2024-09-13T18:57:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.061+0000 7f732d600640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 0x7f730806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.062+0000 7f732d600640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 0x7f730806d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f731c000f60 tx=0x7f731c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.065+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7320053c70 con 0x7f732815d980 2024-09-13T18:57:45.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.247+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73280cd620 con 0x7f732815d980 2024-09-13T18:57:45.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.247+0000 7f7325600640 1 -- 172.21.15.33:0/1539606356 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7320017020 con 0x7f732815d980 2024-09-13T18:57:45.250 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:45.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 msgr2=0x7f730806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 0x7f730806d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f731c000f60 tx=0x7f731c007d50 comp rx=0 tx=0).stop 2024-09-13T18:57:45.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 msgr2=0x7f73280c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f732000c730 tx=0x7f732000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 shutdown_connections 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f730806ac00 0x7f730806d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f732815d980 0x7f73280c4660 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73281594a0 0x7f73280c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 --2- 172.21.15.33:0/1539606356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73280b2e20 0x7f732814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 >> 172.21.15.33:0/1539606356 conn(0x7f73280b0200 msgr2=0x7f73280b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 shutdown_connections 2024-09-13T18:57:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.250+0000 7f732ea00640 1 -- 172.21.15.33:0/1539606356 wait complete. 2024-09-13T18:57:45.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.424+0000 7f110a600640 1 Processor -- start 2024-09-13T18:57:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.424+0000 7f110a600640 1 -- start start 2024-09-13T18:57:45.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 0x7f110415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040cafa0 0x7f1104070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11040714c0 0x7f110415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110415aa30 con 0x7f11040714c0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1104071930 con 0x7f1104156f60 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.425+0000 7f110a600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110406f5f0 con 0x7f11040cafa0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11040714c0 0x7f110415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11040714c0 0x7f110415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58984/0 (socket says 172.21.15.33:58984) 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 -- 172.21.15.33:0/880398180 learned_addr learned my addr 172.21.15.33:0/880398180 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103400640 1 --2- 172.21.15.33:0/880398180 >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 0x7f110415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1102a00640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040cafa0 0x7f1104070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 -- 172.21.15.33:0/880398180 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040cafa0 msgr2=0x7f1104070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040cafa0 0x7f1104070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 -- 172.21.15.33:0/880398180 >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 msgr2=0x7f110415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 --2- 172.21.15.33:0/880398180 >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 0x7f110415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103e00640 1 -- 172.21.15.33:0/880398180 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104070450 con 0x7f11040714c0 2024-09-13T18:57:45.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.426+0000 7f1103400640 1 --2- 172.21.15.33:0/880398180 >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 0x7f110415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:45.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.427+0000 7f1103e00640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040714c0 0x7f110415d060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f11040cb560 tx=0x7f10fc02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf1d7df1f76324 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.427+0000 7f1102000640 1 -- 172.21.15.33:0/880398180 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc02f070 con 0x7f11040714c0 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.427+0000 7f1102000640 1 -- 172.21.15.33:0/880398180 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00b2e0 con 0x7f11040714c0 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.427+0000 7f1102000640 1 -- 172.21.15.33:0/880398180 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc009820 con 0x7f11040714c0 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 -- 172.21.15.33:0/880398180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040714c0 msgr2=0x7f110415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040714c0 0x7f110415d060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f11040cb560 tx=0x7f10fc02c8a0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 -- 172.21.15.33:0/880398180 shutdown_connections 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040cafa0 0x7f1104070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 --2- 172.21.15.33:0/880398180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040714c0 0x7f110415d060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 --2- 172.21.15.33:0/880398180 >> v2:172.21.15.103:3300/0 conn(0x7f1104156f60 0x7f110415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 -- 172.21.15.33:0/880398180 >> 172.21.15.33:0/880398180 conn(0x7f11040b0580 msgr2=0x7f11040b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 -- 172.21.15.33:0/880398180 shutdown_connections 2024-09-13T18:57:45.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.428+0000 7f110a600640 1 -- 172.21.15.33:0/880398180 wait complete. 2024-09-13T18:57:45.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.430+0000 7f110a600640 1 Processor -- start 2024-09-13T18:57:45.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.430+0000 7f110a600640 1 -- start start 2024-09-13T18:57:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 0x7f1104153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 0x7f1104151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1104156f60 0x7f11041f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104154650 con 0x7f11040cafa0 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040a8460 con 0x7f1104156f60 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f110a600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11041539d0 con 0x7f11040714c0 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1102a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 0x7f1104151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1103400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 0x7f1104153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1103400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 0x7f1104153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:33890/0 (socket says 172.21.15.33:33890) 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1103400640 1 -- 172.21.15.33:0/4182461088 learned_addr learned my addr 172.21.15.33:0/4182461088 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1103e00640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1104156f60 0x7f11041f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1102a00640 1 -- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 msgr2=0x7f1104153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1102a00640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 0x7f1104153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1102a00640 1 -- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1104156f60 msgr2=0x7f11041f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.431+0000 7f1102a00640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1104156f60 0x7f11041f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f1102a00640 1 -- 172.21.15.33:0/4182461088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc00bd40 con 0x7f11040cafa0 2024-09-13T18:57:45.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f1102a00640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 0x7f1104151ec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11040b12e0 tx=0x7f10f000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0014620 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0014780 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0014b10 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1104153cb0 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.432+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1104154270 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.433+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1104153780 con 0x7f11040cafa0 2024-09-13T18:57:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.434+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10f0014c70 con 0x7f11040cafa0 2024-09-13T18:57:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.435+0000 7f10fb400640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 0x7f10e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.435+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10f0089590 con 0x7f11040cafa0 2024-09-13T18:57:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.436+0000 7f1103400640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 0x7f10e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.436+0000 7f1103400640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 0x7f10e406d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006d40 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.440+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10f0054810 con 0x7f11040cafa0 2024-09-13T18:57:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.623+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1104153e40 con 0x7f11040cafa0 2024-09-13T18:57:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.623+0000 7f10fb400640 1 -- 172.21.15.33:0/4182461088 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10f005e020 con 0x7f11040cafa0 2024-09-13T18:57:45.626 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 msgr2=0x7f10e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 0x7f10e406d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006d40 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 msgr2=0x7f1104151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 0x7f1104151ec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11040b12e0 tx=0x7f10f000da50 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 shutdown_connections 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f10e406ac00 0x7f10e406d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1104156f60 0x7f11041f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11040cafa0 0x7f1104151ec0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 --2- 172.21.15.33:0/4182461088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11040714c0 0x7f1104153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 >> 172.21.15.33:0/4182461088 conn(0x7f11040b0580 msgr2=0x7f11040cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 shutdown_connections 2024-09-13T18:57:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.625+0000 7f110a600640 1 -- 172.21.15.33:0/4182461088 wait complete. 2024-09-13T18:57:45.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.799+0000 7fd602000640 1 Processor -- start 2024-09-13T18:57:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.799+0000 7fd602000640 1 -- start start 2024-09-13T18:57:45.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd602000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5fc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd602000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc06f5f0 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd602000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc070450 con 0x7fd5fc071690 2024-09-13T18:57:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd602000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc15aa30 con 0x7fd5fc156f60 2024-09-13T18:57:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd5faa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd5fc0cafa0 0x7fd5fc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52712/0 (socket says 172.21.15.33:52712) 2024-09-13T18:57:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.800+0000 7fd5faa00640 1 -- 172.21.15.33:0/962276067 learned_addr learned my addr 172.21.15.33:0/962276067 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fb400640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5fc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527672223 0 0) 0x7fd5fc06f5f0 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e0005730 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1894948332 0 0) 0x7fd5e0005730 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 msgr2=0x7fd5fc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5fc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 >> v1:172.21.15.103:6789/0 conn(0x7fd5fc071690 legacy=0x7fd5fc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc06f840 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fd5e8001670 con 0x7fd5fc0cafa0 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 >> v1:172.21.15.33:6789/0 conn(0x7fd5fc0cafa0 legacy=0x7fd5fc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5e0005bb0 0x7fd5e0005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5e00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5e0006f10 0x7fd5e0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc15aa30 con 0x7fd5e0006f10 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000dc40 con 0x7fd5e0005bb0 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.801+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000de00 con 0x7fd5fc156f60 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fb400640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5e0005bb0 0x7fd5e0005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5e0006f10 0x7fd5e0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5faa00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5e00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 -- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 msgr2=0x7fd5e00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5e00069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 -- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5e0005bb0 msgr2=0x7fd5e0005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5e0005bb0 0x7fd5e0005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fbe00640 1 -- 172.21.15.33:0/962276067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0005730 con 0x7fd5e0006f10 2024-09-13T18:57:45.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5faa00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5fc156f60 0x7fd5e00069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.802+0000 7fd5fb400640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5e0005bb0 0x7fd5e0005fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.803+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5e0006f10 0x7fd5e0007390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001e20 tx=0x7fd5e0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa74d5c88f2e217e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.803+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f402ae40 con 0x7fd5e0006f10 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.803+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4003970 con 0x7fd5e0006f10 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.803+0000 7fd5fa000640 1 -- 172.21.15.33:0/962276067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4003d20 con 0x7fd5e0006f10 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 -- 172.21.15.33:0/962276067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5e0006f10 msgr2=0x7fd5e0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 --2- 172.21.15.33:0/962276067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5e0006f10 0x7fd5e0007390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001e20 tx=0x7fd5e0007a00 comp rx=0 tx=0).stop 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd5fbe00640 1 -- 172.21.15.33:0/962276067 reap_dead start 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 -- 172.21.15.33:0/962276067 shutdown_connections 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 -- 172.21.15.33:0/962276067 >> 172.21.15.33:0/962276067 conn(0x7fd5fc0b0580 msgr2=0x7fd5fc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 -- 172.21.15.33:0/962276067 shutdown_connections 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.804+0000 7fd602000640 1 -- 172.21.15.33:0/962276067 wait complete. 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.806+0000 7fd602000640 1 Processor -- start 2024-09-13T18:57:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.806+0000 7fd602000640 1 -- start start 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 0x7fd5fc0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5fc1551a0 0x7fd5fc06be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc155b80 con 0x7fd5fc155620 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc1f1fa0 con 0x7fd5fc1551a0 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd602000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc1f11e0 con 0x7fd5e0006f10 2024-09-13T18:57:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59014/0 (socket says 172.21.15.33:59014) 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 -- 172.21.15.33:0/2292717702 learned_addr learned my addr 172.21.15.33:0/2292717702 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5faa00640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5fc1551a0 0x7fd5fc06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fb400640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 0x7fd5fc0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 -- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 msgr2=0x7fd5fc0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 0x7fd5fc0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 -- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5fc1551a0 msgr2=0x7fd5fc06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5fc1551a0 0x7fd5fc06be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fbe00640 1 -- 172.21.15.33:0/2292717702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc1f14c0 con 0x7fd5fc155620 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.807+0000 7fd5fb400640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 0x7fd5fc0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd5fbe00640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4005040 tx=0x7fd5f40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4006e80 con 0x7fd5fc155620 2024-09-13T18:57:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4003cf0 con 0x7fd5fc155620 2024-09-13T18:57:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40052d0 con 0x7fd5fc155620 2024-09-13T18:57:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5fc1f17a0 con 0x7fd5fc155620 2024-09-13T18:57:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.808+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5fc0ca690 con 0x7fd5fc155620 2024-09-13T18:57:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.809+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5fc1f1cc0 con 0x7fd5fc155620 2024-09-13T18:57:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.810+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5f4005430 con 0x7fd5fc155620 2024-09-13T18:57:45.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.811+0000 7fd5f3400640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 0x7fd5dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:45.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.811+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5f40a8b20 con 0x7fd5fc155620 2024-09-13T18:57:45.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.811+0000 7fd5fb400640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 0x7fd5dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:45.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.812+0000 7fd5fb400640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 0x7fd5dc06d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009bc0 tx=0x7fd5ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:45.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.815+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5fc1f1cc0 con 0x7fd5fc155620 2024-09-13T18:57:45.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.993+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5fc1f1cc0 con 0x7fd5fc155620 2024-09-13T18:57:45.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.993+0000 7fd5f3400640 1 -- 172.21.15.33:0/2292717702 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5fc1f1cc0 con 0x7fd5fc155620 2024-09-13T18:57:45.996 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:45.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 msgr2=0x7fd5dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 0x7fd5dc06d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009bc0 tx=0x7fd5ec008040 comp rx=0 tx=0).stop 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 msgr2=0x7fd5fc06c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4005040 tx=0x7fd5f40014a0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 shutdown_connections 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd5dc06ac30 0x7fd5dc06d0f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5fc155620 0x7fd5fc06c380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5fc1551a0 0x7fd5fc06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:45.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 --2- 172.21.15.33:0/2292717702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5e0006f10 0x7fd5fc0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 >> 172.21.15.33:0/2292717702 conn(0x7fd5fc0b0580 msgr2=0x7fd5fc157830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 shutdown_connections 2024-09-13T18:57:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:45.995+0000 7fd602000640 1 -- 172.21.15.33:0/2292717702 wait complete. 2024-09-13T18:57:46.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.167+0000 7efdc2400640 1 Processor -- start 2024-09-13T18:57:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.167+0000 7efdc2400640 1 -- start start 2024-09-13T18:57:46.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.168+0000 7efdc2400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdbc153b20 0x7efdbc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.168+0000 7efdc2400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc153f00 con 0x7efdbc159a80 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.168+0000 7efdc2400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0b1a40 con 0x7efdbc06f660 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.168+0000 7efdc2400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0ce600 con 0x7efdbc153b20 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbaa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efdbc159a80 0x7efdbc0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52716/0 (socket says 172.21.15.33:52716) 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdbc153b20 0x7efdbc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbaa00640 1 -- 172.21.15.33:0/2293385420 learned_addr learned my addr 172.21.15.33:0/2293385420 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbb400640 1 -- 172.21.15.33:0/2293385420 >> v1:172.21.15.103:6789/0 conn(0x7efdbc06f660 legacy=0x7efdbc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbb400640 1 -- 172.21.15.33:0/2293385420 >> v1:172.21.15.33:6789/0 conn(0x7efdbc159a80 legacy=0x7efdbc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdbb400640 1 -- 172.21.15.33:0/2293385420 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc15a1f0 con 0x7efdbc153b20 2024-09-13T18:57:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.169+0000 7efdba000640 1 -- 172.21.15.33:0/2293385420 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236718699 0 0) 0x7efdbc153f00 con 0x7efdbc159a80 2024-09-13T18:57:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.170+0000 7efdbb400640 1 --2- 172.21.15.33:0/2293385420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc153b20 0x7efdbc0b3990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097a0 tx=0x7efdac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a886b486a553bc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.170+0000 7efdba000640 1 -- 172.21.15.33:0/2293385420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac032440 con 0x7efdbc153b20 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.170+0000 7efdba000640 1 -- 172.21.15.33:0/2293385420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0325a0 con 0x7efdbc153b20 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.170+0000 7efdba000640 1 -- 172.21.15.33:0/2293385420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac032930 con 0x7efdbc153b20 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 -- 172.21.15.33:0/2293385420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc153b20 msgr2=0x7efdbc0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 --2- 172.21.15.33:0/2293385420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc153b20 0x7efdbc0b3990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097a0 tx=0x7efdac02a230 comp rx=0 tx=0).stop 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 -- 172.21.15.33:0/2293385420 shutdown_connections 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 --2- 172.21.15.33:0/2293385420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc153b20 0x7efdbc0b3990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 -- 172.21.15.33:0/2293385420 >> 172.21.15.33:0/2293385420 conn(0x7efdbc0b0510 msgr2=0x7efdbc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 -- 172.21.15.33:0/2293385420 shutdown_connections 2024-09-13T18:57:46.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.171+0000 7efdc2400640 1 -- 172.21.15.33:0/2293385420 wait complete. 2024-09-13T18:57:46.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.173+0000 7efdc2400640 1 Processor -- start 2024-09-13T18:57:46.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.173+0000 7efdc2400640 1 -- start start 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdbc06f660 0x7efdbc14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdbc153b20 0x7efdbc156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc14ea10 con 0x7efdbc159a80 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1f3230 con 0x7efdbc153b20 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdc2400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0b01c0 con 0x7efdbc06f660 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59040/0 (socket says 172.21.15.33:59040) 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.174+0000 7efdbbe00640 1 -- 172.21.15.33:0/1900164524 learned_addr learned my addr 172.21.15.33:0/1900164524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbb400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdbc06f660 0x7efdbc14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbaa00640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdbc153b20 0x7efdbc156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 -- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdbc06f660 msgr2=0x7efdbc14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdbc06f660 0x7efdbc14e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 -- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdbc153b20 msgr2=0x7efdbc156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdbc153b20 0x7efdbc156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 -- 172.21.15.33:0/1900164524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009400 con 0x7efdbc159a80 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdbbe00640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c6b0 tx=0x7efdb400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4003b70 con 0x7efdbc159a80 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb4003cf0 con 0x7efdbc159a80 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4005310 con 0x7efdbc159a80 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc157610 con 0x7efdbc159a80 2024-09-13T18:57:46.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.175+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc1f2900 con 0x7efdbc159a80 2024-09-13T18:57:46.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.177+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0b3780 con 0x7efdbc159a80 2024-09-13T18:57:46.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.178+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdb4005470 con 0x7efdbc159a80 2024-09-13T18:57:46.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.178+0000 7efdb3400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 0x7efd9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.178+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdb4089050 con 0x7efdbc159a80 2024-09-13T18:57:46.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.179+0000 7efdbb400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 0x7efd9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.179+0000 7efdbb400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 0x7efd9c06d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.183+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efdb40542c0 con 0x7efdbc159a80 2024-09-13T18:57:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.363+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdbc1f33a0 con 0x7efdbc159a80 2024-09-13T18:57:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.364+0000 7efdb3400640 1 -- 172.21.15.33:0/1900164524 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efdb4003e60 con 0x7efdbc159a80 2024-09-13T18:57:46.367 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:46.367 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 msgr2=0x7efd9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 0x7efd9c06d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 msgr2=0x7efdbc156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c6b0 tx=0x7efdb400cb70 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 shutdown_connections 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9c06ac00 0x7efd9c06d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdbc159a80 0x7efdbc156bd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdbc153b20 0x7efdbc156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 --2- 172.21.15.33:0/1900164524 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdbc06f660 0x7efdbc14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 >> 172.21.15.33:0/1900164524 conn(0x7efdbc0b0510 msgr2=0x7efdbc0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 shutdown_connections 2024-09-13T18:57:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.367+0000 7efdc2400640 1 -- 172.21.15.33:0/1900164524 wait complete. 2024-09-13T18:57:46.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:46.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.541+0000 7fcaa3800640 1 Processor -- start 2024-09-13T18:57:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.541+0000 7fcaa3800640 1 -- start start 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.542+0000 7fcaa3800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c156f60 0x7fca9c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.542+0000 7fcaa3800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fca9c0cafa0 0x7fca9c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.542+0000 7fcaa3800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c06f5f0 con 0x7fca9c0714c0 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.542+0000 7fcaa3800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c15aa30 con 0x7fca9c0cafa0 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.542+0000 7fcaa3800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c071930 con 0x7fca9c156f60 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fcaa1800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fca9c0714c0 0x7fca9c15d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52724/0 (socket says 172.21.15.33:52724) 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fcaa1800640 1 -- 172.21.15.33:0/2699404520 learned_addr learned my addr 172.21.15.33:0/2699404520 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca93e00640 1 --2- 172.21.15.33:0/2699404520 >> v2:172.21.15.33:3300/0 conn(0x7fca9c0cafa0 0x7fca9c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fcaa0e00640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c156f60 0x7fca9c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca93e00640 1 -- 172.21.15.33:0/2699404520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c156f60 msgr2=0x7fca9c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca93e00640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c156f60 0x7fca9c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca93e00640 1 -- 172.21.15.33:0/2699404520 >> v1:172.21.15.33:6789/0 conn(0x7fca9c0714c0 legacy=0x7fca9c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca93e00640 1 -- 172.21.15.33:0/2699404520 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c070450 con 0x7fca9c0cafa0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.543+0000 7fca9be00640 1 -- 172.21.15.33:0/2699404520 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514058098 0 0) 0x7fca9c06f5f0 con 0x7fca9c0714c0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.544+0000 7fca93e00640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0cafa0 0x7fca9c070f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca840097a0 tx=0x7fca8402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb3a4af793637fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fca9be00640 1 -- 172.21.15.33:0/2699404520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84032440 con 0x7fca9c0cafa0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fca9be00640 1 -- 172.21.15.33:0/2699404520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca840325a0 con 0x7fca9c0cafa0 2024-09-13T18:57:46.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fca9be00640 1 -- 172.21.15.33:0/2699404520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84032930 con 0x7fca9c0cafa0 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 -- 172.21.15.33:0/2699404520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0cafa0 msgr2=0x7fca9c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0cafa0 0x7fca9c070f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca840097a0 tx=0x7fca8402a180 comp rx=0 tx=0).stop 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 -- 172.21.15.33:0/2699404520 shutdown_connections 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c0cafa0 0x7fca9c070f80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 --2- 172.21.15.33:0/2699404520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c156f60 0x7fca9c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 -- 172.21.15.33:0/2699404520 >> 172.21.15.33:0/2699404520 conn(0x7fca9c0b0580 msgr2=0x7fca9c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 -- 172.21.15.33:0/2699404520 shutdown_connections 2024-09-13T18:57:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.545+0000 7fcaa3800640 1 -- 172.21.15.33:0/2699404520 wait complete. 2024-09-13T18:57:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.547+0000 7fcaa3800640 1 Processor -- start 2024-09-13T18:57:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.547+0000 7fcaa3800640 1 -- start start 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c0714c0 0x7fca9c145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca9c0cafa0 0x7fca9c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c145660 con 0x7fca9c156f60 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c155540 con 0x7fca9c0cafa0 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa3800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c155820 con 0x7fca9c0714c0 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59052/0 (socket says 172.21.15.33:59052) 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa1800640 1 -- 172.21.15.33:0/3201585680 learned_addr learned my addr 172.21.15.33:0/3201585680 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fca93e00640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca9c0cafa0 0x7fca9c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.548+0000 7fcaa0e00640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c0714c0 0x7fca9c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 -- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c0714c0 msgr2=0x7fca9c145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c0714c0 0x7fca9c145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 -- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca9c0cafa0 msgr2=0x7fca9c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca9c0cafa0 0x7fca9c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 -- 172.21.15.33:0/3201585680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84009400 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa1800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c7e0 tx=0x7fca9400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400a640 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400a7c0 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400ab70 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c155b00 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.549+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1560c0 con 0x7fca9c156f60 2024-09-13T18:57:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.550+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0cab20 con 0x7fca9c156f60 2024-09-13T18:57:46.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.551+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca9400acd0 con 0x7fca9c156f60 2024-09-13T18:57:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.553+0000 7fca99600640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 0x7fca7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.553+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca94088930 con 0x7fca9c156f60 2024-09-13T18:57:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.553+0000 7fcaa0e00640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 0x7fca7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.554+0000 7fcaa0e00640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 0x7fca7806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009aa0 tx=0x7fca8c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.557+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fca94053b20 con 0x7fca9c156f60 2024-09-13T18:57:46.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.735+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca9c1562b0 con 0x7fca9c156f60 2024-09-13T18:57:46.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.735+0000 7fca99600640 1 -- 172.21.15.33:0/3201585680 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca94018070 con 0x7fca9c156f60 2024-09-13T18:57:46.738 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 msgr2=0x7fca7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 0x7fca7806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009aa0 tx=0x7fca8c009190 comp rx=0 tx=0).stop 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 msgr2=0x7fca9c1f04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c7e0 tx=0x7fca9400cca0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 shutdown_connections 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fca7806ac00 0x7fca7806d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca9c156f60 0x7fca9c1f04b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca9c0cafa0 0x7fca9c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 --2- 172.21.15.33:0/3201585680 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fca9c0714c0 0x7fca9c145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.737+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 >> 172.21.15.33:0/3201585680 conn(0x7fca9c0b0580 msgr2=0x7fca9c1578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.738+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 shutdown_connections 2024-09-13T18:57:46.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.738+0000 7fcaa3800640 1 -- 172.21.15.33:0/3201585680 wait complete. 2024-09-13T18:57:46.755 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.911+0000 7fabc0000640 1 Processor -- start 2024-09-13T18:57:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.911+0000 7fabc0000640 1 -- start start 2024-09-13T18:57:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabc0000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fabb8071460 0x7fabb806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabc0000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80b2890 con 0x7fabb81461c0 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabc0000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80b1880 con 0x7fabb80b31b0 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabc0000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb80b1ad0 con 0x7fabb8071460 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabbe000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fabb8071460 0x7fabb806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabbd600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fabb81461c0 0x7fabb80b2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52730/0 (socket says 172.21.15.33:52730) 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.912+0000 7fabbd600640 1 -- 172.21.15.33:0/842635273 learned_addr learned my addr 172.21.15.33:0/842635273 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.913+0000 7fabbe000640 1 -- 172.21.15.33:0/842635273 >> v1:172.21.15.103:6789/0 conn(0x7fabb80b31b0 legacy=0x7fabb806bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.913+0000 7fabbe000640 1 -- 172.21.15.33:0/842635273 >> v1:172.21.15.33:6789/0 conn(0x7fabb81461c0 legacy=0x7fabb80b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.913+0000 7fabb7e00640 1 -- 172.21.15.33:0/842635273 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214930819 0 0) 0x7fabb80b1880 con 0x7fabb80b31b0 2024-09-13T18:57:46.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.913+0000 7fabbe000640 1 -- 172.21.15.33:0/842635273 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80b1db0 con 0x7fabb8071460 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.914+0000 7fabbe000640 1 --2- 172.21.15.33:0/842635273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb8071460 0x7fabb806c5b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fabb00097a0 tx=0x7fabb002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14d4a6dcd7090db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.914+0000 7fabb7e00640 1 -- 172.21.15.33:0/842635273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb002ac90 con 0x7fabb8071460 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.914+0000 7fabb7e00640 1 -- 172.21.15.33:0/842635273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb002adf0 con 0x7fabb8071460 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.914+0000 7fabb7e00640 1 -- 172.21.15.33:0/842635273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0032660 con 0x7fabb8071460 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 -- 172.21.15.33:0/842635273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb8071460 msgr2=0x7fabb806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 --2- 172.21.15.33:0/842635273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb8071460 0x7fabb806c5b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fabb00097a0 tx=0x7fabb002a000 comp rx=0 tx=0).stop 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 -- 172.21.15.33:0/842635273 shutdown_connections 2024-09-13T18:57:46.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 --2- 172.21.15.33:0/842635273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb8071460 0x7fabb806c5b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 -- 172.21.15.33:0/842635273 >> 172.21.15.33:0/842635273 conn(0x7fabb80b0580 msgr2=0x7fabb80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 -- 172.21.15.33:0/842635273 shutdown_connections 2024-09-13T18:57:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.915+0000 7fabc0000640 1 -- 172.21.15.33:0/842635273 wait complete. 2024-09-13T18:57:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.916+0000 7fabc0000640 1 Processor -- start 2024-09-13T18:57:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.916+0000 7fabc0000640 1 -- start start 2024-09-13T18:57:46.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 0x7fabb8166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 0x7fabb81647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb81435d0 con 0x7fabb81461c0 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8142770 con 0x7fabb8071460 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.917+0000 7fabc0000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8145930 con 0x7fabb80b31b0 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59074/0 (socket says 172.21.15.33:59074) 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 -- 172.21.15.33:0/2941172719 learned_addr learned my addr 172.21.15.33:0/2941172719 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbd600640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 0x7fabb8166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbcc00640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 0x7fabb81647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 -- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 msgr2=0x7fabb81647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 0x7fabb81647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 -- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 msgr2=0x7fabb8166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 0x7fabb8166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 -- 172.21.15.33:0/2941172719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0009400 con 0x7fabb81461c0 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbd600640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 0x7fabb8166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbcc00640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 0x7fabb81647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.918+0000 7fabbe000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabb0035040 tx=0x7fabb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.919+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb003c670 con 0x7fabb81461c0 2024-09-13T18:57:46.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.919+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb003c7f0 con 0x7fabb81461c0 2024-09-13T18:57:46.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.919+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb81429c0 con 0x7fabb81461c0 2024-09-13T18:57:46.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.919+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb003cba0 con 0x7fabb81461c0 2024-09-13T18:57:46.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.919+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb8142f80 con 0x7fabb81461c0 2024-09-13T18:57:46.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.920+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb8143780 con 0x7fabb81461c0 2024-09-13T18:57:46.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.921+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabb0039040 con 0x7fabb81461c0 2024-09-13T18:57:46.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.922+0000 7fabb5600640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 0x7fab9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:46.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.922+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb00a9b70 con 0x7fabb81461c0 2024-09-13T18:57:46.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.922+0000 7fabbd600640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 0x7fab9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:46.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.923+0000 7fabbd600640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 0x7fab9806d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:46.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:46.926+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabb8143780 con 0x7fabb81461c0 2024-09-13T18:57:47.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.104+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabb8143780 con 0x7fabb81461c0 2024-09-13T18:57:47.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.105+0000 7fabb5600640 1 -- 172.21.15.33:0/2941172719 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabb8143780 con 0x7fabb81461c0 2024-09-13T18:57:47.107 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 msgr2=0x7fab9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 0x7fab9806d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac009040 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 msgr2=0x7fabb8154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabb0035040 tx=0x7fabb00046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 shutdown_connections 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fab9806ac00 0x7fab9806d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb81461c0 0x7fabb8154ff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabb80b31b0 0x7fabb81647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 --2- 172.21.15.33:0/2941172719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabb8071460 0x7fabb8166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 >> 172.21.15.33:0/2941172719 conn(0x7fabb80b0580 msgr2=0x7fabb8160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 shutdown_connections 2024-09-13T18:57:47.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.107+0000 7fabc0000640 1 -- 172.21.15.33:0/2941172719 wait complete. 2024-09-13T18:57:47.126 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.281+0000 7fa2b5600640 1 Processor -- start 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.282+0000 7fa2b5600640 1 -- start start 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b5600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2b015c640 0x7fa2b006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b5600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2b0071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b5600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b00ac870 con 0x7fa2b0071900 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b5600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b00716a0 con 0x7fa2b015c640 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b5600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00b2fc0 con 0x7fa2b0070cb0 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2a7400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa2b0071900 0x7fa2b0160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52738/0 (socket says 172.21.15.33:52738) 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2a7400640 1 -- 172.21.15.33:0/686549584 learned_addr learned my addr 172.21.15.33:0/686549584 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2afe00640 1 --2- 172.21.15.33:0/686549584 >> v2:172.21.15.103:3300/0 conn(0x7fa2b015c640 0x7fa2b006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2b4c00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2b0071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.283+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034422789 0 0) 0x7fa2b00ac870 con 0x7fa2b0071900 2024-09-13T18:57:47.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa294003520 con 0x7fa2b0071900 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4186683690 0 0) 0x7fa294003520 con 0x7fa2b0071900 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 msgr2=0x7fa2b0071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2b0071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 >> v2:172.21.15.103:3300/0 conn(0x7fa2b015c640 msgr2=0x7fa2b006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 --2- 172.21.15.33:0/686549584 >> v2:172.21.15.103:3300/0 conn(0x7fa2b015c640 0x7fa2b006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b015ca20 con 0x7fa2b0071900 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fa298001670 con 0x7fa2b0071900 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 >> v1:172.21.15.33:6789/0 conn(0x7fa2b0071900 legacy=0x7fa2b0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa294003970 0x7fa294003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa294004d00 0x7fa294005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00716a0 con 0x7fa294003970 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00b2fc0 con 0x7fa294004d00 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29400b980 con 0x7fa2b0070cb0 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2afe00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa294003970 0x7fa294003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2a7400640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.284+0000 7fa2b4c00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa294004d00 0x7fa294005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.285+0000 7fa2afe00640 1 -- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 msgr2=0x7fa2940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.285+0000 7fa2afe00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2b0070cb0 0x7fa2940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.285+0000 7fa2afe00640 1 -- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa294004d00 msgr2=0x7fa294005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.285+0000 7fa2afe00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa294004d00 0x7fa294005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.285+0000 7fa2afe00640 1 -- 172.21.15.33:0/686549584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294003520 con 0x7fa294003970 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.286+0000 7fa2afe00640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa294003970 0x7fa294003d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009af0 tx=0x7fa2940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2903ae1ebd56fae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.286+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0031400 con 0x7fa294003970 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.286+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a002d050 con 0x7fa294003970 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.286+0000 7fa2af400640 1 -- 172.21.15.33:0/686549584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0031580 con 0x7fa294003970 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 -- 172.21.15.33:0/686549584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa294003970 msgr2=0x7fa294003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 --2- 172.21.15.33:0/686549584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa294003970 0x7fa294003d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009af0 tx=0x7fa2940057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b4c00640 1 -- 172.21.15.33:0/686549584 reap_dead start 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 -- 172.21.15.33:0/686549584 shutdown_connections 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 -- 172.21.15.33:0/686549584 >> 172.21.15.33:0/686549584 conn(0x7fa2b006ad20 msgr2=0x7fa2b006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 -- 172.21.15.33:0/686549584 shutdown_connections 2024-09-13T18:57:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.287+0000 7fa2b5600640 1 -- 172.21.15.33:0/686549584 wait complete. 2024-09-13T18:57:47.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.288+0000 7fa2b5600640 1 Processor -- start 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.289+0000 7fa2b5600640 1 -- start start 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.289+0000 7fa2b5600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 0x7fa2b014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.289+0000 7fa2b5600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.289+0000 7fa2b5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b0158ac0 0x7fa2b0158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2b5600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00ce0c0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2b5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0150460 con 0x7fa2b0158ac0 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2b5600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0150740 con 0x7fa294003970 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59090/0 (socket says 172.21.15.33:59090) 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 -- 172.21.15.33:0/3958154724 learned_addr learned my addr 172.21.15.33:0/3958154724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2b4c00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b0158ac0 0x7fa2b0158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2afe00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 0x7fa2b014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 -- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 msgr2=0x7fa2b014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 0x7fa2b014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 -- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b0158ac0 msgr2=0x7fa2b0158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b0158ac0 0x7fa2b0158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2a7400640 1 -- 172.21.15.33:0/3958154724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0150a20 con 0x7fa2b014f7a0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.290+0000 7fa2afe00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 0x7fa2b014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2a7400640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa298004f90 tx=0x7fa2980074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298007740 con 0x7fa2b014f7a0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800f9c0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800fd50 con 0x7fa2b014f7a0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b0150d00 con 0x7fa2b014f7a0 2024-09-13T18:57:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.291+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0150160 con 0x7fa2b014f7a0 2024-09-13T18:57:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.292+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b01587e0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.293+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa29801d460 con 0x7fa2b014f7a0 2024-09-13T18:57:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.294+0000 7fa2acc00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 0x7fa28c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.294+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa298089410 con 0x7fa2b014f7a0 2024-09-13T18:57:47.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.295+0000 7fa2afe00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 0x7fa28c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.295+0000 7fa2afe00640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 0x7fa28c06d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.299+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa2b01587e0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.476+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2b01587e0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.476+0000 7fa2acc00640 1 -- 172.21.15.33:0/3958154724 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2b01587e0 con 0x7fa2b014f7a0 2024-09-13T18:57:47.478 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 msgr2=0x7fa28c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 0x7fa28c06d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a0008030 comp rx=0 tx=0).stop 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 msgr2=0x7fa2b014fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa298004f90 tx=0x7fa2980074f0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 shutdown_connections 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa28c06ac30 0x7fa28c06d0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2b0158ac0 0x7fa2b0158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2b014f7a0 0x7fa2b014fc20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 --2- 172.21.15.33:0/3958154724 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa294003970 0x7fa2b014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 >> 172.21.15.33:0/3958154724 conn(0x7fa2b006ad20 msgr2=0x7fa2b00ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 shutdown_connections 2024-09-13T18:57:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.478+0000 7fa2b5600640 1 -- 172.21.15.33:0/3958154724 wait complete. 2024-09-13T18:57:47.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:47.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.650+0000 7fc885000640 1 Processor -- start 2024-09-13T18:57:47.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.650+0000 7fc885000640 1 -- start start 2024-09-13T18:57:47.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8801463c0 0x7fc8800cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc88015cbc0 0x7fc8800d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc8800d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800b5540 con 0x7fc8801463c0 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800b60c0 con 0x7fc88015cbc0 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc885000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800d2350 con 0x7fc8800cf000 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc87f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8801463c0 0x7fc8800cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc87f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8801463c0 0x7fc8800cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59092/0 (socket says 172.21.15.33:59092) 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.651+0000 7fc87f400640 1 -- 172.21.15.33:0/1264578863 learned_addr learned my addr 172.21.15.33:0/1264578863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc877e00640 1 --2- 172.21.15.33:0/1264578863 >> v2:172.21.15.103:3300/0 conn(0x7fc88015cbc0 0x7fc8800d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87fe00640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc8800d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87f400640 1 -- 172.21.15.33:0/1264578863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 msgr2=0x7fc8800d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87f400640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc8800d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87f400640 1 -- 172.21.15.33:0/1264578863 >> v2:172.21.15.103:3300/0 conn(0x7fc88015cbc0 msgr2=0x7fc8800d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:47.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87f400640 1 --2- 172.21.15.33:0/1264578863 >> v2:172.21.15.103:3300/0 conn(0x7fc88015cbc0 0x7fc8800d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87f400640 1 -- 172.21.15.33:0/1264578863 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800b5790 con 0x7fc8801463c0 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.652+0000 7fc87fe00640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc8800d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.653+0000 7fc87f400640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8801463c0 0x7fc8800cfef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc88006a110 tx=0x7fc87002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b2b8b60631dfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.653+0000 7fc87ea00640 1 -- 172.21.15.33:0/1264578863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870032440 con 0x7fc8801463c0 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.653+0000 7fc87ea00640 1 -- 172.21.15.33:0/1264578863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700325a0 con 0x7fc8801463c0 2024-09-13T18:57:47.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.653+0000 7fc87ea00640 1 -- 172.21.15.33:0/1264578863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870032930 con 0x7fc8801463c0 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 -- 172.21.15.33:0/1264578863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8801463c0 msgr2=0x7fc8800cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8801463c0 0x7fc8800cfef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc88006a110 tx=0x7fc87002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 -- 172.21.15.33:0/1264578863 shutdown_connections 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc8800d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 --2- 172.21.15.33:0/1264578863 >> v2:172.21.15.103:3300/0 conn(0x7fc88015cbc0 0x7fc8800d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 --2- 172.21.15.33:0/1264578863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8801463c0 0x7fc8800cfef0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 -- 172.21.15.33:0/1264578863 >> 172.21.15.33:0/1264578863 conn(0x7fc8800b4420 msgr2=0x7fc8800b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:47.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 -- 172.21.15.33:0/1264578863 shutdown_connections 2024-09-13T18:57:47.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.654+0000 7fc885000640 1 -- 172.21.15.33:0/1264578863 wait complete. 2024-09-13T18:57:47.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.656+0000 7fc885000640 1 Processor -- start 2024-09-13T18:57:47.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.656+0000 7fc885000640 1 -- start start 2024-09-13T18:57:47.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc88013da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8801463c0 0x7fc8800cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c8d60 con 0x7fc88015cbc0 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c9040 con 0x7fc8801463c0 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc885000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88013df70 con 0x7fc8800cf000 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc87fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc87f400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc88013da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc87fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59106/0 (socket says 172.21.15.33:59106) 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc877e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8801463c0 0x7fc8800cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.657+0000 7fc87fe00640 1 -- 172.21.15.33:0/4142295239 learned_addr learned my addr 172.21.15.33:0/4142295239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 -- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 msgr2=0x7fc88013da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc88013da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 -- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8801463c0 msgr2=0x7fc8800cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8801463c0 0x7fc8800cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 -- 172.21.15.33:0/4142295239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700094d0 con 0x7fc88015cbc0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc87fe00640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc878007e20 tx=0x7fc87800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878015600 con 0x7fc88015cbc0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800f040 con 0x7fc88015cbc0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8800ce1e0 con 0x7fc88015cbc0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780159c0 con 0x7fc88015cbc0 2024-09-13T18:57:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.658+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8800ce7a0 con 0x7fc88015cbc0 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.659+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc880067360 con 0x7fc88015cbc0 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.660+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc87801e3b0 con 0x7fc88015cbc0 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.661+0000 7fc877400640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 0x7fc85c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.661+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc878089540 con 0x7fc88015cbc0 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.662+0000 7fc87f400640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 0x7fc85c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.662+0000 7fc87f400640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 0x7fc85c06d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc870034000 tx=0x7fc87002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:47.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.665+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc8780547c0 con 0x7fc88015cbc0 2024-09-13T18:57:47.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.847+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc88006c5c0 con 0x7fc88015cbc0 2024-09-13T18:57:47.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.848+0000 7fc877400640 1 -- 172.21.15.33:0/4142295239 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fc878057de0 con 0x7fc88015cbc0 2024-09-13T18:57:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:47.851 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 msgr2=0x7fc85c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 0x7fc85c06d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc870034000 tx=0x7fc87002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 msgr2=0x7fc880140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc878007e20 tx=0x7fc87800d4a0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 shutdown_connections 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc85c06ac30 0x7fc85c06d0f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc88015cbc0 0x7fc880140710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8801463c0 0x7fc8800cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 --2- 172.21.15.33:0/4142295239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8800cf000 0x7fc88013da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:47.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 >> 172.21.15.33:0/4142295239 conn(0x7fc8800b4420 msgr2=0x7fc8800d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:47.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 shutdown_connections 2024-09-13T18:57:47.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:47.850+0000 7fc885000640 1 -- 172.21.15.33:0/4142295239 wait complete. 2024-09-13T18:57:47.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:47.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.025+0000 7fb870e00640 1 Processor -- start 2024-09-13T18:57:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.025+0000 7fb870e00640 1 -- start start 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.026+0000 7fb870e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.026+0000 7fb870e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb86c0cafa0 0x7fb86c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.026+0000 7fb870e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c06f5f0 con 0x7fb86c0714c0 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.026+0000 7fb870e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c15aa30 con 0x7fb86c0cafa0 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.026+0000 7fb870e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c071930 con 0x7fb86c156f60 2024-09-13T18:57:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:33996/0 (socket says 172.21.15.33:33996) 2024-09-13T18:57:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 -- 172.21.15.33:0/2309694032 learned_addr learned my addr 172.21.15.33:0/2309694032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb863e00640 1 --2- 172.21.15.33:0/2309694032 >> v2:172.21.15.103:3300/0 conn(0x7fb86c0cafa0 0x7fb86c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 -- 172.21.15.33:0/2309694032 >> v2:172.21.15.103:3300/0 conn(0x7fb86c0cafa0 msgr2=0x7fb86c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 --2- 172.21.15.33:0/2309694032 >> v2:172.21.15.103:3300/0 conn(0x7fb86c0cafa0 0x7fb86c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 -- 172.21.15.33:0/2309694032 >> v1:172.21.15.103:6789/0 conn(0x7fb86c0714c0 legacy=0x7fb86c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.027+0000 7fb869e00640 1 -- 172.21.15.33:0/2309694032 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c070450 con 0x7fb86c156f60 2024-09-13T18:57:48.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.028+0000 7fb869e00640 1 --2- 172.21.15.33:0/2309694032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c311545f4132590a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.028+0000 7fb869400640 1 -- 172.21.15.33:0/2309694032 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c032440 con 0x7fb86c156f60 2024-09-13T18:57:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.028+0000 7fb869400640 1 -- 172.21.15.33:0/2309694032 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0325a0 con 0x7fb86c156f60 2024-09-13T18:57:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.028+0000 7fb869400640 1 -- 172.21.15.33:0/2309694032 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c032930 con 0x7fb86c156f60 2024-09-13T18:57:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 -- 172.21.15.33:0/2309694032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 msgr2=0x7fb86c15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 --2- 172.21.15.33:0/2309694032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c02a270 comp rx=0 tx=0).stop 2024-09-13T18:57:48.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 -- 172.21.15.33:0/2309694032 shutdown_connections 2024-09-13T18:57:48.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 --2- 172.21.15.33:0/2309694032 >> v2:172.21.15.103:3300/0 conn(0x7fb86c0cafa0 0x7fb86c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 --2- 172.21.15.33:0/2309694032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c156f60 0x7fb86c15a4f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 -- 172.21.15.33:0/2309694032 >> 172.21.15.33:0/2309694032 conn(0x7fb86c0b0580 msgr2=0x7fb86c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 -- 172.21.15.33:0/2309694032 shutdown_connections 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.029+0000 7fb870e00640 1 -- 172.21.15.33:0/2309694032 wait complete. 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.031+0000 7fb870e00640 1 Processor -- start 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.031+0000 7fb870e00640 1 -- start start 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 0x7fb86c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0cafa0 0x7fb86c148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0c8b30 con 0x7fb86c156f60 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1500c0 con 0x7fb86c0714c0 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb870e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c15c770 con 0x7fb86c0cafa0 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb86a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb86a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59116/0 (socket says 172.21.15.33:59116) 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb86a800640 1 -- 172.21.15.33:0/2857070277 learned_addr learned my addr 172.21.15.33:0/2857070277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb869e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 0x7fb86c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.032+0000 7fb863e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0cafa0 0x7fb86c148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 -- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0cafa0 msgr2=0x7fb86c148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0cafa0 0x7fb86c148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 -- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 msgr2=0x7fb86c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 0x7fb86c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 -- 172.21.15.33:0/2857070277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094d0 con 0x7fb86c156f60 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb869e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 0x7fb86c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb86a800640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c7a0 tx=0x7fb86400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864003b70 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864003cf0 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400aa90 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c1493e0 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.033+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c0c8570 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.035+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c15c5d0 con 0x7fb86c156f60 2024-09-13T18:57:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.035+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb86400abf0 con 0x7fb86c156f60 2024-09-13T18:57:48.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.036+0000 7fb862000640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 0x7fb84806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.036+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb864089040 con 0x7fb86c156f60 2024-09-13T18:57:48.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.037+0000 7fb869e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 0x7fb84806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.037+0000 7fb869e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 0x7fb84806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb85c034000 tx=0x7fb85c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.040+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb86c15c5d0 con 0x7fb86c156f60 2024-09-13T18:57:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.221+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb86c15c5d0 con 0x7fb86c156f60 2024-09-13T18:57:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.222+0000 7fb862000640 1 -- 172.21.15.33:0/2857070277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb86c15c5d0 con 0x7fb86c156f60 2024-09-13T18:57:48.225 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 msgr2=0x7fb84806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 0x7fb84806d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb85c034000 tx=0x7fb85c02e000 comp rx=0 tx=0).stop 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 msgr2=0x7fb86c0c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c7a0 tx=0x7fb86400cc60 comp rx=0 tx=0).stop 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 shutdown_connections 2024-09-13T18:57:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac00 0x7fb84806d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c156f60 0x7fb86c0c7c00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0cafa0 0x7fb86c148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 --2- 172.21.15.33:0/2857070277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0714c0 0x7fb86c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 >> 172.21.15.33:0/2857070277 conn(0x7fb86c0b0580 msgr2=0x7fb86c0cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 shutdown_connections 2024-09-13T18:57:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.224+0000 7fb870e00640 1 -- 172.21.15.33:0/2857070277 wait complete. 2024-09-13T18:57:48.242 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:48.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.397+0000 7ff0f3e00640 1 Processor -- start 2024-09-13T18:57:48.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.397+0000 7ff0f3e00640 1 -- start start 2024-09-13T18:57:48.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 0x7ff0f40acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f406b9a0 con 0x7ff0f4145ec0 2024-09-13T18:57:48.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40ad240 con 0x7ff0f40ac870 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f406c970 con 0x7ff0f406b510 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 0x7ff0f40acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:34020/0 (socket says 172.21.15.33:34020) 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0f3400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 0x7ff0f40acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54722/0 (socket says 172.21.15.33:54722) 2024-09-13T18:57:48.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.399+0000 7ff0ebe00640 1 -- 172.21.15.33:0/3379952371 learned_addr learned my addr 172.21.15.33:0/3379952371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.400+0000 7ff0ebe00640 1 -- 172.21.15.33:0/3379952371 >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 msgr2=0x7ff0f40acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.400+0000 7ff0ebe00640 1 --2- 172.21.15.33:0/3379952371 >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 0x7ff0f40acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.400+0000 7ff0ebe00640 1 -- 172.21.15.33:0/3379952371 >> v1:172.21.15.103:6789/0 conn(0x7ff0f4145ec0 legacy=0x7ff0f40adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.400+0000 7ff0ebe00640 1 -- 172.21.15.33:0/3379952371 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f406bc80 con 0x7ff0f406b510 2024-09-13T18:57:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0ebe00640 1 --2- 172.21.15.33:0/3379952371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009870 tx=0x7ff0dc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3357cd3dc568c5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0f2000640 1 -- 172.21.15.33:0/3379952371 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc032440 con 0x7ff0f406b510 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0f2000640 1 -- 172.21.15.33:0/3379952371 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0325a0 con 0x7ff0f406b510 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0f2000640 1 -- 172.21.15.33:0/3379952371 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc032930 con 0x7ff0f406b510 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0f3e00640 1 -- 172.21.15.33:0/3379952371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 msgr2=0x7ff0f40b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.401+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/3379952371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009870 tx=0x7ff0dc02a270 comp rx=0 tx=0).stop 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 -- 172.21.15.33:0/3379952371 shutdown_connections 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/3379952371 >> v2:172.21.15.103:3300/0 conn(0x7ff0f40ac870 0x7ff0f40acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/3379952371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f406b510 0x7ff0f40b2740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 -- 172.21.15.33:0/3379952371 >> 172.21.15.33:0/3379952371 conn(0x7ff0f4069ed0 msgr2=0x7ff0f406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 -- 172.21.15.33:0/3379952371 shutdown_connections 2024-09-13T18:57:48.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.402+0000 7ff0f3e00640 1 -- 172.21.15.33:0/3379952371 wait complete. 2024-09-13T18:57:48.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.403+0000 7ff0f3e00640 1 Processor -- start 2024-09-13T18:57:48.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.403+0000 7ff0f3e00640 1 -- start start 2024-09-13T18:57:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f40ac870 0x7ff0f40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 0x7ff0f4136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4137af0 con 0x7ff0f41f19e0 2024-09-13T18:57:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c6020 con 0x7ff0f4145ec0 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.404+0000 7ff0f3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f413aea0 con 0x7ff0f40ac870 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 0x7ff0f4136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59122/0 (socket says 172.21.15.33:59122) 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 -- 172.21.15.33:0/2108105113 learned_addr learned my addr 172.21.15.33:0/2108105113 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f2a00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f40ac870 0x7ff0f40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 -- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f40ac870 msgr2=0x7ff0f40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f40ac870 0x7ff0f40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 -- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 msgr2=0x7ff0f4136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 0x7ff0f4136b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0f3400640 1 -- 172.21.15.33:0/2108105113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0094d0 con 0x7ff0f41f19e0 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.405+0000 7ff0ebe00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 0x7ff0f4136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0f3400640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00efc0 tx=0x7ff0ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014480 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00f040 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014820 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4137250 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.406+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f4137810 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.407+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40c5d80 con 0x7ff0f41f19e0 2024-09-13T18:57:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.408+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff0ec014980 con 0x7ff0f41f19e0 2024-09-13T18:57:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.409+0000 7ff0eaa00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 0x7ff0d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.409+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0ec089e40 con 0x7ff0f41f19e0 2024-09-13T18:57:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.409+0000 7ff0f2a00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 0x7ff0d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.410+0000 7ff0f2a00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 0x7ff0d006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000f60 tx=0x7ff0e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.413+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff0f40c5d80 con 0x7ff0f41f19e0 2024-09-13T18:57:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.591+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0f40c6160 con 0x7ff0f41f19e0 2024-09-13T18:57:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.592+0000 7ff0eaa00640 1 -- 172.21.15.33:0/2108105113 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0f40c6160 con 0x7ff0f41f19e0 2024-09-13T18:57:48.597 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 msgr2=0x7ff0d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 0x7ff0d006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000f60 tx=0x7ff0e4009040 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 msgr2=0x7ff0f40cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00efc0 tx=0x7ff0ec00c490 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 shutdown_connections 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff0d006ac00 0x7ff0d006d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0f41f19e0 0x7ff0f40cb210 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f4145ec0 0x7ff0f4136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 --2- 172.21.15.33:0/2108105113 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0f40ac870 0x7ff0f40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 >> 172.21.15.33:0/2108105113 conn(0x7ff0f4069ed0 msgr2=0x7ff0f40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 shutdown_connections 2024-09-13T18:57:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.594+0000 7ff0f3e00640 1 -- 172.21.15.33:0/2108105113 wait complete. 2024-09-13T18:57:48.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.768+0000 7fbde6a00640 1 Processor -- start 2024-09-13T18:57:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.768+0000 7fbde6a00640 1 -- start start 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbde0154ad0 0x7fbde00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbde006f830 0x7fbde006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde00ce2c0 0x7fbde00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde006b5b0 con 0x7fbde0154ad0 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde006b7c0 con 0x7fbde006f830 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbde6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde006baa0 con 0x7fbde00ce2c0 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbddfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbde0154ad0 0x7fbde00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbddfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbde0154ad0 0x7fbde00cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59128/0 (socket says 172.21.15.33:59128) 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbddfe00640 1 -- 172.21.15.33:0/3124483734 learned_addr learned my addr 172.21.15.33:0/3124483734 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.769+0000 7fbdd7e00640 1 --2- 172.21.15.33:0/3124483734 >> v2:172.21.15.103:3300/0 conn(0x7fbde006f830 0x7fbde006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbde4a00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde00ce2c0 0x7fbde00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbddfe00640 1 -- 172.21.15.33:0/3124483734 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde00ce2c0 msgr2=0x7fbde00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbddfe00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde00ce2c0 0x7fbde00cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbddfe00640 1 -- 172.21.15.33:0/3124483734 >> v2:172.21.15.103:3300/0 conn(0x7fbde006f830 msgr2=0x7fbde006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbddfe00640 1 --2- 172.21.15.33:0/3124483734 >> v2:172.21.15.103:3300/0 conn(0x7fbde006f830 0x7fbde006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.770+0000 7fbddfe00640 1 -- 172.21.15.33:0/3124483734 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde006bd80 con 0x7fbde0154ad0 2024-09-13T18:57:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.771+0000 7fbddfe00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde0154ad0 0x7fbde00cdd80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbde00ae4c0 tx=0x7fbdd002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ea2e3be15c75a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.771+0000 7fbddf400640 1 -- 172.21.15.33:0/3124483734 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd002ae90 con 0x7fbde0154ad0 2024-09-13T18:57:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.771+0000 7fbddf400640 1 -- 172.21.15.33:0/3124483734 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd0032440 con 0x7fbde0154ad0 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.771+0000 7fbddf400640 1 -- 172.21.15.33:0/3124483734 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00327d0 con 0x7fbde0154ad0 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 -- 172.21.15.33:0/3124483734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde0154ad0 msgr2=0x7fbde00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde0154ad0 0x7fbde00cdd80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbde00ae4c0 tx=0x7fbdd002a140 comp rx=0 tx=0).stop 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 -- 172.21.15.33:0/3124483734 shutdown_connections 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde00ce2c0 0x7fbde00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 --2- 172.21.15.33:0/3124483734 >> v2:172.21.15.103:3300/0 conn(0x7fbde006f830 0x7fbde006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 --2- 172.21.15.33:0/3124483734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde0154ad0 0x7fbde00cdd80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 -- 172.21.15.33:0/3124483734 >> 172.21.15.33:0/3124483734 conn(0x7fbde00b0580 msgr2=0x7fbde00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 -- 172.21.15.33:0/3124483734 shutdown_connections 2024-09-13T18:57:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.772+0000 7fbde6a00640 1 -- 172.21.15.33:0/3124483734 wait complete. 2024-09-13T18:57:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.773+0000 7fbde6a00640 1 Processor -- start 2024-09-13T18:57:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.774+0000 7fbde6a00640 1 -- start start 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.774+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 0x7fbde0150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 0x7fbde014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde014bed0 con 0x7fbde013e0b0 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde014de70 con 0x7fbde014d9f0 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde014b5c0 con 0x7fbde0154ad0 2024-09-13T18:57:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59144/0 (socket says 172.21.15.33:59144) 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 -- 172.21.15.33:0/452156870 learned_addr learned my addr 172.21.15.33:0/452156870 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde4a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 0x7fbde014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbddfe00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 0x7fbde0150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 -- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 msgr2=0x7fbde0150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 0x7fbde0150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 -- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 msgr2=0x7fbde014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 0x7fbde014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbdd7e00640 1 -- 172.21.15.33:0/452156870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00094d0 con 0x7fbde013e0b0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbde4a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 0x7fbde014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.775+0000 7fbddfe00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 0x7fbde0150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbdd7e00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d800 tx=0x7fbdc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80096a0 con 0x7fbde013e0b0 2024-09-13T18:57:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8009800 con 0x7fbde013e0b0 2024-09-13T18:57:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8009b90 con 0x7fbde013e0b0 2024-09-13T18:57:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde01506d0 con 0x7fbde013e0b0 2024-09-13T18:57:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.776+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde014baf0 con 0x7fbde013e0b0 2024-09-13T18:57:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.777+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde014c010 con 0x7fbde013e0b0 2024-09-13T18:57:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.778+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdc8009cf0 con 0x7fbde013e0b0 2024-09-13T18:57:48.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.779+0000 7fbddcc00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 0x7fbdbc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:48.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.779+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdc80899f0 con 0x7fbde013e0b0 2024-09-13T18:57:48.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.779+0000 7fbddfe00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 0x7fbdbc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:48.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.780+0000 7fbddfe00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 0x7fbdbc06d0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034000 tx=0x7fbdd002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.783+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbde014c010 con 0x7fbde013e0b0 2024-09-13T18:57:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.963+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbde014c010 con 0x7fbde013e0b0 2024-09-13T18:57:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.963+0000 7fbddcc00640 1 -- 172.21.15.33:0/452156870 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbde014c010 con 0x7fbde013e0b0 2024-09-13T18:57:48.965 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 msgr2=0x7fbdbc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 0x7fbdbc06d0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034000 tx=0x7fbdd002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 msgr2=0x7fbde014d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d800 tx=0x7fbdc800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 shutdown_connections 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdbc06ac30 0x7fbdbc06d0f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde014d9f0 0x7fbde014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbde013e0b0 0x7fbde014d4b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 --2- 172.21.15.33:0/452156870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbde0154ad0 0x7fbde0150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.965+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 >> 172.21.15.33:0/452156870 conn(0x7fbde00b0580 msgr2=0x7fbde00b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.966+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 shutdown_connections 2024-09-13T18:57:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:48.966+0000 7fbde6a00640 1 -- 172.21.15.33:0/452156870 wait complete. 2024-09-13T18:57:48.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:49.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.136+0000 7f0559e00640 1 Processor -- start 2024-09-13T18:57:49.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.137+0000 7f0559e00640 1 -- start start 2024-09-13T18:57:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0554159480 0x7f05540ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f055406f4b0 0x7f0554070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540717c0 con 0x7f0554071390 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540cd850 con 0x7f055406f4b0 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540cd570 con 0x7f0554159480 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0554071390 0x7f055415ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52748/0 (socket says 172.21.15.33:52748) 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0553e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f055406f4b0 0x7f0554070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0559400640 1 -- 172.21.15.33:0/2082733353 learned_addr learned my addr 172.21.15.33:0/2082733353 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0558a00640 1 --2- 172.21.15.33:0/2082733353 >> v2:172.21.15.103:3300/0 conn(0x7f0554159480 0x7f05540ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.138+0000 7f0553400640 1 -- 172.21.15.33:0/2082733353 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536304140 0 0) 0x7f05540717c0 con 0x7f0554071390 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.139+0000 7f0553400640 1 -- 172.21.15.33:0/2082733353 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c003520 con 0x7f0554071390 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.139+0000 7f0553e00640 1 -- 172.21.15.33:0/2082733353 >> v2:172.21.15.103:3300/0 conn(0x7f0554159480 msgr2=0x7f05540ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.139+0000 7f0553e00640 1 --2- 172.21.15.33:0/2082733353 >> v2:172.21.15.103:3300/0 conn(0x7f0554159480 0x7f05540ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.139+0000 7f0553e00640 1 -- 172.21.15.33:0/2082733353 >> v1:172.21.15.33:6789/0 conn(0x7f0554071390 legacy=0x7f055415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.139+0000 7f0553e00640 1 -- 172.21.15.33:0/2082733353 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540b1740 con 0x7f055406f4b0 2024-09-13T18:57:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0553e00640 1 --2- 172.21.15.33:0/2082733353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f055406f4b0 0x7f0554070e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0554067270 tx=0x7f054002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41d55b7d35b5941 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0553400640 1 -- 172.21.15.33:0/2082733353 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054002ae60 con 0x7f055406f4b0 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0553400640 1 -- 172.21.15.33:0/2082733353 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540032440 con 0x7f055406f4b0 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0553400640 1 -- 172.21.15.33:0/2082733353 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400327b0 con 0x7f055406f4b0 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0559e00640 1 -- 172.21.15.33:0/2082733353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f055406f4b0 msgr2=0x7f0554070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.140+0000 7f0559e00640 1 --2- 172.21.15.33:0/2082733353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f055406f4b0 0x7f0554070e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0554067270 tx=0x7f054002a110 comp rx=0 tx=0).stop 2024-09-13T18:57:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 -- 172.21.15.33:0/2082733353 shutdown_connections 2024-09-13T18:57:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 --2- 172.21.15.33:0/2082733353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f055406f4b0 0x7f0554070e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 --2- 172.21.15.33:0/2082733353 >> v2:172.21.15.103:3300/0 conn(0x7f0554159480 0x7f05540ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 -- 172.21.15.33:0/2082733353 >> 172.21.15.33:0/2082733353 conn(0x7f05540ae310 msgr2=0x7f05540ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 -- 172.21.15.33:0/2082733353 shutdown_connections 2024-09-13T18:57:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.141+0000 7f0559e00640 1 -- 172.21.15.33:0/2082733353 wait complete. 2024-09-13T18:57:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.142+0000 7f0559e00640 1 Processor -- start 2024-09-13T18:57:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.142+0000 7f0559e00640 1 -- start start 2024-09-13T18:57:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 0x7f055415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0554071390 0x7f0554147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415beb0 con 0x7f0554159480 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415b2c0 con 0x7f055406f4b0 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.143+0000 7f0559e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055415b510 con 0x7f0554071390 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59168/0 (socket says 172.21.15.33:59168) 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 -- 172.21.15.33:0/1420415188 learned_addr learned my addr 172.21.15.33:0/1420415188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0553e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0554071390 0x7f0554147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0558a00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 0x7f055415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 -- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0554071390 msgr2=0x7f0554147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0554071390 0x7f0554147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 -- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 msgr2=0x7f055415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 0x7f055415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 -- 172.21.15.33:0/1420415188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009400 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0558a00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 0x7f055415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.144+0000 7f0559400640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f054c00cb40 tx=0x7f054c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.145+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00aca0 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.145+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00ae00 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.145+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055415b7f0 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.145+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c012620 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.145+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0554148380 con 0x7f0554159480 2024-09-13T18:57:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.146+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554067360 con 0x7f0554159480 2024-09-13T18:57:49.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.147+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f054c007070 con 0x7f0554159480 2024-09-13T18:57:49.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.147+0000 7f0550c00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 0x7f053406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.148+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054c0893e0 con 0x7f0554159480 2024-09-13T18:57:49.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.148+0000 7f0558a00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 0x7f053406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.148+0000 7f0558a00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 0x7f053406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0548009af0 tx=0x7f0548008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.151+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f054c0545b0 con 0x7f0554159480 2024-09-13T18:57:49.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.330+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f055415bff0 con 0x7f0554159480 2024-09-13T18:57:49.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.332+0000 7f0550c00640 1 -- 172.21.15.33:0/1420415188 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f055415bff0 con 0x7f0554159480 2024-09-13T18:57:49.334 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:49.334 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:49.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.333+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 msgr2=0x7f053406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 0x7f053406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0548009af0 tx=0x7f0548008040 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 msgr2=0x7f05540ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f054c00cb40 tx=0x7f054c00a060 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 shutdown_connections 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f053406ac00 0x7f053406d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0554159480 0x7f05540ac870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0554071390 0x7f0554147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 --2- 172.21.15.33:0/1420415188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f055406f4b0 0x7f055415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 >> 172.21.15.33:0/1420415188 conn(0x7f05540ae310 msgr2=0x7f05540b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 shutdown_connections 2024-09-13T18:57:49.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.334+0000 7f0559e00640 1 -- 172.21.15.33:0/1420415188 wait complete. 2024-09-13T18:57:49.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:49.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.509+0000 7f7c77e00640 1 Processor -- start 2024-09-13T18:57:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.510+0000 7f7c77e00640 1 -- start start 2024-09-13T18:57:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c780cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c77e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7806cca0 con 0x7f7c780b0d20 2024-09-13T18:57:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c77e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7806cf80 con 0x7f7c7815a6d0 2024-09-13T18:57:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c77e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7806d260 con 0x7f7c780cb640 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c6fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7c780b0d20 0x7f7c7806c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52756/0 (socket says 172.21.15.33:52756) 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c6fe00640 1 -- 172.21.15.33:0/1135869780 learned_addr learned my addr 172.21.15.33:0/1135869780 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.511+0000 7f7c77400640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c780cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891889973 0 0) 0x7f7c7806cca0 con 0x7f7c780b0d20 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c5c003520 con 0x7f7c780b0d20 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952963255 0 0) 0x7f7c7806cf80 con 0x7f7c7815a6d0 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7806cca0 con 0x7f7c7815a6d0 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217427661 0 0) 0x7f7c5c003520 con 0x7f7c780b0d20 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 msgr2=0x7f7c780cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c780cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 >> v1:172.21.15.103:6789/0 conn(0x7f7c7815a6d0 legacy=0x7f7c780b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780b16a0 con 0x7f7c780b0d20 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f7c60001670 con 0x7f7c780b0d20 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 >> v1:172.21.15.33:6789/0 conn(0x7f7c780b0d20 legacy=0x7f7c7806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c5c003b30 0x7f7c5c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0047c0 0x7f7c5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c5c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7806d260 con 0x7f7c5c003b30 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c00bb10 con 0x7f7c5c0047c0 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c00bcd0 con 0x7f7c780cb640 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c76a00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c5c003b30 0x7f7c5c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.512+0000 7f7c6fe00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0047c0 0x7f7c5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c77400640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c5c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c76a00640 1 -- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 msgr2=0x7f7c5c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c76a00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c780cb640 0x7f7c5c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c76a00640 1 -- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0047c0 msgr2=0x7f7c5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c76a00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0047c0 0x7f7c5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.513+0000 7f7c76a00640 1 -- 172.21.15.33:0/1135869780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c003520 con 0x7f7c5c003b30 2024-09-13T18:57:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c76a00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c5c003b30 0x7f7c5c003f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c680018d0 tx=0x7f7c5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8631be7e45652 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680052d0 con 0x7f7c5c003b30 2024-09-13T18:57:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68005430 con 0x7f7c5c003b30 2024-09-13T18:57:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c76000640 1 -- 172.21.15.33:0/1135869780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6802aca0 con 0x7f7c5c003b30 2024-09-13T18:57:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c77e00640 1 -- 172.21.15.33:0/1135869780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c5c003b30 msgr2=0x7f7c5c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c77e00640 1 --2- 172.21.15.33:0/1135869780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c5c003b30 0x7f7c5c003f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c680018d0 tx=0x7f7c5c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.514+0000 7f7c77400640 1 -- 172.21.15.33:0/1135869780 reap_dead start 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.515+0000 7f7c77e00640 1 -- 172.21.15.33:0/1135869780 shutdown_connections 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.515+0000 7f7c77e00640 1 -- 172.21.15.33:0/1135869780 >> 172.21.15.33:0/1135869780 conn(0x7f7c780b0200 msgr2=0x7f7c780b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.515+0000 7f7c77e00640 1 -- 172.21.15.33:0/1135869780 shutdown_connections 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.515+0000 7f7c77e00640 1 -- 172.21.15.33:0/1135869780 wait complete. 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.516+0000 7f7c77e00640 1 Processor -- start 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 -- start start 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c781532d0 0x7f7c781f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 0x7f7c781f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78154440 con 0x7f7c781f27e0 2024-09-13T18:57:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781f31d0 con 0x7f7c5c003b30 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.517+0000 7f7c77e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781537c0 con 0x7f7c781532d0 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 0x7f7c781f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54774/0 (socket says 172.21.15.33:54774) 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 -- 172.21.15.33:0/3815741225 learned_addr learned my addr 172.21.15.33:0/3815741225 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c6fe00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c781532d0 0x7f7c781f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 -- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c781532d0 msgr2=0x7f7c781f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c781532d0 0x7f7c781f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 -- 172.21.15.33:0/3815741225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 msgr2=0x7f7c781f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 0x7f7c781f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c76a00640 1 -- 172.21.15.33:0/3815741225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78153aa0 con 0x7f7c5c003b30 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.518+0000 7f7c77400640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 0x7f7c781f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c76a00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c680019f0 tx=0x7f7c680012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68006e00 con 0x7f7c5c003b30 2024-09-13T18:57:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68007040 con 0x7f7c5c003b30 2024-09-13T18:57:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680073d0 con 0x7f7c5c003b30 2024-09-13T18:57:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c78153d80 con 0x7f7c5c003b30 2024-09-13T18:57:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.519+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c78154c20 con 0x7f7c5c003b30 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.520+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c78154580 con 0x7f7c5c003b30 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.521+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c68007530 con 0x7f7c5c003b30 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.522+0000 7f7c6ea00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 0x7f7c5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.522+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c680a92f0 con 0x7f7c5c003b30 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.522+0000 7f7c6fe00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 0x7f7c5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.523+0000 7f7c6fe00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 0x7f7c5406d0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c60001eb0 tx=0x7f7c60007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.527+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c68074680 con 0x7f7c5c003b30 2024-09-13T18:57:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.703+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c78154580 con 0x7f7c5c003b30 2024-09-13T18:57:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.704+0000 7f7c6ea00640 1 -- 172.21.15.33:0/3815741225 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c78154580 con 0x7f7c5c003b30 2024-09-13T18:57:49.708 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 msgr2=0x7f7c5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 0x7f7c5406d0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c60001eb0 tx=0x7f7c60007040 comp rx=0 tx=0).stop 2024-09-13T18:57:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 msgr2=0x7f7c78152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c680019f0 tx=0x7f7c680012d0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 shutdown_connections 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c5406ac30 0x7f7c5406d0f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c781f27e0 0x7f7c781f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7c781532d0 0x7f7c781f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 --2- 172.21.15.33:0/3815741225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c003b30 0x7f7c78152d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 >> 172.21.15.33:0/3815741225 conn(0x7f7c780b0200 msgr2=0x7f7c780ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 shutdown_connections 2024-09-13T18:57:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.707+0000 7f7c77e00640 1 -- 172.21.15.33:0/3815741225 wait complete. 2024-09-13T18:57:49.726 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.882+0000 7f49e7c00640 1 Processor -- start 2024-09-13T18:57:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.882+0000 7f49e7c00640 1 -- start start 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e7c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49e015c720 0x7f49e006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e7c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e7c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00ad5f0 con 0x7f49e00b3df0 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e7c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00b4240 con 0x7f49e015c720 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e7c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00b3050 con 0x7f49e00ac590 2024-09-13T18:57:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.883+0000 7f49e5200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49e015c720 0x7f49e006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49e015c720 0x7f49e006bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59184/0 (socket says 172.21.15.33:59184) 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 -- 172.21.15.33:0/1303617950 learned_addr learned my addr 172.21.15.33:0/1303617950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5c00640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 -- 172.21.15.33:0/1303617950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 msgr2=0x7f49e00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 -- 172.21.15.33:0/1303617950 >> v1:172.21.15.103:6789/0 conn(0x7f49e00b3df0 legacy=0x7f49e00abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5200640 1 -- 172.21.15.33:0/1303617950 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00b3330 con 0x7f49e015c720 2024-09-13T18:57:49.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.884+0000 7f49e5c00640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:57:49.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.885+0000 7f49e5200640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006bee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009870 tx=0x7f49d402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979915a1a8548de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.885+0000 7f49df400640 1 -- 172.21.15.33:0/1303617950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4032440 con 0x7f49e015c720 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.885+0000 7f49df400640 1 -- 172.21.15.33:0/1303617950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d40325a0 con 0x7f49e015c720 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.885+0000 7f49df400640 1 -- 172.21.15.33:0/1303617950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4032930 con 0x7f49e015c720 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 -- 172.21.15.33:0/1303617950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 msgr2=0x7f49e006bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006bee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009870 tx=0x7f49d402a200 comp rx=0 tx=0).stop 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 -- 172.21.15.33:0/1303617950 shutdown_connections 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1303617950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006bee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 -- 172.21.15.33:0/1303617950 >> 172.21.15.33:0/1303617950 conn(0x7f49e00b0ba0 msgr2=0x7f49e00b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 -- 172.21.15.33:0/1303617950 shutdown_connections 2024-09-13T18:57:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.886+0000 7f49e7c00640 1 -- 172.21.15.33:0/1303617950 wait complete. 2024-09-13T18:57:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.888+0000 7f49e7c00640 1 Processor -- start 2024-09-13T18:57:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.888+0000 7f49e7c00640 1 -- start start 2024-09-13T18:57:49.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49e00b3df0 0x7f49e015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01f24e0 con 0x7f49e015c720 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00ce5f0 con 0x7f49e00b3df0 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e7c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00ce8d0 con 0x7f49e00ac590 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59186/0 (socket says 172.21.15.33:59186) 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 -- 172.21.15.33:0/1182198781 learned_addr learned my addr 172.21.15.33:0/1182198781 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5200640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49dfe00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49e00b3df0 0x7f49e015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 -- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 msgr2=0x7f49e00cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 -- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49e00b3df0 msgr2=0x7f49e015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49e00b3df0 0x7f49e015aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.889+0000 7f49e5c00640 1 -- 172.21.15.33:0/1182198781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40094d0 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49e5c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49d800ce80 tx=0x7f49d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800d840 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800d9e0 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800dd90 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e00cebb0 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.890+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00cf170 con 0x7f49e015c720 2024-09-13T18:57:49.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.891+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e00cf390 con 0x7f49e015c720 2024-09-13T18:57:49.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.892+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49d8015440 con 0x7f49e015c720 2024-09-13T18:57:49.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.893+0000 7f49dcc00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 0x7f49c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:49.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.894+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d8089da0 con 0x7f49e015c720 2024-09-13T18:57:49.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.894+0000 7f49e5200640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 0x7f49c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:49.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.895+0000 7f49e5200640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 0x7f49c006d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49d4034000 tx=0x7f49d402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:49.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:49.898+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f49d8054f90 con 0x7f49e015c720 2024-09-13T18:57:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.076+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49e00ad0b0 con 0x7f49e015c720 2024-09-13T18:57:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.077+0000 7f49dcc00640 1 -- 172.21.15.33:0/1182198781 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49d801a0a0 con 0x7f49e015c720 2024-09-13T18:57:50.080 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 msgr2=0x7f49c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 0x7f49c006d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49d4034000 tx=0x7f49d402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 msgr2=0x7f49e006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49d800ce80 tx=0x7f49d800a710 comp rx=0 tx=0).stop 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 shutdown_connections 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49c006ac00 0x7f49c006d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49e015c720 0x7f49e006fec0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49e00b3df0 0x7f49e015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 --2- 172.21.15.33:0/1182198781 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49e00ac590 0x7f49e00cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 >> 172.21.15.33:0/1182198781 conn(0x7f49e00b0ba0 msgr2=0x7f49e009ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 shutdown_connections 2024-09-13T18:57:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.079+0000 7f49e7c00640 1 -- 172.21.15.33:0/1182198781 wait complete. 2024-09-13T18:57:50.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.255+0000 7fb74e800640 1 Processor -- start 2024-09-13T18:57:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.255+0000 7fb74e800640 1 -- start start 2024-09-13T18:57:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.256+0000 7fb74e800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb748156f60 0x7fb74815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.256+0000 7fb74e800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb748070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.256+0000 7fb74e800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74806f5f0 con 0x7fb7480714c0 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.256+0000 7fb74e800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74815aa30 con 0x7fb748156f60 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.256+0000 7fb74e800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748071930 con 0x7fb7480cafa0 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb747e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb7480714c0 0x7fb74815d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52766/0 (socket says 172.21.15.33:52766) 2024-09-13T18:57:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb747e00640 1 -- 172.21.15.33:0/1463285426 learned_addr learned my addr 172.21.15.33:0/1463285426 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb747400640 1 --2- 172.21.15.33:0/1463285426 >> v2:172.21.15.103:3300/0 conn(0x7fb748156f60 0x7fb74815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746a00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb748070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154104817 0 0) 0x7fb74806f5f0 con 0x7fb7480714c0 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72c003520 con 0x7fb7480714c0 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369052024 0 0) 0x7fb72c003520 con 0x7fb7480714c0 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 msgr2=0x7fb748070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb748070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 >> v2:172.21.15.103:3300/0 conn(0x7fb748156f60 msgr2=0x7fb74815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 --2- 172.21.15.33:0/1463285426 >> v2:172.21.15.103:3300/0 conn(0x7fb748156f60 0x7fb74815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748070450 con 0x7fb7480714c0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fb7400019f0 con 0x7fb7480714c0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.257+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 >> v1:172.21.15.33:6789/0 conn(0x7fb7480714c0 legacy=0x7fb74815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb72c003970 0x7fb72c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb72c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb72c004d00 0x7fb72c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815aa30 con 0x7fb72c004d00 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748071930 con 0x7fb72c003970 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c00db90 con 0x7fb7480cafa0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747400640 1 --2- 172.21.15.33:0/1463285426 >> v2:172.21.15.103:3300/0 conn(0x7fb748156f60 0x7fb74815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb72c004d00 0x7fb72c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb746a00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb72c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747400640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb72c003970 0x7fb72c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 -- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 msgr2=0x7fb72c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7480cafa0 0x7fb72c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 -- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb72c003970 msgr2=0x7fb72c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb72c003970 0x7fb72c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747e00640 1 -- 172.21.15.33:0/1463285426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c003520 con 0x7fb72c004d00 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.258+0000 7fb747400640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb72c003970 0x7fb72c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.259+0000 7fb747e00640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb72c004d00 0x7fb72c005180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb74000a7c0 tx=0x7fb72c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcab8816d03cf0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74002b990 con 0x7fb72c004d00 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74002bb10 con 0x7fb72c004d00 2024-09-13T18:57:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb746000640 1 -- 172.21.15.33:0/1463285426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740034470 con 0x7fb72c004d00 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 -- 172.21.15.33:0/1463285426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb72c004d00 msgr2=0x7fb72c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 --2- 172.21.15.33:0/1463285426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb72c004d00 0x7fb72c005180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb74000a7c0 tx=0x7fb72c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb747e00640 1 -- 172.21.15.33:0/1463285426 reap_dead start 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 -- 172.21.15.33:0/1463285426 shutdown_connections 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 -- 172.21.15.33:0/1463285426 >> 172.21.15.33:0/1463285426 conn(0x7fb7480b0580 msgr2=0x7fb7480b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 -- 172.21.15.33:0/1463285426 shutdown_connections 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.260+0000 7fb74e800640 1 -- 172.21.15.33:0/1463285426 wait complete. 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.262+0000 7fb74e800640 1 Processor -- start 2024-09-13T18:57:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.262+0000 7fb74e800640 1 -- start start 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 0x7fb748142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74815cf10 0x7fb74815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815df70 con 0x7fb748148c70 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815d9b0 con 0x7fb74815cf10 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb74e800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815dc90 con 0x7fb72c004d00 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb746a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb746a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59212/0 (socket says 172.21.15.33:59212) 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb746a00640 1 -- 172.21.15.33:0/472388913 learned_addr learned my addr 172.21.15.33:0/472388913 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.263+0000 7fb747400640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 0x7fb748142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb747e00640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74815cf10 0x7fb74815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 -- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 msgr2=0x7fb748142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 0x7fb748142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 -- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74815cf10 msgr2=0x7fb74815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74815cf10 0x7fb74815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 -- 172.21.15.33:0/472388913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748144d90 con 0x7fb748148c70 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb747400640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 0x7fb748142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb746a00640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7340118e0 tx=0x7fb734011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734004300 con 0x7fb748148c70 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734004460 con 0x7fb748148c70 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb748145070 con 0x7fb748148c70 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400fa20 con 0x7fb748148c70 2024-09-13T18:57:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.264+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb748150960 con 0x7fb748148c70 2024-09-13T18:57:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.265+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7480708e0 con 0x7fb748148c70 2024-09-13T18:57:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.266+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb73400fb80 con 0x7fb748148c70 2024-09-13T18:57:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.267+0000 7fb73f400640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 0x7fb72806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.267+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb734089b60 con 0x7fb748148c70 2024-09-13T18:57:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.267+0000 7fb747400640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 0x7fb72806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.268+0000 7fb747400640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 0x7fb72806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb738009ce0 tx=0x7fb738008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.272+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb734054d30 con 0x7fb748148c70 2024-09-13T18:57:50.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.453+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb748066ef0 con 0x7fb748148c70 2024-09-13T18:57:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.453+0000 7fb73f400640 1 -- 172.21.15.33:0/472388913 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7340230a0 con 0x7fb748148c70 2024-09-13T18:57:50.457 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 msgr2=0x7fb72806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 0x7fb72806d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb738009ce0 tx=0x7fb738008040 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 msgr2=0x7fb748145590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7340118e0 tx=0x7fb734011da0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 shutdown_connections 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb72806ac00 0x7fb72806d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74815cf10 0x7fb74815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb748148c70 0x7fb748145590 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 --2- 172.21.15.33:0/472388913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb72c004d00 0x7fb748142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 >> 172.21.15.33:0/472388913 conn(0x7fb7480b0580 msgr2=0x7fb748156250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 shutdown_connections 2024-09-13T18:57:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.455+0000 7fb74e800640 1 -- 172.21.15.33:0/472388913 wait complete. 2024-09-13T18:57:50.493 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2024-09-13T18:57:50.493 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T18:57:50.494 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.646+0000 7f40d2e00640 1 Processor -- start 2024-09-13T18:57:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.646+0000 7f40d2e00640 1 -- start start 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.647+0000 7f40d2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 0x7f40cc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.647+0000 7f40d2e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0cd850 con 0x7f40cc071560 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40d2e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0cd570 con 0x7f40cc159480 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40d2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b1740 con 0x7f40cc06f4b0 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40d1000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f40cc071560 0x7f40cc0b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52768/0 (socket says 172.21.15.33:52768) 2024-09-13T18:57:50.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40d1000640 1 -- 172.21.15.33:0/1028716604 learned_addr learned my addr 172.21.15.33:0/1028716604 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40d2400640 1 --2- 172.21.15.33:0/1028716604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 0x7f40cc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522549639 0 0) 0x7f40cc0cd850 con 0x7f40cc071560 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b4003520 con 0x7f40cc071560 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.648+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443341078 0 0) 0x7f40cc0cd570 con 0x7f40cc159480 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.649+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40cc0cd850 con 0x7f40cc159480 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.649+0000 7f40d2400640 1 -- 172.21.15.33:0/1028716604 >> v1:172.21.15.103:6789/0 conn(0x7f40cc159480 legacy=0x7f40cc070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.649+0000 7f40d2400640 1 -- 172.21.15.33:0/1028716604 >> v1:172.21.15.33:6789/0 conn(0x7f40cc071560 legacy=0x7f40cc0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.649+0000 7f40d2400640 1 -- 172.21.15.33:0/1028716604 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0b1a20 con 0x7f40cc06f4b0 2024-09-13T18:57:50.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.650+0000 7f40d2400640 1 --2- 172.21.15.33:0/1028716604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 0x7f40cc0ccf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009dc0 tx=0x7f40c402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3bd045c4df6b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.650+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007740 con 0x7f40cc06f4b0 2024-09-13T18:57:50.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.650+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c402d050 con 0x7f40cc06f4b0 2024-09-13T18:57:50.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.650+0000 7f40cbe00640 1 -- 172.21.15.33:0/1028716604 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007aa0 con 0x7f40cc06f4b0 2024-09-13T18:57:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 -- 172.21.15.33:0/1028716604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 msgr2=0x7f40cc0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 --2- 172.21.15.33:0/1028716604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 0x7f40cc0ccf90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009dc0 tx=0x7f40c402a640 comp rx=0 tx=0).stop 2024-09-13T18:57:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 -- 172.21.15.33:0/1028716604 shutdown_connections 2024-09-13T18:57:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 --2- 172.21.15.33:0/1028716604 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc06f4b0 0x7f40cc0ccf90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 -- 172.21.15.33:0/1028716604 >> 172.21.15.33:0/1028716604 conn(0x7f40cc0ae310 msgr2=0x7f40cc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 -- 172.21.15.33:0/1028716604 shutdown_connections 2024-09-13T18:57:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.651+0000 7f40d2e00640 1 -- 172.21.15.33:0/1028716604 wait complete. 2024-09-13T18:57:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.652+0000 7f40d2e00640 1 Processor -- start 2024-09-13T18:57:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 -- start start 2024-09-13T18:57:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc06f4b0 0x7f40cc146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc071560 0x7f40cc14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc14f410 con 0x7f40cc159480 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc14ef80 con 0x7f40cc06f4b0 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.653+0000 7f40d2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc14e370 con 0x7f40cc071560 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59220/0 (socket says 172.21.15.33:59220) 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 -- 172.21.15.33:0/3320829650 learned_addr learned my addr 172.21.15.33:0/3320829650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d1000640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc071560 0x7f40cc14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d1a00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc06f4b0 0x7f40cc146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 -- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc071560 msgr2=0x7f40cc14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc071560 0x7f40cc14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 -- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc06f4b0 msgr2=0x7f40cc146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc06f4b0 0x7f40cc146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.654+0000 7f40d2400640 1 -- 172.21.15.33:0/3320829650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009a70 con 0x7f40cc159480 2024-09-13T18:57:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40d2400640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40c402ac30 tx=0x7f40c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c403c830 con 0x7f40cc159480 2024-09-13T18:57:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c403c990 con 0x7f40cc159480 2024-09-13T18:57:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c403cd20 con 0x7f40cc159480 2024-09-13T18:57:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc14e650 con 0x7f40cc159480 2024-09-13T18:57:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.655+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc14ec10 con 0x7f40cc159480 2024-09-13T18:57:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.656+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc067360 con 0x7f40cc159480 2024-09-13T18:57:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.657+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40c4031400 con 0x7f40cc159480 2024-09-13T18:57:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.658+0000 7f40c9600640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 0x7f40ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.658+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40c40aa670 con 0x7f40cc159480 2024-09-13T18:57:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.659+0000 7f40d1a00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 0x7f40ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.659+0000 7f40d1a00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 0x7f40ac06d0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40c00011e0 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:50.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.662+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40c40757c0 con 0x7f40cc159480 2024-09-13T18:57:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.844+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40cc06ef90 con 0x7f40cc159480 2024-09-13T18:57:50.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.846+0000 7f40c9600640 1 -- 172.21.15.33:0/3320829650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f40c402ae60 con 0x7f40cc159480 2024-09-13T18:57:50.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:50.850 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 msgr2=0x7f40ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 0x7f40ac06d0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40c00011e0 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 msgr2=0x7f40cc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40c402ac30 tx=0x7f40c4004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 shutdown_connections 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f40ac06ac30 0x7f40ac06d0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc159480 0x7f40cc06fdb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f40cc071560 0x7f40cc14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 --2- 172.21.15.33:0/3320829650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc06f4b0 0x7f40cc146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 >> 172.21.15.33:0/3320829650 conn(0x7f40cc0ae310 msgr2=0x7f40cc154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 shutdown_connections 2024-09-13T18:57:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:50.848+0000 7f40d2e00640 1 -- 172.21.15.33:0/3320829650 wait complete. 2024-09-13T18:57:50.868 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:50.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.023+0000 7f6b48c00640 1 Processor -- start 2024-09-13T18:57:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.024+0000 7f6b48c00640 1 -- start start 2024-09-13T18:57:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b48c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b440b2e20 0x7f6b440cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b48c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b440cc370 con 0x7f6b441594a0 2024-09-13T18:57:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b48c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b440cd1b0 con 0x7f6b4415d980 2024-09-13T18:57:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b48c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b44159880 con 0x7f6b440b2e20 2024-09-13T18:57:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b43400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6b441594a0 0x7f6b440b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52770/0 (socket says 172.21.15.33:52770) 2024-09-13T18:57:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b43400640 1 -- 172.21.15.33:0/3023315410 learned_addr learned my addr 172.21.15.33:0/3023315410 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.025+0000 7f6b3be00640 1 --2- 172.21.15.33:0/3023315410 >> v2:172.21.15.33:3300/0 conn(0x7f6b440b2e20 0x7f6b440cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.026+0000 7f6b42a00640 1 -- 172.21.15.33:0/3023315410 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515715085 0 0) 0x7f6b440cc370 con 0x7f6b441594a0 2024-09-13T18:57:51.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.026+0000 7f6b42a00640 1 -- 172.21.15.33:0/3023315410 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28003520 con 0x7f6b441594a0 2024-09-13T18:57:51.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.026+0000 7f6b3be00640 1 -- 172.21.15.33:0/3023315410 >> v1:172.21.15.103:6789/0 conn(0x7f6b4415d980 legacy=0x7f6b4406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.026+0000 7f6b3be00640 1 -- 172.21.15.33:0/3023315410 >> v1:172.21.15.33:6789/0 conn(0x7f6b441594a0 legacy=0x7f6b440b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.026+0000 7f6b3be00640 1 -- 172.21.15.33:0/3023315410 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b440cc5a0 con 0x7f6b440b2e20 2024-09-13T18:57:51.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b3be00640 1 --2- 172.21.15.33:0/3023315410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b440b2e20 0x7f6b440cdf10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097a0 tx=0x7f6b2c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1773d0a50b7ce5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b42a00640 1 -- 172.21.15.33:0/3023315410 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c032440 con 0x7f6b440b2e20 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b42a00640 1 -- 172.21.15.33:0/3023315410 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0325a0 con 0x7f6b440b2e20 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b42a00640 1 -- 172.21.15.33:0/3023315410 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c032930 con 0x7f6b440b2e20 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b48c00640 1 -- 172.21.15.33:0/3023315410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b440b2e20 msgr2=0x7f6b440cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.027+0000 7f6b48c00640 1 --2- 172.21.15.33:0/3023315410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b440b2e20 0x7f6b440cdf10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097a0 tx=0x7f6b2c02a230 comp rx=0 tx=0).stop 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.028+0000 7f6b48c00640 1 -- 172.21.15.33:0/3023315410 shutdown_connections 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.028+0000 7f6b48c00640 1 --2- 172.21.15.33:0/3023315410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b440b2e20 0x7f6b440cdf10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.028+0000 7f6b48c00640 1 -- 172.21.15.33:0/3023315410 >> 172.21.15.33:0/3023315410 conn(0x7f6b440b0200 msgr2=0x7f6b440b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.028+0000 7f6b48c00640 1 -- 172.21.15.33:0/3023315410 shutdown_connections 2024-09-13T18:57:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.028+0000 7f6b48c00640 1 -- 172.21.15.33:0/3023315410 wait complete. 2024-09-13T18:57:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.029+0000 7f6b48c00640 1 Processor -- start 2024-09-13T18:57:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.029+0000 7f6b48c00640 1 -- start start 2024-09-13T18:57:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 0x7f6b441ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 0x7f6b4414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4414efb0 con 0x7f6b441594a0 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b441521a0 con 0x7f6b4415d980 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b48c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44152440 con 0x7f6b440b2e20 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.030+0000 7f6b3be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59246/0 (socket says 172.21.15.33:59246) 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 -- 172.21.15.33:0/973073230 learned_addr learned my addr 172.21.15.33:0/973073230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b43e00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 0x7f6b4414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b43400640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 0x7f6b441ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 -- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 msgr2=0x7f6b441ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 0x7f6b441ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 -- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 msgr2=0x7f6b4414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 0x7f6b4414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 -- 172.21.15.33:0/973073230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009400 con 0x7f6b441594a0 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b43e00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 0x7f6b4414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b43400640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 0x7f6b441ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3be00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c035040 tx=0x7f6b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.031+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c006e10 con 0x7f6b441594a0 2024-09-13T18:57:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.032+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c032e90 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.032+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c030be0 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.032+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b44152720 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.032+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4414f200 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.033+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b440cd640 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.033+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6b2c039040 con 0x7f6b441594a0 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.034+0000 7f6b3b400640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 0x7f6b2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.034+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b2c0a9c90 con 0x7f6b441594a0 2024-09-13T18:57:51.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.035+0000 7f6b43400640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 0x7f6b2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.035+0000 7f6b43400640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 0x7f6b2006d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007fd0 tx=0x7f6b34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.039+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6b2c074f80 con 0x7f6b441594a0 2024-09-13T18:57:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.218+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b4406cc60 con 0x7f6b441594a0 2024-09-13T18:57:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.219+0000 7f6b3b400640 1 -- 172.21.15.33:0/973073230 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b2c030d40 con 0x7f6b441594a0 2024-09-13T18:57:51.222 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 msgr2=0x7f6b2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 0x7f6b2006d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007fd0 tx=0x7f6b34009040 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 msgr2=0x7f6b44151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c035040 tx=0x7f6b2c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 shutdown_connections 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6b2006ac00 0x7f6b2006d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4415d980 0x7f6b4414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b441594a0 0x7f6b44151c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 --2- 172.21.15.33:0/973073230 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6b440b2e20 0x7f6b441ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 >> 172.21.15.33:0/973073230 conn(0x7f6b440b0200 msgr2=0x7f6b44071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 shutdown_connections 2024-09-13T18:57:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.221+0000 7f6b48c00640 1 -- 172.21.15.33:0/973073230 wait complete. 2024-09-13T18:57:51.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:51.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.395+0000 7f8b58c00640 1 Processor -- start 2024-09-13T18:57:51.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.395+0000 7f8b58c00640 1 -- start start 2024-09-13T18:57:51.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b58c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b5406f830 0x7f8b5406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b58c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b540ce490 con 0x7f8b54154ad0 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b58c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5406b7c0 con 0x7f8b54070420 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b58c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5406b5b0 con 0x7f8b5406f830 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b49400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b5406f830 0x7f8b5406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b51e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8b54154ad0 0x7f8b540cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52776/0 (socket says 172.21.15.33:52776) 2024-09-13T18:57:51.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.396+0000 7f8b51e00640 1 -- 172.21.15.33:0/3610943547 learned_addr learned my addr 172.21.15.33:0/3610943547 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.397+0000 7f8b49400640 1 -- 172.21.15.33:0/3610943547 >> v1:172.21.15.103:6789/0 conn(0x7f8b54070420 legacy=0x7f8b540cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.397+0000 7f8b49400640 1 -- 172.21.15.33:0/3610943547 >> v1:172.21.15.33:6789/0 conn(0x7f8b54154ad0 legacy=0x7f8b540cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.397+0000 7f8b49400640 1 -- 172.21.15.33:0/3610943547 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5406baa0 con 0x7f8b5406f830 2024-09-13T18:57:51.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.397+0000 7f8b51400640 1 -- 172.21.15.33:0/3610943547 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289986279 0 0) 0x7f8b540ce490 con 0x7f8b54154ad0 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.398+0000 7f8b49400640 1 --2- 172.21.15.33:0/3610943547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b5406f830 0x7f8b5406fee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097a0 tx=0x7f8b3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f507f3bde60a7c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.398+0000 7f8b51400640 1 -- 172.21.15.33:0/3610943547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032440 con 0x7f8b5406f830 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.398+0000 7f8b51400640 1 -- 172.21.15.33:0/3610943547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0325a0 con 0x7f8b5406f830 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.398+0000 7f8b51400640 1 -- 172.21.15.33:0/3610943547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032930 con 0x7f8b5406f830 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 -- 172.21.15.33:0/3610943547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b5406f830 msgr2=0x7f8b5406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 --2- 172.21.15.33:0/3610943547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b5406f830 0x7f8b5406fee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097a0 tx=0x7f8b3c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 -- 172.21.15.33:0/3610943547 shutdown_connections 2024-09-13T18:57:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 --2- 172.21.15.33:0/3610943547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b5406f830 0x7f8b5406fee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 -- 172.21.15.33:0/3610943547 >> 172.21.15.33:0/3610943547 conn(0x7f8b540b0580 msgr2=0x7f8b540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 -- 172.21.15.33:0/3610943547 shutdown_connections 2024-09-13T18:57:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.399+0000 7f8b58c00640 1 -- 172.21.15.33:0/3610943547 wait complete. 2024-09-13T18:57:51.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.400+0000 7f8b58c00640 1 Processor -- start 2024-09-13T18:57:51.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.400+0000 7f8b58c00640 1 -- start start 2024-09-13T18:57:51.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 0x7f8b54149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b54154ad0 0x7f8b54155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 0x7f8b5415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5414b0f0 con 0x7f8b54143fe0 2024-09-13T18:57:51.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54156350 con 0x7f8b54070420 2024-09-13T18:57:51.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.401+0000 7f8b58c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5414a4e0 con 0x7f8b54154ad0 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 0x7f8b5415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b51e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 0x7f8b54149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b49400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b54154ad0 0x7f8b54155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b51e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 0x7f8b54149e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54850/0 (socket says 172.21.15.33:54850) 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b51e00640 1 -- 172.21.15.33:0/4133758449 learned_addr learned my addr 172.21.15.33:0/4133758449 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 -- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b54154ad0 msgr2=0x7f8b54155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b54154ad0 0x7f8b54155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 -- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 msgr2=0x7f8b54149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 0x7f8b54149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 -- 172.21.15.33:0/4133758449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009400 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.402+0000 7f8b52800640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 0x7f8b5415cb80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c690 tx=0x7f8b4c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.403+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c003b70 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.403+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c003cd0 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.403+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c005310 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.403+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5414a7c0 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.403+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5414ad80 con 0x7f8b54143fe0 2024-09-13T18:57:51.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.404+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5414b230 con 0x7f8b54143fe0 2024-09-13T18:57:51.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.405+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b4c005470 con 0x7f8b54143fe0 2024-09-13T18:57:51.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.406+0000 7f8b4aa00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 0x7f8b3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.406+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b4c089070 con 0x7f8b54143fe0 2024-09-13T18:57:51.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.406+0000 7f8b51e00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 0x7f8b3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.407+0000 7f8b51e00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 0x7f8b3006d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b44007c40 tx=0x7f8b44007b90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.410+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8b4c0bc9c0 con 0x7f8b54143fe0 2024-09-13T18:57:51.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.588+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b540718e0 con 0x7f8b54143fe0 2024-09-13T18:57:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.589+0000 7f8b4aa00640 1 -- 172.21.15.33:0/4133758449 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b4c054260 con 0x7f8b54143fe0 2024-09-13T18:57:51.592 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 msgr2=0x7f8b3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 0x7f8b3006d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b44007c40 tx=0x7f8b44007b90 comp rx=0 tx=0).stop 2024-09-13T18:57:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 msgr2=0x7f8b5415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 0x7f8b5415cb80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c690 tx=0x7f8b4c00cb50 comp rx=0 tx=0).stop 2024-09-13T18:57:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 shutdown_connections 2024-09-13T18:57:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8b3006ac00 0x7f8b3006d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b54143fe0 0x7f8b5415cb80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b54154ad0 0x7f8b54155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 --2- 172.21.15.33:0/4133758449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b54070420 0x7f8b54149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 >> 172.21.15.33:0/4133758449 conn(0x7f8b540b0580 msgr2=0x7f8b54070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 shutdown_connections 2024-09-13T18:57:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.591+0000 7f8b58c00640 1 -- 172.21.15.33:0/4133758449 wait complete. 2024-09-13T18:57:51.610 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:51.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.765+0000 7fc699200640 1 Processor -- start 2024-09-13T18:57:51.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.766+0000 7fc699200640 1 -- start start 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc699200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc694071cc0 0x7fc6940cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc699200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc6940cfcf0 0x7fc6940cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc699200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6940d0550 con 0x7fc694157e70 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc699200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69415ef10 con 0x7fc6940cfcf0 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc699200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69415ab60 con 0x7fc694071cc0 2024-09-13T18:57:51.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc693e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc6940cfcf0 0x7fc6940cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc693e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc6940cfcf0 0x7fc6940cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59266/0 (socket says 172.21.15.33:59266) 2024-09-13T18:57:51.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc693e00640 1 -- 172.21.15.33:0/3630151877 learned_addr learned my addr 172.21.15.33:0/3630151877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:51.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.767+0000 7fc68aa00640 1 --2- 172.21.15.33:0/3630151877 >> v2:172.21.15.103:3300/0 conn(0x7fc694071cc0 0x7fc6940cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.768+0000 7fc693e00640 1 -- 172.21.15.33:0/3630151877 >> v2:172.21.15.103:3300/0 conn(0x7fc694071cc0 msgr2=0x7fc6940cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:51.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.768+0000 7fc693e00640 1 --2- 172.21.15.33:0/3630151877 >> v2:172.21.15.103:3300/0 conn(0x7fc694071cc0 0x7fc6940cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.768+0000 7fc693e00640 1 -- 172.21.15.33:0/3630151877 >> v1:172.21.15.103:6789/0 conn(0x7fc694157e70 legacy=0x7fc6940715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.768+0000 7fc693e00640 1 -- 172.21.15.33:0/3630151877 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69415b8e0 con 0x7fc6940cfcf0 2024-09-13T18:57:51.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc693e00640 1 --2- 172.21.15.33:0/3630151877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6940cfcf0 0x7fc6940cd190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc69406fe80 tx=0x7fc68c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10da58331a3feaae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc692a00640 1 -- 172.21.15.33:0/3630151877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c031600 con 0x7fc6940cfcf0 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc692a00640 1 -- 172.21.15.33:0/3630151877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c02d050 con 0x7fc6940cfcf0 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc692a00640 1 -- 172.21.15.33:0/3630151877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c031980 con 0x7fc6940cfcf0 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc699200640 1 -- 172.21.15.33:0/3630151877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6940cfcf0 msgr2=0x7fc6940cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.769+0000 7fc699200640 1 --2- 172.21.15.33:0/3630151877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6940cfcf0 0x7fc6940cd190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc69406fe80 tx=0x7fc68c02a6a0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 -- 172.21.15.33:0/3630151877 shutdown_connections 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 --2- 172.21.15.33:0/3630151877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6940cfcf0 0x7fc6940cd190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 --2- 172.21.15.33:0/3630151877 >> v2:172.21.15.103:3300/0 conn(0x7fc694071cc0 0x7fc6940cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 -- 172.21.15.33:0/3630151877 >> 172.21.15.33:0/3630151877 conn(0x7fc69406d6c0 msgr2=0x7fc69406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 -- 172.21.15.33:0/3630151877 shutdown_connections 2024-09-13T18:57:51.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.770+0000 7fc699200640 1 -- 172.21.15.33:0/3630151877 wait complete. 2024-09-13T18:57:51.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.771+0000 7fc699200640 1 Processor -- start 2024-09-13T18:57:51.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.771+0000 7fc699200640 1 -- start start 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc694071cc0 0x7fc6940ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6940cfcf0 0x7fc694152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940a8460 con 0x7fc694157e70 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940aa310 con 0x7fc694071cc0 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.772+0000 7fc699200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940aa5f0 con 0x7fc6940cfcf0 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59276/0 (socket says 172.21.15.33:59276) 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 -- 172.21.15.33:0/271182070 learned_addr learned my addr 172.21.15.33:0/271182070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693400640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc694071cc0 0x7fc6940ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc68aa00640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6940cfcf0 0x7fc694152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 -- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6940cfcf0 msgr2=0x7fc694152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6940cfcf0 0x7fc694152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 -- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc694071cc0 msgr2=0x7fc6940ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc694071cc0 0x7fc6940ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 -- 172.21.15.33:0/271182070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c009b30 con 0x7fc694157e70 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.773+0000 7fc693e00640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc68c034040 tx=0x7fc68c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.774+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c03d860 con 0x7fc694157e70 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.774+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c03d9e0 con 0x7fc694157e70 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.774+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c03dd90 con 0x7fc694157e70 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.774+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6940aa8d0 con 0x7fc694157e70 2024-09-13T18:57:51.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.774+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6941533d0 con 0x7fc694157e70 2024-09-13T18:57:51.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.775+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc694067360 con 0x7fc694157e70 2024-09-13T18:57:51.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.776+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc68c03b400 con 0x7fc694157e70 2024-09-13T18:57:51.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.776+0000 7fc68be00640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 0x7fc67006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:51.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.777+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68c0aa240 con 0x7fc694157e70 2024-09-13T18:57:51.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.777+0000 7fc693400640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 0x7fc67006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:51.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.778+0000 7fc693400640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 0x7fc67006d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc69415ced0 tx=0x7fc684009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:51.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.781+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc68c075430 con 0x7fc694157e70 2024-09-13T18:57:51.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.959+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6940ced80 con 0x7fc694157e70 2024-09-13T18:57:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.959+0000 7fc68be00640 1 -- 172.21.15.33:0/271182070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6940ced80 con 0x7fc694157e70 2024-09-13T18:57:51.963 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 msgr2=0x7fc67006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 0x7fc67006d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc69415ced0 tx=0x7fc684009040 comp rx=0 tx=0).stop 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 msgr2=0x7fc69415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc68c034040 tx=0x7fc68c004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 shutdown_connections 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc67006ac00 0x7fc67006d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc694157e70 0x7fc69415d250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6940cfcf0 0x7fc694152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 --2- 172.21.15.33:0/271182070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc694071cc0 0x7fc6940ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 >> 172.21.15.33:0/271182070 conn(0x7fc69406d6c0 msgr2=0x7fc6940b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 shutdown_connections 2024-09-13T18:57:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:51.962+0000 7fc699200640 1 -- 172.21.15.33:0/271182070 wait complete. 2024-09-13T18:57:51.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-13T18:57:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.133+0000 7fc15ee00640 1 Processor -- start 2024-09-13T18:57:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.134+0000 7fc15ee00640 1 -- start start 2024-09-13T18:57:52.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.135+0000 7fc15ee00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1580b1b00 0x7fc1580cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.135+0000 7fc15ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580cde50 0x7fc15815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.135+0000 7fc15ee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15806bea0 con 0x7fc15815a520 2024-09-13T18:57:52.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.135+0000 7fc15ee00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15806c180 con 0x7fc1580b1b00 2024-09-13T18:57:52.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.135+0000 7fc15ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15806c460 con 0x7fc1580cde50 2024-09-13T18:57:52.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc14fe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1580b1b00 0x7fc1580cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc157e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc15815a520 0x7fc15806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:54984/0 (socket says 172.21.15.33:54984) 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc157e00640 1 -- 172.21.15.33:0/491036339 learned_addr learned my addr 172.21.15.33:0/491036339 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc15ce00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580cde50 0x7fc15815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc14fe00640 1 -- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580cde50 msgr2=0x7fc15815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc14fe00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580cde50 0x7fc15815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc14fe00640 1 -- 172.21.15.33:0/491036339 >> v1:172.21.15.103:6789/0 conn(0x7fc15815a520 legacy=0x7fc15806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc14fe00640 1 -- 172.21.15.33:0/491036339 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15806c740 con 0x7fc1580b1b00 2024-09-13T18:57:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.136+0000 7fc157400640 1 -- 172.21.15.33:0/491036339 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263554136 0 0) 0x7fc15806bea0 con 0x7fc15815a520 2024-09-13T18:57:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.137+0000 7fc14fe00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580b1b00 0x7fc1580cd910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097a0 tx=0x7fc14002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63de8097ba54b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.137+0000 7fc157400640 1 -- 172.21.15.33:0/491036339 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140032440 con 0x7fc1580b1b00 2024-09-13T18:57:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.137+0000 7fc157400640 1 -- 172.21.15.33:0/491036339 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400325a0 con 0x7fc1580b1b00 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.137+0000 7fc157400640 1 -- 172.21.15.33:0/491036339 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140032930 con 0x7fc1580b1b00 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 -- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580b1b00 msgr2=0x7fc1580cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580b1b00 0x7fc1580cd910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097a0 tx=0x7fc14002a180 comp rx=0 tx=0).stop 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 -- 172.21.15.33:0/491036339 shutdown_connections 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580cde50 0x7fc15815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 --2- 172.21.15.33:0/491036339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580b1b00 0x7fc1580cd910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 -- 172.21.15.33:0/491036339 >> 172.21.15.33:0/491036339 conn(0x7fc1580b0510 msgr2=0x7fc1580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 -- 172.21.15.33:0/491036339 shutdown_connections 2024-09-13T18:57:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.138+0000 7fc15ee00640 1 -- 172.21.15.33:0/491036339 wait complete. 2024-09-13T18:57:52.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.140+0000 7fc15ee00640 1 Processor -- start 2024-09-13T18:57:52.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.140+0000 7fc15ee00640 1 -- start start 2024-09-13T18:57:52.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580b1b00 0x7fc158154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580cde50 0x7fc1580acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581529c0 con 0x7fc15815a520 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15806fb30 con 0x7fc1580cde50 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15806fe10 con 0x7fc1580b1b00 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59278/0 (socket says 172.21.15.33:59278) 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc15ce00640 1 -- 172.21.15.33:0/3400564705 learned_addr learned my addr 172.21.15.33:0/3400564705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc14fe00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580cde50 0x7fc1580acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.141+0000 7fc157e00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580b1b00 0x7fc158154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 -- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580b1b00 msgr2=0x7fc158154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:52.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580b1b00 0x7fc158154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 -- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580cde50 msgr2=0x7fc1580acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580cde50 0x7fc1580acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 -- 172.21.15.33:0/3400564705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009400 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ce00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc15000efc0 tx=0x7fc15000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150014480 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000f040 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150014820 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1580700f0 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.142+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc158070ed0 con 0x7fc15815a520 2024-09-13T18:57:52.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.143+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc158152b00 con 0x7fc15815a520 2024-09-13T18:57:52.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.144+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc150014980 con 0x7fc15815a520 2024-09-13T18:57:52.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.145+0000 7fc154c00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 0x7fc13406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:52.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.145+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc150089f00 con 0x7fc15815a520 2024-09-13T18:57:52.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.146+0000 7fc157e00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 0x7fc13406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:52.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.146+0000 7fc157e00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 0x7fc13406d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc148000f60 tx=0x7fc148007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.149+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc158152b00 con 0x7fc15815a520 2024-09-13T18:57:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:52.396+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7fc158152b00 con 0x7fc15815a520 2024-09-13T18:57:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.228+0000 7fc154c00640 1 -- 172.21.15.33:0/3400564705 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v58) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc158152b00 con 0x7fc15815a520 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 msgr2=0x7fc13406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 0x7fc13406d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc148000f60 tx=0x7fc148007c00 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 msgr2=0x7fc15814ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc15000efc0 tx=0x7fc15000c490 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 shutdown_connections 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc13406ac00 0x7fc13406d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15815a520 0x7fc15814ac70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1580cde50 0x7fc1580acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 --2- 172.21.15.33:0/3400564705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1580b1b00 0x7fc158154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 >> 172.21.15.33:0/3400564705 conn(0x7fc1580b0510 msgr2=0x7fc1580cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 shutdown_connections 2024-09-13T18:57:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.231+0000 7fc15ee00640 1 -- 172.21.15.33:0/3400564705 wait complete. 2024-09-13T18:57:53.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:57:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.413+0000 7fb97f200640 1 Processor -- start 2024-09-13T18:57:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.413+0000 7fb97f200640 1 -- start start 2024-09-13T18:57:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb97f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb97806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb97f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780b2890 con 0x7fb9780b31b0 2024-09-13T18:57:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb97f200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780b1880 con 0x7fb9781461c0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb97f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780b1ad0 con 0x7fb978071460 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb977400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb9780b31b0 0x7fb97806bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42328/0 (socket says 172.21.15.33:42328) 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.414+0000 7fb977400640 1 -- 172.21.15.33:0/1200433773 learned_addr learned my addr 172.21.15.33:0/1200433773 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb97d200640 1 --2- 172.21.15.33:0/1200433773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb97806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805546994 0 0) 0x7fb9780b2890 con 0x7fb9780b31b0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb95c003520 con 0x7fb9780b31b0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740738697 0 0) 0x7fb9780b1880 con 0x7fb9781461c0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9780b2890 con 0x7fb9781461c0 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb97d200640 1 -- 172.21.15.33:0/1200433773 >> v1:172.21.15.103:6789/0 conn(0x7fb9781461c0 legacy=0x7fb9780b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb97d200640 1 -- 172.21.15.33:0/1200433773 >> v1:172.21.15.33:6789/0 conn(0x7fb9780b31b0 legacy=0x7fb97806bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.415+0000 7fb97d200640 1 -- 172.21.15.33:0/1200433773 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780b1db0 con 0x7fb978071460 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.416+0000 7fb97d200640 1 --2- 172.21.15.33:0/1200433773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb97806c5b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb970009dc0 tx=0x7fb97002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc44c9d71f2e6d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970007740 con 0x7fb978071460 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97002d050 con 0x7fb978071460 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb976a00640 1 -- 172.21.15.33:0/1200433773 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970007aa0 con 0x7fb978071460 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 -- 172.21.15.33:0/1200433773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 msgr2=0x7fb97806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 --2- 172.21.15.33:0/1200433773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb97806c5b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb970009dc0 tx=0x7fb97002a5b0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 -- 172.21.15.33:0/1200433773 shutdown_connections 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 --2- 172.21.15.33:0/1200433773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb97806c5b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 -- 172.21.15.33:0/1200433773 >> 172.21.15.33:0/1200433773 conn(0x7fb9780b0580 msgr2=0x7fb9780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 -- 172.21.15.33:0/1200433773 shutdown_connections 2024-09-13T18:57:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.417+0000 7fb97f200640 1 -- 172.21.15.33:0/1200433773 wait complete. 2024-09-13T18:57:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.419+0000 7fb97f200640 1 Processor -- start 2024-09-13T18:57:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.419+0000 7fb97f200640 1 -- start start 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb978160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9781461c0 0x7fb9781409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978142110 con 0x7fb9780b31b0 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978141490 con 0x7fb9781461c0 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978141770 con 0x7fb978071460 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb977400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb977400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54912/0 (socket says 172.21.15.33:54912) 2024-09-13T18:57:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb977400640 1 -- 172.21.15.33:0/1199828 learned_addr learned my addr 172.21.15.33:0/1199828 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb977e00640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb978160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.420+0000 7fb97d200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9781461c0 0x7fb9781409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 -- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 msgr2=0x7fb978160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb978160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 -- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9781461c0 msgr2=0x7fb9781409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9781461c0 0x7fb9781409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 -- 172.21.15.33:0/1199828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009a70 con 0x7fb9780b31b0 2024-09-13T18:57:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb977400640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c490 tx=0x7fb96400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964005ce0 con 0x7fb9780b31b0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964005e40 con 0x7fb9780b31b0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964007270 con 0x7fb9780b31b0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb978141a50 con 0x7fb9780b31b0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.421+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9781431d0 con 0x7fb9780b31b0 2024-09-13T18:57:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.422+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978142250 con 0x7fb9780b31b0 2024-09-13T18:57:53.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.423+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb964007490 con 0x7fb9780b31b0 2024-09-13T18:57:53.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.424+0000 7fb96fe00640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 0x7fb95806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:53.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.424+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb964088810 con 0x7fb9780b31b0 2024-09-13T18:57:53.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.425+0000 7fb977e00640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 0x7fb95806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:53.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.425+0000 7fb977e00640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 0x7fb95806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb968007fd0 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.428+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb978142250 con 0x7fb9780b31b0 2024-09-13T18:57:53.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.611+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb978142250 con 0x7fb9780b31b0 2024-09-13T18:57:53.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.615+0000 7fb96fe00640 1 -- 172.21.15.33:0/1199828 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb978142250 con 0x7fb9780b31b0 2024-09-13T18:57:53.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 msgr2=0x7fb95806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 0x7fb95806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb968007fd0 tx=0x7fb968009040 comp rx=0 tx=0).stop 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 msgr2=0x7fb978142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c490 tx=0x7fb96400c950 comp rx=0 tx=0).stop 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 shutdown_connections 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb95806ac00 0x7fb95806d0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9781461c0 0x7fb9781409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780b31b0 0x7fb978142530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 --2- 172.21.15.33:0/1199828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb978071460 0x7fb978160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.617+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 >> 172.21.15.33:0/1199828 conn(0x7fb9780b0580 msgr2=0x7fb97815cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.618+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 shutdown_connections 2024-09-13T18:57:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:53.618+0000 7fb97f200640 1 -- 172.21.15.33:0/1199828 wait complete. 2024-09-13T18:57:53.637 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:57:53.637 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:57:53.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:57:53.837 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:57:53.838 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:53.838 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:53.874 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:53.874 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:53.951 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:53.952 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:54.027 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.217+0000 7f2138800640 1 Processor -- start 2024-09-13T18:57:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.217+0000 7f2138800640 1 -- start start 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2138800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21300b1b00 0x7f21300cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2138800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213006bea0 con 0x7f213015a520 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2138800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213006c180 con 0x7f21300cde50 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2138800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213006c460 con 0x7f21300b1b00 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2135e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f213015a520 0x7f213006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42336/0 (socket says 172.21.15.33:42336) 2024-09-13T18:57:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2135e00640 1 -- 172.21.15.33:0/4030023799 learned_addr learned my addr 172.21.15.33:0/4030023799 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662360283 0 0) 0x7f213006bea0 con 0x7f213015a520 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2135400640 1 --2- 172.21.15.33:0/4030023799 >> v2:172.21.15.103:3300/0 conn(0x7f21300b1b00 0x7f21300cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.219+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2118003520 con 0x7f213015a520 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 95820988 0 0) 0x7f2118003520 con 0x7f213015a520 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 >> v2:172.21.15.103:3300/0 conn(0x7f21300b1b00 msgr2=0x7f21300cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 --2- 172.21.15.33:0/4030023799 >> v2:172.21.15.103:3300/0 conn(0x7f21300b1b00 0x7f21300cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 >> v1:172.21.15.103:6789/0 conn(0x7f21300cde50 legacy=0x7f213015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213006c740 con 0x7f213015a520 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f2124001670 con 0x7f213015a520 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 >> v1:172.21.15.33:6789/0 conn(0x7f213015a520 legacy=0x7f213006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 0x7f2118003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21180047c0 0x7f2118004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118005180 0x7f211800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213006c460 con 0x7f2118003970 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211800c020 con 0x7f2118005180 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211800c1e0 con 0x7f21180047c0 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2135e00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 0x7f2118003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2136800640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118005180 0x7f211800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.220+0000 7f2135400640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21180047c0 0x7f2118004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2135e00640 1 -- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21180047c0 msgr2=0x7f2118004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2135e00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21180047c0 0x7f2118004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2135e00640 1 -- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118005180 msgr2=0x7f211800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2135e00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118005180 0x7f211800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2135e00640 1 -- 172.21.15.33:0/4030023799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118003520 con 0x7f2118003970 2024-09-13T18:57:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.221+0000 7f2136800640 1 -- 172.21.15.33:0/4030023799 reap_dead start 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2135e00640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 0x7f2118003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f212400c240 tx=0x7f21180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee57dd3ddbb4338 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212402e070 con 0x7f2118003970 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21240058d0 con 0x7f2118003970 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2134a00640 1 -- 172.21.15.33:0/4030023799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124005ca0 con 0x7f2118003970 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2138800640 1 -- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 msgr2=0x7f2118003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.222+0000 7f2138800640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 0x7f2118003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f212400c240 tx=0x7f21180057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.223+0000 7f2138800640 1 -- 172.21.15.33:0/4030023799 shutdown_connections 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.223+0000 7f2138800640 1 --2- 172.21.15.33:0/4030023799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2118003970 0x7f2118003d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.223+0000 7f2138800640 1 -- 172.21.15.33:0/4030023799 >> 172.21.15.33:0/4030023799 conn(0x7f21300b0510 msgr2=0x7f21300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:54.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.223+0000 7f2138800640 1 -- 172.21.15.33:0/4030023799 shutdown_connections 2024-09-13T18:57:54.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.223+0000 7f2138800640 1 -- 172.21.15.33:0/4030023799 wait complete. 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.224+0000 7f2138800640 1 Processor -- start 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.224+0000 7f2138800640 1 -- start start 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118003970 0x7f213015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 0x7f21300cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213015de80 con 0x7f2130151a90 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213014e2c0 con 0x7f2118003970 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2138800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213015d300 con 0x7f2130152db0 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.225+0000 7f2135400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54920/0 (socket says 172.21.15.33:54920) 2024-09-13T18:57:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 -- 172.21.15.33:0/2658768422 learned_addr learned my addr 172.21.15.33:0/2658768422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135e00640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118003970 0x7f213015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2136800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 0x7f21300cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 -- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 msgr2=0x7f21300cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 0x7f21300cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 -- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118003970 msgr2=0x7f213015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118003970 0x7f213015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 -- 172.21.15.33:0/2658768422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213015d5e0 con 0x7f2130151a90 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2136800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 0x7f21300cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.226+0000 7f2135400640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2120011a70 tx=0x7f2120011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.227+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120009680 con 0x7f2130151a90 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.227+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000fb50 con 0x7f2130151a90 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.227+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000fee0 con 0x7f2130151a90 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.227+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213015d8c0 con 0x7f2130151a90 2024-09-13T18:57:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.227+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2130151ef0 con 0x7f2130151a90 2024-09-13T18:57:54.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.228+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300ae950 con 0x7f2130151a90 2024-09-13T18:57:54.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.229+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2120014440 con 0x7f2130151a90 2024-09-13T18:57:54.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.230+0000 7f212a000640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 0x7f211406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.230+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2120089af0 con 0x7f2130151a90 2024-09-13T18:57:54.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.230+0000 7f2135e00640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 0x7f211406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.231+0000 7f2135e00640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 0x7f211406d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2124033000 tx=0x7f212402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.235+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2120054cc0 con 0x7f2130151a90 2024-09-13T18:57:54.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.415+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21300ae670 con 0x7f2130151a90 2024-09-13T18:57:54.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.416+0000 7f212a000640 1 -- 172.21.15.33:0/2658768422 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f21200582e0 con 0x7f2130151a90 2024-09-13T18:57:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:54.420 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:14.484066+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 msgr2=0x7f211406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 0x7f211406d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2124033000 tx=0x7f212402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 msgr2=0x7f213014dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2120011a70 tx=0x7f2120011f30 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 shutdown_connections 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f211406ac30 0x7f211406d0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2130152db0 0x7f21300cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2130151a90 0x7f213014dd80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 --2- 172.21.15.33:0/2658768422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2118003970 0x7f213015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.418+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 >> 172.21.15.33:0/2658768422 conn(0x7f21300b0510 msgr2=0x7f2130157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.419+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 shutdown_connections 2024-09-13T18:57:54.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.419+0000 7f2138800640 1 -- 172.21.15.33:0/2658768422 wait complete. 2024-09-13T18:57:54.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:54.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:54.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.593+0000 7f18e2c00640 1 Processor -- start 2024-09-13T18:57:54.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.593+0000 7f18e2c00640 1 -- start start 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.594+0000 7f18e2c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f18dc154ad0 0x7f18dc0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.594+0000 7f18e2c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc06b7c0 con 0x7f18dc06f830 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.594+0000 7f18e2c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc06baa0 con 0x7f18dc0ce2c0 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.594+0000 7f18e2c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc06b5b0 con 0x7f18dc154ad0 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18dbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f18dc154ad0 0x7f18dc0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18d3400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f18dc06f830 0x7f18dc06fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42340/0 (socket says 172.21.15.33:42340) 2024-09-13T18:57:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18d3400640 1 -- 172.21.15.33:0/2925038197 learned_addr learned my addr 172.21.15.33:0/2925038197 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18dbe00640 1 -- 172.21.15.33:0/2925038197 >> v1:172.21.15.103:6789/0 conn(0x7f18dc0ce2c0 legacy=0x7f18dc0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18dbe00640 1 -- 172.21.15.33:0/2925038197 >> v1:172.21.15.33:6789/0 conn(0x7f18dc06f830 legacy=0x7f18dc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.595+0000 7f18dbe00640 1 -- 172.21.15.33:0/2925038197 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc06bd80 con 0x7f18dc154ad0 2024-09-13T18:57:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.596+0000 7f18dbe00640 1 --2- 172.21.15.33:0/2925038197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc154ad0 0x7f18dc0cdd80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0097a0 tx=0x7f18cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c11bb0e9015d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.596+0000 7f18db400640 1 -- 172.21.15.33:0/2925038197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc032440 con 0x7f18dc154ad0 2024-09-13T18:57:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18db400640 1 -- 172.21.15.33:0/2925038197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0325a0 con 0x7f18dc154ad0 2024-09-13T18:57:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18db400640 1 -- 172.21.15.33:0/2925038197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc032930 con 0x7f18dc154ad0 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 -- 172.21.15.33:0/2925038197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc154ad0 msgr2=0x7f18dc0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2925038197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc154ad0 0x7f18dc0cdd80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0097a0 tx=0x7f18cc02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 -- 172.21.15.33:0/2925038197 shutdown_connections 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2925038197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc154ad0 0x7f18dc0cdd80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 -- 172.21.15.33:0/2925038197 >> 172.21.15.33:0/2925038197 conn(0x7f18dc0b0580 msgr2=0x7f18dc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 -- 172.21.15.33:0/2925038197 shutdown_connections 2024-09-13T18:57:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.597+0000 7f18e2c00640 1 -- 172.21.15.33:0/2925038197 wait complete. 2024-09-13T18:57:54.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.599+0000 7f18e2c00640 1 Processor -- start 2024-09-13T18:57:54.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.599+0000 7f18e2c00640 1 -- start start 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18dc154ad0 0x7f18dc1f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18dc1f2cf0 0x7f18dc1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f01a0 con 0x7f18dc159cf0 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f0480 con 0x7f18dc1f2cf0 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e2c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f0760 con 0x7f18dc154ad0 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54928/0 (socket says 172.21.15.33:54928) 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 -- 172.21.15.33:0/2121127192 learned_addr learned my addr 172.21.15.33:0/2121127192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18dbe00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18dc154ad0 0x7f18dc1f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18d3400640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18dc1f2cf0 0x7f18dc1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 -- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18dc154ad0 msgr2=0x7f18dc1f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18dc154ad0 0x7f18dc1f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 -- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18dc1f2cf0 msgr2=0x7f18dc1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18dc1f2cf0 0x7f18dc1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.600+0000 7f18e0c00640 1 -- 172.21.15.33:0/2121127192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009400 con 0x7f18dc159cf0 2024-09-13T18:57:54.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18e0c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c730 tx=0x7f18d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4003b70 con 0x7f18dc159cf0 2024-09-13T18:57:54.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4003cd0 con 0x7f18dc159cf0 2024-09-13T18:57:54.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400aa90 con 0x7f18dc159cf0 2024-09-13T18:57:54.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc1f0a40 con 0x7f18dc159cf0 2024-09-13T18:57:54.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.601+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc1f3170 con 0x7f18dc159cf0 2024-09-13T18:57:54.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.602+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0a8460 con 0x7f18dc159cf0 2024-09-13T18:57:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.603+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18d400abf0 con 0x7f18dc159cf0 2024-09-13T18:57:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.604+0000 7f18d8c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 0x7f18b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.605+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18d4088fe0 con 0x7f18dc159cf0 2024-09-13T18:57:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.605+0000 7f18dbe00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 0x7f18b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.606+0000 7f18dbe00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 0x7f18b806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18cc034000 tx=0x7f18cc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.609+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18dc0a8460 con 0x7f18dc159cf0 2024-09-13T18:57:54.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.787+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18dc0a8460 con 0x7f18dc159cf0 2024-09-13T18:57:54.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.787+0000 7f18d8c00640 1 -- 172.21.15.33:0/2121127192 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18dc0a8460 con 0x7f18dc159cf0 2024-09-13T18:57:54.791 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 msgr2=0x7f18b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 0x7f18b806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18cc034000 tx=0x7f18cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 msgr2=0x7f18dc06c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c730 tx=0x7f18d400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 shutdown_connections 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18b806ac30 0x7f18b806d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18dc159cf0 0x7f18dc06c480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18dc1f2cf0 0x7f18dc1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 --2- 172.21.15.33:0/2121127192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18dc154ad0 0x7f18dc1f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.789+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 >> 172.21.15.33:0/2121127192 conn(0x7f18dc0b0580 msgr2=0x7f18dc0cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:54.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.790+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 shutdown_connections 2024-09-13T18:57:54.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.790+0000 7f18e2c00640 1 -- 172.21.15.33:0/2121127192 wait complete. 2024-09-13T18:57:54.809 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:54.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.963+0000 7fd3ca800640 1 Processor -- start 2024-09-13T18:57:54.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.963+0000 7fd3ca800640 1 -- start start 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3c4154ad0 0x7fd3c40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406f830 0x7fd3c406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c40ce2c0 0x7fd3c40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c406b5b0 con 0x7fd3c406f830 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c406b7c0 con 0x7fd3c4154ad0 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3ca800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c406baa0 con 0x7fd3c40ce2c0 2024-09-13T18:57:54.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3c2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406f830 0x7fd3c406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3c2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406f830 0x7fd3c406fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54934/0 (socket says 172.21.15.33:54934) 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3c2a00640 1 -- 172.21.15.33:0/2548248323 learned_addr learned my addr 172.21.15.33:0/2548248323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.964+0000 7fd3c3e00640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c40ce2c0 0x7fd3c40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c3400640 1 --2- 172.21.15.33:0/2548248323 >> v2:172.21.15.103:3300/0 conn(0x7fd3c4154ad0 0x7fd3c40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c2a00640 1 -- 172.21.15.33:0/2548248323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c40ce2c0 msgr2=0x7fd3c40cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c40ce2c0 0x7fd3c40cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c2a00640 1 -- 172.21.15.33:0/2548248323 >> v2:172.21.15.103:3300/0 conn(0x7fd3c4154ad0 msgr2=0x7fd3c40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/2548248323 >> v2:172.21.15.103:3300/0 conn(0x7fd3c4154ad0 0x7fd3c40cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.965+0000 7fd3c2a00640 1 -- 172.21.15.33:0/2548248323 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c406bd80 con 0x7fd3c406f830 2024-09-13T18:57:54.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.966+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406f830 0x7fd3c406fee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40b1340 tx=0x7fd3b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b153a0b30d80dda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.966+0000 7fd3c2000640 1 -- 172.21.15.33:0/2548248323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b002ae90 con 0x7fd3c406f830 2024-09-13T18:57:54.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.966+0000 7fd3c2000640 1 -- 172.21.15.33:0/2548248323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b0032440 con 0x7fd3c406f830 2024-09-13T18:57:54.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.966+0000 7fd3c2000640 1 -- 172.21.15.33:0/2548248323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00327d0 con 0x7fd3c406f830 2024-09-13T18:57:54.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 -- 172.21.15.33:0/2548248323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406f830 msgr2=0x7fd3c406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406f830 0x7fd3c406fee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40b1340 tx=0x7fd3b002a140 comp rx=0 tx=0).stop 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 -- 172.21.15.33:0/2548248323 shutdown_connections 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c40ce2c0 0x7fd3c40cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 --2- 172.21.15.33:0/2548248323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406f830 0x7fd3c406fee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 --2- 172.21.15.33:0/2548248323 >> v2:172.21.15.103:3300/0 conn(0x7fd3c4154ad0 0x7fd3c40cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 -- 172.21.15.33:0/2548248323 >> 172.21.15.33:0/2548248323 conn(0x7fd3c40b0580 msgr2=0x7fd3c40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 -- 172.21.15.33:0/2548248323 shutdown_connections 2024-09-13T18:57:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.967+0000 7fd3ca800640 1 -- 172.21.15.33:0/2548248323 wait complete. 2024-09-13T18:57:54.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.968+0000 7fd3ca800640 1 Processor -- start 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.969+0000 7fd3ca800640 1 -- start start 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.969+0000 7fd3ca800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c4154ad0 0x7fd3c415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.969+0000 7fd3ca800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c414aae0 0x7fd3c4150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3ca800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4150c50 con 0x7fd3c414a660 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3ca800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415aef0 con 0x7fd3c414aae0 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3ca800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4149810 con 0x7fd3c4154ad0 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54938/0 (socket says 172.21.15.33:54938) 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 -- 172.21.15.33:0/1860906539 learned_addr learned my addr 172.21.15.33:0/1860906539 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c3400640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c4154ad0 0x7fd3c415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c3e00640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c414aae0 0x7fd3c4150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 -- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c4154ad0 msgr2=0x7fd3c415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c4154ad0 0x7fd3c415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 -- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c414aae0 msgr2=0x7fd3c4150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c414aae0 0x7fd3c4150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.970+0000 7fd3c2a00640 1 -- 172.21.15.33:0/1860906539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00094d0 con 0x7fd3c414a660 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3c2a00640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd3b002a180 tx=0x7fd3b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b003d830 con 0x7fd3c414a660 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b003d990 con 0x7fd3c414a660 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b003dd00 con 0x7fd3c414a660 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4150970 con 0x7fd3c414a660 2024-09-13T18:57:54.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.971+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c414bc50 con 0x7fd3c414a660 2024-09-13T18:57:54.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.972+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c414b7d0 con 0x7fd3c414a660 2024-09-13T18:57:54.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.973+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3b0039040 con 0x7fd3c414a660 2024-09-13T18:57:54.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.974+0000 7fd3bb400640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 0x7fd3a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:54.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.974+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b00a9db0 con 0x7fd3c414a660 2024-09-13T18:57:54.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.974+0000 7fd3c3400640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 0x7fd3a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:54.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.975+0000 7fd3c3400640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 0x7fd3a406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4153240 tx=0x7fd3b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:54.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:54.978+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3c414b7d0 con 0x7fd3c414a660 2024-09-13T18:57:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.156+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3c414b7d0 con 0x7fd3c414a660 2024-09-13T18:57:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.156+0000 7fd3bb400640 1 -- 172.21.15.33:0/1860906539 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3c414b7d0 con 0x7fd3c414a660 2024-09-13T18:57:55.160 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 msgr2=0x7fd3a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 0x7fd3a406d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4153240 tx=0x7fd3b4009190 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 msgr2=0x7fd3c414fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd3b002a180 tx=0x7fd3b00046c0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 shutdown_connections 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd3a406ac00 0x7fd3a406d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3c414aae0 0x7fd3c4150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c414a660 0x7fd3c414fdd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 --2- 172.21.15.33:0/1860906539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3c4154ad0 0x7fd3c415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.158+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 >> 172.21.15.33:0/1860906539 conn(0x7fd3c40b0580 msgr2=0x7fd3c41595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.159+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 shutdown_connections 2024-09-13T18:57:55.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.159+0000 7fd3ca800640 1 -- 172.21.15.33:0/1860906539 wait complete. 2024-09-13T18:57:55.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:55.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.336+0000 7f9d47400640 1 Processor -- start 2024-09-13T18:57:55.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.336+0000 7f9d47400640 1 -- start start 2024-09-13T18:57:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d47400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d40071690 0x7f9d4015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d47400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d400cafa0 0x7f9d400cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d47400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4006f5f0 con 0x7f9d40156f60 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d47400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4015aa30 con 0x7f9d400cafa0 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d47400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d40070450 con 0x7f9d40071690 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d400cafa0 0x7f9d400cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d400cafa0 0x7f9d400cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54952/0 (socket says 172.21.15.33:54952) 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 -- 172.21.15.33:0/321874495 learned_addr learned my addr 172.21.15.33:0/321874495 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d3fe00640 1 --2- 172.21.15.33:0/321874495 >> v2:172.21.15.103:3300/0 conn(0x7f9d40071690 0x7f9d4015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 -- 172.21.15.33:0/321874495 >> v2:172.21.15.103:3300/0 conn(0x7f9d40071690 msgr2=0x7f9d4015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 --2- 172.21.15.33:0/321874495 >> v2:172.21.15.103:3300/0 conn(0x7f9d40071690 0x7f9d4015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 -- 172.21.15.33:0/321874495 >> v1:172.21.15.103:6789/0 conn(0x7f9d40156f60 legacy=0x7f9d40070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.338+0000 7f9d45400640 1 -- 172.21.15.33:0/321874495 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4006f840 con 0x7f9d400cafa0 2024-09-13T18:57:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.339+0000 7f9d45400640 1 --2- 172.21.15.33:0/321874495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d400cafa0 0x7f9d400cc8b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d400b12e0 tx=0x7f9d3802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784d672a622c556e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d3f400640 1 -- 172.21.15.33:0/321874495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38032430 con 0x7f9d400cafa0 2024-09-13T18:57:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d3f400640 1 -- 172.21.15.33:0/321874495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38032590 con 0x7f9d400cafa0 2024-09-13T18:57:55.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d3f400640 1 -- 172.21.15.33:0/321874495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38032920 con 0x7f9d400cafa0 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 -- 172.21.15.33:0/321874495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d400cafa0 msgr2=0x7f9d400cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 --2- 172.21.15.33:0/321874495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d400cafa0 0x7f9d400cc8b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d400b12e0 tx=0x7f9d3802c940 comp rx=0 tx=0).stop 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 -- 172.21.15.33:0/321874495 shutdown_connections 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 --2- 172.21.15.33:0/321874495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d400cafa0 0x7f9d400cc8b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 --2- 172.21.15.33:0/321874495 >> v2:172.21.15.103:3300/0 conn(0x7f9d40071690 0x7f9d4015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 -- 172.21.15.33:0/321874495 >> 172.21.15.33:0/321874495 conn(0x7f9d400b0580 msgr2=0x7f9d400b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 -- 172.21.15.33:0/321874495 shutdown_connections 2024-09-13T18:57:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.340+0000 7f9d47400640 1 -- 172.21.15.33:0/321874495 wait complete. 2024-09-13T18:57:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.342+0000 7f9d47400640 1 Processor -- start 2024-09-13T18:57:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.342+0000 7f9d47400640 1 -- start start 2024-09-13T18:57:55.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d40071690 0x7f9d400af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d400cafa0 0x7f9d4015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40139750 con 0x7f9d40156f60 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4015bc10 con 0x7f9d40071690 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d47400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d40138b70 con 0x7f9d400cafa0 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d45400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.343+0000 7f9d44a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d40071690 0x7f9d400af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54962/0 (socket says 172.21.15.33:54962) 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 -- 172.21.15.33:0/1600376313 learned_addr learned my addr 172.21.15.33:0/1600376313 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d3fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d400cafa0 0x7f9d4015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 -- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d400cafa0 msgr2=0x7f9d4015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d400cafa0 0x7f9d4015b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 -- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d40071690 msgr2=0x7f9d400af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d40071690 0x7f9d400af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 -- 172.21.15.33:0/1600376313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009b30 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.344+0000 7f9d45400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d38034040 tx=0x7f9d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.345+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38032430 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.345+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3803b850 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.345+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40138db0 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.345+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3803bc00 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.345+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d40139370 con 0x7f9d40156f60 2024-09-13T18:57:55.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.346+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d40139890 con 0x7f9d40156f60 2024-09-13T18:57:55.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.348+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d38031390 con 0x7f9d40156f60 2024-09-13T18:57:55.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.349+0000 7f9d3cc00640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 0x7f9d2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.349+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d380a9ea0 con 0x7f9d40156f60 2024-09-13T18:57:55.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.349+0000 7f9d44a00640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 0x7f9d2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.350+0000 7f9d44a00640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 0x7f9d2006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000f60 tx=0x7f9d34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.353+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9d40139890 con 0x7f9d40156f60 2024-09-13T18:57:55.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.535+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d40139890 con 0x7f9d40156f60 2024-09-13T18:57:55.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.535+0000 7f9d3cc00640 1 -- 172.21.15.33:0/1600376313 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d40139890 con 0x7f9d40156f60 2024-09-13T18:57:55.539 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 msgr2=0x7f9d2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 0x7f9d2006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d34000f60 tx=0x7f9d34009040 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 msgr2=0x7f9d4015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d38034040 tx=0x7f9d38004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 shutdown_connections 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9d2006ac00 0x7f9d2006d0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d40156f60 0x7f9d4015b6d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d400cafa0 0x7f9d4015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 --2- 172.21.15.33:0/1600376313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d40071690 0x7f9d400af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 >> 172.21.15.33:0/1600376313 conn(0x7f9d400b0580 msgr2=0x7f9d400cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 shutdown_connections 2024-09-13T18:57:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.537+0000 7f9d47400640 1 -- 172.21.15.33:0/1600376313 wait complete. 2024-09-13T18:57:55.557 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:57:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.713+0000 7f11cce00640 1 Processor -- start 2024-09-13T18:57:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.713+0000 7f11cce00640 1 -- start start 2024-09-13T18:57:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11cce00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11c81453d0 0x7f11c80cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11cce00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80ac870 con 0x7f11c80b12d0 2024-09-13T18:57:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11cce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80b1d20 con 0x7f11c806a5e0 2024-09-13T18:57:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11cce00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80cc2a0 con 0x7f11c81453d0 2024-09-13T18:57:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11bfe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f11c80b12d0 0x7f11c8069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42348/0 (socket says 172.21.15.33:42348) 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11bfe00640 1 -- 172.21.15.33:0/1525630685 learned_addr learned my addr 172.21.15.33:0/1525630685 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.714+0000 7f11c7400640 1 --2- 172.21.15.33:0/1525630685 >> v2:172.21.15.103:3300/0 conn(0x7f11c81453d0 0x7f11c80cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245815136 0 0) 0x7f11c80ac870 con 0x7f11c80b12d0 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11ac003520 con 0x7f11c80b12d0 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923782360 0 0) 0x7f11c80b1d20 con 0x7f11c806a5e0 2024-09-13T18:57:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c80ac870 con 0x7f11c806a5e0 2024-09-13T18:57:55.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2199503905 0 0) 0x7f11ac003520 con 0x7f11c80b12d0 2024-09-13T18:57:55.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 >> v2:172.21.15.103:3300/0 conn(0x7f11c81453d0 msgr2=0x7f11c80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 --2- 172.21.15.33:0/1525630685 >> v2:172.21.15.103:3300/0 conn(0x7f11c81453d0 0x7f11c80cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 >> v1:172.21.15.103:6789/0 conn(0x7f11c806a5e0 legacy=0x7f11c80acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80b2000 con 0x7f11c80b12d0 2024-09-13T18:57:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f11b0001670 con 0x7f11c80b12d0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 >> v1:172.21.15.33:6789/0 conn(0x7f11c80b12d0 legacy=0x7f11c8069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11ac003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac0047c0 0x7f11ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11ac0051d0 0x7f11ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cc2a0 con 0x7f11ac003b50 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac00c100 con 0x7f11ac0047c0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac00c2c0 con 0x7f11ac0051d0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11c7400640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11ac003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.715+0000 7f11bfe00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac0047c0 0x7f11ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7e00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11ac0051d0 0x7f11ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7400640 1 -- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11ac0051d0 msgr2=0x7f11ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7400640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11ac0051d0 0x7f11ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7400640 1 -- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac0047c0 msgr2=0x7f11ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7400640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac0047c0 0x7f11ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7400640 1 -- 172.21.15.33:0/1525630685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac003520 con 0x7f11ac003b50 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7e00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11ac0051d0 0x7f11ac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.716+0000 7f11c7e00640 1 -- 172.21.15.33:0/1525630685 reap_dead start 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.717+0000 7f11c7400640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11ac003f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009ac0 tx=0x7f11ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b7ca52bba9b37f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.717+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8031400 con 0x7f11ac003b50 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.717+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b802d050 con 0x7f11ac003b50 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.717+0000 7f11c6a00640 1 -- 172.21.15.33:0/1525630685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8031780 con 0x7f11ac003b50 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 -- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 msgr2=0x7f11ac003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11ac003f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009ac0 tx=0x7f11ac0057f0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 -- 172.21.15.33:0/1525630685 shutdown_connections 2024-09-13T18:57:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 --2- 172.21.15.33:0/1525630685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11ac003f50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 -- 172.21.15.33:0/1525630685 >> 172.21.15.33:0/1525630685 conn(0x7f11c80affd0 msgr2=0x7f11c80b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 -- 172.21.15.33:0/1525630685 shutdown_connections 2024-09-13T18:57:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.718+0000 7f11cce00640 1 -- 172.21.15.33:0/1525630685 wait complete. 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.719+0000 7f11cce00640 1 Processor -- start 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.720+0000 7f11cce00640 1 -- start start 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.720+0000 7f11cce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.720+0000 7f11cce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11c80af180 0x7f11c80af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.720+0000 7f11cce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11c80c4940 0x7f11c80c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11cce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80afb40 con 0x7f11ac003b50 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11cce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c815dc10 con 0x7f11c80af180 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11cce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80c5300 con 0x7f11c80c4940 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54968/0 (socket says 172.21.15.33:54968) 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 -- 172.21.15.33:0/1624404549 learned_addr learned my addr 172.21.15.33:0/1624404549 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11bfe00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11c80af180 0x7f11c80af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7e00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11c80c4940 0x7f11c80c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 -- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11c80c4940 msgr2=0x7f11c80c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11c80c4940 0x7f11c80c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 -- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11c80af180 msgr2=0x7f11c80af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11c80af180 0x7f11c80af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.721+0000 7f11c7400640 1 -- 172.21.15.33:0/1624404549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c81429a0 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11c7400640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009be0 tx=0x7f11b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b803b600 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b803b760 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c815ce50 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b803baf0 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.722+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c815d410 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.723+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8067320 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.724+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f11b803bc50 con 0x7f11ac003b50 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.725+0000 7f11bf400640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 0x7f11a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.725+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f11b80a95c0 con 0x7f11ac003b50 2024-09-13T18:57:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.725+0000 7f11bfe00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 0x7f11a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.726+0000 7f11bfe00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 0x7f11a406d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11b0001b80 tx=0x7f11b0001a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.729+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f11b80747c0 con 0x7f11ac003b50 2024-09-13T18:57:55.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.924+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11c81429a0 con 0x7f11ac003b50 2024-09-13T18:57:55.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.924+0000 7f11bf400640 1 -- 172.21.15.33:0/1624404549 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11c81429a0 con 0x7f11ac003b50 2024-09-13T18:57:55.927 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 msgr2=0x7f11a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 0x7f11a406d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11b0001b80 tx=0x7f11b0001a30 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 msgr2=0x7f11c8141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009be0 tx=0x7f11b8004730 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 shutdown_connections 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f11a406ac00 0x7f11a406d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11c80c4940 0x7f11c80c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11c80af180 0x7f11c80af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 --2- 172.21.15.33:0/1624404549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ac003b50 0x7f11c8141e20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 >> 172.21.15.33:0/1624404549 conn(0x7f11c80affd0 msgr2=0x7f11c80ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 shutdown_connections 2024-09-13T18:57:55.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:55.926+0000 7f11cce00640 1 -- 172.21.15.33:0/1624404549 wait complete. 2024-09-13T18:57:55.945 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:57:55.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:55.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T18:57:56.008 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:57:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:56.009 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:57:56.051 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:57:56.052 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:56.092 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:57:56.092 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:56.170 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:57:56.171 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:56.251 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:56.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.404+0000 7f45ede00640 1 Processor -- start 2024-09-13T18:57:56.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.404+0000 7f45ede00640 1 -- start start 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45ede00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45e8159a80 0x7f45e806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45ede00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e8153f00 con 0x7f45e80b3990 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45ede00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80b1a40 con 0x7f45e8153b20 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45ede00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80ce600 con 0x7f45e8159a80 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45dfe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45e80b3990 0x7f45e806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42350/0 (socket says 172.21.15.33:42350) 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45dfe00640 1 -- 172.21.15.33:0/4274215629 learned_addr learned my addr 172.21.15.33:0/4274215629 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45e7400640 1 --2- 172.21.15.33:0/4274215629 >> v2:172.21.15.103:3300/0 conn(0x7f45e8159a80 0x7f45e806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847984865 0 0) 0x7f45e8153f00 con 0x7f45e80b3990 2024-09-13T18:57:56.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.406+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc005730 con 0x7f45e80b3990 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172201361 0 0) 0x7f45e80b1a40 con 0x7f45e8153b20 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e8153f00 con 0x7f45e8153b20 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3527602606 0 0) 0x7f45cc005730 con 0x7f45e80b3990 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 >> v2:172.21.15.103:3300/0 conn(0x7f45e8159a80 msgr2=0x7f45e806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 --2- 172.21.15.33:0/4274215629 >> v2:172.21.15.103:3300/0 conn(0x7f45e8159a80 0x7f45e806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 >> v1:172.21.15.103:6789/0 conn(0x7f45e8153b20 legacy=0x7f45e80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e815a1f0 con 0x7f45e80b3990 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f45d0001670 con 0x7f45e80b3990 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 >> v1:172.21.15.33:6789/0 conn(0x7f45e80b3990 legacy=0x7f45e806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45cc005d60 0x7f45cc006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45cc0069d0 0x7f45cc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45cc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80ce600 con 0x7f45cc007390 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc00e260 con 0x7f45cc0069d0 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc00e420 con 0x7f45cc005d60 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e7400640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45cc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45e6a00640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45cc005d60 0x7f45cc006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.407+0000 7f45dfe00640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45cc0069d0 0x7f45cc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 -- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45cc005d60 msgr2=0x7f45cc006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45cc005d60 0x7f45cc006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 -- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45cc0069d0 msgr2=0x7f45cc006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45cc0069d0 0x7f45cc006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 -- 172.21.15.33:0/4274215629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc005730 con 0x7f45cc007390 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.408+0000 7f45e7400640 1 -- 172.21.15.33:0/4274215629 reap_dead start 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45e7400640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45cc00db90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009fc0 tx=0x7f45cc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be73d52053a66a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0003b90 con 0x7f45cc007390 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000f040 con 0x7f45cc007390 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45e6000640 1 -- 172.21.15.33:0/4274215629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004020 con 0x7f45cc007390 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45ede00640 1 -- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 msgr2=0x7f45cc00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45ede00640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45cc00db90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009fc0 tx=0x7f45cc007a00 comp rx=0 tx=0).stop 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45ede00640 1 -- 172.21.15.33:0/4274215629 shutdown_connections 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45ede00640 1 --2- 172.21.15.33:0/4274215629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45cc00db90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.409+0000 7f45ede00640 1 -- 172.21.15.33:0/4274215629 >> 172.21.15.33:0/4274215629 conn(0x7f45e80b0510 msgr2=0x7f45e80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:56.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.410+0000 7f45ede00640 1 -- 172.21.15.33:0/4274215629 shutdown_connections 2024-09-13T18:57:56.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.410+0000 7f45ede00640 1 -- 172.21.15.33:0/4274215629 wait complete. 2024-09-13T18:57:56.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.411+0000 7f45ede00640 1 Processor -- start 2024-09-13T18:57:56.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.411+0000 7f45ede00640 1 -- start start 2024-09-13T18:57:56.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8148470 0x7f45e815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45e815c310 0x7f45e8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815b230 con 0x7f45cc007390 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815cb70 con 0x7f45e8148470 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45ede00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e81488f0 con 0x7f45e815c310 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45e6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45e6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54974/0 (socket says 172.21.15.33:54974) 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.412+0000 7f45e6a00640 1 -- 172.21.15.33:0/3133544409 learned_addr learned my addr 172.21.15.33:0/3133544409 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45dfe00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8148470 0x7f45e815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e7400640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45e815c310 0x7f45e8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 -- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45e815c310 msgr2=0x7f45e8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45e815c310 0x7f45e8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 -- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8148470 msgr2=0x7f45e815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8148470 0x7f45e815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 -- 172.21.15.33:0/3133544409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e815c890 con 0x7f45cc007390 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45e6a00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f45d800f720 tx=0x7f45d800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.413+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d80050d0 con 0x7f45cc007390 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.414+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8005230 con 0x7f45cc007390 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.414+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800d6d0 con 0x7f45cc007390 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.414+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e815ab70 con 0x7f45cc007390 2024-09-13T18:57:56.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.414+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e81565a0 con 0x7f45cc007390 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.415+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e815b370 con 0x7f45cc007390 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.416+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45d800d830 con 0x7f45cc007390 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.416+0000 7f45df400640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 0x7f45c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.417+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f45d8089180 con 0x7f45cc007390 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.417+0000 7f45dfe00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 0x7f45c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.417+0000 7f45dfe00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 0x7f45c406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45d0001030 tx=0x7f45d0000fc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.421+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45e815b370 con 0x7f45cc007390 2024-09-13T18:57:56.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.600+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45e8156730 con 0x7f45cc007390 2024-09-13T18:57:56.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.602+0000 7f45df400640 1 -- 172.21.15.33:0/3133544409 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f45d8054420 con 0x7f45cc007390 2024-09-13T18:57:56.605 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:56.605 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 msgr2=0x7f45c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 0x7f45c406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45d0001030 tx=0x7f45d0000fc0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 msgr2=0x7f45e815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f45d800f720 tx=0x7f45d800fbe0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 shutdown_connections 2024-09-13T18:57:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f45c406ac00 0x7f45c406d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45e815c310 0x7f45e8158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8148470 0x7f45e815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 --2- 172.21.15.33:0/3133544409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45cc007390 0x7f45e815b650 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 >> 172.21.15.33:0/3133544409 conn(0x7f45e80b0510 msgr2=0x7f45e80ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 shutdown_connections 2024-09-13T18:57:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.604+0000 7f45ede00640 1 -- 172.21.15.33:0/3133544409 wait complete. 2024-09-13T18:57:56.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:56.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:56.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.778+0000 7ff6bbe00640 1 Processor -- start 2024-09-13T18:57:56.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.778+0000 7ff6bbe00640 1 -- start start 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6bbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff6bc0b2e20 0x7ff6bc0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6bbe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc0cc370 con 0x7ff6bc1594a0 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6bbe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc0cd1b0 con 0x7ff6bc15d980 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6bbe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc159880 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6baa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff6bc1594a0 0x7ff6bc0b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42354/0 (socket says 172.21.15.33:42354) 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6baa00640 1 -- 172.21.15.33:0/2786372899 learned_addr learned my addr 172.21.15.33:0/2786372899 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6b2000640 1 --2- 172.21.15.33:0/2786372899 >> v2:172.21.15.33:3300/0 conn(0x7ff6bc0b2e20 0x7ff6bc0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6ba000640 1 -- 172.21.15.33:0/2786372899 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691702968 0 0) 0x7ff6bc0cc370 con 0x7ff6bc1594a0 2024-09-13T18:57:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6ba000640 1 -- 172.21.15.33:0/2786372899 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a0005730 con 0x7ff6bc1594a0 2024-09-13T18:57:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6b2000640 1 -- 172.21.15.33:0/2786372899 >> v1:172.21.15.103:6789/0 conn(0x7ff6bc15d980 legacy=0x7ff6bc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6b2000640 1 -- 172.21.15.33:0/2786372899 >> v1:172.21.15.33:6789/0 conn(0x7ff6bc1594a0 legacy=0x7ff6bc0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.780+0000 7ff6b2000640 1 -- 172.21.15.33:0/2786372899 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0cc5a0 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.781+0000 7ff6b2000640 1 --2- 172.21.15.33:0/2786372899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc0b2e20 0x7ff6bc0cdf10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40097a0 tx=0x7ff6a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ad6471e0bb2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6ba000640 1 -- 172.21.15.33:0/2786372899 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4032440 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6ba000640 1 -- 172.21.15.33:0/2786372899 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a40325a0 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6ba000640 1 -- 172.21.15.33:0/2786372899 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4032930 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 -- 172.21.15.33:0/2786372899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc0b2e20 msgr2=0x7ff6bc0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/2786372899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc0b2e20 0x7ff6bc0cdf10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40097a0 tx=0x7ff6a402a230 comp rx=0 tx=0).stop 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 -- 172.21.15.33:0/2786372899 shutdown_connections 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/2786372899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc0b2e20 0x7ff6bc0cdf10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 -- 172.21.15.33:0/2786372899 >> 172.21.15.33:0/2786372899 conn(0x7ff6bc0b0200 msgr2=0x7ff6bc0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 -- 172.21.15.33:0/2786372899 shutdown_connections 2024-09-13T18:57:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.782+0000 7ff6bbe00640 1 -- 172.21.15.33:0/2786372899 wait complete. 2024-09-13T18:57:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.784+0000 7ff6bbe00640 1 Processor -- start 2024-09-13T18:57:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.784+0000 7ff6bbe00640 1 -- start start 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6bc0b2e20 0x7ff6bc14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6bc1594a0 0x7ff6bc158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc1566d0 con 0x7ff6bc15d980 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc156970 con 0x7ff6bc1594a0 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bbe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc156c50 con 0x7ff6bc0b2e20 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55000/0 (socket says 172.21.15.33:55000) 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6bb400640 1 -- 172.21.15.33:0/79757357 learned_addr learned my addr 172.21.15.33:0/79757357 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6b2000640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6bc1594a0 0x7ff6bc158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.785+0000 7ff6baa00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6bc0b2e20 0x7ff6bc14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 -- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6bc0b2e20 msgr2=0x7ff6bc14fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6bc0b2e20 0x7ff6bc14fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 -- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6bc1594a0 msgr2=0x7ff6bc158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6bc1594a0 0x7ff6bc158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 -- 172.21.15.33:0/79757357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009400 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bb400640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c6b0 tx=0x7ff6b400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003b70 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4003cf0 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003ea0 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.786+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc156f30 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.787+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc150320 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.787+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc157450 con 0x7ff6bc15d980 2024-09-13T18:57:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.788+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6b4005310 con 0x7ff6bc15d980 2024-09-13T18:57:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.790+0000 7ff6b3e00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 0x7ff69806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.790+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff6b4089110 con 0x7ff6bc15d980 2024-09-13T18:57:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.790+0000 7ff6baa00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 0x7ff69806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.791+0000 7ff6baa00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 0x7ff69806d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0011e0 tx=0x7ff6ac007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.794+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff6bc157450 con 0x7ff6bc15d980 2024-09-13T18:57:56.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.972+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6bc157450 con 0x7ff6bc15d980 2024-09-13T18:57:56.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.973+0000 7ff6b3e00640 1 -- 172.21.15.33:0/79757357 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6bc157450 con 0x7ff6bc15d980 2024-09-13T18:57:56.976 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 msgr2=0x7ff69806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 0x7ff69806d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0011e0 tx=0x7ff6ac007d30 comp rx=0 tx=0).stop 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 msgr2=0x7ff6bc1edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c6b0 tx=0x7ff6b400cb70 comp rx=0 tx=0).stop 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 shutdown_connections 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff69806ac00 0x7ff69806d0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6bc15d980 0x7ff6bc1edfb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6bc1594a0 0x7ff6bc158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 --2- 172.21.15.33:0/79757357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff6bc0b2e20 0x7ff6bc14fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 >> 172.21.15.33:0/79757357 conn(0x7ff6bc0b0200 msgr2=0x7ff6bc0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 shutdown_connections 2024-09-13T18:57:56.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:56.975+0000 7ff6bbe00640 1 -- 172.21.15.33:0/79757357 wait complete. 2024-09-13T18:57:56.993 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:57.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.149+0000 7f4d1f600640 1 Processor -- start 2024-09-13T18:57:57.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.149+0000 7f4d1f600640 1 -- start start 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.150+0000 7f4d1f600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d1806c180 0x7f4d181655b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.150+0000 7f4d1f600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1815abe0 con 0x7f4d1806b570 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.150+0000 7f4d1f600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d18071af0 con 0x7f4d1815a800 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.150+0000 7f4d1f600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1806c5b0 con 0x7f4d1806c180 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d17e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4d1806b570 0x7f4d180acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42360/0 (socket says 172.21.15.33:42360) 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d17e00640 1 -- 172.21.15.33:0/1669743288 learned_addr learned my addr 172.21.15.33:0/1669743288 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:57.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d1d600640 1 --2- 172.21.15.33:0/1669743288 >> v2:172.21.15.33:3300/0 conn(0x7f4d1806c180 0x7f4d181655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d1d600640 1 -- 172.21.15.33:0/1669743288 >> v1:172.21.15.103:6789/0 conn(0x7f4d1815a800 legacy=0x7f4d180ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d1d600640 1 -- 172.21.15.33:0/1669743288 >> v1:172.21.15.33:6789/0 conn(0x7f4d1806b570 legacy=0x7f4d180acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d1d600640 1 -- 172.21.15.33:0/1669743288 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18071dd0 con 0x7f4d1806c180 2024-09-13T18:57:57.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.151+0000 7f4d17400640 1 -- 172.21.15.33:0/1669743288 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935593679 0 0) 0x7f4d04001110 con 0x7f4d1806b570 2024-09-13T18:57:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.152+0000 7f4d1d600640 1 --2- 172.21.15.33:0/1669743288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1806c180 0x7f4d181655b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009d90 tx=0x7f4d1002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c22918fd27d2f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.152+0000 7f4d17400640 1 -- 172.21.15.33:0/1669743288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10031600 con 0x7f4d1806c180 2024-09-13T18:57:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d17400640 1 -- 172.21.15.33:0/1669743288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1002d050 con 0x7f4d1806c180 2024-09-13T18:57:57.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d17400640 1 -- 172.21.15.33:0/1669743288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10031980 con 0x7f4d1806c180 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 -- 172.21.15.33:0/1669743288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1806c180 msgr2=0x7f4d181655b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 --2- 172.21.15.33:0/1669743288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1806c180 0x7f4d181655b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009d90 tx=0x7f4d1002a610 comp rx=0 tx=0).stop 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 -- 172.21.15.33:0/1669743288 shutdown_connections 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 --2- 172.21.15.33:0/1669743288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1806c180 0x7f4d181655b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 -- 172.21.15.33:0/1669743288 >> 172.21.15.33:0/1669743288 conn(0x7f4d180b0ba0 msgr2=0x7f4d180b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 -- 172.21.15.33:0/1669743288 shutdown_connections 2024-09-13T18:57:57.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.153+0000 7f4d1f600640 1 -- 172.21.15.33:0/1669743288 wait complete. 2024-09-13T18:57:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.155+0000 7f4d1f600640 1 Processor -- start 2024-09-13T18:57:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.155+0000 7f4d1f600640 1 -- start start 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d1806b570 0x7f4d180cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 0x7f4d1814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1814fb80 con 0x7f4d1815a800 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1814f520 con 0x7f4d1806b570 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1f600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1814f850 con 0x7f4d1806c180 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1d600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1d600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55010/0 (socket says 172.21.15.33:55010) 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1d600640 1 -- 172.21.15.33:0/3390022475 learned_addr learned my addr 172.21.15.33:0/3390022475 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:57.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d1cc00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d1806b570 0x7f4d180cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.156+0000 7f4d17e00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 0x7f4d1814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 -- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 msgr2=0x7f4d1814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 0x7f4d1814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 -- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d1806b570 msgr2=0x7f4d180cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d1806b570 0x7f4d180cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 -- 172.21.15.33:0/3390022475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009a70 con 0x7f4d1815a800 2024-09-13T18:57:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d17e00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 0x7f4d1814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1d600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d1002ac00 tx=0x7f4d10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1003c830 con 0x7f4d1815a800 2024-09-13T18:57:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1003c990 con 0x7f4d1815a800 2024-09-13T18:57:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1003cd00 con 0x7f4d1815a800 2024-09-13T18:57:57.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d180cc7e0 con 0x7f4d1815a800 2024-09-13T18:57:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.157+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d180cbb00 con 0x7f4d1815a800 2024-09-13T18:57:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.158+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1814fcf0 con 0x7f4d1815a800 2024-09-13T18:57:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.159+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d10045460 con 0x7f4d1815a800 2024-09-13T18:57:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.160+0000 7f4d14c00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 0x7f4cf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.160+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d100aafb0 con 0x7f4d1815a800 2024-09-13T18:57:57.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.161+0000 7f4d1cc00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 0x7f4cf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.161+0000 7f4d1cc00640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 0x7f4cf806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c004f60 tx=0x7f4d0c007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.164+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d10079b00 con 0x7f4d1815a800 2024-09-13T18:57:57.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.346+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d180ac680 con 0x7f4d1815a800 2024-09-13T18:57:57.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.346+0000 7f4d14c00640 1 -- 172.21.15.33:0/3390022475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d10040020 con 0x7f4d1815a800 2024-09-13T18:57:57.350 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 msgr2=0x7f4cf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 0x7f4cf806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c004f60 tx=0x7f4d0c007e30 comp rx=0 tx=0).stop 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 msgr2=0x7f4d180cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d1002ac00 tx=0x7f4d10004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 shutdown_connections 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cf806ac00 0x7f4cf806d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d1815a800 0x7f4d180cb5c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d1806c180 0x7f4d1814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.348+0000 7f4d1f600640 1 --2- 172.21.15.33:0/3390022475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d1806b570 0x7f4d180cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.349+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 >> 172.21.15.33:0/3390022475 conn(0x7f4d180b0ba0 msgr2=0x7f4d18156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:57.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.349+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 shutdown_connections 2024-09-13T18:57:57.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.349+0000 7f4d1f600640 1 -- 172.21.15.33:0/3390022475 wait complete. 2024-09-13T18:57:57.368 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:57.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.521+0000 7f2bf3e00640 1 Processor -- start 2024-09-13T18:57:57.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.522+0000 7f2bf3e00640 1 -- start start 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 0x7f2bf40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bf3e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf40b30e0 con 0x7f2bf40cbb00 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bf3e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf415a800 con 0x7f2bf40cbf40 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bf3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40b24d0 con 0x7f2bf415a420 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bea000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2bf40cbb00 0x7f2bf40cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42362/0 (socket says 172.21.15.33:42362) 2024-09-13T18:57:57.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bea000640 1 -- 172.21.15.33:0/3759148869 learned_addr learned my addr 172.21.15.33:0/3759148869 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.523+0000 7f2bf2a00640 1 --2- 172.21.15.33:0/3759148869 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 0x7f2bf40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607434241 0 0) 0x7f2bf40b30e0 con 0x7f2bf40cbb00 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd8003520 con 0x7f2bf40cbb00 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905054397 0 0) 0x7f2bf415a800 con 0x7f2bf40cbf40 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf40b30e0 con 0x7f2bf40cbf40 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792405794 0 0) 0x7f2bd8003520 con 0x7f2bf40cbb00 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2a00640 1 -- 172.21.15.33:0/3759148869 >> v1:172.21.15.103:6789/0 conn(0x7f2bf40cbf40 legacy=0x7f2bf406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2a00640 1 -- 172.21.15.33:0/3759148869 >> v1:172.21.15.33:6789/0 conn(0x7f2bf40cbb00 legacy=0x7f2bf40cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.524+0000 7f2bf2a00640 1 -- 172.21.15.33:0/3759148869 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40b27b0 con 0x7f2bf415a420 2024-09-13T18:57:57.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.525+0000 7f2bf2a00640 1 --2- 172.21.15.33:0/3759148869 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 0x7f2bf40b1ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097d0 tx=0x7f2be402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18eefff1020ea9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc001670 con 0x7f2bf415a420 2024-09-13T18:57:57.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be402abd0 con 0x7f2bf415a420 2024-09-13T18:57:57.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf2000640 1 -- 172.21.15.33:0/3759148869 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4032440 con 0x7f2bf415a420 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 -- 172.21.15.33:0/3759148869 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 msgr2=0x7f2bf40b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/3759148869 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 0x7f2bf40b1ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097d0 tx=0x7f2be402a140 comp rx=0 tx=0).stop 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 -- 172.21.15.33:0/3759148869 shutdown_connections 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/3759148869 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf415a420 0x7f2bf40b1ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 -- 172.21.15.33:0/3759148869 >> 172.21.15.33:0/3759148869 conn(0x7f2bf4069ed0 msgr2=0x7f2bf406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.526+0000 7f2bf3e00640 1 -- 172.21.15.33:0/3759148869 shutdown_connections 2024-09-13T18:57:57.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.527+0000 7f2bf3e00640 1 -- 172.21.15.33:0/3759148869 wait complete. 2024-09-13T18:57:57.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.528+0000 7f2bf3e00640 1 Processor -- start 2024-09-13T18:57:57.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.528+0000 7f2bf3e00640 1 -- start start 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf40cbb00 0x7f2bf414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 0x7f2bf4152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf414d720 con 0x7f2bf415a420 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4152f90 con 0x7f2bf40cbf40 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.529+0000 7f2bf3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4153270 con 0x7f2bf40cbb00 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55016/0 (socket says 172.21.15.33:55016) 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 -- 172.21.15.33:0/2684686570 learned_addr learned my addr 172.21.15.33:0/2684686570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:57.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf2a00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf40cbb00 0x7f2bf414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bea000640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 0x7f2bf4152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 -- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf40cbb00 msgr2=0x7f2bf414d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf40cbb00 0x7f2bf414d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 -- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 msgr2=0x7f2bf4152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 0x7f2bf4152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 -- 172.21.15.33:0/2684686570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009400 con 0x7f2bf415a420 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bea000640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 0x7f2bf4152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.530+0000 7f2bf3400640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c7c0 tx=0x7f2bec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.531+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003da0 con 0x7f2bf415a420 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.531+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec005070 con 0x7f2bf415a420 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.531+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec005420 con 0x7f2bf415a420 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.531+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf4153550 con 0x7f2bf415a420 2024-09-13T18:57:57.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.531+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4152ba0 con 0x7f2bf415a420 2024-09-13T18:57:57.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.532+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf4153d50 con 0x7f2bf415a420 2024-09-13T18:57:57.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.533+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2bec005580 con 0x7f2bf415a420 2024-09-13T18:57:57.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.534+0000 7f2beb400640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 0x7f2bd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.534+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2bec088c70 con 0x7f2bf415a420 2024-09-13T18:57:57.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.534+0000 7f2bf2a00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 0x7f2bd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.535+0000 7f2bf2a00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 0x7f2bd006d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2be4034000 tx=0x7f2be402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.538+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2bec053de0 con 0x7f2bf415a420 2024-09-13T18:57:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.716+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bf40b1ed0 con 0x7f2bf415a420 2024-09-13T18:57:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.717+0000 7f2beb400640 1 -- 172.21.15.33:0/2684686570 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bec017070 con 0x7f2bf415a420 2024-09-13T18:57:57.720 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.718+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 msgr2=0x7f2bd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.718+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 0x7f2bd006d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2be4034000 tx=0x7f2be402e000 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 msgr2=0x7f2bf41f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c7c0 tx=0x7f2bec00cc80 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 shutdown_connections 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2bd006ac00 0x7f2bd006d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bf415a420 0x7f2bf41f2410 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf40cbf40 0x7f2bf4152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 --2- 172.21.15.33:0/2684686570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2bf40cbb00 0x7f2bf414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 >> 172.21.15.33:0/2684686570 conn(0x7f2bf4069ed0 msgr2=0x7f2bf4154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 shutdown_connections 2024-09-13T18:57:57.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.719+0000 7f2bf3e00640 1 -- 172.21.15.33:0/2684686570 wait complete. 2024-09-13T18:57:57.738 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:57:57.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.892+0000 7fd95fe00640 1 Processor -- start 2024-09-13T18:57:57.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.892+0000 7fd95fe00640 1 -- start start 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd96015c810 0x7fd9600b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9600cd3f0 0x7fd9600d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95fe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600d0260 con 0x7fd9600b4650 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95fe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600ce160 con 0x7fd9600cd3f0 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600b4a70 con 0x7fd96015c810 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd956000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd9600b4650 0x7fd9600ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42364/0 (socket says 172.21.15.33:42364) 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd956000640 1 -- 172.21.15.33:0/1647180617 learned_addr learned my addr 172.21.15.33:0/1647180617 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:57:57.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9600cd3f0 0x7fd9600d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.893+0000 7fd95ea00640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd96015c810 0x7fd9600b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.894+0000 7fd95f400640 1 -- 172.21.15.33:0/1647180617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd96015c810 msgr2=0x7fd9600b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.894+0000 7fd95f400640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd96015c810 0x7fd9600b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.894+0000 7fd95f400640 1 -- 172.21.15.33:0/1647180617 >> v1:172.21.15.33:6789/0 conn(0x7fd9600b4650 legacy=0x7fd9600ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.894+0000 7fd95f400640 1 -- 172.21.15.33:0/1647180617 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600b1c50 con 0x7fd9600cd3f0 2024-09-13T18:57:57.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.894+0000 7fd95e000640 1 -- 172.21.15.33:0/1647180617 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689286883 0 0) 0x7fd9600d0260 con 0x7fd9600b4650 2024-09-13T18:57:57.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.895+0000 7fd95f400640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9600cd3f0 0x7fd9600d09d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd95802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5de503a957bc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.895+0000 7fd95e000640 1 -- 172.21.15.33:0/1647180617 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958007740 con 0x7fd9600cd3f0 2024-09-13T18:57:57.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.895+0000 7fd95e000640 1 -- 172.21.15.33:0/1647180617 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95802d050 con 0x7fd9600cd3f0 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.895+0000 7fd95e000640 1 -- 172.21.15.33:0/1647180617 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958007ac0 con 0x7fd9600cd3f0 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 -- 172.21.15.33:0/1647180617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9600cd3f0 msgr2=0x7fd9600d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9600cd3f0 0x7fd9600d09d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd95802a660 comp rx=0 tx=0).stop 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 -- 172.21.15.33:0/1647180617 shutdown_connections 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9600cd3f0 0x7fd9600d09d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 --2- 172.21.15.33:0/1647180617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd96015c810 0x7fd9600b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 -- 172.21.15.33:0/1647180617 >> 172.21.15.33:0/1647180617 conn(0x7fd96006c050 msgr2=0x7fd96006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 -- 172.21.15.33:0/1647180617 shutdown_connections 2024-09-13T18:57:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.896+0000 7fd95fe00640 1 -- 172.21.15.33:0/1647180617 wait complete. 2024-09-13T18:57:57.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.897+0000 7fd95fe00640 1 Processor -- start 2024-09-13T18:57:57.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.898+0000 7fd95fe00640 1 -- start start 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.898+0000 7fd95fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600b4650 0x7fd9601f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.898+0000 7fd95fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9600cd3f0 0x7fd96015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.898+0000 7fd95fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95fe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960147550 con 0x7fd96015c810 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015aae0 con 0x7fd9600b4650 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015adc0 con 0x7fd9600cd3f0 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55030/0 (socket says 172.21.15.33:55030) 2024-09-13T18:57:57.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 -- 172.21.15.33:0/2766102165 learned_addr learned my addr 172.21.15.33:0/2766102165 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd956000640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9600cd3f0 0x7fd96015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95ea00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600b4650 0x7fd9601f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 -- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9600cd3f0 msgr2=0x7fd96015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9600cd3f0 0x7fd96015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 -- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600b4650 msgr2=0x7fd9601f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600b4650 0x7fd9601f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.899+0000 7fd95f400640 1 -- 172.21.15.33:0/2766102165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009a70 con 0x7fd96015c810 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd95f400640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95803c830 con 0x7fd96015c810 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95803c990 con 0x7fd96015c810 2024-09-13T18:57:57.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96015b0a0 con 0x7fd96015c810 2024-09-13T18:57:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95803cd00 con 0x7fd96015c810 2024-09-13T18:57:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.900+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9601f32b0 con 0x7fd96015c810 2024-09-13T18:57:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.901+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9601476c0 con 0x7fd96015c810 2024-09-13T18:57:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.902+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd958031400 con 0x7fd96015c810 2024-09-13T18:57:57.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.903+0000 7fd957400640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 0x7fd93c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:57.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.903+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9580aabc0 con 0x7fd96015c810 2024-09-13T18:57:57.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.904+0000 7fd95ea00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 0x7fd93c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:57.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.904+0000 7fd95ea00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 0x7fd93c06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd950009a30 tx=0x7fd950008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:57.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:57.907+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd958075dc0 con 0x7fd96015c810 2024-09-13T18:57:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.098+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9600ce650 con 0x7fd96015c810 2024-09-13T18:57:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.099+0000 7fd957400640 1 -- 172.21.15.33:0/2766102165 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd95803ce60 con 0x7fd96015c810 2024-09-13T18:57:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:57:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 msgr2=0x7fd93c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 0x7fd93c06d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd950009a30 tx=0x7fd950008040 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 msgr2=0x7fd96015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd958004a40 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 shutdown_connections 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd93c06ac00 0x7fd93c06d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd96015c810 0x7fd96015d420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9600cd3f0 0x7fd96015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 --2- 172.21.15.33:0/2766102165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600b4650 0x7fd9601f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 >> 172.21.15.33:0/2766102165 conn(0x7fd96006c050 msgr2=0x7fd9600b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 shutdown_connections 2024-09-13T18:57:58.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.101+0000 7fd95fe00640 1 -- 172.21.15.33:0/2766102165 wait complete. 2024-09-13T18:57:58.119 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:57:58.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:58.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T18:57:58.188 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:57:58.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:57:58.188 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:57:58.241 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:58.241 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:58.277 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:58.277 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:58.352 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:57:58.352 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:57:58.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:57:58.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.620+0000 7fc277200640 1 Processor -- start 2024-09-13T18:57:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.620+0000 7fc277200640 1 -- start start 2024-09-13T18:57:58.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc277200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278071560 0x7fc2780ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc277200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc27806f4b0 0x7fc2780b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc277200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2780cd850 con 0x7fc278159480 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc277200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2780cd570 con 0x7fc27806f4b0 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc277200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780b1740 con 0x7fc278071560 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc276800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc27806f4b0 0x7fc2780b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc276800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc27806f4b0 0x7fc2780b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55044/0 (socket says 172.21.15.33:55044) 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc276800640 1 -- 172.21.15.33:0/429719719 learned_addr learned my addr 172.21.15.33:0/429719719 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.621+0000 7fc26fe00640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278071560 0x7fc2780ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.622+0000 7fc276800640 1 -- 172.21.15.33:0/429719719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278071560 msgr2=0x7fc2780ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.622+0000 7fc276800640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278071560 0x7fc2780ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.622+0000 7fc276800640 1 -- 172.21.15.33:0/429719719 >> v1:172.21.15.103:6789/0 conn(0x7fc278159480 legacy=0x7fc278070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.622+0000 7fc276800640 1 -- 172.21.15.33:0/429719719 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780b1a20 con 0x7fc27806f4b0 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.623+0000 7fc276800640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27806f4b0 0x7fc2780b2220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc270009e50 tx=0x7fc27002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459cbe1ad497d129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.623+0000 7fc275400640 1 -- 172.21.15.33:0/429719719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27002aea0 con 0x7fc27806f4b0 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.623+0000 7fc275400640 1 -- 172.21.15.33:0/429719719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27002d050 con 0x7fc27806f4b0 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.623+0000 7fc275400640 1 -- 172.21.15.33:0/429719719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270031820 con 0x7fc27806f4b0 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 -- 172.21.15.33:0/429719719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27806f4b0 msgr2=0x7fc2780b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27806f4b0 0x7fc2780b2220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc270009e50 tx=0x7fc27002a680 comp rx=0 tx=0).stop 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 -- 172.21.15.33:0/429719719 shutdown_connections 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27806f4b0 0x7fc2780b2220 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 --2- 172.21.15.33:0/429719719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278071560 0x7fc2780ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 -- 172.21.15.33:0/429719719 >> 172.21.15.33:0/429719719 conn(0x7fc2780ae310 msgr2=0x7fc2780ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 -- 172.21.15.33:0/429719719 shutdown_connections 2024-09-13T18:57:58.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.624+0000 7fc277200640 1 -- 172.21.15.33:0/429719719 wait complete. 2024-09-13T18:57:58.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.625+0000 7fc277200640 1 Processor -- start 2024-09-13T18:57:58.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 -- start start 2024-09-13T18:57:58.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27806f4b0 0x7fc27813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278159480 0x7fc2781662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27813b7f0 con 0x7fc278071560 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27813ab70 con 0x7fc27806f4b0 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.626+0000 7fc277200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27813ae50 con 0x7fc278159480 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55052/0 (socket says 172.21.15.33:55052) 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 -- 172.21.15.33:0/3194659329 learned_addr learned my addr 172.21.15.33:0/3194659329 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc276800640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278159480 0x7fc2781662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc275e00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27806f4b0 0x7fc27813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 -- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278159480 msgr2=0x7fc2781662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278159480 0x7fc2781662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 -- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27806f4b0 msgr2=0x7fc27813c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27806f4b0 0x7fc27813c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.627+0000 7fc26fe00640 1 -- 172.21.15.33:0/3194659329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270009b30 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc26fe00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e980 tx=0x7fc26000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260009670 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000ca00 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000cd90 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27813b130 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.628+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27813c990 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.629+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc278067360 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.630+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc260013470 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.631+0000 7fc26e000640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 0x7fc25406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.631+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc260089610 con 0x7fc278071560 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.631+0000 7fc275e00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 0x7fc25406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.632+0000 7fc275e00640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 0x7fc25406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f60 tx=0x7fc268009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:58.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.635+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc260054780 con 0x7fc278071560 2024-09-13T18:57:58.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.819+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc27813b930 con 0x7fc278071560 2024-09-13T18:57:58.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.821+0000 7fc26e000640 1 -- 172.21.15.33:0/3194659329 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7fc27813b930 con 0x7fc278071560 2024-09-13T18:57:58.824 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:57:58.824 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 msgr2=0x7fc25406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 0x7fc25406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f60 tx=0x7fc268009040 comp rx=0 tx=0).stop 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 msgr2=0x7fc278165d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e980 tx=0x7fc26000ee40 comp rx=0 tx=0).stop 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 shutdown_connections 2024-09-13T18:57:58.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc25406ac00 0x7fc25406d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc278159480 0x7fc2781662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc278071560 0x7fc278165d70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 --2- 172.21.15.33:0/3194659329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27806f4b0 0x7fc27813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 >> 172.21.15.33:0/3194659329 conn(0x7fc2780ae310 msgr2=0x7fc2780af270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 shutdown_connections 2024-09-13T18:57:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.823+0000 7fc277200640 1 -- 172.21.15.33:0/3194659329 wait complete. 2024-09-13T18:57:58.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:57:58.843 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:57:59.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.998+0000 7fb616400640 1 Processor -- start 2024-09-13T18:57:59.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.998+0000 7fb616400640 1 -- start start 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb616400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb610154ad0 0x7fb6100cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb616400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6100ce2c0 0x7fb6100cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb616400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61006b7c0 con 0x7fb61006f830 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb616400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61006b5b0 con 0x7fb610154ad0 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb616400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61006baa0 con 0x7fb6100ce2c0 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb60f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb610154ad0 0x7fb6100cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb60f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb610154ad0 0x7fb6100cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55062/0 (socket says 172.21.15.33:55062) 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb60f400640 1 -- 172.21.15.33:0/415615334 learned_addr learned my addr 172.21.15.33:0/415615334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:58.999+0000 7fb60fe00640 1 --2- 172.21.15.33:0/415615334 >> v2:172.21.15.103:3300/0 conn(0x7fb6100ce2c0 0x7fb6100cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.000+0000 7fb60f400640 1 -- 172.21.15.33:0/415615334 >> v2:172.21.15.103:3300/0 conn(0x7fb6100ce2c0 msgr2=0x7fb6100cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:59.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.000+0000 7fb60f400640 1 --2- 172.21.15.33:0/415615334 >> v2:172.21.15.103:3300/0 conn(0x7fb6100ce2c0 0x7fb6100cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.000+0000 7fb60f400640 1 -- 172.21.15.33:0/415615334 >> v1:172.21.15.103:6789/0 conn(0x7fb61006f830 legacy=0x7fb61006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.000+0000 7fb60f400640 1 -- 172.21.15.33:0/415615334 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61006bd80 con 0x7fb610154ad0 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.001+0000 7fb60f400640 1 --2- 172.21.15.33:0/415615334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610154ad0 0x7fb6100cdd80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ce780 tx=0x7fb60002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37777f402ea98657 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.001+0000 7fb60ea00640 1 -- 172.21.15.33:0/415615334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600032440 con 0x7fb610154ad0 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.001+0000 7fb60ea00640 1 -- 172.21.15.33:0/415615334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6000325a0 con 0x7fb610154ad0 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.001+0000 7fb60ea00640 1 -- 172.21.15.33:0/415615334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600032930 con 0x7fb610154ad0 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 -- 172.21.15.33:0/415615334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610154ad0 msgr2=0x7fb6100cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 --2- 172.21.15.33:0/415615334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610154ad0 0x7fb6100cdd80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6100ce780 tx=0x7fb60002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 -- 172.21.15.33:0/415615334 shutdown_connections 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 --2- 172.21.15.33:0/415615334 >> v2:172.21.15.103:3300/0 conn(0x7fb6100ce2c0 0x7fb6100cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 --2- 172.21.15.33:0/415615334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610154ad0 0x7fb6100cdd80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 -- 172.21.15.33:0/415615334 >> 172.21.15.33:0/415615334 conn(0x7fb6100b0580 msgr2=0x7fb6100b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 -- 172.21.15.33:0/415615334 shutdown_connections 2024-09-13T18:57:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.002+0000 7fb616400640 1 -- 172.21.15.33:0/415615334 wait complete. 2024-09-13T18:57:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.003+0000 7fb616400640 1 Processor -- start 2024-09-13T18:57:59.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 -- start start 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb610154ad0 0x7fb61014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb61015d040 0x7fb61015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015da30 con 0x7fb610156100 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.004+0000 7fb616400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101f31b0 con 0x7fb610154ad0 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb616400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6101f2530 con 0x7fb61015d040 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55076/0 (socket says 172.21.15.33:55076) 2024-09-13T18:57:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 -- 172.21.15.33:0/3962226963 learned_addr learned my addr 172.21.15.33:0/3962226963 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb60f400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb610154ad0 0x7fb61014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb60fe00640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb61015d040 0x7fb61015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 -- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb61015d040 msgr2=0x7fb61015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb61015d040 0x7fb61015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 -- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb610154ad0 msgr2=0x7fb61014ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb610154ad0 0x7fb61014ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 -- 172.21.15.33:0/3962226963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6000094d0 con 0x7fb610156100 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.005+0000 7fb606a00640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c450 tx=0x7fb5f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.006+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80052d0 con 0x7fb610156100 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.006+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f8005430 con 0x7fb610156100 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.006+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8012870 con 0x7fb610156100 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.006+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6101f2810 con 0x7fb610156100 2024-09-13T18:57:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.006+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6101f2dd0 con 0x7fb610156100 2024-09-13T18:57:59.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.007+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6100cdd80 con 0x7fb610156100 2024-09-13T18:57:59.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.008+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb5f80129d0 con 0x7fb610156100 2024-09-13T18:57:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.009+0000 7fb607e00640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 0x7fb5ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.009+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb5f8088e50 con 0x7fb610156100 2024-09-13T18:57:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.009+0000 7fb60f400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 0x7fb5ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.010+0000 7fb60f400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 0x7fb5ec06d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb600034000 tx=0x7fb60002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.013+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb5f8053fa0 con 0x7fb610156100 2024-09-13T18:57:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.191+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb61015dbc0 con 0x7fb610156100 2024-09-13T18:57:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.191+0000 7fb607e00640 1 -- 172.21.15.33:0/3962226963 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5f80575c0 con 0x7fb610156100 2024-09-13T18:57:59.195 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 msgr2=0x7fb5ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 0x7fb5ec06d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb600034000 tx=0x7fb60002e000 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 msgr2=0x7fb610156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c450 tx=0x7fb5f800c910 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 shutdown_connections 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb5ec06ac30 0x7fb5ec06d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb61015d040 0x7fb61015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb610156100 0x7fb610156580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 --2- 172.21.15.33:0/3962226963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb610154ad0 0x7fb61014ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 >> 172.21.15.33:0/3962226963 conn(0x7fb6100b0580 msgr2=0x7fb6100cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 shutdown_connections 2024-09-13T18:57:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.193+0000 7fb616400640 1 -- 172.21.15.33:0/3962226963 wait complete. 2024-09-13T18:57:59.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:57:59.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.368+0000 7fc497e00640 1 Processor -- start 2024-09-13T18:57:59.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.368+0000 7fc497e00640 1 -- start start 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc49806b630 0x7fc4980b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4980b2000 con 0x7fc4980b1be0 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc498157310 con 0x7fc49806b630 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980b29c0 con 0x7fc498156f30 2024-09-13T18:57:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc496a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc496a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:49422/0 (socket says 172.21.15.33:49422) 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc496a00640 1 -- 172.21.15.33:0/1625271136 learned_addr learned my addr 172.21.15.33:0/1625271136 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc497400640 1 --1- 172.21.15.33:0/1625271136 >> v1:172.21.15.103:6789/0 conn(0x7fc4980b1be0 0x7fc49815ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:57986/0 (socket says 172.21.15.33:57986) 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.369+0000 7fc48e000640 1 --2- 172.21.15.33:0/1625271136 >> v2:172.21.15.103:3300/0 conn(0x7fc49806b630 0x7fc4980b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.370+0000 7fc496a00640 1 -- 172.21.15.33:0/1625271136 >> v2:172.21.15.103:3300/0 conn(0x7fc49806b630 msgr2=0x7fc4980b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.370+0000 7fc496a00640 1 --2- 172.21.15.33:0/1625271136 >> v2:172.21.15.103:3300/0 conn(0x7fc49806b630 0x7fc4980b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.370+0000 7fc496a00640 1 -- 172.21.15.33:0/1625271136 >> v1:172.21.15.103:6789/0 conn(0x7fc4980b1be0 legacy=0x7fc49815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.370+0000 7fc496000640 1 -- 172.21.15.33:0/1625271136 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793778330 0 0) 0x7fc4980b2000 con 0x7fc4980b1be0 2024-09-13T18:57:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.370+0000 7fc496a00640 1 -- 172.21.15.33:0/1625271136 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980b2ca0 con 0x7fc498156f30 2024-09-13T18:57:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.371+0000 7fc496a00640 1 --2- 172.21.15.33:0/1625271136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc488009870 tx=0x7fc48802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e976e2005207159c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.371+0000 7fc496000640 1 -- 172.21.15.33:0/1625271136 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488032440 con 0x7fc498156f30 2024-09-13T18:57:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.371+0000 7fc496000640 1 -- 172.21.15.33:0/1625271136 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4880325a0 con 0x7fc498156f30 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.371+0000 7fc496000640 1 -- 172.21.15.33:0/1625271136 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488032930 con 0x7fc498156f30 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 -- 172.21.15.33:0/1625271136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 msgr2=0x7fc49815a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 --2- 172.21.15.33:0/1625271136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc488009870 tx=0x7fc48802a250 comp rx=0 tx=0).stop 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 -- 172.21.15.33:0/1625271136 shutdown_connections 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 --2- 172.21.15.33:0/1625271136 >> v2:172.21.15.103:3300/0 conn(0x7fc49806b630 0x7fc4980b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 --2- 172.21.15.33:0/1625271136 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc498156f30 0x7fc49815a460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 -- 172.21.15.33:0/1625271136 >> 172.21.15.33:0/1625271136 conn(0x7fc498069ed0 msgr2=0x7fc49806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 -- 172.21.15.33:0/1625271136 shutdown_connections 2024-09-13T18:57:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.372+0000 7fc497e00640 1 -- 172.21.15.33:0/1625271136 wait complete. 2024-09-13T18:57:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.374+0000 7fc497e00640 1 Processor -- start 2024-09-13T18:57:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.374+0000 7fc497e00640 1 -- start start 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc49806b630 0x7fc498155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc498156f30 0x7fc49814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498151400 con 0x7fc4980b1be0 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498155aa0 con 0x7fc498156f30 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4980a8990 con 0x7fc49806b630 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc48e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc48e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55078/0 (socket says 172.21.15.33:55078) 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc48e000640 1 -- 172.21.15.33:0/176803214 learned_addr learned my addr 172.21.15.33:0/176803214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc496a00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc49806b630 0x7fc498155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.375+0000 7fc497400640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc498156f30 0x7fc49814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 -- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc49806b630 msgr2=0x7fc498155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc49806b630 0x7fc498155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 -- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc498156f30 msgr2=0x7fc49814a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc498156f30 0x7fc49814a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 -- 172.21.15.33:0/176803214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880094d0 con 0x7fc4980b1be0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48e000640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e9b0 tx=0x7fc48000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480009670 con 0x7fc4980b1be0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000c9a0 con 0x7fc4980b1be0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000cd50 con 0x7fc4980b1be0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.376+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4981540a0 con 0x7fc4980b1be0 2024-09-13T18:57:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.377+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4980a8460 con 0x7fc4980b1be0 2024-09-13T18:57:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.378+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4981549d0 con 0x7fc4980b1be0 2024-09-13T18:57:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.378+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc480013470 con 0x7fc4980b1be0 2024-09-13T18:57:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.379+0000 7fc48f400640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 0x7fc47406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.379+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc4800895c0 con 0x7fc4980b1be0 2024-09-13T18:57:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.380+0000 7fc496a00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 0x7fc47406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.381+0000 7fc496a00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 0x7fc47406d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc488034000 tx=0x7fc48802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.383+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc4981549d0 con 0x7fc4980b1be0 2024-09-13T18:57:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.559+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4981549d0 con 0x7fc4980b1be0 2024-09-13T18:57:59.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.560+0000 7fc48f400640 1 -- 172.21.15.33:0/176803214 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4981549d0 con 0x7fc4980b1be0 2024-09-13T18:57:59.563 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:57:59.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 msgr2=0x7fc47406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 0x7fc47406d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc488034000 tx=0x7fc48802e000 comp rx=0 tx=0).stop 2024-09-13T18:57:59.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 msgr2=0x7fc498153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e9b0 tx=0x7fc48000ee70 comp rx=0 tx=0).stop 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 shutdown_connections 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc47406ac30 0x7fc47406d0f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc498156f30 0x7fc49814a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980b1be0 0x7fc498153590 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 --2- 172.21.15.33:0/176803214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc49806b630 0x7fc498155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 >> 172.21.15.33:0/176803214 conn(0x7fc498069ed0 msgr2=0x7fc4981575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 shutdown_connections 2024-09-13T18:57:59.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.562+0000 7fc497e00640 1 -- 172.21.15.33:0/176803214 wait complete. 2024-09-13T18:57:59.581 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:57:59.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.735+0000 7f4b8a200640 1 Processor -- start 2024-09-13T18:57:59.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.735+0000 7f4b8a200640 1 -- start start 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.736+0000 7f4b8a200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b840cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.736+0000 7f4b8a200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8406f830 0x7f4b8406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b8a200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8406b7c0 con 0x7f4b840ce2c0 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b8a200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8406b5b0 con 0x7f4b8406f830 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b8a200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8406baa0 con 0x7f4b84154ad0 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8406f830 0x7f4b8406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8406f830 0x7f4b8406fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55090/0 (socket says 172.21.15.33:55090) 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 -- 172.21.15.33:0/2208372156 learned_addr learned my addr 172.21.15.33:0/2208372156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 -- 172.21.15.33:0/2208372156 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 msgr2=0x7f4b840cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 --2- 172.21.15.33:0/2208372156 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b840cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 -- 172.21.15.33:0/2208372156 >> v1:172.21.15.103:6789/0 conn(0x7f4b840ce2c0 legacy=0x7f4b840cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:57:59.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.737+0000 7f4b7be00640 1 -- 172.21.15.33:0/2208372156 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8406bd80 con 0x7f4b8406f830 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.738+0000 7f4b7be00640 1 --2- 172.21.15.33:0/2208372156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8406f830 0x7f4b8406fee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098a0 tx=0x7f4b6c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5d5d5cd9c4e8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.738+0000 7f4b82a00640 1 -- 172.21.15.33:0/2208372156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c032440 con 0x7f4b8406f830 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b82a00640 1 -- 172.21.15.33:0/2208372156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0325a0 con 0x7f4b8406f830 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b82a00640 1 -- 172.21.15.33:0/2208372156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c032930 con 0x7f4b8406f830 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 -- 172.21.15.33:0/2208372156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8406f830 msgr2=0x7f4b8406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 --2- 172.21.15.33:0/2208372156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8406f830 0x7f4b8406fee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098a0 tx=0x7f4b6c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 -- 172.21.15.33:0/2208372156 shutdown_connections 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 --2- 172.21.15.33:0/2208372156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8406f830 0x7f4b8406fee0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 --2- 172.21.15.33:0/2208372156 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b840cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 -- 172.21.15.33:0/2208372156 >> 172.21.15.33:0/2208372156 conn(0x7f4b840b0580 msgr2=0x7f4b840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 -- 172.21.15.33:0/2208372156 shutdown_connections 2024-09-13T18:57:59.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.739+0000 7f4b8a200640 1 -- 172.21.15.33:0/2208372156 wait complete. 2024-09-13T18:57:59.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.741+0000 7f4b8a200640 1 Processor -- start 2024-09-13T18:57:59.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.741+0000 7f4b8a200640 1 -- start start 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b8414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8414acd0 0x7f4b84148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841500d0 con 0x7f4b8414b150 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841502c0 con 0x7f4b8414acd0 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b8a200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841505a0 con 0x7f4b84154ad0 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b83e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b83e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55096/0 (socket says 172.21.15.33:55096) 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b83e00640 1 -- 172.21.15.33:0/4186969349 learned_addr learned my addr 172.21.15.33:0/4186969349 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:57:59.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b83400640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b8414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.742+0000 7f4b7be00640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8414acd0 0x7f4b84148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 -- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 msgr2=0x7f4b8414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b8414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 -- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8414acd0 msgr2=0x7f4b84148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8414acd0 0x7f4b84148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 -- 172.21.15.33:0/4186969349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0094d0 con 0x7f4b8414b150 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b83e00640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c700 tx=0x7f4b7c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00aa50 con 0x7f4b8414b150 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c00abb0 con 0x7f4b8414b150 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8414a4d0 con 0x7f4b8414b150 2024-09-13T18:57:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00ce10 con 0x7f4b8414b150 2024-09-13T18:57:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.743+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8414a180 con 0x7f4b8414b150 2024-09-13T18:57:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.744+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b84150760 con 0x7f4b8414b150 2024-09-13T18:57:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.745+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b7c012420 con 0x7f4b8414b150 2024-09-13T18:57:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.746+0000 7f4b7b400640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 0x7f4b6006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:57:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.746+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4b7c089980 con 0x7f4b8414b150 2024-09-13T18:57:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.747+0000 7f4b83400640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 0x7f4b6006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:57:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.748+0000 7f4b83400640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 0x7f4b6006d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b841470a0 tx=0x7f4b74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:57:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.750+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b7c054a40 con 0x7f4b8414b150 2024-09-13T18:57:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.927+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b8414a9f0 con 0x7f4b8414b150 2024-09-13T18:57:59.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.928+0000 7f4b7b400640 1 -- 172.21.15.33:0/4186969349 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b8414a9f0 con 0x7f4b8414b150 2024-09-13T18:57:59.931 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 msgr2=0x7f4b6006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 0x7f4b6006d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b841470a0 tx=0x7f4b74008040 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 msgr2=0x7f4b841486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c700 tx=0x7f4b7c00cbc0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 shutdown_connections 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6006ac30 0x7f4b6006d0f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8414b150 0x7f4b841486d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8414acd0 0x7f4b84148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 --2- 172.21.15.33:0/4186969349 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b84154ad0 0x7f4b8414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 >> 172.21.15.33:0/4186969349 conn(0x7f4b840b0580 msgr2=0x7f4b840709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:57:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 shutdown_connections 2024-09-13T18:57:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:57:59.930+0000 7f4b8a200640 1 -- 172.21.15.33:0/4186969349 wait complete. 2024-09-13T18:57:59.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:58:00.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.102+0000 7f92b8800640 1 Processor -- start 2024-09-13T18:58:00.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.102+0000 7f92b8800640 1 -- start start 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b8800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92b0159610 0x7f92b0070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b8800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92b00b3790 0x7f92b00cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b8800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00709e0 con 0x7f92b0070540 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b8800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b01599f0 con 0x7f92b0159610 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b8800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b0070cc0 con 0x7f92b00b3790 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b5e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92b0159610 0x7f92b0070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b5e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92b0159610 0x7f92b0070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55102/0 (socket says 172.21.15.33:55102) 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b5400640 1 --1- 172.21.15.33:0/264602802 >> v1:172.21.15.33:6789/0 conn(0x7f92b0070540 0x7f92b00b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42378/0 (socket says 172.21.15.33:42378) 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.103+0000 7f92b5e00640 1 -- 172.21.15.33:0/264602802 learned_addr learned my addr 172.21.15.33:0/264602802 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b6800640 1 --2- 172.21.15.33:0/264602802 >> v2:172.21.15.103:3300/0 conn(0x7f92b00b3790 0x7f92b00cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b5e00640 1 -- 172.21.15.33:0/264602802 >> v2:172.21.15.103:3300/0 conn(0x7f92b00b3790 msgr2=0x7f92b00cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b5e00640 1 --2- 172.21.15.33:0/264602802 >> v2:172.21.15.103:3300/0 conn(0x7f92b00b3790 0x7f92b00cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b5e00640 1 -- 172.21.15.33:0/264602802 >> v1:172.21.15.33:6789/0 conn(0x7f92b0070540 legacy=0x7f92b00b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b5e00640 1 -- 172.21.15.33:0/264602802 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0070fa0 con 0x7f92b0159610 2024-09-13T18:58:00.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.104+0000 7f92b4a00640 1 -- 172.21.15.33:0/264602802 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863457136 0 0) 0x7f92b00709e0 con 0x7f92b0070540 2024-09-13T18:58:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.105+0000 7f92b5e00640 1 --2- 172.21.15.33:0/264602802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b0159610 0x7f92b0070000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b006bac0 tx=0x7f92a402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e5d69bf9443616 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.105+0000 7f92b4a00640 1 -- 172.21.15.33:0/264602802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4032640 con 0x7f92b0159610 2024-09-13T18:58:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.105+0000 7f92b4a00640 1 -- 172.21.15.33:0/264602802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a40327a0 con 0x7f92b0159610 2024-09-13T18:58:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.105+0000 7f92b4a00640 1 -- 172.21.15.33:0/264602802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4032b30 con 0x7f92b0159610 2024-09-13T18:58:00.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 -- 172.21.15.33:0/264602802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b0159610 msgr2=0x7f92b0070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 --2- 172.21.15.33:0/264602802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b0159610 0x7f92b0070000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b006bac0 tx=0x7f92a402c940 comp rx=0 tx=0).stop 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 -- 172.21.15.33:0/264602802 shutdown_connections 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 --2- 172.21.15.33:0/264602802 >> v2:172.21.15.103:3300/0 conn(0x7f92b00b3790 0x7f92b00cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 --2- 172.21.15.33:0/264602802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b0159610 0x7f92b0070000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 -- 172.21.15.33:0/264602802 >> 172.21.15.33:0/264602802 conn(0x7f92b00b0510 msgr2=0x7f92b00b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 -- 172.21.15.33:0/264602802 shutdown_connections 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.106+0000 7f92b8800640 1 -- 172.21.15.33:0/264602802 wait complete. 2024-09-13T18:58:00.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.108+0000 7f92b8800640 1 Processor -- start 2024-09-13T18:58:00.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.108+0000 7f92b8800640 1 -- start start 2024-09-13T18:58:00.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0070540 0x7f92b01f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b0159610 0x7f92b01509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b015abf0 con 0x7f92b00b3790 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0153580 con 0x7f92b0070540 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b8800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0153860 con 0x7f92b0159610 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55104/0 (socket says 172.21.15.33:55104) 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 -- 172.21.15.33:0/3657837383 learned_addr learned my addr 172.21.15.33:0/3657837383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5e00640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0070540 0x7f92b01f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b6800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b0159610 0x7f92b01509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 -- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b0159610 msgr2=0x7f92b01509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b0159610 0x7f92b01509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 -- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0070540 msgr2=0x7f92b01f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0070540 0x7f92b01f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.109+0000 7f92b5400640 1 -- 172.21.15.33:0/3657837383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a400b770 con 0x7f92b00b3790 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92b5400640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c4d0 tx=0x7f92a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00074e0 con 0x7f92b00b3790 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0007660 con 0x7f92b00b3790 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0004a20 con 0x7f92b00b3790 2024-09-13T18:58:00.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0153b40 con 0x7f92b00b3790 2024-09-13T18:58:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.110+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b014a5b0 con 0x7f92b00b3790 2024-09-13T18:58:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.111+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b00cdda0 con 0x7f92b00b3790 2024-09-13T18:58:00.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.112+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92a0004b80 con 0x7f92b00b3790 2024-09-13T18:58:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.113+0000 7f92aa000640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 0x7f929406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.113+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f92a00884f0 con 0x7f92b00b3790 2024-09-13T18:58:00.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.113+0000 7f92b5e00640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 0x7f929406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.114+0000 7f92b5e00640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 0x7f929406d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92a4037000 tx=0x7f92a4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.117+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f92a00536e0 con 0x7f92b00b3790 2024-09-13T18:58:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.308+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92b00cdac0 con 0x7f92b00b3790 2024-09-13T18:58:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.309+0000 7f92aa000640 1 -- 172.21.15.33:0/3657837383 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92a0056d00 con 0x7f92b00b3790 2024-09-13T18:58:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:58:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 msgr2=0x7f929406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 0x7f929406d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92a4037000 tx=0x7f92a4032000 comp rx=0 tx=0).stop 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 msgr2=0x7f92b014a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c4d0 tx=0x7f92a000c990 comp rx=0 tx=0).stop 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 shutdown_connections 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f929406ac00 0x7f929406d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b0159610 0x7f92b01509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b00b3790 0x7f92b014a070 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 --2- 172.21.15.33:0/3657837383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0070540 0x7f92b01f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 >> 172.21.15.33:0/3657837383 conn(0x7f92b00b0510 msgr2=0x7f92b00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:00.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 shutdown_connections 2024-09-13T18:58:00.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.311+0000 7f92b8800640 1 -- 172.21.15.33:0/3657837383 wait complete. 2024-09-13T18:58:00.330 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T18:58:00.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:00.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T18:58:00.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:58:00.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:00.392 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:58:00.427 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:00.427 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:00.467 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:00.468 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:00.547 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:00.547 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:00.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.777+0000 7f6a6b600640 1 Processor -- start 2024-09-13T18:58:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.777+0000 7f6a6b600640 1 -- start start 2024-09-13T18:58:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a6b600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6a6415b910 0x7f6a64165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a6b600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6406bea0 con 0x7f6a6415a520 2024-09-13T18:58:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a6b600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6406c180 con 0x7f6a640b1b00 2024-09-13T18:58:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a6b600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6406c460 con 0x7f6a6415b910 2024-09-13T18:58:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a68c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6a6415a520 0x7f6a6406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42386/0 (socket says 172.21.15.33:42386) 2024-09-13T18:58:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a68c00640 1 -- 172.21.15.33:0/612612678 learned_addr learned my addr 172.21.15.33:0/612612678 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.778+0000 7f6a69600640 1 --2- 172.21.15.33:0/612612678 >> v2:172.21.15.103:3300/0 conn(0x7f6a6415b910 0x7f6a64165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.779+0000 7f6a63e00640 1 -- 172.21.15.33:0/612612678 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276689153 0 0) 0x7f6a6406bea0 con 0x7f6a6415a520 2024-09-13T18:58:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.779+0000 7f6a63e00640 1 -- 172.21.15.33:0/612612678 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003520 con 0x7f6a6415a520 2024-09-13T18:58:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.779+0000 7f6a69600640 1 -- 172.21.15.33:0/612612678 >> v1:172.21.15.103:6789/0 conn(0x7f6a640b1b00 legacy=0x7f6a640cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.779+0000 7f6a69600640 1 -- 172.21.15.33:0/612612678 >> v1:172.21.15.33:6789/0 conn(0x7f6a6415a520 legacy=0x7f6a6406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.779+0000 7f6a69600640 1 -- 172.21.15.33:0/612612678 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6406c740 con 0x7f6a6415b910 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.780+0000 7f6a69600640 1 --2- 172.21.15.33:0/612612678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64165190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009d90 tx=0x7f6a5c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60eccb3f3075a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.780+0000 7f6a63e00640 1 -- 172.21.15.33:0/612612678 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c007740 con 0x7f6a6415b910 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.780+0000 7f6a63e00640 1 -- 172.21.15.33:0/612612678 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c02d050 con 0x7f6a6415b910 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.780+0000 7f6a63e00640 1 -- 172.21.15.33:0/612612678 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c007ac0 con 0x7f6a6415b910 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 -- 172.21.15.33:0/612612678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 msgr2=0x7f6a64165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 --2- 172.21.15.33:0/612612678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64165190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009d90 tx=0x7f6a5c02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 -- 172.21.15.33:0/612612678 shutdown_connections 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 --2- 172.21.15.33:0/612612678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64165190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 -- 172.21.15.33:0/612612678 >> 172.21.15.33:0/612612678 conn(0x7f6a640b0510 msgr2=0x7f6a640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 -- 172.21.15.33:0/612612678 shutdown_connections 2024-09-13T18:58:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.781+0000 7f6a6b600640 1 -- 172.21.15.33:0/612612678 wait complete. 2024-09-13T18:58:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.782+0000 7f6a6b600640 1 Processor -- start 2024-09-13T18:58:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.783+0000 7f6a6b600640 1 -- start start 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.783+0000 7f6a6b600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.783+0000 7f6a6b600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 0x7f6a641f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.783+0000 7f6a6b600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a6b600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641491e0 con 0x7f6a640b1b00 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a6b600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6414b560 con 0x7f6a6415b910 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a6b600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6414b840 con 0x7f6a6415a520 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55116/0 (socket says 172.21.15.33:55116) 2024-09-13T18:58:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 -- 172.21.15.33:0/2545512918 learned_addr learned my addr 172.21.15.33:0/2545512918 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a69600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a5be00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 0x7f6a641f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 -- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 msgr2=0x7f6a641f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 0x7f6a641f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 -- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 msgr2=0x7f6a64157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 -- 172.21.15.33:0/2545512918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009a70 con 0x7f6a640b1b00 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a5be00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 0x7f6a641f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.784+0000 7f6a68c00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c500 tx=0x7f6a5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.785+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54005ce0 con 0x7f6a640b1b00 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.785+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54005e40 con 0x7f6a640b1b00 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.785+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54007330 con 0x7f6a640b1b00 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.785+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6414bb20 con 0x7f6a640b1b00 2024-09-13T18:58:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.785+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a641f21e0 con 0x7f6a640b1b00 2024-09-13T18:58:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.786+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a640cd910 con 0x7f6a640b1b00 2024-09-13T18:58:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.787+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a54007550 con 0x7f6a640b1b00 2024-09-13T18:58:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.788+0000 7f6a61600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 0x7f6a4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.788+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6a54088a30 con 0x7f6a640b1b00 2024-09-13T18:58:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.788+0000 7f6a5be00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 0x7f6a4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.789+0000 7f6a5be00640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 0x7f6a4006d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a640706e0 tx=0x7f6a4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:00.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.792+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a54053c40 con 0x7f6a640b1b00 2024-09-13T18:58:00.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.970+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a640ccc30 con 0x7f6a640b1b00 2024-09-13T18:58:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.971+0000 7f6a61600640 1 -- 172.21.15.33:0/2545512918 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f6a54017020 con 0x7f6a640b1b00 2024-09-13T18:58:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:00.975 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 msgr2=0x7f6a4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 0x7f6a4006d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a640706e0 tx=0x7f6a4c009040 comp rx=0 tx=0).stop 2024-09-13T18:58:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 msgr2=0x7f6a64148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c500 tx=0x7f6a5400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 shutdown_connections 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a4006ac00 0x7f6a4006d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a6415b910 0x7f6a64157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a6415a520 0x7f6a641f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 --2- 172.21.15.33:0/2545512918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a640b1b00 0x7f6a64148ca0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 >> 172.21.15.33:0/2545512918 conn(0x7f6a640b0510 msgr2=0x7f6a64158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 shutdown_connections 2024-09-13T18:58:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:00.974+0000 7f6a6b600640 1 -- 172.21.15.33:0/2545512918 wait complete. 2024-09-13T18:58:00.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:00.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:01.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.153+0000 7f5b87200640 1 Processor -- start 2024-09-13T18:58:01.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.154+0000 7f5b87200640 1 -- start start 2024-09-13T18:58:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b881594a0 0x7f5b880cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b8815d980 0x7f5b880b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b880b2c50 0x7f5b8806c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880b3100 con 0x7f5b880b2c50 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b88159880 con 0x7f5b8815d980 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b87200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880cc370 con 0x7f5b881594a0 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b86800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b880b2c50 0x7f5b8806c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b86800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b880b2c50 0x7f5b8806c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55122/0 (socket says 172.21.15.33:55122) 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b86800640 1 -- 172.21.15.33:0/1896513096 learned_addr learned my addr 172.21.15.33:0/1896513096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b7fe00640 1 --2- 172.21.15.33:0/1896513096 >> v2:172.21.15.103:3300/0 conn(0x7f5b8815d980 0x7f5b880b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.155+0000 7f5b85e00640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b881594a0 0x7f5b880cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.156+0000 7f5b86800640 1 -- 172.21.15.33:0/1896513096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b881594a0 msgr2=0x7f5b880cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.156+0000 7f5b86800640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b881594a0 0x7f5b880cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.156+0000 7f5b86800640 1 -- 172.21.15.33:0/1896513096 >> v2:172.21.15.103:3300/0 conn(0x7f5b8815d980 msgr2=0x7f5b880b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.156+0000 7f5b86800640 1 --2- 172.21.15.33:0/1896513096 >> v2:172.21.15.103:3300/0 conn(0x7f5b8815d980 0x7f5b880b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.156+0000 7f5b86800640 1 -- 172.21.15.33:0/1896513096 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880cd1b0 con 0x7f5b880b2c50 2024-09-13T18:58:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.157+0000 7f5b86800640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b880b2c50 0x7f5b8806c450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b8806b310 tx=0x7f5b8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b564e5a910c59f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.157+0000 7f5b85400640 1 -- 172.21.15.33:0/1896513096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80031600 con 0x7f5b880b2c50 2024-09-13T18:58:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.157+0000 7f5b85400640 1 -- 172.21.15.33:0/1896513096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8002d050 con 0x7f5b880b2c50 2024-09-13T18:58:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.157+0000 7f5b85400640 1 -- 172.21.15.33:0/1896513096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80031980 con 0x7f5b880b2c50 2024-09-13T18:58:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 -- 172.21.15.33:0/1896513096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b880b2c50 msgr2=0x7f5b8806c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b880b2c50 0x7f5b8806c450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b8806b310 tx=0x7f5b8002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 -- 172.21.15.33:0/1896513096 shutdown_connections 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b880b2c50 0x7f5b8806c450 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 --2- 172.21.15.33:0/1896513096 >> v2:172.21.15.103:3300/0 conn(0x7f5b8815d980 0x7f5b880b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 --2- 172.21.15.33:0/1896513096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b881594a0 0x7f5b880cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 -- 172.21.15.33:0/1896513096 >> 172.21.15.33:0/1896513096 conn(0x7f5b880b0200 msgr2=0x7f5b880b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 -- 172.21.15.33:0/1896513096 shutdown_connections 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.158+0000 7f5b87200640 1 -- 172.21.15.33:0/1896513096 wait complete. 2024-09-13T18:58:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.159+0000 7f5b87200640 1 Processor -- start 2024-09-13T18:58:01.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.160+0000 7f5b87200640 1 -- start start 2024-09-13T18:58:01.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.160+0000 7f5b87200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b880b2c50 0x7f5b880c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.160+0000 7f5b87200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b881594a0 0x7f5b88149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.160+0000 7f5b87200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b87200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c7b20 con 0x7f5b8815d980 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b87200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c83c0 con 0x7f5b881594a0 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b87200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c98d0 con 0x7f5b880b2c50 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55126/0 (socket says 172.21.15.33:55126) 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 -- 172.21.15.33:0/1371214355 learned_addr learned my addr 172.21.15.33:0/1371214355 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b85e00640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b880b2c50 0x7f5b880c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b7fe00640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b881594a0 0x7f5b88149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 -- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b880b2c50 msgr2=0x7f5b880c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b880b2c50 0x7f5b880c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 -- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b881594a0 msgr2=0x7f5b88149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b881594a0 0x7f5b88149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.161+0000 7f5b86800640 1 -- 172.21.15.33:0/1371214355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009b30 con 0x7f5b8815d980 2024-09-13T18:58:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b86800640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b80034040 tx=0x7f5b80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8003d860 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8003d9e0 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8003dd90 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880ca030 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.162+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b880c8050 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.163+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880c8530 con 0x7f5b8815d980 2024-09-13T18:58:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.164+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b8003b400 con 0x7f5b8815d980 2024-09-13T18:58:01.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.165+0000 7f5b7e000640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 0x7f5b6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.165+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5b800aa0e0 con 0x7f5b8815d980 2024-09-13T18:58:01.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.165+0000 7f5b85e00640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 0x7f5b6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.166+0000 7f5b85e00640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 0x7f5b6406d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009b40 tx=0x7f5b78009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.169+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5b80075250 con 0x7f5b8815d980 2024-09-13T18:58:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.349+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b880cb180 con 0x7f5b8815d980 2024-09-13T18:58:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.350+0000 7f5b7e000640 1 -- 172.21.15.33:0/1371214355 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b880cb180 con 0x7f5b8815d980 2024-09-13T18:58:01.353 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 msgr2=0x7f5b6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 0x7f5b6406d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009b40 tx=0x7f5b78009190 comp rx=0 tx=0).stop 2024-09-13T18:58:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 msgr2=0x7f5b8815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b80034040 tx=0x7f5b80004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 shutdown_connections 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6406ac30 0x7f5b6406d0f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b8815d980 0x7f5b8815bf30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b881594a0 0x7f5b88149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 --2- 172.21.15.33:0/1371214355 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b880b2c50 0x7f5b880c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 >> 172.21.15.33:0/1371214355 conn(0x7f5b880b0200 msgr2=0x7f5b880b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 shutdown_connections 2024-09-13T18:58:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.352+0000 7f5b87200640 1 -- 172.21.15.33:0/1371214355 wait complete. 2024-09-13T18:58:01.371 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:01.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.529+0000 7fa622800640 1 Processor -- start 2024-09-13T18:58:01.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.529+0000 7fa622800640 1 -- start start 2024-09-13T18:58:01.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.530+0000 7fa622800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 0x7fa61c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.530+0000 7fa622800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.530+0000 7fa622800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0b2030 con 0x7fa61c0b1be0 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa622800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c157310 con 0x7fa61c156f30 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa622800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0b29c0 con 0x7fa61c06b630 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa621400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 0x7fa61c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:49472/0 (socket says 172.21.15.33:49472) 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 -- 172.21.15.33:0/3238400253 learned_addr learned my addr 172.21.15.33:0/3238400253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 -- 172.21.15.33:0/3238400253 >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 msgr2=0x7fa61c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 --2- 172.21.15.33:0/3238400253 >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 0x7fa61c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 -- 172.21.15.33:0/3238400253 >> v1:172.21.15.103:6789/0 conn(0x7fa61c0b1be0 legacy=0x7fa61c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa620a00640 1 -- 172.21.15.33:0/3238400253 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0b2ca0 con 0x7fa61c06b630 2024-09-13T18:58:01.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.531+0000 7fa621400640 1 --2- 172.21.15.33:0/3238400253 >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 0x7fa61c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:01.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa620a00640 1 --2- 172.21.15.33:0/3238400253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa60800bb10 tx=0x7fa60802c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adcf79c2e94abad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa61be00640 1 -- 172.21.15.33:0/3238400253 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608032820 con 0x7fa61c06b630 2024-09-13T18:58:01.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa61be00640 1 -- 172.21.15.33:0/3238400253 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60802e040 con 0x7fa61c06b630 2024-09-13T18:58:01.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa61be00640 1 -- 172.21.15.33:0/3238400253 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608032ba0 con 0x7fa61c06b630 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa622800640 1 -- 172.21.15.33:0/3238400253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 msgr2=0x7fa61c0b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.533+0000 7fa622800640 1 --2- 172.21.15.33:0/3238400253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa60800bb10 tx=0x7fa60802c920 comp rx=0 tx=0).stop 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 -- 172.21.15.33:0/3238400253 shutdown_connections 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 --2- 172.21.15.33:0/3238400253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c0b16a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 --2- 172.21.15.33:0/3238400253 >> v2:172.21.15.103:3300/0 conn(0x7fa61c156f30 0x7fa61c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 -- 172.21.15.33:0/3238400253 >> 172.21.15.33:0/3238400253 conn(0x7fa61c069ed0 msgr2=0x7fa61c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 -- 172.21.15.33:0/3238400253 shutdown_connections 2024-09-13T18:58:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.534+0000 7fa622800640 1 -- 172.21.15.33:0/3238400253 wait complete. 2024-09-13T18:58:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.535+0000 7fa622800640 1 Processor -- start 2024-09-13T18:58:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.535+0000 7fa622800640 1 -- start start 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa61c156f30 0x7fa61c1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1f3980 con 0x7fa61c0b1be0 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0ae2f0 con 0x7fa61c156f30 2024-09-13T18:58:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.536+0000 7fa622800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1f3330 con 0x7fa61c06b630 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55132/0 (socket says 172.21.15.33:55132) 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 -- 172.21.15.33:0/2165713415 learned_addr learned my addr 172.21.15.33:0/2165713415 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa621400640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa621e00640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa61c156f30 0x7fa61c1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 -- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 msgr2=0x7fa61c1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c1490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 -- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa61c156f30 msgr2=0x7fa61c1f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa61c156f30 0x7fa61c1f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.537+0000 7fa620a00640 1 -- 172.21.15.33:0/2165713415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009400 con 0x7fa61c0b1be0 2024-09-13T18:58:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa620a00640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60802c960 tx=0x7fa608004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60803a940 con 0x7fa61c0b1be0 2024-09-13T18:58:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60803f070 con 0x7fa61c0b1be0 2024-09-13T18:58:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60803ad00 con 0x7fa61c0b1be0 2024-09-13T18:58:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60800b770 con 0x7fa61c0b1be0 2024-09-13T18:58:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.538+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c0ae540 con 0x7fa61c0b1be0 2024-09-13T18:58:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.539+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c0b3a60 con 0x7fa61c0b1be0 2024-09-13T18:58:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.540+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa60803b420 con 0x7fa61c0b1be0 2024-09-13T18:58:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.541+0000 7fa619600640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 0x7fa5fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.541+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa608041070 con 0x7fa61c0b1be0 2024-09-13T18:58:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.541+0000 7fa621400640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 0x7fa5fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.542+0000 7fa621400640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 0x7fa5fc06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa610009c30 tx=0x7fa610009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.545+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa608075840 con 0x7fa61c0b1be0 2024-09-13T18:58:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.721+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa61c071780 con 0x7fa61c0b1be0 2024-09-13T18:58:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.722+0000 7fa619600640 1 -- 172.21.15.33:0/2165713415 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa608078e60 con 0x7fa61c0b1be0 2024-09-13T18:58:01.725 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 msgr2=0x7fa5fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 0x7fa5fc06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa610009c30 tx=0x7fa610009190 comp rx=0 tx=0).stop 2024-09-13T18:58:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 msgr2=0x7fa61c1f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60802c960 tx=0x7fa608004730 comp rx=0 tx=0).stop 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 shutdown_connections 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5fc06ac00 0x7fa5fc06d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa61c156f30 0x7fa61c1f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61c0b1be0 0x7fa61c1f27b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 --2- 172.21.15.33:0/2165713415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa61c06b630 0x7fa61c1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 >> 172.21.15.33:0/2165713415 conn(0x7fa61c069ed0 msgr2=0x7fa61c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 shutdown_connections 2024-09-13T18:58:01.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.724+0000 7fa622800640 1 -- 172.21.15.33:0/2165713415 wait complete. 2024-09-13T18:58:01.744 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:01.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.898+0000 7f3ad5a00640 1 Processor -- start 2024-09-13T18:58:01.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.899+0000 7f3ad5a00640 1 -- start start 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ad015a420 0x7f3ad00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad00cbb00 0x7f3ad00cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad00b30e0 con 0x7f3ad00cbf40 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad015a800 con 0x7f3ad015a420 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00b24d0 con 0x7f3ad00cbb00 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3acfe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ad015a420 0x7f3ad00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3acfe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ad015a420 0x7f3ad00b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:56736/0 (socket says 172.21.15.33:56736) 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3acfe00640 1 -- 172.21.15.33:0/2431463671 learned_addr learned my addr 172.21.15.33:0/2431463671 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ac7400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad00cbb00 0x7f3ad00cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.900+0000 7f3ad5000640 1 --1- 172.21.15.33:0/2431463671 >> v1:172.21.15.103:6789/0 conn(0x7f3ad00cbf40 0x7f3ad015df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:58018/0 (socket says 172.21.15.33:58018) 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.901+0000 7f3acfe00640 1 -- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad00cbb00 msgr2=0x7f3ad00cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.901+0000 7f3acfe00640 1 --2- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad00cbb00 0x7f3ad00cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.901+0000 7f3acfe00640 1 -- 172.21.15.33:0/2431463671 >> v1:172.21.15.103:6789/0 conn(0x7f3ad00cbf40 legacy=0x7f3ad015df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.901+0000 7f3acfe00640 1 -- 172.21.15.33:0/2431463671 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00b27b0 con 0x7f3ad015a420 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.902+0000 7f3acfe00640 1 --2- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad015a420 0x7f3ad00b1ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009870 tx=0x7f3ac002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d9b2ac0b5eb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.902+0000 7f3acf400640 1 -- 172.21.15.33:0/2431463671 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0032440 con 0x7f3ad015a420 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.902+0000 7f3acf400640 1 -- 172.21.15.33:0/2431463671 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac00325a0 con 0x7f3ad015a420 2024-09-13T18:58:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.902+0000 7f3acf400640 1 -- 172.21.15.33:0/2431463671 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0032930 con 0x7f3ad015a420 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 -- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad015a420 msgr2=0x7f3ad00b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad015a420 0x7f3ad00b1ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009870 tx=0x7f3ac002a250 comp rx=0 tx=0).stop 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 -- 172.21.15.33:0/2431463671 shutdown_connections 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad00cbb00 0x7f3ad00cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/2431463671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad015a420 0x7f3ad00b1ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 -- 172.21.15.33:0/2431463671 >> 172.21.15.33:0/2431463671 conn(0x7f3ad0069ed0 msgr2=0x7f3ad006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 -- 172.21.15.33:0/2431463671 shutdown_connections 2024-09-13T18:58:01.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.903+0000 7f3ad5a00640 1 -- 172.21.15.33:0/2431463671 wait complete. 2024-09-13T18:58:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.904+0000 7f3ad5a00640 1 Processor -- start 2024-09-13T18:58:01.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 -- start start 2024-09-13T18:58:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 0x7f3ad014da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 0x7f3ad014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad014d810 con 0x7f3ad00cbf40 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01529d0 con 0x7f3ad00cbb00 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.905+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad006f5c0 con 0x7f3ad015a420 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55134/0 (socket says 172.21.15.33:55134) 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 -- 172.21.15.33:0/472048536 learned_addr learned my addr 172.21.15.33:0/472048536 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ad5000640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 0x7f3ad014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3acfe00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 0x7f3ad014da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 -- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 msgr2=0x7f3ad014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 0x7f3ad014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 -- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 msgr2=0x7f3ad014da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 0x7f3ad014da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ac7400640 1 -- 172.21.15.33:0/472048536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac00094d0 con 0x7f3ad00cbf40 2024-09-13T18:58:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3ad5000640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 0x7f3ad014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.906+0000 7f3acfe00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 0x7f3ad014da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3ac7400640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9b0 tx=0x7f3ab800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8009670 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800c9a0 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad006f8a0 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800cd30 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.907+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad006fe60 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.908+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad006fff0 con 0x7f3ad00cbf40 2024-09-13T18:58:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.909+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ab8013470 con 0x7f3ad00cbf40 2024-09-13T18:58:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.910+0000 7f3accc00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 0x7f3aac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.910+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3ab8089670 con 0x7f3ad00cbf40 2024-09-13T18:58:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.910+0000 7f3acfe00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 0x7f3aac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.911+0000 7f3acfe00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 0x7f3aac06d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0034000 tx=0x7f3ac002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:01.914+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ab8054730 con 0x7f3ad00cbf40 2024-09-13T18:58:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.095+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ad006a9c0 con 0x7f3ad00cbf40 2024-09-13T18:58:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.096+0000 7f3accc00640 1 -- 172.21.15.33:0/472048536 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ab8057d50 con 0x7f3ad00cbf40 2024-09-13T18:58:02.099 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 msgr2=0x7f3aac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 0x7f3aac06d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0034000 tx=0x7f3ac002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 msgr2=0x7f3ad014ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9b0 tx=0x7f3ab800ee70 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 shutdown_connections 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3aac06ac00 0x7f3aac06d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ad015a420 0x7f3ad014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ad00cbf40 0x7f3ad014ff30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 --2- 172.21.15.33:0/472048536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ad00cbb00 0x7f3ad014da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 >> 172.21.15.33:0/472048536 conn(0x7f3ad0069ed0 msgr2=0x7f3ad006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 shutdown_connections 2024-09-13T18:58:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.098+0000 7f3ad5a00640 1 -- 172.21.15.33:0/472048536 wait complete. 2024-09-13T18:58:02.117 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:58:02.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.272+0000 7fa0a3200640 1 Processor -- start 2024-09-13T18:58:02.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.272+0000 7fa0a3200640 1 -- start start 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.273+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 0x7fa0a4070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a3200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40cd580 con 0x7fa0a4160280 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a3200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40b4ea0 con 0x7fa0a4069ed0 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b5180 con 0x7fa0a415fb80 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a1400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa0a4160280 0x7fa0a40b4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42398/0 (socket says 172.21.15.33:42398) 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a1400640 1 -- 172.21.15.33:0/3206804792 learned_addr learned my addr 172.21.15.33:0/3206804792 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:02.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a1e00640 1 --2- 172.21.15.33:0/3206804792 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 0x7fa0a4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380275672 0 0) 0x7fa0a40cd580 con 0x7fa0a4160280 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.274+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa088003520 con 0x7fa0a4160280 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.275+0000 7fa0a1e00640 1 -- 172.21.15.33:0/3206804792 >> v1:172.21.15.103:6789/0 conn(0x7fa0a4069ed0 legacy=0x7fa0a40cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.275+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897934458 0 0) 0x7fa0a40b4ea0 con 0x7fa0a4069ed0 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.275+0000 7fa0a1e00640 1 -- 172.21.15.33:0/3206804792 >> v1:172.21.15.33:6789/0 conn(0x7fa0a4160280 legacy=0x7fa0a40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.275+0000 7fa0a1e00640 1 -- 172.21.15.33:0/3206804792 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40b5460 con 0x7fa0a415fb80 2024-09-13T18:58:02.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a1e00640 1 --2- 172.21.15.33:0/3206804792 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 0x7fa0a4070260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0940097d0 tx=0x7fa09402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37e872701bc12105 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094032440 con 0x7fa0a415fb80 2024-09-13T18:58:02.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0940325a0 con 0x7fa0a415fb80 2024-09-13T18:58:02.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a0a00640 1 -- 172.21.15.33:0/3206804792 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094032930 con 0x7fa0a415fb80 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a3200640 1 -- 172.21.15.33:0/3206804792 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 msgr2=0x7fa0a4070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.276+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3206804792 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 0x7fa0a4070260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0940097d0 tx=0x7fa09402a180 comp rx=0 tx=0).stop 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.277+0000 7fa0a3200640 1 -- 172.21.15.33:0/3206804792 shutdown_connections 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.277+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3206804792 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a415fb80 0x7fa0a4070260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.277+0000 7fa0a3200640 1 -- 172.21.15.33:0/3206804792 >> 172.21.15.33:0/3206804792 conn(0x7fa0a40b1260 msgr2=0x7fa0a40b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.277+0000 7fa0a3200640 1 -- 172.21.15.33:0/3206804792 shutdown_connections 2024-09-13T18:58:02.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.277+0000 7fa0a3200640 1 -- 172.21.15.33:0/3206804792 wait complete. 2024-09-13T18:58:02.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.278+0000 7fa0a3200640 1 Processor -- start 2024-09-13T18:58:02.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.278+0000 7fa0a3200640 1 -- start start 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a4069ed0 0x7fa0a41f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a415fb80 0x7fa0a41f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41f2200 con 0x7fa0a4160280 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41f5010 con 0x7fa0a415fb80 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415ce30 con 0x7fa0a4069ed0 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.279+0000 7fa0a2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55146/0 (socket says 172.21.15.33:55146) 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 -- 172.21.15.33:0/3788328591 learned_addr learned my addr 172.21.15.33:0/3788328591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a1e00640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a4069ed0 0x7fa0a41f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a1400640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a415fb80 0x7fa0a41f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 -- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a4069ed0 msgr2=0x7fa0a41f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a4069ed0 0x7fa0a41f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 -- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a415fb80 msgr2=0x7fa0a41f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a415fb80 0x7fa0a41f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 -- 172.21.15.33:0/3788328591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094009400 con 0x7fa0a4160280 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa0a2800640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa09c001560 tx=0x7fa09c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.280+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c003da0 con 0x7fa0a4160280 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.281+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c005070 con 0x7fa0a4160280 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.281+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c005420 con 0x7fa0a4160280 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.281+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a415d110 con 0x7fa0a4160280 2024-09-13T18:58:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.281+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a415d6d0 con 0x7fa0a4160280 2024-09-13T18:58:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.282+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4067050 con 0x7fa0a4160280 2024-09-13T18:58:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.283+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa09c005580 con 0x7fa0a4160280 2024-09-13T18:58:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.283+0000 7fa09a000640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 0x7fa08406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.284+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa09c088cb0 con 0x7fa0a4160280 2024-09-13T18:58:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.284+0000 7fa0a1e00640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 0x7fa08406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.285+0000 7fa0a1e00640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 0x7fa08406d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa094034000 tx=0x7fa09402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.288+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa09c053e20 con 0x7fa0a4160280 2024-09-13T18:58:02.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.478+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0a4067320 con 0x7fa0a4160280 2024-09-13T18:58:02.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.478+0000 7fa09a000640 1 -- 172.21.15.33:0/3788328591 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa09c017070 con 0x7fa0a4160280 2024-09-13T18:58:02.481 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 msgr2=0x7fa08406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 0x7fa08406d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa094034000 tx=0x7fa09402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 msgr2=0x7fa0a40aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa09c001560 tx=0x7fa09c00cc70 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 shutdown_connections 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa08406ac00 0x7fa08406d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a4160280 0x7fa0a40aa910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a415fb80 0x7fa0a41f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 --2- 172.21.15.33:0/3788328591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0a4069ed0 0x7fa0a41f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 >> 172.21.15.33:0/3788328591 conn(0x7fa0a40b1260 msgr2=0x7fa0a406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:02.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 shutdown_connections 2024-09-13T18:58:02.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.480+0000 7fa0a3200640 1 -- 172.21.15.33:0/3788328591 wait complete. 2024-09-13T18:58:02.500 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T18:58:02.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:02.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T18:58:02.568 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:58:02.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:02.568 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:58:02.607 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:58:02.607 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:02.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.759+0000 7f0b8ea00640 1 Processor -- start 2024-09-13T18:58:02.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.759+0000 7f0b8ea00640 1 -- start start 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.760+0000 7f0b8ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0b880b25b0 0x7f0b8806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.760+0000 7f0b8ea00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b8806af30 0x7f0b8806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.760+0000 7f0b8ea00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8815de90 con 0x7f0b8815dab0 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.760+0000 7f0b8ea00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8813ded0 con 0x7f0b880b25b0 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.760+0000 7f0b8ea00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8806be70 con 0x7f0b8806af30 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0b880b25b0 0x7f0b8806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0b8815dab0 0x7f0b880b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42410/0 (socket says 172.21.15.33:42410) 2024-09-13T18:58:02.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0b880b25b0 0x7f0b8806a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55162/0 (socket says 172.21.15.33:55162) 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87e00640 1 -- 172.21.15.33:0/3941033942 learned_addr learned my addr 172.21.15.33:0/3941033942 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 -- 172.21.15.33:0/3941033942 >> v2:172.21.15.103:3300/0 conn(0x7f0b8806af30 msgr2=0x7f0b8806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 --2- 172.21.15.33:0/3941033942 >> v2:172.21.15.103:3300/0 conn(0x7f0b8806af30 0x7f0b8806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 -- 172.21.15.33:0/3941033942 >> v1:172.21.15.33:6789/0 conn(0x7f0b8815dab0 legacy=0x7f0b880b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.761+0000 7f0b87400640 1 -- 172.21.15.33:0/3941033942 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8806c150 con 0x7f0b880b25b0 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.762+0000 7f0b87400640 1 --2- 172.21.15.33:0/3941033942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b880b25b0 0x7f0b8806a9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b8806fe50 tx=0x7f0b7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401df791de5c9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.762+0000 7f0b86a00640 1 -- 172.21.15.33:0/3941033942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7402ae60 con 0x7f0b880b25b0 2024-09-13T18:58:02.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.762+0000 7f0b86a00640 1 -- 172.21.15.33:0/3941033942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74032440 con 0x7f0b880b25b0 2024-09-13T18:58:02.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.762+0000 7f0b86a00640 1 -- 172.21.15.33:0/3941033942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740327d0 con 0x7f0b880b25b0 2024-09-13T18:58:02.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3941033942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b880b25b0 msgr2=0x7f0b8806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3941033942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b880b25b0 0x7f0b8806a9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b8806fe50 tx=0x7f0b7402a110 comp rx=0 tx=0).stop 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3941033942 shutdown_connections 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3941033942 >> v2:172.21.15.103:3300/0 conn(0x7f0b8806af30 0x7f0b8806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3941033942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b880b25b0 0x7f0b8806a9f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3941033942 >> 172.21.15.33:0/3941033942 conn(0x7f0b880ae480 msgr2=0x7f0b880b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3941033942 shutdown_connections 2024-09-13T18:58:02.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.763+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3941033942 wait complete. 2024-09-13T18:58:02.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.765+0000 7f0b8ea00640 1 Processor -- start 2024-09-13T18:58:02.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.765+0000 7f0b8ea00640 1 -- start start 2024-09-13T18:58:02.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b880b25b0 0x7f0b8813d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b8815dab0 0x7f0b8815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880ca950 con 0x7f0b8806af30 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c9cd0 con 0x7f0b8815dab0 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ea00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c9fb0 con 0x7f0b880b25b0 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55172/0 (socket says 172.21.15.33:55172) 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 -- 172.21.15.33:0/3078899486 learned_addr learned my addr 172.21.15.33:0/3078899486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b8ca00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b8815dab0 0x7f0b8815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87400640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b880b25b0 0x7f0b8813d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 -- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b880b25b0 msgr2=0x7f0b8813d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b880b25b0 0x7f0b8813d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 -- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b8815dab0 msgr2=0x7f0b8815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b8815dab0 0x7f0b8815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.766+0000 7f0b87e00640 1 -- 172.21.15.33:0/3078899486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009400 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b87e00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c400 tx=0x7f0b7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78005ce0 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78005e40 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b780072f0 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880ca290 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.767+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b880cb2b0 con 0x7f0b8806af30 2024-09-13T18:58:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.768+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880caa90 con 0x7f0b8806af30 2024-09-13T18:58:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.769+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b78007510 con 0x7f0b8806af30 2024-09-13T18:58:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.770+0000 7f0b7fe00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 0x7f0b6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.770+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0b78088a00 con 0x7f0b8806af30 2024-09-13T18:58:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.771+0000 7f0b87400640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 0x7f0b6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.771+0000 7f0b87400640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 0x7f0b6806d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b74034000 tx=0x7f0b7402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:02.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.774+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b880caa90 con 0x7f0b8806af30 2024-09-13T18:58:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.989+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b880caa90 con 0x7f0b8806af30 2024-09-13T18:58:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.989+0000 7f0b7fe00640 1 -- 172.21.15.33:0/3078899486 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f0b880caa90 con 0x7f0b8806af30 2024-09-13T18:58:02.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:02.993 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:58:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 msgr2=0x7f0b6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 0x7f0b6806d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b74034000 tx=0x7f0b7402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 msgr2=0x7f0b880cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c400 tx=0x7f0b7800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 shutdown_connections 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0b6806ac00 0x7f0b6806d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b8815dab0 0x7f0b8815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0b880b25b0 0x7f0b8813d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.991+0000 7f0b8ea00640 1 --2- 172.21.15.33:0/3078899486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0b8806af30 0x7f0b880cad70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.992+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 >> 172.21.15.33:0/3078899486 conn(0x7f0b880ae480 msgr2=0x7f0b880ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.992+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 shutdown_connections 2024-09-13T18:58:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:02.992+0000 7f0b8ea00640 1 -- 172.21.15.33:0/3078899486 wait complete. 2024-09-13T18:58:03.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.163+0000 7fb795e00640 1 Processor -- start 2024-09-13T18:58:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.163+0000 7fb795e00640 1 -- start start 2024-09-13T18:58:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb795e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb79015a520 0x7fb79006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb795e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb79015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb795e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79006bc00 con 0x7fb7900b1b00 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb795e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79006bea0 con 0x7fb79015a520 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb795e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79006c180 con 0x7fb7900ce020 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb79015a520 0x7fb79006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb786000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb7900b1b00 0x7fb7900cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42130/0 (socket says 172.21.15.33:42130) 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb786000640 1 -- 172.21.15.33:0/1503045628 learned_addr learned my addr 172.21.15.33:0/1503045628 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78f400640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb79015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78ea00640 1 -- 172.21.15.33:0/1503045628 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 msgr2=0x7fb79015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78ea00640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb79015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78ea00640 1 -- 172.21.15.33:0/1503045628 >> v1:172.21.15.33:6789/0 conn(0x7fb7900b1b00 legacy=0x7fb7900cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78ea00640 1 -- 172.21.15.33:0/1503045628 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79006c460 con 0x7fb79015a520 2024-09-13T18:58:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.165+0000 7fb78e000640 1 -- 172.21.15.33:0/1503045628 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992407697 0 0) 0x7fb79006bc00 con 0x7fb7900b1b00 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.166+0000 7fb78ea00640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79015a520 0x7fb79006b6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb7800097a0 tx=0x7fb78002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6a1e9dc45a8221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb78e000640 1 -- 172.21.15.33:0/1503045628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78002ae50 con 0x7fb79015a520 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb78e000640 1 -- 172.21.15.33:0/1503045628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780032440 con 0x7fb79015a520 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb78e000640 1 -- 172.21.15.33:0/1503045628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800327d0 con 0x7fb79015a520 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 -- 172.21.15.33:0/1503045628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79015a520 msgr2=0x7fb79006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79015a520 0x7fb79006b6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb7800097a0 tx=0x7fb78002a100 comp rx=0 tx=0).stop 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 -- 172.21.15.33:0/1503045628 shutdown_connections 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb79015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 --2- 172.21.15.33:0/1503045628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb79015a520 0x7fb79006b6c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 -- 172.21.15.33:0/1503045628 >> 172.21.15.33:0/1503045628 conn(0x7fb7900b0510 msgr2=0x7fb7900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.167+0000 7fb795e00640 1 -- 172.21.15.33:0/1503045628 shutdown_connections 2024-09-13T18:58:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.168+0000 7fb795e00640 1 -- 172.21.15.33:0/1503045628 wait complete. 2024-09-13T18:58:03.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.169+0000 7fb795e00640 1 Processor -- start 2024-09-13T18:58:03.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.169+0000 7fb795e00640 1 -- start start 2024-09-13T18:58:03.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb7900a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb79015a520 0x7fb7901563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900ab590 con 0x7fb7900b1b00 2024-09-13T18:58:03.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79014fa20 con 0x7fb79015a520 2024-09-13T18:58:03.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb795e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900ab9b0 con 0x7fb7900ce020 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb78ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb78ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60220/0 (socket says 172.21.15.33:60220) 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.170+0000 7fb78ea00640 1 -- 172.21.15.33:0/517005498 learned_addr learned my addr 172.21.15.33:0/517005498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb786000640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb7900a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78f400640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb79015a520 0x7fb7901563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 -- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 msgr2=0x7fb7900a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb7900a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 -- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb79015a520 msgr2=0x7fb7901563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb79015a520 0x7fb7901563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 -- 172.21.15.33:0/517005498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009400 con 0x7fb7900b1b00 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb78ea00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb780035040 tx=0x7fb7800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78003d710 con 0x7fb7900b1b00 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78003d890 con 0x7fb7900b1b00 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900aa910 con 0x7fb7900b1b00 2024-09-13T18:58:03.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.171+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78003dc40 con 0x7fb7900b1b00 2024-09-13T18:58:03.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.172+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900aaed0 con 0x7fb7900b1b00 2024-09-13T18:58:03.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.173+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900ab800 con 0x7fb7900b1b00 2024-09-13T18:58:03.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.174+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb780039040 con 0x7fb7900b1b00 2024-09-13T18:58:03.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.175+0000 7fb787e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 0x7fb76c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.175+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb7800aa260 con 0x7fb7900b1b00 2024-09-13T18:58:03.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.175+0000 7fb786000640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 0x7fb76c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.176+0000 7fb786000640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 0x7fb76c06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb79015db20 tx=0x7fb778007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.178+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb780075530 con 0x7fb7900b1b00 2024-09-13T18:58:03.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.359+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb79015a900 con 0x7fb7900b1b00 2024-09-13T18:58:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.360+0000 7fb787e00640 1 -- 172.21.15.33:0/517005498 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7fb780078b50 con 0x7fb7900b1b00 2024-09-13T18:58:03.364 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:03.364 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 msgr2=0x7fb76c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 0x7fb76c06d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb79015db20 tx=0x7fb778007d50 comp rx=0 tx=0).stop 2024-09-13T18:58:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 msgr2=0x7fb79014f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb780035040 tx=0x7fb7800046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 shutdown_connections 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb76c06ac00 0x7fb76c06d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb79015a520 0x7fb7901563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7900ce020 0x7fb7900a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 --2- 172.21.15.33:0/517005498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7900b1b00 0x7fb79014f4e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 >> 172.21.15.33:0/517005498 conn(0x7fb7900b0510 msgr2=0x7fb7900cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 shutdown_connections 2024-09-13T18:58:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.363+0000 7fb795e00640 1 -- 172.21.15.33:0/517005498 wait complete. 2024-09-13T18:58:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:57:11.566731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:57:12.521241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:03.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.539+0000 7fd0e3600640 1 Processor -- start 2024-09-13T18:58:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.539+0000 7fd0e3600640 1 -- start start 2024-09-13T18:58:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.540+0000 7fd0e3600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 0x7fd0dc0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.540+0000 7fd0e3600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.540+0000 7fd0e3600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc06ec70 con 0x7fd0dc06e820 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.540+0000 7fd0e3600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0b5820 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.540+0000 7fd0e3600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc06ad80 con 0x7fd0dc15c9d0 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0e1600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd0dc06e820 0x7fd0dc06afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42134/0 (socket says 172.21.15.33:42134) 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0e1600640 1 -- 172.21.15.33:0/3537607800 learned_addr learned my addr 172.21.15.33:0/3537607800 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 --2- 172.21.15.33:0/3537607800 >> v2:172.21.15.33:3300/0 conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60234/0 (socket says 172.21.15.33:60234) 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/3537607800 >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 0x7fd0dc0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 -- 172.21.15.33:0/3537607800 >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 msgr2=0x7fd0dc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 --2- 172.21.15.33:0/3537607800 >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 0x7fd0dc0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 -- 172.21.15.33:0/3537607800 >> v1:172.21.15.33:6789/0 conn(0x7fd0dc06e820 legacy=0x7fd0dc06afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0dbe00640 1 -- 172.21.15.33:0/3537607800 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0b4e50 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.541+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/3537607800 >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 0x7fd0dc0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.542+0000 7fd0dbe00640 1 --2- 172.21.15.33:0/3537607800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc070930 tx=0x7fd0c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbdb0c3be4acd76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.542+0000 7fd0db400640 1 -- 172.21.15.33:0/3537607800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8032440 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.542+0000 7fd0db400640 1 -- 172.21.15.33:0/3537607800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c80325a0 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.542+0000 7fd0db400640 1 -- 172.21.15.33:0/3537607800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8032930 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 -- 172.21.15.33:0/3537607800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 msgr2=0x7fd0dc06e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 --2- 172.21.15.33:0/3537607800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc070930 tx=0x7fd0c802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 -- 172.21.15.33:0/3537607800 shutdown_connections 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 --2- 172.21.15.33:0/3537607800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc06e2e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 --2- 172.21.15.33:0/3537607800 >> v2:172.21.15.103:3300/0 conn(0x7fd0dc15c9d0 0x7fd0dc0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 -- 172.21.15.33:0/3537607800 >> 172.21.15.33:0/3537607800 conn(0x7fd0dc0b5d60 msgr2=0x7fd0dc0b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 -- 172.21.15.33:0/3537607800 shutdown_connections 2024-09-13T18:58:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.543+0000 7fd0e3600640 1 -- 172.21.15.33:0/3537607800 wait complete. 2024-09-13T18:58:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.545+0000 7fd0e3600640 1 Processor -- start 2024-09-13T18:58:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.545+0000 7fd0e3600640 1 -- start start 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 0x7fd0dc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 0x7fd0dc09d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09df40 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09e220 con 0x7fd0dc06e820 2024-09-13T18:58:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e3600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09e500 con 0x7fd0dc15c9d0 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60238/0 (socket says 172.21.15.33:60238) 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 -- 172.21.15.33:0/4214671694 learned_addr learned my addr 172.21.15.33:0/4214671694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 0x7fd0dc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0dbe00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 0x7fd0dc09d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 -- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 msgr2=0x7fd0dc09d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 0x7fd0dc09d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 -- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 msgr2=0x7fd0dc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 0x7fd0dc14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e1600640 1 -- 172.21.15.33:0/4214671694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009400 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0dbe00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 0x7fd0dc09d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.546+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 0x7fd0dc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0e1600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400ca80 tx=0x7fd0d400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400ac30 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400ad90 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4012600 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc09e7e0 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.547+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc14c600 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.548+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc15a700 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.549+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd0d4007070 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.550+0000 7fd0d8c00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 0x7fd0bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.550+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd0d4088fa0 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.550+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 0x7fd0bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.551+0000 7fd0e0c00640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 0x7fd0bc06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000a990 tx=0x7fd0d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.554+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd0d40bc9c0 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.732+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0dc06ec70 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.732+0000 7fd0d8c00640 1 -- 172.21.15.33:0/4214671694 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0dc06ec70 con 0x7fd0dc15cdb0 2024-09-13T18:58:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 msgr2=0x7fd0bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 0x7fd0bc06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000a990 tx=0x7fd0d0008040 comp rx=0 tx=0).stop 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 msgr2=0x7fd0dc09d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400ca80 tx=0x7fd0d400cf40 comp rx=0 tx=0).stop 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 shutdown_connections 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd0bc06ac00 0x7fd0bc06d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0dc15cdb0 0x7fd0dc09d8e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0dc15c9d0 0x7fd0dc09d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 --2- 172.21.15.33:0/4214671694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0dc06e820 0x7fd0dc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 >> 172.21.15.33:0/4214671694 conn(0x7fd0dc0b5d60 msgr2=0x7fd0dc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 shutdown_connections 2024-09-13T18:58:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.734+0000 7fd0e3600640 1 -- 172.21.15.33:0/4214671694 wait complete. 2024-09-13T18:58:03.754 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.908+0000 7f2c3e400640 1 Processor -- start 2024-09-13T18:58:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.908+0000 7f2c3e400640 1 -- start start 2024-09-13T18:58:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.909+0000 7f2c3e400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 0x7f2c380cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.909+0000 7f2c3e400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c3806f830 0x7f2c3806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.909+0000 7f2c3e400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3806b7c0 con 0x7f2c380ce2c0 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c3e400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3806b5b0 con 0x7f2c3806f830 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c3e400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3806baa0 con 0x7f2c38154ad0 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c3806f830 0x7f2c3806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c3806f830 0x7f2c3806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60250/0 (socket says 172.21.15.33:60250) 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 -- 172.21.15.33:0/370561264 learned_addr learned my addr 172.21.15.33:0/370561264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c37400640 1 --2- 172.21.15.33:0/370561264 >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 0x7f2c380cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 -- 172.21.15.33:0/370561264 >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 msgr2=0x7f2c380cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 --2- 172.21.15.33:0/370561264 >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 0x7f2c380cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 -- 172.21.15.33:0/370561264 >> v1:172.21.15.103:6789/0 conn(0x7f2c380ce2c0 legacy=0x7f2c380cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c2fe00640 1 -- 172.21.15.33:0/370561264 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3806bd80 con 0x7f2c3806f830 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.910+0000 7f2c37400640 1 --2- 172.21.15.33:0/370561264 >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 0x7f2c380cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.911+0000 7f2c2fe00640 1 --2- 172.21.15.33:0/370561264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3806f830 0x7f2c3806fee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2c380b1340 tx=0x7f2c2002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c965105a6e9868bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.911+0000 7f2c36a00640 1 -- 172.21.15.33:0/370561264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20032440 con 0x7f2c3806f830 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c36a00640 1 -- 172.21.15.33:0/370561264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c200325a0 con 0x7f2c3806f830 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c36a00640 1 -- 172.21.15.33:0/370561264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20032930 con 0x7f2c3806f830 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 -- 172.21.15.33:0/370561264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3806f830 msgr2=0x7f2c3806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 --2- 172.21.15.33:0/370561264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3806f830 0x7f2c3806fee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2c380b1340 tx=0x7f2c2002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 -- 172.21.15.33:0/370561264 shutdown_connections 2024-09-13T18:58:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 --2- 172.21.15.33:0/370561264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c3806f830 0x7f2c3806fee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 --2- 172.21.15.33:0/370561264 >> v2:172.21.15.103:3300/0 conn(0x7f2c38154ad0 0x7f2c380cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 -- 172.21.15.33:0/370561264 >> 172.21.15.33:0/370561264 conn(0x7f2c380b0580 msgr2=0x7f2c380b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 -- 172.21.15.33:0/370561264 shutdown_connections 2024-09-13T18:58:03.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.912+0000 7f2c3e400640 1 -- 172.21.15.33:0/370561264 wait complete. 2024-09-13T18:58:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.914+0000 7f2c3e400640 1 Processor -- start 2024-09-13T18:58:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.914+0000 7f2c3e400640 1 -- start start 2024-09-13T18:58:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c38154ad0 0x7f2c381ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c381435e0 0x7f2c3814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381502c0 con 0x7f2c381f0a90 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381f0040 con 0x7f2c381435e0 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c3e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38143a60 con 0x7f2c38154ad0 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c37e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c37e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60254/0 (socket says 172.21.15.33:60254) 2024-09-13T18:58:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c37e00640 1 -- 172.21.15.33:0/976782034 learned_addr learned my addr 172.21.15.33:0/976782034 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c37400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c38154ad0 0x7f2c381ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.915+0000 7f2c2fe00640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c381435e0 0x7f2c3814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 -- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c38154ad0 msgr2=0x7f2c381ed5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c38154ad0 0x7f2c381ed5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 -- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c381435e0 msgr2=0x7f2c3814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c381435e0 0x7f2c3814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 -- 172.21.15.33:0/976782034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200094d0 con 0x7f2c381f0a90 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c37e00640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c730 tx=0x7f2c3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30003b70 con 0x7f2c381f0a90 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30003cd0 con 0x7f2c381f0a90 2024-09-13T18:58:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000aa30 con 0x7f2c381f0a90 2024-09-13T18:58:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c381f0f40 con 0x7f2c381f0a90 2024-09-13T18:58:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.916+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38143fd0 con 0x7f2c381f0a90 2024-09-13T18:58:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.917+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38140c20 con 0x7f2c381f0a90 2024-09-13T18:58:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.918+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c3000ab90 con 0x7f2c381f0a90 2024-09-13T18:58:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.919+0000 7f2c2f400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 0x7f2c1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.919+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2c30088fe0 con 0x7f2c381f0a90 2024-09-13T18:58:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.920+0000 7f2c37400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 0x7f2c1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.920+0000 7f2c37400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 0x7f2c1406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c38141480 tx=0x7f2c28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:03.923+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c30054240 con 0x7f2c381f0a90 2024-09-13T18:58:04.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.101+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c38154020 con 0x7f2c381f0a90 2024-09-13T18:58:04.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.102+0000 7f2c2f400640 1 -- 172.21.15.33:0/976782034 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c30057860 con 0x7f2c381f0a90 2024-09-13T18:58:04.105 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:04.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 msgr2=0x7f2c1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 0x7f2c1406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c38141480 tx=0x7f2c28008040 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 msgr2=0x7f2c3815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c730 tx=0x7f2c3000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 shutdown_connections 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c1406ac00 0x7f2c1406d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381f0a90 0x7f2c3815c390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c381435e0 0x7f2c3814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 --2- 172.21.15.33:0/976782034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c38154ad0 0x7f2c381ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 >> 172.21.15.33:0/976782034 conn(0x7f2c380b0580 msgr2=0x7f2c38153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 shutdown_connections 2024-09-13T18:58:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.104+0000 7f2c3e400640 1 -- 172.21.15.33:0/976782034 wait complete. 2024-09-13T18:58:04.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:04.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.281+0000 7fcec1400640 1 Processor -- start 2024-09-13T18:58:04.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.281+0000 7fcec1400640 1 -- start start 2024-09-13T18:58:04.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec1400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcebc0d1b90 0x7fcebc0d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec1400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0d06e0 con 0x7fcebc0ccf20 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec1400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0b1ce0 con 0x7fcebc0d1b90 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0d2510 con 0x7fcebc15ca40 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec0a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcebc0ccf20 0x7fcebc06bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42136/0 (socket says 172.21.15.33:42136) 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcec0a00640 1 -- 172.21.15.33:0/1450620795 learned_addr learned my addr 172.21.15.33:0/1450620795 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcebb400640 1 --2- 172.21.15.33:0/1450620795 >> v2:172.21.15.103:3300/0 conn(0x7fcebc0d1b90 0x7fcebc0d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcebbe00640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.283+0000 7fcebaa00640 1 -- 172.21.15.33:0/1450620795 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196686346 0 0) 0x7fcebc0d06e0 con 0x7fcebc0ccf20 2024-09-13T18:58:04.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.284+0000 7fcebaa00640 1 -- 172.21.15.33:0/1450620795 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003520 con 0x7fcebc0ccf20 2024-09-13T18:58:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.284+0000 7fcebb400640 1 -- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 msgr2=0x7fcebc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.284+0000 7fcebb400640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.284+0000 7fcebb400640 1 -- 172.21.15.33:0/1450620795 >> v1:172.21.15.33:6789/0 conn(0x7fcebc0ccf20 legacy=0x7fcebc06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.284+0000 7fcebb400640 1 -- 172.21.15.33:0/1450620795 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0cdb30 con 0x7fcebc0d1b90 2024-09-13T18:58:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.285+0000 7fcebb400640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc0d1fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcea80097a0 tx=0x7fcea802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f74ccd5dc9726f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.285+0000 7fcebaa00640 1 -- 172.21.15.33:0/1450620795 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea802ae40 con 0x7fcebc0d1b90 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.285+0000 7fcebaa00640 1 -- 172.21.15.33:0/1450620795 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea8032440 con 0x7fcebc0d1b90 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.285+0000 7fcebaa00640 1 -- 172.21.15.33:0/1450620795 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80327d0 con 0x7fcebc0d1b90 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 -- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 msgr2=0x7fcebc0d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc0d1fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcea80097a0 tx=0x7fcea802a0f0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 -- 172.21.15.33:0/1450620795 shutdown_connections 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc0d1fd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 --2- 172.21.15.33:0/1450620795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc0d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 -- 172.21.15.33:0/1450620795 >> 172.21.15.33:0/1450620795 conn(0x7fcebc0cf560 msgr2=0x7fcebc0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 -- 172.21.15.33:0/1450620795 shutdown_connections 2024-09-13T18:58:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.286+0000 7fcec1400640 1 -- 172.21.15.33:0/1450620795 wait complete. 2024-09-13T18:58:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.288+0000 7fcec1400640 1 Processor -- start 2024-09-13T18:58:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.288+0000 7fcec1400640 1 -- start start 2024-09-13T18:58:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1576a0 con 0x7fcebc0ccf20 2024-09-13T18:58:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15dd70 con 0x7fcebc0d1b90 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc157500 con 0x7fcebc15ca40 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60258/0 (socket says 172.21.15.33:60258) 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 -- 172.21.15.33:0/1406941775 learned_addr learned my addr 172.21.15.33:0/1406941775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcec0a00640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebb400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 -- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 msgr2=0x7fcebc156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 -- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 msgr2=0x7fcebc15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.289+0000 7fcebbe00640 1 -- 172.21.15.33:0/1406941775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8009400 con 0x7fcebc0ccf20 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fcebbe00640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fceac00e8a0 tx=0x7fceac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0094f0 con 0x7fcebc0ccf20 2024-09-13T18:58:04.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00c8e0 con 0x7fcebc0ccf20 2024-09-13T18:58:04.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00cc90 con 0x7fcebc0ccf20 2024-09-13T18:58:04.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0a9b70 con 0x7fcebc0ccf20 2024-09-13T18:58:04.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.290+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc0a9240 con 0x7fcebc0ccf20 2024-09-13T18:58:04.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.292+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc0cd700 con 0x7fcebc0ccf20 2024-09-13T18:58:04.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.292+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fceac013470 con 0x7fcebc0ccf20 2024-09-13T18:58:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.294+0000 7fceb3e00640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 0x7fce9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.294+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fceac089410 con 0x7fcebc0ccf20 2024-09-13T18:58:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.294+0000 7fcebb400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 0x7fce9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.295+0000 7fcebb400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 0x7fce9c06d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.297+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fceac054610 con 0x7fcebc0ccf20 2024-09-13T18:58:04.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.476+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcebc0b8640 con 0x7fcebc0ccf20 2024-09-13T18:58:04.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.477+0000 7fceb3e00640 1 -- 172.21.15.33:0/1406941775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceac057c30 con 0x7fcebc0ccf20 2024-09-13T18:58:04.481 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 msgr2=0x7fce9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 0x7fce9c06d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcea8034000 tx=0x7fcea802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 msgr2=0x7fcebc15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fceac00e8a0 tx=0x7fceac00ed60 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 shutdown_connections 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce9c06ac00 0x7fce9c06d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcebc15ca40 0x7fcebc156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcebc0d1b90 0x7fcebc15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 --2- 172.21.15.33:0/1406941775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcebc0ccf20 0x7fcebc15ec40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 >> 172.21.15.33:0/1406941775 conn(0x7fcebc0cf560 msgr2=0x7fcebc0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:04.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 shutdown_connections 2024-09-13T18:58:04.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.480+0000 7fcec1400640 1 -- 172.21.15.33:0/1406941775 wait complete. 2024-09-13T18:58:04.500 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.654+0000 7fec22800640 1 Processor -- start 2024-09-13T18:58:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.654+0000 7fec22800640 1 -- start start 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.655+0000 7fec22800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec1c15c770 0x7fec1c069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.655+0000 7fec22800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0ae1e0 con 0x7fec1c0b3da0 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.655+0000 7fec22800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0ad140 con 0x7fec1c15cb50 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.655+0000 7fec22800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0ad420 con 0x7fec1c15c770 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec1c15c770 0x7fec1c069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fec1c0b3da0 0x7fec1c06cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42148/0 (socket says 172.21.15.33:42148) 2024-09-13T18:58:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1be00640 1 -- 172.21.15.33:0/3182401675 learned_addr learned my addr 172.21.15.33:0/3182401675 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:04.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1b400640 1 -- 172.21.15.33:0/3182401675 >> v1:172.21.15.103:6789/0 conn(0x7fec1c15cb50 legacy=0x7fec1c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1b400640 1 -- 172.21.15.33:0/3182401675 >> v1:172.21.15.33:6789/0 conn(0x7fec1c0b3da0 legacy=0x7fec1c06cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1b400640 1 -- 172.21.15.33:0/3182401675 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0ad700 con 0x7fec1c15c770 2024-09-13T18:58:04.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.656+0000 7fec1a000640 1 -- 172.21.15.33:0/3182401675 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572663364 0 0) 0x7fec1c0ae1e0 con 0x7fec1c0b3da0 2024-09-13T18:58:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.657+0000 7fec1b400640 1 --2- 172.21.15.33:0/3182401675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c069ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0097a0 tx=0x7fec0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aacb37395c19f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.657+0000 7fec1a000640 1 -- 172.21.15.33:0/3182401675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032440 con 0x7fec1c15c770 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec1a000640 1 -- 172.21.15.33:0/3182401675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c0325a0 con 0x7fec1c15c770 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec1a000640 1 -- 172.21.15.33:0/3182401675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032930 con 0x7fec1c15c770 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 -- 172.21.15.33:0/3182401675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 msgr2=0x7fec1c069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 --2- 172.21.15.33:0/3182401675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c069ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0097a0 tx=0x7fec0c02a230 comp rx=0 tx=0).stop 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 -- 172.21.15.33:0/3182401675 shutdown_connections 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 --2- 172.21.15.33:0/3182401675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c069ed0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 -- 172.21.15.33:0/3182401675 >> 172.21.15.33:0/3182401675 conn(0x7fec1c06afe0 msgr2=0x7fec1c06b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 -- 172.21.15.33:0/3182401675 shutdown_connections 2024-09-13T18:58:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.658+0000 7fec22800640 1 -- 172.21.15.33:0/3182401675 wait complete. 2024-09-13T18:58:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.660+0000 7fec22800640 1 Processor -- start 2024-09-13T18:58:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.660+0000 7fec22800640 1 -- start start 2024-09-13T18:58:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec1c0b3da0 0x7fec1c0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec1c15cb50 0x7fec1c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c155560 con 0x7fec1c15c770 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c154fa0 con 0x7fec1c15cb50 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec22800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c155280 con 0x7fec1c0b3da0 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec1aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec1aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60274/0 (socket says 172.21.15.33:60274) 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.661+0000 7fec1aa00640 1 -- 172.21.15.33:0/3705638633 learned_addr learned my addr 172.21.15.33:0/3705638633 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1b400640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec1c0b3da0 0x7fec1c0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1be00640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec1c15cb50 0x7fec1c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 -- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec1c0b3da0 msgr2=0x7fec1c0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec1c0b3da0 0x7fec1c0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 -- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec1c15cb50 msgr2=0x7fec1c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec1c15cb50 0x7fec1c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 -- 172.21.15.33:0/3705638633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009400 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec1aa00640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c400 tx=0x7fec0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec080052d0 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08005430 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.662+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0ae4e0 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.663+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08003830 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.663+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0b2200 con 0x7fec1c15c770 2024-09-13T18:58:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.664+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c06a7a0 con 0x7fec1c15c770 2024-09-13T18:58:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.665+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec08003990 con 0x7fec1c15c770 2024-09-13T18:58:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.666+0000 7fec13400640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 0x7febfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.666+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fec080888a0 con 0x7fec1c15c770 2024-09-13T18:58:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.666+0000 7fec1b400640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 0x7febfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.667+0000 7fec1b400640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 0x7febfc06d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec0c034000 tx=0x7fec0c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:04.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.674+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec08053aa0 con 0x7fec1c15c770 2024-09-13T18:58:04.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.890+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec1c0b3940 con 0x7fec1c15c770 2024-09-13T18:58:04.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.890+0000 7fec13400640 1 -- 172.21.15.33:0/3705638633 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fec08017090 con 0x7fec1c15c770 2024-09-13T18:58:04.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:04.894 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:58:04.894 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:58:04.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 msgr2=0x7febfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 0x7febfc06d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec0c034000 tx=0x7fec0c02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 msgr2=0x7fec1c153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c400 tx=0x7fec0800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 shutdown_connections 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febfc06ac00 0x7febfc06d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec1c15cb50 0x7fec1c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1c15c770 0x7fec1c153bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 --2- 172.21.15.33:0/3705638633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec1c0b3da0 0x7fec1c0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 >> 172.21.15.33:0/3705638633 conn(0x7fec1c06afe0 msgr2=0x7fec1c070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 shutdown_connections 2024-09-13T18:58:04.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:04.894+0000 7fec22800640 1 -- 172.21.15.33:0/3705638633 wait complete. 2024-09-13T18:58:04.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:05.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.075+0000 7f9711800640 1 Processor -- start 2024-09-13T18:58:05.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.075+0000 7f9711800640 1 -- start start 2024-09-13T18:58:05.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f9711800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f970c0b3a40 0x7f970c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f9711800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f970c0ac870 0x7f970c0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f9711800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c13fbc0 con 0x7f970c160370 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f9711800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c06cca0 con 0x7f970c0b3a40 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f9711800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c15ce80 con 0x7f970c0ac870 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f970c0b3a40 0x7f970c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970a000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f970c160370 0x7f970c0b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42162/0 (socket says 172.21.15.33:42162) 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970a000640 1 -- 172.21.15.33:0/1534161147 learned_addr learned my addr 172.21.15.33:0/1534161147 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f970c0b3a40 0x7f970c1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60284/0 (socket says 172.21.15.33:60284) 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970b400640 1 --2- 172.21.15.33:0/1534161147 >> v2:172.21.15.103:3300/0 conn(0x7f970c0ac870 0x7f970c0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 -- 172.21.15.33:0/1534161147 >> v2:172.21.15.103:3300/0 conn(0x7f970c0ac870 msgr2=0x7f970c0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 --2- 172.21.15.33:0/1534161147 >> v2:172.21.15.103:3300/0 conn(0x7f970c0ac870 0x7f970c0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 -- 172.21.15.33:0/1534161147 >> v1:172.21.15.33:6789/0 conn(0x7f970c160370 legacy=0x7f970c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.077+0000 7f970aa00640 1 -- 172.21.15.33:0/1534161147 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0ad1c0 con 0x7f970c0b3a40 2024-09-13T18:58:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.078+0000 7f970aa00640 1 --2- 172.21.15.33:0/1534161147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0b3a40 0x7f970c1428a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f970c06f5f0 tx=0x7f96fc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f21f1a3fe77790d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.079+0000 7f9709600640 1 -- 172.21.15.33:0/1534161147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc02add0 con 0x7f970c0b3a40 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.079+0000 7f9709600640 1 -- 172.21.15.33:0/1534161147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc032440 con 0x7f970c0b3a40 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.079+0000 7f9709600640 1 -- 172.21.15.33:0/1534161147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0327d0 con 0x7f970c0b3a40 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.079+0000 7f9711800640 1 -- 172.21.15.33:0/1534161147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0b3a40 msgr2=0x7f970c1428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.079+0000 7f9711800640 1 --2- 172.21.15.33:0/1534161147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0b3a40 0x7f970c1428a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f970c06f5f0 tx=0x7f96fc02a080 comp rx=0 tx=0).stop 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 -- 172.21.15.33:0/1534161147 shutdown_connections 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 --2- 172.21.15.33:0/1534161147 >> v2:172.21.15.103:3300/0 conn(0x7f970c0ac870 0x7f970c0acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 --2- 172.21.15.33:0/1534161147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0b3a40 0x7f970c1428a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 -- 172.21.15.33:0/1534161147 >> 172.21.15.33:0/1534161147 conn(0x7f970c0b0510 msgr2=0x7f970c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 -- 172.21.15.33:0/1534161147 shutdown_connections 2024-09-13T18:58:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.080+0000 7f9711800640 1 -- 172.21.15.33:0/1534161147 wait complete. 2024-09-13T18:58:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.081+0000 7f9711800640 1 Processor -- start 2024-09-13T18:58:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.081+0000 7f9711800640 1 -- start start 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f970c0b3a40 0x7f970c13e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c160370 0x7f970c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c13edf0 con 0x7f970c0ac870 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c153ea0 con 0x7f970c160370 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.082+0000 7f9711800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c145040 con 0x7f970c0b3a40 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60298/0 (socket says 172.21.15.33:60298) 2024-09-13T18:58:05.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 -- 172.21.15.33:0/2147505395 learned_addr learned my addr 172.21.15.33:0/2147505395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970a000640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f970c0b3a40 0x7f970c13e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970b400640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c160370 0x7f970c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 -- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f970c0b3a40 msgr2=0x7f970c13e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f970c0b3a40 0x7f970c13e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 -- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c160370 msgr2=0x7f970c141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c160370 0x7f970c141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 -- 172.21.15.33:0/2147505395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009400 con 0x7f970c0ac870 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.083+0000 7f970aa00640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.084+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc03d850 con 0x7f970c0ac870 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.084+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc03d9d0 con 0x7f970c0ac870 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.084+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c13e830 con 0x7f970c0ac870 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.084+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc03dd80 con 0x7f970c0ac870 2024-09-13T18:58:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.084+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c1540f0 con 0x7f970c0ac870 2024-09-13T18:58:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.085+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c1611b0 con 0x7f970c0ac870 2024-09-13T18:58:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.086+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f96fc039040 con 0x7f970c0ac870 2024-09-13T18:58:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.087+0000 7f9702a00640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 0x7f96ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.087+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f96fc0a9cf0 con 0x7f970c0ac870 2024-09-13T18:58:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.087+0000 7f970a000640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 0x7f96ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.088+0000 7f970a000640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 0x7f96ec06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f970c142db0 tx=0x7f96f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.091+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f96fc074e40 con 0x7f970c0ac870 2024-09-13T18:58:05.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.274+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f970c0ce4d0 con 0x7f970c0ac870 2024-09-13T18:58:05.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.275+0000 7f9702a00640 1 -- 172.21.15.33:0/2147505395 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f96fc041090 con 0x7f970c0ac870 2024-09-13T18:58:05.279 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:05.279 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:05.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 msgr2=0x7f96ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 0x7f96ec06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f970c142db0 tx=0x7f96f8009040 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 msgr2=0x7f970c144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000c00 tx=0x7f96fc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 shutdown_connections 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f96ec06ac00 0x7f96ec06d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c160370 0x7f970c141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f970c0b3a40 0x7f970c13e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 --2- 172.21.15.33:0/2147505395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f970c0ac870 0x7f970c144b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 >> 172.21.15.33:0/2147505395 conn(0x7f970c0b0510 msgr2=0x7f970c071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 shutdown_connections 2024-09-13T18:58:05.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.279+0000 7f9711800640 1 -- 172.21.15.33:0/2147505395 wait complete. 2024-09-13T18:58:05.307 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:58:05.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.460+0000 7f79c5e00640 1 Processor -- start 2024-09-13T18:58:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.460+0000 7f79c5e00640 1 -- start start 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c0153b20 0x7f79c00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79c5e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79c006f660 0x7f79c006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79c5e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c0153f00 con 0x7f79c0159a80 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79c5e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00ce600 con 0x7f79c006f660 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79c5e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0070f90 con 0x7f79c0153b20 2024-09-13T18:58:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79bf400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79c006f660 0x7f79c006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79b7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f79c0159a80 0x7f79c00b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42168/0 (socket says 172.21.15.33:42168) 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79b7e00640 1 -- 172.21.15.33:0/3387865192 learned_addr learned my addr 172.21.15.33:0/3387865192 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79bf400640 1 --2- 172.21.15.33:0/3387865192 >> v2:172.21.15.33:3300/0 conn(0x7f79c006f660 0x7f79c006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60304/0 (socket says 172.21.15.33:60304) 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.461+0000 7f79bea00640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c0153b20 0x7f79c00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.462+0000 7f79bf400640 1 -- 172.21.15.33:0/3387865192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c0153b20 msgr2=0x7f79c00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.462+0000 7f79bf400640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c0153b20 0x7f79c00b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.462+0000 7f79bf400640 1 -- 172.21.15.33:0/3387865192 >> v1:172.21.15.33:6789/0 conn(0x7f79c0159a80 legacy=0x7f79c00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.462+0000 7f79bf400640 1 -- 172.21.15.33:0/3387865192 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b1a40 con 0x7f79c006f660 2024-09-13T18:58:05.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.462+0000 7f79be000640 1 -- 172.21.15.33:0/3387865192 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153800811 0 0) 0x7f79c0153f00 con 0x7f79c0159a80 2024-09-13T18:58:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.463+0000 7f79bf400640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c006f660 0x7f79c006faf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009dc0 tx=0x7f79b802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a066ac39e7d1e6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.463+0000 7f79be000640 1 -- 172.21.15.33:0/3387865192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8007740 con 0x7f79c006f660 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.463+0000 7f79be000640 1 -- 172.21.15.33:0/3387865192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b802d050 con 0x7f79c006f660 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.463+0000 7f79be000640 1 -- 172.21.15.33:0/3387865192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8007ac0 con 0x7f79c006f660 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 -- 172.21.15.33:0/3387865192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c006f660 msgr2=0x7f79c006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c006f660 0x7f79c006faf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009dc0 tx=0x7f79b802a680 comp rx=0 tx=0).stop 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 -- 172.21.15.33:0/3387865192 shutdown_connections 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c006f660 0x7f79c006faf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 --2- 172.21.15.33:0/3387865192 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c0153b20 0x7f79c00b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 -- 172.21.15.33:0/3387865192 >> 172.21.15.33:0/3387865192 conn(0x7f79c00b0510 msgr2=0x7f79c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 -- 172.21.15.33:0/3387865192 shutdown_connections 2024-09-13T18:58:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.464+0000 7f79c5e00640 1 -- 172.21.15.33:0/3387865192 wait complete. 2024-09-13T18:58:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.466+0000 7f79c5e00640 1 Processor -- start 2024-09-13T18:58:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.466+0000 7f79c5e00640 1 -- start start 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c006f660 0x7f79c00acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c0153b20 0x7f79c0142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0144520 con 0x7f79c0159a80 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01439a0 con 0x7f79c0153b20 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79c5e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0159490 con 0x7f79c006f660 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60306/0 (socket says 172.21.15.33:60306) 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 -- 172.21.15.33:0/1428636803 learned_addr learned my addr 172.21.15.33:0/1428636803 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bea00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c006f660 0x7f79c00acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79b7e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c0153b20 0x7f79c0142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 -- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c006f660 msgr2=0x7f79c00acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c006f660 0x7f79c00acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 -- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c0153b20 msgr2=0x7f79c0142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c0153b20 0x7f79c0142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.467+0000 7f79bf400640 1 -- 172.21.15.33:0/1428636803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009a70 con 0x7f79c0159a80 2024-09-13T18:58:05.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79bf400640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f79b802ac70 tx=0x7f79b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8003b90 con 0x7f79c0159a80 2024-09-13T18:58:05.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8003cf0 con 0x7f79c0159a80 2024-09-13T18:58:05.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8004230 con 0x7f79c0159a80 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c0144940 con 0x7f79c0159a80 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.468+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0143e60 con 0x7f79c0159a80 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.470+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c00cd9e0 con 0x7f79c0159a80 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.470+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f79b8004390 con 0x7f79c0159a80 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.471+0000 7f79b7400640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.471+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f79b80aa2e0 con 0x7f79c0159a80 2024-09-13T18:58:05.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.472+0000 7f79bea00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.472+0000 7f79bea00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009aa0 tx=0x7f79b0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.475+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f79b80754e0 con 0x7f79c0159a80 2024-09-13T18:58:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.688+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c006faf0 con 0x7f79c0159a80 2024-09-13T18:58:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.688+0000 7f79b7400640 1 -- 172.21.15.33:0/1428636803 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f79b802ae60 con 0x7f79c0159a80 2024-09-13T18:58:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:05.692 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:58:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.690+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 msgr2=0x7f799c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.690+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009aa0 tx=0x7f79b0009190 comp rx=0 tx=0).stop 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.690+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 msgr2=0x7f79c0143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.690+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f79b802ac70 tx=0x7f79b8004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 shutdown_connections 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79c0159a80 0x7f79c0143460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79c0153b20 0x7f79c0142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 --2- 172.21.15.33:0/1428636803 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79c006f660 0x7f79c00acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 >> 172.21.15.33:0/1428636803 conn(0x7f79c00b0510 msgr2=0x7f79c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 shutdown_connections 2024-09-13T18:58:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.691+0000 7f79c5e00640 1 -- 172.21.15.33:0/1428636803 wait complete. 2024-09-13T18:58:05.710 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:05.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.862+0000 7f32ae800640 1 Processor -- start 2024-09-13T18:58:05.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.862+0000 7f32ae800640 1 -- start start 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.863+0000 7f32ae800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.863+0000 7f32ae800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a8159fc0 con 0x7f32a806f660 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.863+0000 7f32ae800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a8153f00 con 0x7f32a8153b20 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32ae800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b3df0 con 0x7f32a80b3990 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f32a806f660 0x7f32a806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42170/0 (socket says 172.21.15.33:42170) 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a7e00640 1 -- 172.21.15.33:0/537805995 learned_addr learned my addr 172.21.15.33:0/537805995 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6a00640 1 --2- 172.21.15.33:0/537805995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6000640 1 -- 172.21.15.33:0/537805995 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323673388 0 0) 0x7f32a8159fc0 con 0x7f32a806f660 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6000640 1 -- 172.21.15.33:0/537805995 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f328c003520 con 0x7f32a806f660 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6a00640 1 -- 172.21.15.33:0/537805995 >> v1:172.21.15.103:6789/0 conn(0x7f32a8153b20 legacy=0x7f32a80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6a00640 1 -- 172.21.15.33:0/537805995 >> v1:172.21.15.33:6789/0 conn(0x7f32a806f660 legacy=0x7f32a806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.864+0000 7f32a6a00640 1 -- 172.21.15.33:0/537805995 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80b1a40 con 0x7f32a80b3990 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.865+0000 7f32a6a00640 1 --2- 172.21.15.33:0/537805995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a8159a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32940097d0 tx=0x7f329402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb3fc95504a4315 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32a6000640 1 -- 172.21.15.33:0/537805995 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294032440 con 0x7f32a80b3990 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32a6000640 1 -- 172.21.15.33:0/537805995 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940325a0 con 0x7f32a80b3990 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32a6000640 1 -- 172.21.15.33:0/537805995 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294032910 con 0x7f32a80b3990 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32ae800640 1 -- 172.21.15.33:0/537805995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 msgr2=0x7f32a8159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32ae800640 1 --2- 172.21.15.33:0/537805995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a8159a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32940097d0 tx=0x7f329402a210 comp rx=0 tx=0).stop 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32ae800640 1 -- 172.21.15.33:0/537805995 shutdown_connections 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32ae800640 1 --2- 172.21.15.33:0/537805995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a8159a80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.866+0000 7f32ae800640 1 -- 172.21.15.33:0/537805995 >> 172.21.15.33:0/537805995 conn(0x7f32a80b0510 msgr2=0x7f32a80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.867+0000 7f32ae800640 1 -- 172.21.15.33:0/537805995 shutdown_connections 2024-09-13T18:58:05.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.867+0000 7f32ae800640 1 -- 172.21.15.33:0/537805995 wait complete. 2024-09-13T18:58:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.868+0000 7f32ae800640 1 Processor -- start 2024-09-13T18:58:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.868+0000 7f32ae800640 1 -- start start 2024-09-13T18:58:05.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a806f660 0x7f32a8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a8153680 con 0x7f32a8153b20 2024-09-13T18:58:05.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a814a6d0 con 0x7f32a806f660 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.869+0000 7f32ae800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a8154090 con 0x7f32a80b3990 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60312/0 (socket says 172.21.15.33:60312) 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 -- 172.21.15.33:0/1329689205 learned_addr learned my addr 172.21.15.33:0/1329689205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7400640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a806f660 0x7f32a8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a6a00640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 -- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 msgr2=0x7f32a814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a814a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 -- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a806f660 msgr2=0x7f32a8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a806f660 0x7f32a8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 -- 172.21.15.33:0/1329689205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009400 con 0x7f32a8153b20 2024-09-13T18:58:05.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.870+0000 7f32a7e00640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32a000caa0 tx=0x7f32a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.871+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000ac00 con 0x7f32a8153b20 2024-09-13T18:58:05.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.871+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000ad60 con 0x7f32a8153b20 2024-09-13T18:58:05.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.871+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a8155630 con 0x7f32a8153b20 2024-09-13T18:58:05.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.871+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0012620 con 0x7f32a8153b20 2024-09-13T18:58:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.871+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a8155bf0 con 0x7f32a8153b20 2024-09-13T18:58:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.872+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a806faf0 con 0x7f32a8153b20 2024-09-13T18:58:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.873+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32a0007070 con 0x7f32a8153b20 2024-09-13T18:58:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.873+0000 7f329f400640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 0x7f328806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.874+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f32a00892d0 con 0x7f32a8153b20 2024-09-13T18:58:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.874+0000 7f32a7400640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 0x7f328806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.875+0000 7f32a7400640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 0x7f328806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3298000f60 tx=0x7f3298009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:05.877+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f32a00544d0 con 0x7f32a8153b20 2024-09-13T18:58:06.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.090+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32a81552e0 con 0x7f32a8153b20 2024-09-13T18:58:06.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.091+0000 7f329f400640 1 -- 172.21.15.33:0/1329689205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f32a0057af0 con 0x7f32a8153b20 2024-09-13T18:58:06.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:06.095 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4188774574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4188774574},{"type":"v1","addr":"172.21.15.33:6835","nonce":4188774574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3044401279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3044401279},{"type":"v1","addr":"172.21.15.103:6836","nonce":3044401279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2259031051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2259031051},{"type":"v1","addr":"172.21.15.33:6833","nonce":2259031051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:57:13.481646+0000","modified":"2024-09-13T18:57:16.493197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/2996407679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2996407679},{"type":"v1","addr":"172.21.15.103:6837","nonce":2996407679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:58:06.095 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-13T18:58:06.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 msgr2=0x7f328806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 0x7f328806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3298000f60 tx=0x7f3298009040 comp rx=0 tx=0).stop 2024-09-13T18:58:06.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 msgr2=0x7f32a81f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32a000caa0 tx=0x7f32a000cf60 comp rx=0 tx=0).stop 2024-09-13T18:58:06.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 shutdown_connections 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f328806ac00 0x7f328806d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a8153b20 0x7f32a81f25f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32a80b3990 0x7f32a814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.093+0000 7f32ae800640 1 --2- 172.21.15.33:0/1329689205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a806f660 0x7f32a8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.094+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 >> 172.21.15.33:0/1329689205 conn(0x7f32a80b0510 msgr2=0x7f32a815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.094+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 shutdown_connections 2024-09-13T18:58:06.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.094+0000 7f32ae800640 1 -- 172.21.15.33:0/1329689205 wait complete. 2024-09-13T18:58:06.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:06.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.264+0000 7f4ad9a00640 1 Processor -- start 2024-09-13T18:58:06.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.264+0000 7f4ad9a00640 1 -- start start 2024-09-13T18:58:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.265+0000 7f4ad9a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.265+0000 7f4ad9a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ad40ac870 0x7f4ad40acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.265+0000 7f4ad9a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad413fbc0 con 0x7f4ad4160370 2024-09-13T18:58:06.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.265+0000 7f4ad9a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad406cca0 con 0x7f4ad40ac870 2024-09-13T18:58:06.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.265+0000 7f4ad9a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40ad220 con 0x7f4ad40b3a40 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad2a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad3400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ad40ac870 0x7f4ad40acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad2a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:50038/0 (socket says 172.21.15.33:50038) 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad2000640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4ad4160370 0x7f4ad40b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:44162/0 (socket says 172.21.15.33:44162) 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad2a00640 1 -- 172.21.15.33:0/4252581653 learned_addr learned my addr 172.21.15.33:0/4252581653 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad3400640 1 -- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 msgr2=0x7f4ad41428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad3400640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad3400640 1 -- 172.21.15.33:0/4252581653 >> v1:172.21.15.103:6789/0 conn(0x7f4ad4160370 legacy=0x7f4ad40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad3400640 1 -- 172.21.15.33:0/4252581653 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad415ce80 con 0x7f4ad40ac870 2024-09-13T18:58:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad2a00640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:06.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.266+0000 7f4ad1600640 1 -- 172.21.15.33:0/4252581653 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304467589 0 0) 0x7f4ad413fbc0 con 0x7f4ad4160370 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad3400640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40ac870 0x7f4ad40acce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009dc0 tx=0x7f4acc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5419564bc67d32d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad1600640 1 -- 172.21.15.33:0/4252581653 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc007740 con 0x7f4ad40ac870 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad1600640 1 -- 172.21.15.33:0/4252581653 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc02d050 con 0x7f4ad40ac870 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad1600640 1 -- 172.21.15.33:0/4252581653 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc007ac0 con 0x7f4ad40ac870 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad9a00640 1 -- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40ac870 msgr2=0x7f4ad40acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.268+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40ac870 0x7f4ad40acce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009dc0 tx=0x7f4acc02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 -- 172.21.15.33:0/4252581653 shutdown_connections 2024-09-13T18:58:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40ac870 0x7f4ad40acce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/4252581653 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad40b3a40 0x7f4ad41428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 -- 172.21.15.33:0/4252581653 >> 172.21.15.33:0/4252581653 conn(0x7f4ad40b0510 msgr2=0x7f4ad40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 -- 172.21.15.33:0/4252581653 shutdown_connections 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.269+0000 7f4ad9a00640 1 -- 172.21.15.33:0/4252581653 wait complete. 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.270+0000 7f4ad9a00640 1 Processor -- start 2024-09-13T18:58:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.270+0000 7f4ad9a00640 1 -- start start 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40b3a40 0x7f4ad4144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad4160370 0x7f4ad413e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4144650 con 0x7f4ad40ac870 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad41448d0 con 0x7f4ad40b3a40 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.271+0000 7f4ad9a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4144bb0 con 0x7f4ad4160370 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60318/0 (socket says 172.21.15.33:60318) 2024-09-13T18:58:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 -- 172.21.15.33:0/18228119 learned_addr learned my addr 172.21.15.33:0/18228119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2000640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40b3a40 0x7f4ad4144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad3400640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad4160370 0x7f4ad413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 -- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad4160370 msgr2=0x7f4ad413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad4160370 0x7f4ad413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 -- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40b3a40 msgr2=0x7f4ad4144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40b3a40 0x7f4ad4144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 -- 172.21.15.33:0/18228119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40094d0 con 0x7f4ad40ac870 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.272+0000 7f4ad2a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400e9d0 tx=0x7f4ac400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.273+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400ca60 con 0x7f4ad40ac870 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.273+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400cbc0 con 0x7f4ad40ac870 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.273+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4013470 con 0x7f4ad40ac870 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.273+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc009a70 con 0x7f4ad40ac870 2024-09-13T18:58:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.273+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad4145170 con 0x7f4ad40ac870 2024-09-13T18:58:06.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.274+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40668d0 con 0x7f4ad40ac870 2024-09-13T18:58:06.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.275+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ac40135d0 con 0x7f4ad40ac870 2024-09-13T18:58:06.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.276+0000 7f4acaa00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 0x7f4ab406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.276+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4ac40896e0 con 0x7f4ad40ac870 2024-09-13T18:58:06.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.276+0000 7f4ad2000640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 0x7f4ab406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.277+0000 7f4ad2000640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 0x7f4ab406d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ad413f7b0 tx=0x7f4ac0007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.280+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4ac40548f0 con 0x7f4ad40ac870 2024-09-13T18:58:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.464+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad41611b0 con 0x7f4ad40ac870 2024-09-13T18:58:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.465+0000 7f4acaa00640 1 -- 172.21.15.33:0/18228119 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f4ac4057f10 con 0x7f4ad40ac870 2024-09-13T18:58:06.469 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:06.469 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:57:56.238010+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:57:11.566731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:57:12.521241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 msgr2=0x7f4ab406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 0x7f4ab406d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ad413f7b0 tx=0x7f4ac0007de0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 msgr2=0x7f4ad4145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400e9d0 tx=0x7f4ac400ee90 comp rx=0 tx=0).stop 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 shutdown_connections 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ab406ac00 0x7f4ab406d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ad4160370 0x7f4ad413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ad40b3a40 0x7f4ad4144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 --2- 172.21.15.33:0/18228119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ad40ac870 0x7f4ad4145f10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 >> 172.21.15.33:0/18228119 conn(0x7f4ad40b0510 msgr2=0x7f4ad4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 shutdown_connections 2024-09-13T18:58:06.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.468+0000 7f4ad9a00640 1 -- 172.21.15.33:0/18228119 wait complete. 2024-09-13T18:58:06.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:58:06.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.639+0000 7f4638e00640 1 Processor -- start 2024-09-13T18:58:06.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.639+0000 7f4638e00640 1 -- start start 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4638e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 0x7f4634070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4638e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 0x7f46340cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4638e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340709e0 con 0x7f4634070540 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4638e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46341599f0 con 0x7f4634159610 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4638e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634070cc0 con 0x7f46340b3790 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4629400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4634070540 0x7f46340b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42172/0 (socket says 172.21.15.33:42172) 2024-09-13T18:58:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4629400640 1 -- 172.21.15.33:0/1896023571 learned_addr learned my addr 172.21.15.33:0/1896023571 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4631e00640 1 --2- 172.21.15.33:0/1896023571 >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 0x7f4634070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4632800640 1 --2- 172.21.15.33:0/1896023571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 0x7f46340cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4631400640 1 -- 172.21.15.33:0/1896023571 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192546874 0 0) 0x7f46340709e0 con 0x7f4634070540 2024-09-13T18:58:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.641+0000 7f4631400640 1 -- 172.21.15.33:0/1896023571 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4618003520 con 0x7f4634070540 2024-09-13T18:58:06.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.642+0000 7f4632800640 1 -- 172.21.15.33:0/1896023571 >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 msgr2=0x7f4634070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:06.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.642+0000 7f4632800640 1 --2- 172.21.15.33:0/1896023571 >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 0x7f4634070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.642+0000 7f4632800640 1 -- 172.21.15.33:0/1896023571 >> v1:172.21.15.33:6789/0 conn(0x7f4634070540 legacy=0x7f46340b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.642+0000 7f4632800640 1 -- 172.21.15.33:0/1896023571 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634070fa0 con 0x7f46340b3790 2024-09-13T18:58:06.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.642+0000 7f4631e00640 1 --2- 172.21.15.33:0/1896023571 >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 0x7f4634070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:06.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4632800640 1 --2- 172.21.15.33:0/1896023571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 0x7f46340cd080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d90 tx=0x7f462c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f354dbb4c30d2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4631400640 1 -- 172.21.15.33:0/1896023571 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c007740 con 0x7f46340b3790 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4631400640 1 -- 172.21.15.33:0/1896023571 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c02d050 con 0x7f46340b3790 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4631400640 1 -- 172.21.15.33:0/1896023571 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c007aa0 con 0x7f46340b3790 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4638e00640 1 -- 172.21.15.33:0/1896023571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 msgr2=0x7f46340cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.643+0000 7f4638e00640 1 --2- 172.21.15.33:0/1896023571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 0x7f46340cd080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d90 tx=0x7f462c02a660 comp rx=0 tx=0).stop 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 -- 172.21.15.33:0/1896023571 shutdown_connections 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 --2- 172.21.15.33:0/1896023571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46340b3790 0x7f46340cd080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 --2- 172.21.15.33:0/1896023571 >> v2:172.21.15.103:3300/0 conn(0x7f4634159610 0x7f4634070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 -- 172.21.15.33:0/1896023571 >> 172.21.15.33:0/1896023571 conn(0x7f46340b0510 msgr2=0x7f46340b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 -- 172.21.15.33:0/1896023571 shutdown_connections 2024-09-13T18:58:06.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.644+0000 7f4638e00640 1 -- 172.21.15.33:0/1896023571 wait complete. 2024-09-13T18:58:06.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.645+0000 7f4638e00640 1 Processor -- start 2024-09-13T18:58:06.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.646+0000 7f4638e00640 1 -- start start 2024-09-13T18:58:06.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.646+0000 7f4638e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.646+0000 7f4638e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 0x7f4634156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4638e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4634159610 0x7f46340ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4638e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463414ca70 con 0x7f4634070540 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4638e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340c8af0 con 0x7f46340b3790 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4638e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463414c790 con 0x7f4634159610 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60326/0 (socket says 172.21.15.33:60326) 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 -- 172.21.15.33:0/1452467637 learned_addr learned my addr 172.21.15.33:0/1452467637 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4629400640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 0x7f4634156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 -- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4634159610 msgr2=0x7f46340ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4634159610 0x7f46340ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 -- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 msgr2=0x7f4634156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 0x7f4634156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 -- 172.21.15.33:0/1452467637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009400 con 0x7f4634070540 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4629400640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 0x7f4634156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.647+0000 7f4631e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f462400ebe0 tx=0x7f462400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.648+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624009760 con 0x7f4634070540 2024-09-13T18:58:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.648+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400cc30 con 0x7f4634070540 2024-09-13T18:58:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.648+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400eee0 con 0x7f4634070540 2024-09-13T18:58:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.648+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c009a70 con 0x7f4634070540 2024-09-13T18:58:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.648+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340c9070 con 0x7f4634070540 2024-09-13T18:58:06.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.649+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634070000 con 0x7f4634070540 2024-09-13T18:58:06.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.650+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4624013470 con 0x7f4634070540 2024-09-13T18:58:06.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.651+0000 7f462aa00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 0x7f461006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:06.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.651+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4624089790 con 0x7f4634070540 2024-09-13T18:58:06.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.651+0000 7f4629400640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 0x7f461006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:06.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.652+0000 7f4629400640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 0x7f461006d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4634150150 tx=0x7f461c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:06.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.655+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4624054850 con 0x7f4634070540 2024-09-13T18:58:06.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.868+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46340b1810 con 0x7f4634070540 2024-09-13T18:58:06.872 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T18:58:06.869+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:58:06.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.881+0000 7f462aa00640 1 -- 172.21.15.33:0/1452467637 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4624057e70 con 0x7f4634070540 2024-09-13T18:58:06.885 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:58:06.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 msgr2=0x7f461006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 0x7f461006d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4634150150 tx=0x7f461c009040 comp rx=0 tx=0).stop 2024-09-13T18:58:06.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 msgr2=0x7f4634156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f462400ebe0 tx=0x7f462400c520 comp rx=0 tx=0).stop 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 shutdown_connections 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f461006ac00 0x7f461006d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4634159610 0x7f46340ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46340b3790 0x7f4634156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 --2- 172.21.15.33:0/1452467637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4634070540 0x7f4634156a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 >> 172.21.15.33:0/1452467637 conn(0x7f46340b0510 msgr2=0x7f46340ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 shutdown_connections 2024-09-13T18:58:06.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:06.884+0000 7f4638e00640 1 -- 172.21.15.33:0/1452467637 wait complete. 2024-09-13T18:58:06.895 INFO:tasks.ceph.mds.d.smithi103.stderr: -8445> 2024-09-13T18:57:09.046+0000 7fcba2200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:58:06.898 INFO:tasks.ceph.mds.d.smithi103.stderr: -7339> 2024-09-13T18:57:15.048+0000 7fcb9aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:58:06.903 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:58:06.953 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:58:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.059+0000 7f5d51400640 1 Processor -- start 2024-09-13T18:58:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.059+0000 7f5d51400640 1 -- start start 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.060+0000 7f5d51400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 0x7f5d4c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.060+0000 7f5d51400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d4c06f660 0x7f5d4c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.060+0000 7f5d51400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c153f00 con 0x7f5d4c159a80 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.060+0000 7f5d51400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0ce600 con 0x7f5d4c06f660 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.060+0000 7f5d51400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c070f90 con 0x7f5d4c153b20 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d41e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5d4c159a80 0x7f5d4c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42182/0 (socket says 172.21.15.33:42182) 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d41e00640 1 -- 172.21.15.33:0/669424528 learned_addr learned my addr 172.21.15.33:0/669424528 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4a800640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 0x7f5d4c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4b200640 1 --2- 172.21.15.33:0/669424528 >> v2:172.21.15.103:3300/0 conn(0x7f5d4c06f660 0x7f5d4c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d49e00640 1 -- 172.21.15.33:0/669424528 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766774843 0 0) 0x7f5d4c153f00 con 0x7f5d4c159a80 2024-09-13T18:58:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d49e00640 1 -- 172.21.15.33:0/669424528 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d30005730 con 0x7f5d4c159a80 2024-09-13T18:58:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4b200640 1 -- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 msgr2=0x7f5d4c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4b200640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 0x7f5d4c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4b200640 1 -- 172.21.15.33:0/669424528 >> v1:172.21.15.33:6789/0 conn(0x7f5d4c159a80 legacy=0x7f5d4c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4b200640 1 -- 172.21.15.33:0/669424528 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0b1a40 con 0x7f5d4c06f660 2024-09-13T18:58:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.061+0000 7f5d4a800640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 0x7f5d4c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d4b200640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c06f660 0x7f5d4c06faf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009dc0 tx=0x7f5d4402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b616dc4a55d88c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d49e00640 1 -- 172.21.15.33:0/669424528 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44007740 con 0x7f5d4c06f660 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d49e00640 1 -- 172.21.15.33:0/669424528 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4402d050 con 0x7f5d4c06f660 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d49e00640 1 -- 172.21.15.33:0/669424528 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44007ac0 con 0x7f5d4c06f660 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d51400640 1 -- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c06f660 msgr2=0x7f5d4c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.063+0000 7f5d51400640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c06f660 0x7f5d4c06faf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009dc0 tx=0x7f5d4402a680 comp rx=0 tx=0).stop 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 -- 172.21.15.33:0/669424528 shutdown_connections 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c06f660 0x7f5d4c06faf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 --2- 172.21.15.33:0/669424528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c153b20 0x7f5d4c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 -- 172.21.15.33:0/669424528 >> 172.21.15.33:0/669424528 conn(0x7f5d4c0b0510 msgr2=0x7f5d4c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 -- 172.21.15.33:0/669424528 shutdown_connections 2024-09-13T18:58:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.064+0000 7f5d51400640 1 -- 172.21.15.33:0/669424528 wait complete. 2024-09-13T18:58:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.065+0000 7f5d51400640 1 Processor -- start 2024-09-13T18:58:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.065+0000 7f5d51400640 1 -- start start 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c153b20 0x7f5d4c1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c159a80 0x7f5d4c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c156b30 con 0x7f5d4c06f660 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c156f50 con 0x7f5d4c153b20 2024-09-13T18:58:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d51400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c146570 con 0x7f5d4c159a80 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d4a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d4a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60342/0 (socket says 172.21.15.33:60342) 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.066+0000 7f5d4a800640 1 -- 172.21.15.33:0/2977854224 learned_addr learned my addr 172.21.15.33:0/2977854224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c153b20 0x7f5d4c1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4b200640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c159a80 0x7f5d4c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 -- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c159a80 msgr2=0x7f5d4c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c159a80 0x7f5d4c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 -- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c153b20 msgr2=0x7f5d4c1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c153b20 0x7f5d4c1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 -- 172.21.15.33:0/2977854224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009400 con 0x7f5d4c06f660 2024-09-13T18:58:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d4a800640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e990 tx=0x7f5d3c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00c9e0 con 0x7f5d4c06f660 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00cb40 con 0x7f5d4c06f660 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00ced0 con 0x7f5d4c06f660 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.067+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d44009a70 con 0x7f5d4c06f660 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.068+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c155eb0 con 0x7f5d4c06f660 2024-09-13T18:58:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.069+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c06faf0 con 0x7f5d4c06f660 2024-09-13T18:58:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.069+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d3c013470 con 0x7f5d4c06f660 2024-09-13T18:58:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.070+0000 7f5d43400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 0x7f5d2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.070+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f5d3c089620 con 0x7f5d4c06f660 2024-09-13T18:58:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.071+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 0x7f5d2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.071+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 0x7f5d2806d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c14f690 tx=0x7f5d34007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.074+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5d3c0547d0 con 0x7f5d4c06f660 2024-09-13T18:58:07.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.296+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d4c0b0a90 con 0x7f5d4c06f660 2024-09-13T18:58:07.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.888+0000 7f5d43400640 1 -- 172.21.15.33:0/2977854224 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d3c057df0 con 0x7f5d4c06f660 2024-09-13T18:58:07.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 msgr2=0x7f5d2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 0x7f5d2806d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c14f690 tx=0x7f5d34007d30 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 msgr2=0x7f5d4c146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e990 tx=0x7f5d3c00ee50 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 shutdown_connections 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d2806ac30 0x7f5d2806d0f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d4c159a80 0x7f5d4c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d4c153b20 0x7f5d4c1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 --2- 172.21.15.33:0/2977854224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d4c06f660 0x7f5d4c146030 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 >> 172.21.15.33:0/2977854224 conn(0x7f5d4c0b0510 msgr2=0x7f5d4c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 shutdown_connections 2024-09-13T18:58:07.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:07.891+0000 7f5d51400640 1 -- 172.21.15.33:0/2977854224 wait complete. 2024-09-13T18:58:07.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:58:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.069+0000 7f3371400640 1 Processor -- start 2024-09-13T18:58:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.069+0000 7f3371400640 1 -- start start 2024-09-13T18:58:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3371400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f336c06cd60 0x7f336c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3371400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c15b770 0x7f336c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3371400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c151a20 con 0x7f336c0cd870 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3371400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0cc430 con 0x7f336c06cd60 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3371400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0b1bb0 con 0x7f336c15b770 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f336a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f336c06cd60 0x7f336c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f336a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f336c06cd60 0x7f336c0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60346/0 (socket says 172.21.15.33:60346) 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f336a800640 1 -- 172.21.15.33:0/2243469389 learned_addr learned my addr 172.21.15.33:0/2243469389 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.070+0000 7f3361e00640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c15b770 0x7f336c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.071+0000 7f336a800640 1 -- 172.21.15.33:0/2243469389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c15b770 msgr2=0x7f336c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.071+0000 7f336a800640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c15b770 0x7f336c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.071+0000 7f336a800640 1 -- 172.21.15.33:0/2243469389 >> v1:172.21.15.103:6789/0 conn(0x7f336c0cd870 legacy=0x7f336c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.071+0000 7f336a800640 1 -- 172.21.15.33:0/2243469389 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0b1e70 con 0x7f336c06cd60 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.072+0000 7f336a800640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c06cd60 0x7f336c0b2950 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f335c009870 tx=0x7f335c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85c999b2d61c3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.072+0000 7f3369e00640 1 -- 172.21.15.33:0/2243469389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c032440 con 0x7f336c06cd60 2024-09-13T18:58:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.072+0000 7f3369e00640 1 -- 172.21.15.33:0/2243469389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0325a0 con 0x7f336c06cd60 2024-09-13T18:58:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.072+0000 7f3369e00640 1 -- 172.21.15.33:0/2243469389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c032930 con 0x7f336c06cd60 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 -- 172.21.15.33:0/2243469389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c06cd60 msgr2=0x7f336c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c06cd60 0x7f336c0b2950 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f335c009870 tx=0x7f335c02a270 comp rx=0 tx=0).stop 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 -- 172.21.15.33:0/2243469389 shutdown_connections 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c15b770 0x7f336c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 --2- 172.21.15.33:0/2243469389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c06cd60 0x7f336c0b2950 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 -- 172.21.15.33:0/2243469389 >> 172.21.15.33:0/2243469389 conn(0x7f336c0b0510 msgr2=0x7f336c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 -- 172.21.15.33:0/2243469389 shutdown_connections 2024-09-13T18:58:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.073+0000 7f3371400640 1 -- 172.21.15.33:0/2243469389 wait complete. 2024-09-13T18:58:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.075+0000 7f3371400640 1 Processor -- start 2024-09-13T18:58:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.075+0000 7f3371400640 1 -- start start 2024-09-13T18:58:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.075+0000 7f3371400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c06cd60 0x7f336c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.075+0000 7f3371400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c0cd870 0x7f336c13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f3371400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f3371400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0aa650 con 0x7f336c15b770 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f3371400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0aa930 con 0x7f336c06cd60 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f3371400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0aac10 con 0x7f336c0cd870 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60358/0 (socket says 172.21.15.33:60358) 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 -- 172.21.15.33:0/2573503153 learned_addr learned my addr 172.21.15.33:0/2573503153 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336a800640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c06cd60 0x7f336c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f3361e00640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c0cd870 0x7f336c13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 -- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c0cd870 msgr2=0x7f336c13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c0cd870 0x7f336c13e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 -- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c06cd60 msgr2=0x7f336c141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c06cd60 0x7f336c141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.076+0000 7f336b200640 1 -- 172.21.15.33:0/2573503153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0094d0 con 0x7f336c15b770 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f336b200640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f336400c730 tx=0x7f336400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364003b70 con 0x7f336c15b770 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364003cf0 con 0x7f336c15b770 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364003ea0 con 0x7f336c15b770 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c0aaef0 con 0x7f336c15b770 2024-09-13T18:58:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.077+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c14f9f0 con 0x7f336c15b770 2024-09-13T18:58:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.078+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c14fc10 con 0x7f336c15b770 2024-09-13T18:58:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.079+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3364005520 con 0x7f336c15b770 2024-09-13T18:58:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.080+0000 7f3363400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 0x7f334806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.080+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3364089200 con 0x7f336c15b770 2024-09-13T18:58:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.080+0000 7f336a800640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 0x7f334806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.081+0000 7f336a800640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 0x7f334806d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:08.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.084+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f336c14fc10 con 0x7f336c15b770 2024-09-13T18:58:08.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.262+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f336c0ab410 con 0x7f336c15b770 2024-09-13T18:58:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.891+0000 7f3363400640 1 -- 172.21.15.33:0/2573503153 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f336c0ab410 con 0x7f336c15b770 2024-09-13T18:58:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:58:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 msgr2=0x7f334806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 0x7f334806d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 msgr2=0x7f336c0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f336400c730 tx=0x7f336400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 shutdown_connections 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f334806ac00 0x7f334806d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c15b770 0x7f336c0a9c90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f336c0cd870 0x7f336c13e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 --2- 172.21.15.33:0/2573503153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c06cd60 0x7f336c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 >> 172.21.15.33:0/2573503153 conn(0x7f336c0b0510 msgr2=0x7f336c0ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 shutdown_connections 2024-09-13T18:58:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:08.894+0000 7f3371400640 1 -- 172.21.15.33:0/2573503153 wait complete. 2024-09-13T18:58:08.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:58:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.077+0000 7f54e4a00640 1 Processor -- start 2024-09-13T18:58:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.077+0000 7f54e4a00640 1 -- start start 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54e015cb80 0x7f54e00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e00b15b0 0x7f54e00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54e00cfa60 0x7f54e0160590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e00b86f0 con 0x7f54e00cfa60 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e00b1f60 con 0x7f54e015cb80 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54e4a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00cd0b0 con 0x7f54e00b15b0 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54df200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54e00cfa60 0x7f54e0160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.078+0000 7f54df200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54e00cfa60 0x7f54e0160590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60370/0 (socket says 172.21.15.33:60370) 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 -- 172.21.15.33:0/4264465909 learned_addr learned my addr 172.21.15.33:0/4264465909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54de800640 1 --2- 172.21.15.33:0/4264465909 >> v2:172.21.15.103:3300/0 conn(0x7f54e015cb80 0x7f54e00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54dde00640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e00b15b0 0x7f54e00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 -- 172.21.15.33:0/4264465909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e00b15b0 msgr2=0x7f54e00cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e00b15b0 0x7f54e00cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 -- 172.21.15.33:0/4264465909 >> v2:172.21.15.103:3300/0 conn(0x7f54e015cb80 msgr2=0x7f54e00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 --2- 172.21.15.33:0/4264465909 >> v2:172.21.15.103:3300/0 conn(0x7f54e015cb80 0x7f54e00cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.079+0000 7f54df200640 1 -- 172.21.15.33:0/4264465909 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00b1c80 con 0x7f54e00cfa60 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.080+0000 7f54df200640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e0160590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f54e0067df0 tx=0x7f54d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b25939fd3a597 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.080+0000 7f54dd400640 1 -- 172.21.15.33:0/4264465909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8031600 con 0x7f54e00cfa60 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.080+0000 7f54dd400640 1 -- 172.21.15.33:0/4264465909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d802d050 con 0x7f54e00cfa60 2024-09-13T18:58:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.080+0000 7f54dd400640 1 -- 172.21.15.33:0/4264465909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8031980 con 0x7f54e00cfa60 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 -- 172.21.15.33:0/4264465909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 msgr2=0x7f54e0160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e0160590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f54e0067df0 tx=0x7f54d802a730 comp rx=0 tx=0).stop 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 -- 172.21.15.33:0/4264465909 shutdown_connections 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e00b15b0 0x7f54e00cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 --2- 172.21.15.33:0/4264465909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e0160590 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 --2- 172.21.15.33:0/4264465909 >> v2:172.21.15.103:3300/0 conn(0x7f54e015cb80 0x7f54e00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 -- 172.21.15.33:0/4264465909 >> 172.21.15.33:0/4264465909 conn(0x7f54e00b41c0 msgr2=0x7f54e00b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 -- 172.21.15.33:0/4264465909 shutdown_connections 2024-09-13T18:58:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.081+0000 7f54e4a00640 1 -- 172.21.15.33:0/4264465909 wait complete. 2024-09-13T18:58:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.083+0000 7f54e4a00640 1 Processor -- start 2024-09-13T18:58:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.083+0000 7f54e4a00640 1 -- start start 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54e00b15b0 0x7f54e01f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e015cb80 0x7f54e00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e015f9e0 con 0x7f54e00cfa60 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e015d100 con 0x7f54e00b15b0 2024-09-13T18:58:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54e4a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e015d3e0 con 0x7f54e015cb80 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54dde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54dde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60386/0 (socket says 172.21.15.33:60386) 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54dde00640 1 -- 172.21.15.33:0/3536764619 learned_addr learned my addr 172.21.15.33:0/3536764619 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.084+0000 7f54de800640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54e00b15b0 0x7f54e01f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54df200640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e015cb80 0x7f54e00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 -- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e015cb80 msgr2=0x7f54e00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e015cb80 0x7f54e00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 -- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54e00b15b0 msgr2=0x7f54e01f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54e00b15b0 0x7f54e01f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 -- 172.21.15.33:0/3536764619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8009b30 con 0x7f54e00cfa60 2024-09-13T18:58:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54dde00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e890 tx=0x7f54cc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00c940 con 0x7f54e00cfa60 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc00caa0 con 0x7f54e00cfa60 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.085+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e015d6c0 con 0x7f54e00cfa60 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.086+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00ce30 con 0x7f54e00cfa60 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.086+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e00c6b60 con 0x7f54e00cfa60 2024-09-13T18:58:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.086+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0161200 con 0x7f54e00cfa60 2024-09-13T18:58:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.087+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54cc013470 con 0x7f54e00cfa60 2024-09-13T18:58:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.088+0000 7f54d6a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.088+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f54cc089480 con 0x7f54e00cfa60 2024-09-13T18:58:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.089+0000 7f54de800640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.089+0000 7f54de800640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 0x7f54c006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54e015f630 tx=0x7f54d0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:09.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.092+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f54cc054750 con 0x7f54e00cfa60 2024-09-13T18:58:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.273+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54e00b4d40 con 0x7f54e00cfa60 2024-09-13T18:58:09.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.897+0000 7f54d6a00640 1 -- 172.21.15.33:0/3536764619 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54cc057d70 con 0x7f54e00cfa60 2024-09-13T18:58:09.901 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T18:58:09.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 msgr2=0x7f54c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 0x7f54c006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54e015f630 tx=0x7f54d0009190 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 msgr2=0x7f54e00c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e890 tx=0x7f54cc00ed50 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 shutdown_connections 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f54e015cb80 0x7f54e00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54e00cfa60 0x7f54e00c7e60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 --2- 172.21.15.33:0/3536764619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54e00b15b0 0x7f54e01f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 >> 172.21.15.33:0/3536764619 conn(0x7f54e00b41c0 msgr2=0x7f54e00b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 shutdown_connections 2024-09-13T18:58:09.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:09.900+0000 7f54e4a00640 1 -- 172.21.15.33:0/3536764619 wait complete. 2024-09-13T18:58:09.921 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:58:09.921 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:58:09.921 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:58:09.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:09.921 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:58:09.921 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:58:09.922 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:58:09.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:09.922 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:58:09.922 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:58:09.922 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:58:09.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:09.922 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:58:09.923 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:58:09.923 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:58:09.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:09.936 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:58:09.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:58:09.937 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:58:09.938 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:58:09.940 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:58:09.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:58:09.941 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:58:09.941 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:58:09.982 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:58:09.982 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:09.984 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:58:09.985 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:09.985 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:58:09.985 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:09.987 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:58:09.987 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:09.987 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:58:10.116 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T18:58:10.116 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:58:10.117 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T18:58:10.117 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:58:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.155+0000 7f9dc6c00640 1 Processor -- start 2024-09-13T18:58:10.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.155+0000 7f9dc6c00640 1 -- start start 2024-09-13T18:58:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.156+0000 7f9dc6c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9dc00b1b30 0x7f9dc00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.156+0000 7f9dc6c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dc00cba50 0x7f9dc00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.156+0000 7f9dc6c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc006ba80 con 0x7f9dc0151590 2024-09-13T18:58:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.156+0000 7f9dc6c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00cc3a0 con 0x7f9dc00b1b30 2024-09-13T18:58:10.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.156+0000 7f9dc6c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00b2270 con 0x7f9dc00cba50 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dbf400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9dc00b1b30 0x7f9dc00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dbf400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9dc00b1b30 0x7f9dc00cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60418/0 (socket says 172.21.15.33:60418) 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dbf400640 1 -- 172.21.15.33:0/2683645896 learned_addr learned my addr 172.21.15.33:0/2683645896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dc4c00640 1 --2- 172.21.15.33:0/2683645896 >> v2:172.21.15.103:3300/0 conn(0x7f9dc00cba50 0x7f9dc00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dbf400640 1 -- 172.21.15.33:0/2683645896 >> v2:172.21.15.103:3300/0 conn(0x7f9dc00cba50 msgr2=0x7f9dc00cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.157+0000 7f9dbf400640 1 --2- 172.21.15.33:0/2683645896 >> v2:172.21.15.103:3300/0 conn(0x7f9dc00cba50 0x7f9dc00cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.158+0000 7f9dbf400640 1 -- 172.21.15.33:0/2683645896 >> v1:172.21.15.33:6789/0 conn(0x7f9dc0151590 legacy=0x7f9dc006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:10.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.158+0000 7f9dbf400640 1 -- 172.21.15.33:0/2683645896 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00b2550 con 0x7f9dc00b1b30 2024-09-13T18:58:10.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.159+0000 7f9dbf400640 1 --2- 172.21.15.33:0/2683645896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00b1b30 0x7f9dc00cdda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9dc015aab0 tx=0x7f9dac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca46b6d0a818c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:10.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.161+0000 7f9dbea00640 1 -- 172.21.15.33:0/2683645896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac032440 con 0x7f9dc00b1b30 2024-09-13T18:58:10.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.162+0000 7f9dbea00640 1 -- 172.21.15.33:0/2683645896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0325a0 con 0x7f9dc00b1b30 2024-09-13T18:58:10.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.162+0000 7f9dbea00640 1 -- 172.21.15.33:0/2683645896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac032930 con 0x7f9dc00b1b30 2024-09-13T18:58:10.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.162+0000 7f9dc6c00640 1 -- 172.21.15.33:0/2683645896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00b1b30 msgr2=0x7f9dc00cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:10.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.162+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/2683645896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00b1b30 0x7f9dc00cdda0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9dc015aab0 tx=0x7f9dac02a230 comp rx=0 tx=0).stop 2024-09-13T18:58:10.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 -- 172.21.15.33:0/2683645896 shutdown_connections 2024-09-13T18:58:10.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/2683645896 >> v2:172.21.15.103:3300/0 conn(0x7f9dc00cba50 0x7f9dc00cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:10.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/2683645896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00b1b30 0x7f9dc00cdda0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:10.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 -- 172.21.15.33:0/2683645896 >> 172.21.15.33:0/2683645896 conn(0x7f9dc00b0510 msgr2=0x7f9dc00b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:10.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 -- 172.21.15.33:0/2683645896 shutdown_connections 2024-09-13T18:58:10.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.163+0000 7f9dc6c00640 1 -- 172.21.15.33:0/2683645896 wait complete. 2024-09-13T18:58:10.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.165+0000 7f9dc6c00640 1 Processor -- start 2024-09-13T18:58:10.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.165+0000 7f9dc6c00640 1 -- start start 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9dc00b1b30 0x7f9dc01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0151590 0x7f9dc0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc015cae0 con 0x7f9dc00cba50 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc015bc50 con 0x7f9dc0151590 2024-09-13T18:58:10.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc6c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0152b00 con 0x7f9dc00b1b30 2024-09-13T18:58:10.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dc4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0151590 0x7f9dc0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60422/0 (socket says 172.21.15.33:60422) 2024-09-13T18:58:10.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 -- 172.21.15.33:0/844493623 learned_addr learned my addr 172.21.15.33:0/844493623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:10.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbfe00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9dc00b1b30 0x7f9dc01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 -- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9dc00b1b30 msgr2=0x7f9dc01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9dc00b1b30 0x7f9dc01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 -- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0151590 msgr2=0x7f9dc0070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0151590 0x7f9dc0070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.166+0000 7f9dbf400640 1 -- 172.21.15.33:0/844493623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0094d0 con 0x7f9dc00cba50 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.167+0000 7f9dbf400640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.167+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac032440 con 0x7f9dc00cba50 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.167+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac030980 con 0x7f9dc00cba50 2024-09-13T18:58:10.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.167+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac030d30 con 0x7f9dc00cba50 2024-09-13T18:58:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.167+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc015be60 con 0x7f9dc00cba50 2024-09-13T18:58:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.168+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc015c420 con 0x7f9dc00cba50 2024-09-13T18:58:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.169+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc015cc20 con 0x7f9dc00cba50 2024-09-13T18:58:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.170+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9dac039040 con 0x7f9dc00cba50 2024-09-13T18:58:10.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.170+0000 7f9db7e00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 0x7f9da006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:10.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.170+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9dac0a99c0 con 0x7f9dc00cba50 2024-09-13T18:58:10.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.171+0000 7f9dbfe00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 0x7f9da006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:10.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.172+0000 7f9dbfe00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 0x7f9da006d110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.175+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9dc015cc20 con 0x7f9dc00cba50 2024-09-13T18:58:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:10.370+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9dc015cc20 con 0x7f9dc00cba50 2024-09-13T18:58:11.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.164+0000 7f9db7e00640 1 -- 172.21.15.33:0/844493623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9dc015cc20 con 0x7f9dc00cba50 2024-09-13T18:58:11.168 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 msgr2=0x7f9da006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 0x7f9da006d110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0009060 comp rx=0 tx=0).stop 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 msgr2=0x7f9dc01f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 shutdown_connections 2024-09-13T18:58:11.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9da006ac50 0x7f9da006d110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0151590 0x7f9dc0070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dc00cba50 0x7f9dc01f6230 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 --2- 172.21.15.33:0/844493623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9dc00b1b30 0x7f9dc01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.167+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 >> 172.21.15.33:0/844493623 conn(0x7f9dc00b0510 msgr2=0x7f9dc014e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.168+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 shutdown_connections 2024-09-13T18:58:11.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.168+0000 7f9dc6c00640 1 -- 172.21.15.33:0/844493623 wait complete. 2024-09-13T18:58:11.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:58:11.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.348+0000 7ff1c7c00640 1 Processor -- start 2024-09-13T18:58:11.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.348+0000 7ff1c7c00640 1 -- start start 2024-09-13T18:58:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.349+0000 7ff1c7c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.349+0000 7ff1c7c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1c00b1b00 0x7ff1c00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1c7c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c006bc00 con 0x7ff1c00cde50 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1c7c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c006bea0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1c7c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c006c180 con 0x7ff1c015a520 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1c00b1b00 0x7ff1c00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1c00b1b00 0x7ff1c00cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60432/0 (socket says 172.21.15.33:60432) 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 -- 172.21.15.33:0/1482941332 learned_addr learned my addr 172.21.15.33:0/1482941332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1c5200640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 -- 172.21.15.33:0/1482941332 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 msgr2=0x7ff1c006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 -- 172.21.15.33:0/1482941332 >> v1:172.21.15.103:6789/0 conn(0x7ff1c00cde50 legacy=0x7ff1c00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.350+0000 7ff1bfe00640 1 -- 172.21.15.33:0/1482941332 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c006c460 con 0x7ff1c00b1b00 2024-09-13T18:58:11.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.351+0000 7ff1bfe00640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c00cd910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0098a0 tx=0x7ff1ac02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ddc6de56e06889 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1bf400640 1 -- 172.21.15.33:0/1482941332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac032440 con 0x7ff1c00b1b00 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1bf400640 1 -- 172.21.15.33:0/1482941332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0325a0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1bf400640 1 -- 172.21.15.33:0/1482941332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac032930 con 0x7ff1c00b1b00 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1482941332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 msgr2=0x7ff1c00cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c00cd910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0098a0 tx=0x7ff1ac02a290 comp rx=0 tx=0).stop 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1482941332 shutdown_connections 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c00cd910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1482941332 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1482941332 >> 172.21.15.33:0/1482941332 conn(0x7ff1c00b0510 msgr2=0x7ff1c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1482941332 shutdown_connections 2024-09-13T18:58:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.352+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1482941332 wait complete. 2024-09-13T18:58:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.354+0000 7ff1c7c00640 1 Processor -- start 2024-09-13T18:58:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.354+0000 7ff1c7c00640 1 -- start start 2024-09-13T18:58:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1c00cde50 0x7ff1c0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c01461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0154070 con 0x7ff1c00b1b00 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0146700 con 0x7ff1c00cde50 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c7c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0150c60 con 0x7ff1c015a520 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60438/0 (socket says 172.21.15.33:60438) 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c5200640 1 -- 172.21.15.33:0/1445158747 learned_addr learned my addr 172.21.15.33:0/1445158747 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1bfe00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1c00cde50 0x7ff1c0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.355+0000 7ff1c5c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c01461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 -- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 msgr2=0x7ff1c01461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c01461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 -- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1c00cde50 msgr2=0x7ff1c0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1c00cde50 0x7ff1c0153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 -- 172.21.15.33:0/1445158747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0094d0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c5200640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e870 tx=0x7ff1b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40094f0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400c940 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400ccf0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c0150f40 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.356+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c01f25c0 con 0x7ff1c00b1b00 2024-09-13T18:58:11.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.357+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00ad420 con 0x7ff1c00b1b00 2024-09-13T18:58:11.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.358+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff1b4013470 con 0x7ff1c00b1b00 2024-09-13T18:58:11.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.359+0000 7ff1bcc00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 0x7ff1a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.359+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1b4089130 con 0x7ff1c00b1b00 2024-09-13T18:58:11.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.359+0000 7ff1bfe00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 0x7ff1a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.360+0000 7ff1bfe00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 0x7ff1a006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac034000 tx=0x7ff1ac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.363+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff1b4054670 con 0x7ff1c00b1b00 2024-09-13T18:58:11.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:58:11.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:58:11.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.613+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff1c00cad50 con 0x7ff1c00b1b00 2024-09-13T18:58:11.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.613+0000 7ff1bcc00640 1 -- 172.21.15.33:0/1445158747 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff1b4057c90 con 0x7ff1c00b1b00 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T18:58:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T18:58:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T18:58:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T18:58:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mds", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRmg4LVEBAAJr5anGGPMlaaPxLFy94COQ==", 2024-09-13T18:58:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRmKozVEBAAfEa9SgwO1NawDih6RLtGGg==", 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-osd", 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRmcZXVEBAAV8FxsfRLBiHonBcq+GkhHw==", 2024-09-13T18:58:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRm/J3VEBAA41IO9wxyzfuJJn6zLXSXlg==", 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRmaqbVEBAAy57Kg96TbFw3w91nE1n/iA==", 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDyiuRmKK/VEBAAu1oWxE3ZHesSR2PA4N9Q1Q==", 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:58:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T18:58:11.634 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:58:11.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 msgr2=0x7ff1a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 0x7ff1a006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac034000 tx=0x7ff1ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:11.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 msgr2=0x7ff1c01f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e870 tx=0x7ff1b400ed30 comp rx=0 tx=0).stop 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 shutdown_connections 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff1a006ac00 0x7ff1a006d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff1c015a520 0x7ff1c01461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1c00cde50 0x7ff1c0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 --2- 172.21.15.33:0/1445158747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1c00b1b00 0x7ff1c01f2dc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.615+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 >> 172.21.15.33:0/1445158747 conn(0x7ff1c00b0510 msgr2=0x7ff1c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.616+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 shutdown_connections 2024-09-13T18:58:11.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.616+0000 7ff1c7c00640 1 -- 172.21.15.33:0/1445158747 wait complete. 2024-09-13T18:58:11.637 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T18:58:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.790+0000 7f2a7fc00640 1 Processor -- start 2024-09-13T18:58:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.790+0000 7f2a7fc00640 1 -- start start 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7fc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a7815a520 0x7f2a7806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7fc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2a780ce020 0x7f2a7815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7fc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7806bc00 con 0x7f2a780b1b00 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7fc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7806bea0 con 0x7f2a780ce020 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7fc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7806c180 con 0x7f2a7815a520 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a7dc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2a780ce020 0x7f2a7815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a6fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2a780b1b00 0x7f2a780cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42226/0 (socket says 172.21.15.33:42226) 2024-09-13T18:58:11.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.791+0000 7f2a6fe00640 1 -- 172.21.15.33:0/1245622813 learned_addr learned my addr 172.21.15.33:0/1245622813 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:11.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.792+0000 7f2a7d200640 1 --2- 172.21.15.33:0/1245622813 >> v2:172.21.15.103:3300/0 conn(0x7f2a7815a520 0x7f2a7806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.792+0000 7f2a7dc00640 1 -- 172.21.15.33:0/1245622813 >> v2:172.21.15.103:3300/0 conn(0x7f2a7815a520 msgr2=0x7f2a7806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:11.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.792+0000 7f2a7dc00640 1 --2- 172.21.15.33:0/1245622813 >> v2:172.21.15.103:3300/0 conn(0x7f2a7815a520 0x7f2a7806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.792+0000 7f2a7dc00640 1 -- 172.21.15.33:0/1245622813 >> v1:172.21.15.33:6789/0 conn(0x7f2a780b1b00 legacy=0x7f2a780cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.792+0000 7f2a7dc00640 1 -- 172.21.15.33:0/1245622813 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7806c460 con 0x7f2a780ce020 2024-09-13T18:58:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.793+0000 7f2a7dc00640 1 --2- 172.21.15.33:0/1245622813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7815a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a780b14f0 tx=0x7f2a7002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80836bc4665c67c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.793+0000 7f2a77e00640 1 -- 172.21.15.33:0/1245622813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7002aea0 con 0x7f2a780ce020 2024-09-13T18:58:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.793+0000 7f2a77e00640 1 -- 172.21.15.33:0/1245622813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7002d050 con 0x7f2a780ce020 2024-09-13T18:58:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.793+0000 7f2a77e00640 1 -- 172.21.15.33:0/1245622813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70007960 con 0x7f2a780ce020 2024-09-13T18:58:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 -- 172.21.15.33:0/1245622813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 msgr2=0x7f2a7815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/1245622813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7815a900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a780b14f0 tx=0x7f2a7002a680 comp rx=0 tx=0).stop 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 -- 172.21.15.33:0/1245622813 shutdown_connections 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/1245622813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7815a900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/1245622813 >> v2:172.21.15.103:3300/0 conn(0x7f2a7815a520 0x7f2a7806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 -- 172.21.15.33:0/1245622813 >> 172.21.15.33:0/1245622813 conn(0x7f2a780b0510 msgr2=0x7f2a780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 -- 172.21.15.33:0/1245622813 shutdown_connections 2024-09-13T18:58:11.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.794+0000 7f2a7fc00640 1 -- 172.21.15.33:0/1245622813 wait complete. 2024-09-13T18:58:11.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.796+0000 7f2a7fc00640 1 Processor -- start 2024-09-13T18:58:11.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.796+0000 7f2a7fc00640 1 -- start start 2024-09-13T18:58:11.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a780b1b00 0x7f2a781568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a7815a520 0x7f2a780cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7814a6b0 con 0x7f2a780ce020 2024-09-13T18:58:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78151b20 con 0x7f2a7815a520 2024-09-13T18:58:11.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78151e00 con 0x7f2a780b1b00 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60452/0 (socket says 172.21.15.33:60452) 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 -- 172.21.15.33:0/321909361 learned_addr learned my addr 172.21.15.33:0/321909361 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7d200640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a780b1b00 0x7f2a781568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a7dc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a7815a520 0x7f2a780cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 -- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a780b1b00 msgr2=0x7f2a781568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a780b1b00 0x7f2a781568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 -- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a7815a520 msgr2=0x7f2a780cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a7815a520 0x7f2a780cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.797+0000 7f2a6fe00640 1 -- 172.21.15.33:0/321909361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009a70 con 0x7f2a780ce020 2024-09-13T18:58:11.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a6fe00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000c4a0 tx=0x7f2a6000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60005ce0 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a60005e40 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60007270 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a781520e0 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.798+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a781526a0 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.799+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7815b980 con 0x7f2a780ce020 2024-09-13T18:58:11.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.800+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a60007490 con 0x7f2a780ce020 2024-09-13T18:58:11.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.801+0000 7f2a75600640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 0x7f2a5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:11.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.801+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a600884f0 con 0x7f2a780ce020 2024-09-13T18:58:11.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.801+0000 7f2a7d200640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 0x7f2a5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:11.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.802+0000 7f2a7d200640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 0x7f2a5406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a781f5ae0 tx=0x7f2a68009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:11.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:11.805+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a7815b980 con 0x7f2a780ce020 2024-09-13T18:58:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.059+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2a7815b980 con 0x7f2a780ce020 2024-09-13T18:58:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.062+0000 7f2a75600640 1 -- 172.21.15.33:0/321909361 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2a7815b980 con 0x7f2a780ce020 2024-09-13T18:58:12.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 msgr2=0x7f2a5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 0x7f2a5406d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a781f5ae0 tx=0x7f2a68009190 comp rx=0 tx=0).stop 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 msgr2=0x7f2a7814a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000c4a0 tx=0x7f2a6000c960 comp rx=0 tx=0).stop 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 shutdown_connections 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a5406ac00 0x7f2a5406d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a7815a520 0x7f2a780cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a780ce020 0x7f2a7814a170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 --2- 172.21.15.33:0/321909361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a780b1b00 0x7f2a781568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 >> 172.21.15.33:0/321909361 conn(0x7f2a780b0510 msgr2=0x7f2a78158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 shutdown_connections 2024-09-13T18:58:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.065+0000 7f2a7fc00640 1 -- 172.21.15.33:0/321909361 wait complete. 2024-09-13T18:58:12.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T18:58:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.238+0000 7f364b800640 1 Processor -- start 2024-09-13T18:58:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.238+0000 7f364b800640 1 -- start start 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.239+0000 7f364b800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f364406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.239+0000 7f364b800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36440b1b00 0x7f36440cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.239+0000 7f364b800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364406bc00 con 0x7f36440cde50 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.239+0000 7f364b800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364406bea0 con 0x7f36440b1b00 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.239+0000 7f364b800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364406c180 con 0x7f364415a520 2024-09-13T18:58:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36440b1b00 0x7f36440cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36440b1b00 0x7f36440cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60454/0 (socket says 172.21.15.33:60454) 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 -- 172.21.15.33:0/279332661 learned_addr learned my addr 172.21.15.33:0/279332661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3648e00640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f364406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 -- 172.21.15.33:0/279332661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 msgr2=0x7f364406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f364406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 -- 172.21.15.33:0/279332661 >> v1:172.21.15.103:6789/0 conn(0x7f36440cde50 legacy=0x7f36440b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3643e00640 1 -- 172.21.15.33:0/279332661 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364406c460 con 0x7f36440b1b00 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.240+0000 7f3648e00640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f364406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.241+0000 7f3643e00640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440b1b00 0x7f36440cd910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f36300098a0 tx=0x7f363002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817fbc634c556dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.241+0000 7f3643400640 1 -- 172.21.15.33:0/279332661 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630032440 con 0x7f36440b1b00 2024-09-13T18:58:12.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.241+0000 7f3643400640 1 -- 172.21.15.33:0/279332661 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300325a0 con 0x7f36440b1b00 2024-09-13T18:58:12.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.241+0000 7f3643400640 1 -- 172.21.15.33:0/279332661 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630032930 con 0x7f36440b1b00 2024-09-13T18:58:12.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 -- 172.21.15.33:0/279332661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440b1b00 msgr2=0x7f36440cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440b1b00 0x7f36440cd910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f36300098a0 tx=0x7f363002a290 comp rx=0 tx=0).stop 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 -- 172.21.15.33:0/279332661 shutdown_connections 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440b1b00 0x7f36440cd910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 --2- 172.21.15.33:0/279332661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f364406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 -- 172.21.15.33:0/279332661 >> 172.21.15.33:0/279332661 conn(0x7f36440b0510 msgr2=0x7f36440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 -- 172.21.15.33:0/279332661 shutdown_connections 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.242+0000 7f364b800640 1 -- 172.21.15.33:0/279332661 wait complete. 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.244+0000 7f364b800640 1 Processor -- start 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.244+0000 7f364b800640 1 -- start start 2024-09-13T18:58:12.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440b1b00 0x7f36441f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f36441461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644154070 con 0x7f36440cde50 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644146700 con 0x7f36440b1b00 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f364b800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3644150c60 con 0x7f364415a520 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f3643e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f3643e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60468/0 (socket says 172.21.15.33:60468) 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f3643e00640 1 -- 172.21.15.33:0/1580604836 learned_addr learned my addr 172.21.15.33:0/1580604836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:12.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f3648e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440b1b00 0x7f36441f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.245+0000 7f3649800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f36441461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 -- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 msgr2=0x7f36441461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f36441461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 -- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440b1b00 msgr2=0x7f36441f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440b1b00 0x7f36441f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 -- 172.21.15.33:0/1580604836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300094d0 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3643e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3630000c00 tx=0x7f36300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630032440 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630030b80 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363003d440 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3644150f40 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.246+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36441f25c0 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.247+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440cd910 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.248+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3630039040 con 0x7f36440cde50 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.249+0000 7f3640c00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 0x7f362406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.249+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f36300a9a90 con 0x7f36440cde50 2024-09-13T18:58:12.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.250+0000 7f3648e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 0x7f362406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.250+0000 7f3648e00640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 0x7f362406d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3638006fd0 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.253+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3630074fd0 con 0x7f36440cde50 2024-09-13T18:58:12.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.498+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f36440ad420 con 0x7f36440cde50 2024-09-13T18:58:12.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.502+0000 7f3640c00640 1 -- 172.21.15.33:0/1580604836 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f36300785f0 con 0x7f36440cde50 2024-09-13T18:58:12.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 msgr2=0x7f362406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 0x7f362406d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3638006fd0 tx=0x7f3638008040 comp rx=0 tx=0).stop 2024-09-13T18:58:12.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 msgr2=0x7f3644153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3630000c00 tx=0x7f36300046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 shutdown_connections 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f362406ac00 0x7f362406d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f364415a520 0x7f36441461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440cde50 0x7f3644153b30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 --2- 172.21.15.33:0/1580604836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36440b1b00 0x7f36441f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 >> 172.21.15.33:0/1580604836 conn(0x7f36440b0510 msgr2=0x7f36440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 shutdown_connections 2024-09-13T18:58:12.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.505+0000 7f364b800640 1 -- 172.21.15.33:0/1580604836 wait complete. 2024-09-13T18:58:12.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T18:58:12.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.676+0000 7efc7b200640 1 Processor -- start 2024-09-13T18:58:12.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.676+0000 7efc7b200640 1 -- start start 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.677+0000 7efc7b200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efc7415a520 0x7efc7406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.677+0000 7efc7b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740b1b00 0x7efc740cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.677+0000 7efc7b200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7406bc00 con 0x7efc740cde50 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc7b200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7406bea0 con 0x7efc7415a520 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc7b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7406c180 con 0x7efc740b1b00 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efc7415a520 0x7efc7406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc79200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efc740cde50 0x7efc740b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42242/0 (socket says 172.21.15.33:42242) 2024-09-13T18:58:12.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc79200640 1 -- 172.21.15.33:0/2316220535 learned_addr learned my addr 172.21.15.33:0/2316220535 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc6be00640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740b1b00 0x7efc740cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73e00640 1 -- 172.21.15.33:0/2316220535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740b1b00 msgr2=0x7efc740cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73e00640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740b1b00 0x7efc740cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73e00640 1 -- 172.21.15.33:0/2316220535 >> v1:172.21.15.33:6789/0 conn(0x7efc740cde50 legacy=0x7efc740b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73e00640 1 -- 172.21.15.33:0/2316220535 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7406c460 con 0x7efc7415a520 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.678+0000 7efc73400640 1 -- 172.21.15.33:0/2316220535 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688747855 0 0) 0x7efc7406bc00 con 0x7efc740cde50 2024-09-13T18:58:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.679+0000 7efc73e00640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc7406b6c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc640097d0 tx=0x7efc6402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c209a2ed068c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc73400640 1 -- 172.21.15.33:0/2316220535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64032440 con 0x7efc7415a520 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc73400640 1 -- 172.21.15.33:0/2316220535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640325a0 con 0x7efc7415a520 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc73400640 1 -- 172.21.15.33:0/2316220535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64032930 con 0x7efc7415a520 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 -- 172.21.15.33:0/2316220535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 msgr2=0x7efc7406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc7406b6c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc640097d0 tx=0x7efc6402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 -- 172.21.15.33:0/2316220535 shutdown_connections 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740b1b00 0x7efc740cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 --2- 172.21.15.33:0/2316220535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc7406b6c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 -- 172.21.15.33:0/2316220535 >> 172.21.15.33:0/2316220535 conn(0x7efc740b0510 msgr2=0x7efc740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 -- 172.21.15.33:0/2316220535 shutdown_connections 2024-09-13T18:58:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.680+0000 7efc7b200640 1 -- 172.21.15.33:0/2316220535 wait complete. 2024-09-13T18:58:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.682+0000 7efc7b200640 1 Processor -- start 2024-09-13T18:58:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.682+0000 7efc7b200640 1 -- start start 2024-09-13T18:58:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc740b1b00 0x7efc7415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740cde50 0x7efc740acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ad300 con 0x7efc7415a520 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741f1110 con 0x7efc740b1b00 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc7b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7415b950 con 0x7efc740cde50 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc79200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc79200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60496/0 (socket says 172.21.15.33:60496) 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc79200640 1 -- 172.21.15.33:0/2340317593 learned_addr learned my addr 172.21.15.33:0/2340317593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc6be00640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740cde50 0x7efc740acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.683+0000 7efc73e00640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc740b1b00 0x7efc7415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 -- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740cde50 msgr2=0x7efc740acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740cde50 0x7efc740acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 -- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc740b1b00 msgr2=0x7efc7415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc740b1b00 0x7efc7415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 -- 172.21.15.33:0/2340317593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009400 con 0x7efc7415a520 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc79200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c7e0 tx=0x7efc6c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00a640 con 0x7efc7415a520 2024-09-13T18:58:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c00a7c0 con 0x7efc7415a520 2024-09-13T18:58:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00ab70 con 0x7efc7415a520 2024-09-13T18:58:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7415da20 con 0x7efc7415a520 2024-09-13T18:58:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.684+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc741f1360 con 0x7efc7415a520 2024-09-13T18:58:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.685+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc741f1580 con 0x7efc7415a520 2024-09-13T18:58:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.686+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc6c00acd0 con 0x7efc7415a520 2024-09-13T18:58:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.687+0000 7efc70c00640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 0x7efc5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.687+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc6c088550 con 0x7efc7415a520 2024-09-13T18:58:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.688+0000 7efc73e00640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 0x7efc5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.688+0000 7efc73e00640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 0x7efc5006d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc6402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:12.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.692+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc6c053b20 con 0x7efc7415a520 2024-09-13T18:58:12.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.944+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efc740cd910 con 0x7efc7415a520 2024-09-13T18:58:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.949+0000 7efc70c00640 1 -- 172.21.15.33:0/2340317593 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc6c018020 con 0x7efc7415a520 2024-09-13T18:58:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 msgr2=0x7efc5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 0x7efc5006d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc6402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 msgr2=0x7efc74154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c7e0 tx=0x7efc6c00cca0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 shutdown_connections 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efc5006ac00 0x7efc5006d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7415a520 0x7efc74154e80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc740cde50 0x7efc740acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 --2- 172.21.15.33:0/2340317593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc740b1b00 0x7efc7415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 >> 172.21.15.33:0/2340317593 conn(0x7efc740b0510 msgr2=0x7efc740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 shutdown_connections 2024-09-13T18:58:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:12.951+0000 7efc7b200640 1 -- 172.21.15.33:0/2340317593 wait complete. 2024-09-13T18:58:12.970 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T18:58:13.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.124+0000 7f21d3200640 1 Processor -- start 2024-09-13T18:58:13.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.124+0000 7f21d3200640 1 -- start start 2024-09-13T18:58:13.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21d40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d3200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40cd850 con 0x7f21d4071560 2024-09-13T18:58:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d3200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40cd570 con 0x7f21d4159480 2024-09-13T18:58:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b1740 con 0x7f21d406f4b0 2024-09-13T18:58:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d1400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21d4071560 0x7f21d40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58742/0 (socket says 172.21.15.33:58742) 2024-09-13T18:58:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.125+0000 7f21d1400640 1 -- 172.21.15.33:0/140552211 learned_addr learned my addr 172.21.15.33:0/140552211 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d2800640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21d40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912245354 0 0) 0x7f21d40cd850 con 0x7f21d4071560 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8003520 con 0x7f21d4071560 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350355206 0 0) 0x7f21d40cd570 con 0x7f21d4159480 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d40cd850 con 0x7f21d4159480 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628121105 0 0) 0x7f21b8003520 con 0x7f21d4071560 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 msgr2=0x7f21d40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21d40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 >> v1:172.21.15.103:6789/0 conn(0x7f21d4159480 legacy=0x7f21d4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40b1a20 con 0x7f21d4071560 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f21c0001670 con 0x7f21d4071560 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 >> v1:172.21.15.33:6789/0 conn(0x7f21d4071560 legacy=0x7f21d40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.126+0000 7f21d0a00640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b80040e0 0x7f21b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d0a00640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b1740 con 0x7f21b80040e0 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b800bb40 con 0x7f21b8004d00 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b800bd00 con 0x7f21d406f4b0 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b80040e0 0x7f21b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1e00640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d2800640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 -- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 msgr2=0x7f21b8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:13.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21d406f4b0 0x7f21b8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 -- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b8004d00 msgr2=0x7f21b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:13.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.127+0000 7f21d1400640 1 -- 172.21.15.33:0/140552211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8003520 con 0x7f21b80040e0 2024-09-13T18:58:13.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.128+0000 7f21d1400640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b80040e0 0x7f21b80047c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007f70 tx=0x7f21b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17c63f7b51ff369 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.128+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0005ad0 con 0x7f21b80040e0 2024-09-13T18:58:13.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.128+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c002d070 con 0x7f21b80040e0 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.128+0000 7f21d0a00640 1 -- 172.21.15.33:0/140552211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0007070 con 0x7f21b80040e0 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 -- 172.21.15.33:0/140552211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b80040e0 msgr2=0x7f21b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 --2- 172.21.15.33:0/140552211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b80040e0 0x7f21b80047c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007f70 tx=0x7f21b80057f0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d2800640 1 -- 172.21.15.33:0/140552211 reap_dead start 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 -- 172.21.15.33:0/140552211 shutdown_connections 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 -- 172.21.15.33:0/140552211 >> 172.21.15.33:0/140552211 conn(0x7f21d40ae310 msgr2=0x7f21d40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 -- 172.21.15.33:0/140552211 shutdown_connections 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.129+0000 7f21d3200640 1 -- 172.21.15.33:0/140552211 wait complete. 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.131+0000 7f21d3200640 1 Processor -- start 2024-09-13T18:58:13.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.131+0000 7f21d3200640 1 -- start start 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21b80040e0 0x7f21d41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41557c0 0x7f21d41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40ad230 con 0x7f21d40ac870 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4159900 con 0x7f21d41557c0 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41578f0 con 0x7f21b80040e0 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34484/0 (socket says 172.21.15.33:34484) 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d1e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21b80040e0 0x7f21d41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d2800640 1 -- 172.21.15.33:0/2083142633 learned_addr learned my addr 172.21.15.33:0/2083142633 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.132+0000 7f21d1400640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41557c0 0x7f21d41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 -- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21b80040e0 msgr2=0x7f21d41573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21b80040e0 0x7f21d41573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 -- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41557c0 msgr2=0x7f21d41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41557c0 0x7f21d41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 -- 172.21.15.33:0/2083142633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d4157b90 con 0x7f21d40ac870 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d2800640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21d404ebc0 tx=0x7f21cc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00e040 con 0x7f21d40ac870 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc00f040 con 0x7f21d40ac870 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc015430 con 0x7f21d40ac870 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4157e70 con 0x7f21d40ac870 2024-09-13T18:58:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.133+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4158430 con 0x7f21d40ac870 2024-09-13T18:58:13.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.134+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4067360 con 0x7f21d40ac870 2024-09-13T18:58:13.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.135+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21cc015590 con 0x7f21d40ac870 2024-09-13T18:58:13.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.137+0000 7f21ca000640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 0x7f21b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.137+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f21cc089610 con 0x7f21d40ac870 2024-09-13T18:58:13.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.137+0000 7f21d1e00640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 0x7f21b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.138+0000 7f21d1e00640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 0x7f21b406d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000c00 tx=0x7f21c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.141+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21cc054b50 con 0x7f21d40ac870 2024-09-13T18:58:13.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.384+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f21d40b4530 con 0x7f21d40ac870 2024-09-13T18:58:13.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.389+0000 7f21ca000640 1 -- 172.21.15.33:0/2083142633 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f21cc058170 con 0x7f21d40ac870 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 msgr2=0x7f21b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 0x7f21b406d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f21c4000c00 tx=0x7f21c4009040 comp rx=0 tx=0).stop 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 msgr2=0x7f21d40accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21d404ebc0 tx=0x7f21cc00f580 comp rx=0 tx=0).stop 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 shutdown_connections 2024-09-13T18:58:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f21b406ac00 0x7f21b406d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d40ac870 0x7f21d40accf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41557c0 0x7f21d41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 --2- 172.21.15.33:0/2083142633 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21b80040e0 0x7f21d41573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 >> 172.21.15.33:0/2083142633 conn(0x7f21d40ae310 msgr2=0x7f21d406cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 shutdown_connections 2024-09-13T18:58:13.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.392+0000 7f21d3200640 1 -- 172.21.15.33:0/2083142633 wait complete. 2024-09-13T18:58:13.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T18:58:13.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.563+0000 7f5d8f200640 1 Processor -- start 2024-09-13T18:58:13.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.564+0000 7f5d8f200640 1 -- start start 2024-09-13T18:58:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8f200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d900b40c0 0x7f5d9015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d9015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d900cbfc0 con 0x7f5d9015a5c0 2024-09-13T18:58:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8f200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900cce20 con 0x7f5d900b40c0 2024-09-13T18:58:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900707a0 con 0x7f5d900cbac0 2024-09-13T18:58:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8de00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5d9015a5c0 0x7f5d900b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58758/0 (socket says 172.21.15.33:58758) 2024-09-13T18:58:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8de00640 1 -- 172.21.15.33:0/3783282888 learned_addr learned my addr 172.21.15.33:0/3783282888 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d85400640 1 --2- 172.21.15.33:0/3783282888 >> v2:172.21.15.103:3300/0 conn(0x7f5d900b40c0 0x7f5d9015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.565+0000 7f5d8e800640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d9015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d8d400640 1 -- 172.21.15.33:0/3783282888 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229366526 0 0) 0x7f5d900cbfc0 con 0x7f5d9015a5c0 2024-09-13T18:58:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d8d400640 1 -- 172.21.15.33:0/3783282888 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d74003520 con 0x7f5d9015a5c0 2024-09-13T18:58:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d85400640 1 -- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 msgr2=0x7f5d9015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d85400640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d9015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d85400640 1 -- 172.21.15.33:0/3783282888 >> v1:172.21.15.33:6789/0 conn(0x7f5d9015a5c0 legacy=0x7f5d900b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.566+0000 7f5d85400640 1 -- 172.21.15.33:0/3783282888 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d90070a80 con 0x7f5d900b40c0 2024-09-13T18:58:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.567+0000 7f5d85400640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d9015a9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5d780097a0 tx=0x7f5d7802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d66363dcd4fd4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.567+0000 7f5d8d400640 1 -- 172.21.15.33:0/3783282888 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78032440 con 0x7f5d900b40c0 2024-09-13T18:58:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.567+0000 7f5d8d400640 1 -- 172.21.15.33:0/3783282888 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d780325a0 con 0x7f5d900b40c0 2024-09-13T18:58:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.567+0000 7f5d8d400640 1 -- 172.21.15.33:0/3783282888 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78032910 con 0x7f5d900b40c0 2024-09-13T18:58:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 -- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 msgr2=0x7f5d9015a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d9015a9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5d780097a0 tx=0x7f5d7802a180 comp rx=0 tx=0).stop 2024-09-13T18:58:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 -- 172.21.15.33:0/3783282888 shutdown_connections 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d9015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 --2- 172.21.15.33:0/3783282888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d9015a9a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 -- 172.21.15.33:0/3783282888 >> 172.21.15.33:0/3783282888 conn(0x7f5d900ae310 msgr2=0x7f5d900ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 -- 172.21.15.33:0/3783282888 shutdown_connections 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.568+0000 7f5d8f200640 1 -- 172.21.15.33:0/3783282888 wait complete. 2024-09-13T18:58:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.570+0000 7f5d8f200640 1 Processor -- start 2024-09-13T18:58:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.570+0000 7f5d8f200640 1 -- start start 2024-09-13T18:58:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d901ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d901f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901efa00 con 0x7f5d9015a5c0 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90141c10 con 0x7f5d900b40c0 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901f3b20 con 0x7f5d900cbac0 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34488/0 (socket says 172.21.15.33:34488) 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 -- 172.21.15.33:0/1389823340 learned_addr learned my addr 172.21.15.33:0/1389823340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d85400640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d901f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8de00640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d901ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 -- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 msgr2=0x7f5d901f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d901f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 -- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 msgr2=0x7f5d901ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d901ef4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.571+0000 7f5d8e800640 1 -- 172.21.15.33:0/1389823340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d78009400 con 0x7f5d9015a5c0 2024-09-13T18:58:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d8e800640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800efc0 tx=0x7f5d8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88014480 con 0x7f5d9015a5c0 2024-09-13T18:58:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800f040 con 0x7f5d9015a5c0 2024-09-13T18:58:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d901f3e00 con 0x7f5d9015a5c0 2024-09-13T18:58:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88014820 con 0x7f5d9015a5c0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.572+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d901479a0 con 0x7f5d9015a5c0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.573+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90067360 con 0x7f5d9015a5c0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.574+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d88014980 con 0x7f5d9015a5c0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.575+0000 7f5d86a00640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 0x7f5d6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.575+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d88089fe0 con 0x7f5d9015a5c0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.575+0000 7f5d8de00640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 0x7f5d6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.576+0000 7f5d8de00640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 0x7f5d6c06d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d80005880 tx=0x7f5d80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:13.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.579+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5d88055470 con 0x7f5d9015a5c0 2024-09-13T18:58:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.823+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5d90141d80 con 0x7f5d9015a5c0 2024-09-13T18:58:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.828+0000 7f5d86a00640 1 -- 172.21.15.33:0/1389823340 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5d880180a0 con 0x7f5d9015a5c0 2024-09-13T18:58:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 msgr2=0x7f5d6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 0x7f5d6c06d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d80005880 tx=0x7f5d80009040 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 msgr2=0x7f5d90154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800efc0 tx=0x7f5d8800c490 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 shutdown_connections 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5d6c06ac00 0x7f5d6c06d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9015a5c0 0x7f5d90154ec0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5d900cbac0 0x7f5d901f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 --2- 172.21.15.33:0/1389823340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d900b40c0 0x7f5d901ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 >> 172.21.15.33:0/1389823340 conn(0x7f5d900ae310 msgr2=0x7f5d900cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 shutdown_connections 2024-09-13T18:58:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:13.830+0000 7f5d8f200640 1 -- 172.21.15.33:0/1389823340 wait complete. 2024-09-13T18:58:13.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T18:58:14.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.003+0000 7fd0b1400640 1 Processor -- start 2024-09-13T18:58:14.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.003+0000 7fd0b1400640 1 -- start start 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.004+0000 7fd0b1400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0ac159210 0x7fd0ac0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.004+0000 7fd0b1400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac159680 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0b1400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac15a430 con 0x7fd0ac0b3100 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0b1400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0b2930 con 0x7fd0ac159210 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0a3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0ac159210 0x7fd0ac0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0aa800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd0ac0b1e40 0x7fd0ac0b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58768/0 (socket says 172.21.15.33:58768) 2024-09-13T18:58:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0aa800640 1 -- 172.21.15.33:0/4033436334 learned_addr learned my addr 172.21.15.33:0/4033436334 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0a3e00640 1 -- 172.21.15.33:0/4033436334 >> v1:172.21.15.103:6789/0 conn(0x7fd0ac0b3100 legacy=0x7fd0ac070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0a3e00640 1 -- 172.21.15.33:0/4033436334 >> v1:172.21.15.33:6789/0 conn(0x7fd0ac0b1e40 legacy=0x7fd0ac0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0a3e00640 1 -- 172.21.15.33:0/4033436334 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0b3520 con 0x7fd0ac159210 2024-09-13T18:58:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.005+0000 7fd0a9e00640 1 -- 172.21.15.33:0/4033436334 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136390315 0 0) 0x7fd0ac159680 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.006+0000 7fd0a3e00640 1 --2- 172.21.15.33:0/4033436334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac159210 0x7fd0ac0b2bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd0940097a0 tx=0x7fd09402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280bd1a41fb231c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.006+0000 7fd0a9e00640 1 -- 172.21.15.33:0/4033436334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09402ae50 con 0x7fd0ac159210 2024-09-13T18:58:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0a9e00640 1 -- 172.21.15.33:0/4033436334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094032440 con 0x7fd0ac159210 2024-09-13T18:58:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0a9e00640 1 -- 172.21.15.33:0/4033436334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0940327d0 con 0x7fd0ac159210 2024-09-13T18:58:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 -- 172.21.15.33:0/4033436334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac159210 msgr2=0x7fd0ac0b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 --2- 172.21.15.33:0/4033436334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac159210 0x7fd0ac0b2bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd0940097a0 tx=0x7fd09402a140 comp rx=0 tx=0).stop 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 -- 172.21.15.33:0/4033436334 shutdown_connections 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 --2- 172.21.15.33:0/4033436334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac159210 0x7fd0ac0b2bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 -- 172.21.15.33:0/4033436334 >> 172.21.15.33:0/4033436334 conn(0x7fd0ac0b0510 msgr2=0x7fd0ac0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 -- 172.21.15.33:0/4033436334 shutdown_connections 2024-09-13T18:58:14.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.007+0000 7fd0b1400640 1 -- 172.21.15.33:0/4033436334 wait complete. 2024-09-13T18:58:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.009+0000 7fd0b1400640 1 Processor -- start 2024-09-13T18:58:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.009+0000 7fd0b1400640 1 -- start start 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0ac0b3100 0x7fd0ac166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0ac159210 0x7fd0ac13b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0acf60 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac1f02e0 con 0x7fd0ac0b3100 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0b1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac1f05c0 con 0x7fd0ac159210 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0aa800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0aa800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34504/0 (socket says 172.21.15.33:34504) 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0ac0b3100 0x7fd0ac166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0aa800640 1 -- 172.21.15.33:0/941473352 learned_addr learned my addr 172.21.15.33:0/941473352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.010+0000 7fd0ab200640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0ac159210 0x7fd0ac13b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 -- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0ac159210 msgr2=0x7fd0ac13b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0ac159210 0x7fd0ac13b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 -- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0ac0b3100 msgr2=0x7fd0ac166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0ac0b3100 0x7fd0ac166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 -- 172.21.15.33:0/941473352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009400 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0aa800640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c430 tx=0x7fd09c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0074e0 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c007660 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c004a20 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac1f08a0 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.011+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac156d70 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.012+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac156f90 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.013+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd09c004b80 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.014+0000 7fd0a2a00640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.014+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd09c088d60 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.015+0000 7fd0a3e00640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.015+0000 7fd0a3e00640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd09402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.018+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd09c0542a0 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.261+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd0ac0b2bc0 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.265+0000 7fd0a2a00640 1 -- 172.21.15.33:0/941473352 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd09c0578c0 con 0x7fd0ac0b1e40 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.267+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 msgr2=0x7fd08806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.267+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd09402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.267+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 msgr2=0x7fd0ac1efd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.267+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c430 tx=0x7fd09c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 shutdown_connections 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0ac159210 0x7fd0ac13b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0ac0b3100 0x7fd0ac166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 --2- 172.21.15.33:0/941473352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0ac0b1e40 0x7fd0ac1efd00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 >> 172.21.15.33:0/941473352 conn(0x7fd0ac0b0510 msgr2=0x7fd0ac0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 shutdown_connections 2024-09-13T18:58:14.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.268+0000 7fd0b1400640 1 -- 172.21.15.33:0/941473352 wait complete. 2024-09-13T18:58:14.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.440+0000 7fabd6800640 1 Processor -- start 2024-09-13T18:58:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.440+0000 7fabd6800640 1 -- start start 2024-09-13T18:58:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabd6800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fabd015a520 0x7fabd006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabd6800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd00ce020 0x7fabd015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabd6800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd006bc00 con 0x7fabd00b1b00 2024-09-13T18:58:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabd6800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd006bea0 con 0x7fabd015a520 2024-09-13T18:58:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabd6800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd006c180 con 0x7fabd00ce020 2024-09-13T18:58:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabcf400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fabd015a520 0x7fabd006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.441+0000 7fabcfe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd00ce020 0x7fabd015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fabd015a520 0x7fabd006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:51286/0 (socket says 172.21.15.33:51286) 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 -- 172.21.15.33:0/443585575 learned_addr learned my addr 172.21.15.33:0/443585575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 -- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd00ce020 msgr2=0x7fabd015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 --2- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd00ce020 0x7fabd015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 -- 172.21.15.33:0/443585575 >> v1:172.21.15.103:6789/0 conn(0x7fabd00b1b00 legacy=0x7fabd00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.442+0000 7fabcf400640 1 -- 172.21.15.33:0/443585575 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd006c460 con 0x7fabd015a520 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.443+0000 7fabcf400640 1 --2- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd015a520 0x7fabd006b6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009870 tx=0x7fabc002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c09fd2f8f72b7b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.443+0000 7fabcea00640 1 -- 172.21.15.33:0/443585575 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0032440 con 0x7fabd015a520 2024-09-13T18:58:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.443+0000 7fabcea00640 1 -- 172.21.15.33:0/443585575 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc00325a0 con 0x7fabd015a520 2024-09-13T18:58:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.443+0000 7fabcea00640 1 -- 172.21.15.33:0/443585575 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0032930 con 0x7fabd015a520 2024-09-13T18:58:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 -- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd015a520 msgr2=0x7fabd006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 --2- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd015a520 0x7fabd006b6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009870 tx=0x7fabc002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 -- 172.21.15.33:0/443585575 shutdown_connections 2024-09-13T18:58:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 --2- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd00ce020 0x7fabd015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 --2- 172.21.15.33:0/443585575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd015a520 0x7fabd006b6c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 -- 172.21.15.33:0/443585575 >> 172.21.15.33:0/443585575 conn(0x7fabd00b0510 msgr2=0x7fabd00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 -- 172.21.15.33:0/443585575 shutdown_connections 2024-09-13T18:58:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.444+0000 7fabd6800640 1 -- 172.21.15.33:0/443585575 wait complete. 2024-09-13T18:58:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.446+0000 7fabd6800640 1 Processor -- start 2024-09-13T18:58:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.446+0000 7fabd6800640 1 -- start start 2024-09-13T18:58:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd00b1b00 0x7fabd01e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd015a520 0x7fabd00aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01f5bb0 con 0x7fabd00ce020 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01546e0 con 0x7fabd00b1b00 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabd6800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01f5e00 con 0x7fabd015a520 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabc7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabc7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34514/0 (socket says 172.21.15.33:34514) 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabc7e00640 1 -- 172.21.15.33:0/1734594345 learned_addr learned my addr 172.21.15.33:0/1734594345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabcfe00640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd015a520 0x7fabd00aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.447+0000 7fabcf400640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd00b1b00 0x7fabd01e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 -- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd015a520 msgr2=0x7fabd00aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd015a520 0x7fabd00aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 -- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd00b1b00 msgr2=0x7fabd01e2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd00b1b00 0x7fabd01e2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 -- 172.21.15.33:0/1734594345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00094d0 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7e00640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c480 tx=0x7fabb800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80052d0 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8005430 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8012870 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.448+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd01f60e0 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.449+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd01f66a0 con 0x7fabd00ce020 2024-09-13T18:58:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.450+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd00adb90 con 0x7fabd00ce020 2024-09-13T18:58:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.450+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabb80129d0 con 0x7fabd00ce020 2024-09-13T18:58:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.451+0000 7fabc7400640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 0x7fabac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.451+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fabb8088a80 con 0x7fabd00ce020 2024-09-13T18:58:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.452+0000 7fabcf400640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 0x7fabac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.452+0000 7fabcf400640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 0x7fabac06d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fabc0034000 tx=0x7fabc002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.455+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabb8054050 con 0x7fabd00ce020 2024-09-13T18:58:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.633+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd015a900 con 0x7fabd00ce020 2024-09-13T18:58:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.634+0000 7fabc7400640 1 -- 172.21.15.33:0/1734594345 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12857 (secure 0 0 0) 0x7fabb8057670 con 0x7fabd00ce020 2024-09-13T18:58:14.637 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:11.161303+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 msgr2=0x7fabac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 0x7fabac06d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fabc0034000 tx=0x7fabc002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 msgr2=0x7fabd0153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c480 tx=0x7fabb800c940 comp rx=0 tx=0).stop 2024-09-13T18:58:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 shutdown_connections 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fabac06ac00 0x7fabac06d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fabd015a520 0x7fabd00aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabd00ce020 0x7fabd0153ba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 --2- 172.21.15.33:0/1734594345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd00b1b00 0x7fabd01e2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 >> 172.21.15.33:0/1734594345 conn(0x7fabd00b0510 msgr2=0x7fabd00708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 shutdown_connections 2024-09-13T18:58:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.636+0000 7fabd6800640 1 -- 172.21.15.33:0/1734594345 wait complete. 2024-09-13T18:58:14.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:14.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:14.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.811+0000 7f072ce00640 1 Processor -- start 2024-09-13T18:58:14.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.811+0000 7f072ce00640 1 -- start start 2024-09-13T18:58:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.812+0000 7f072ce00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0728071690 0x7f072815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.812+0000 7f072ce00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072806f5f0 con 0x7f07280cafa0 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.812+0000 7f072ce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0728070450 con 0x7f0728156f60 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.812+0000 7f072ce00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072815aa30 con 0x7f0728071690 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0726800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f07280cafa0 0x7f07280cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58784/0 (socket says 172.21.15.33:58784) 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0725400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0728071690 0x7f072815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0726800640 1 -- 172.21.15.33:0/333454191 learned_addr learned my addr 172.21.15.33:0/333454191 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0725400640 1 -- 172.21.15.33:0/333454191 >> v1:172.21.15.103:6789/0 conn(0x7f0728156f60 legacy=0x7f0728070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0725400640 1 -- 172.21.15.33:0/333454191 >> v1:172.21.15.33:6789/0 conn(0x7f07280cafa0 legacy=0x7f07280cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.813+0000 7f0725400640 1 -- 172.21.15.33:0/333454191 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072806f840 con 0x7f0728071690 2024-09-13T18:58:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.814+0000 7f0725400640 1 --2- 172.21.15.33:0/333454191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0728071690 0x7f072815a4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f071402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3b306088f8d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.814+0000 7f0724a00640 1 -- 172.21.15.33:0/333454191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714032440 con 0x7f0728071690 2024-09-13T18:58:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.814+0000 7f0724a00640 1 -- 172.21.15.33:0/333454191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140325a0 con 0x7f0728071690 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.814+0000 7f0724a00640 1 -- 172.21.15.33:0/333454191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714032930 con 0x7f0728071690 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 -- 172.21.15.33:0/333454191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0728071690 msgr2=0x7f072815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 --2- 172.21.15.33:0/333454191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0728071690 0x7f072815a4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f071402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 -- 172.21.15.33:0/333454191 shutdown_connections 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 --2- 172.21.15.33:0/333454191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0728071690 0x7f072815a4f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 -- 172.21.15.33:0/333454191 >> 172.21.15.33:0/333454191 conn(0x7f07280b0580 msgr2=0x7f07280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 -- 172.21.15.33:0/333454191 shutdown_connections 2024-09-13T18:58:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.815+0000 7f072ce00640 1 -- 172.21.15.33:0/333454191 wait complete. 2024-09-13T18:58:14.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.817+0000 7f072ce00640 1 Processor -- start 2024-09-13T18:58:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.817+0000 7f072ce00640 1 -- start start 2024-09-13T18:58:14.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0728071690 0x7f07281f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0728156f60 0x7f07281f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281f3330 con 0x7f07280cafa0 2024-09-13T18:58:14.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281f2330 con 0x7f0728156f60 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f072ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07281f63a0 con 0x7f0728071690 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34546/0 (socket says 172.21.15.33:34546) 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 -- 172.21.15.33:0/1299163108 learned_addr learned my addr 172.21.15.33:0/1299163108 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0726800640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0728156f60 0x7f07281f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725e00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0728071690 0x7f07281f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 -- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0728071690 msgr2=0x7f07281f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0728071690 0x7f07281f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 -- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0728156f60 msgr2=0x7f07281f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0728156f60 0x7f07281f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.818+0000 7f0725400640 1 -- 172.21.15.33:0/1299163108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009400 con 0x7f07280cafa0 2024-09-13T18:58:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f0725400640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f07140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714030b80 con 0x7f07280cafa0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714030ce0 con 0x7f07280cafa0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071403b640 con 0x7f07280cafa0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07281f6680 con 0x7f07280cafa0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.819+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07281f28d0 con 0x7f07280cafa0 2024-09-13T18:58:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.820+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07281f68c0 con 0x7f07280cafa0 2024-09-13T18:58:14.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.821+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0714039040 con 0x7f07280cafa0 2024-09-13T18:58:14.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.822+0000 7f071e000640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 0x7f070806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:14.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.822+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07140a98a0 con 0x7f07280cafa0 2024-09-13T18:58:14.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.822+0000 7f0725e00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 0x7f070806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:14.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.823+0000 7f0725e00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 0x7f070806d0f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0728157630 tx=0x7f0718009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:14.826+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0714074e70 con 0x7f07280cafa0 2024-09-13T18:58:15.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.004+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07280708c0 con 0x7f07280cafa0 2024-09-13T18:58:15.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.005+0000 7f071e000640 1 -- 172.21.15.33:0/1299163108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07280708c0 con 0x7f07280cafa0 2024-09-13T18:58:15.008 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 msgr2=0x7f070806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 0x7f070806d0f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0728157630 tx=0x7f0718009060 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 msgr2=0x7f07280adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f07140046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 shutdown_connections 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f070806ac30 0x7f070806d0f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0728156f60 0x7f07281f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07280cafa0 0x7f07280adc00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 --2- 172.21.15.33:0/1299163108 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0728071690 0x7f07281f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 >> 172.21.15.33:0/1299163108 conn(0x7f07280b0580 msgr2=0x7f0728151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 shutdown_connections 2024-09-13T18:58:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.007+0000 7f072ce00640 1 -- 172.21.15.33:0/1299163108 wait complete. 2024-09-13T18:58:15.026 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:58:15.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.181+0000 7fe233800640 1 Processor -- start 2024-09-13T18:58:15.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.181+0000 7fe233800640 1 -- start start 2024-09-13T18:58:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe233800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe22c15c270 0x7fe22c070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe233800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06c310 0x7fe22c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe233800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0b1f00 con 0x7fe22c06ffb0 2024-09-13T18:58:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe233800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c15c650 con 0x7fe22c15c270 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe233800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0712c0 con 0x7fe22c06c310 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe230e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe22c15c270 0x7fe22c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe230e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe22c15c270 0x7fe22c070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34552/0 (socket says 172.21.15.33:34552) 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe230e00640 1 -- 172.21.15.33:0/2814801161 learned_addr learned my addr 172.21.15.33:0/2814801161 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.183+0000 7fe231800640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06c310 0x7fe22c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.184+0000 7fe230e00640 1 -- 172.21.15.33:0/2814801161 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06c310 msgr2=0x7fe22c0b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.184+0000 7fe230e00640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06c310 0x7fe22c0b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.184+0000 7fe230e00640 1 -- 172.21.15.33:0/2814801161 >> v1:172.21.15.103:6789/0 conn(0x7fe22c06ffb0 legacy=0x7fe22c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.184+0000 7fe230e00640 1 -- 172.21.15.33:0/2814801161 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c070fe0 con 0x7fe22c15c270 2024-09-13T18:58:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.185+0000 7fe230e00640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c070950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe22002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6337203c636fb35b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.185+0000 7fe22b400640 1 -- 172.21.15.33:0/2814801161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220032440 con 0x7fe22c15c270 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.185+0000 7fe22b400640 1 -- 172.21.15.33:0/2814801161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200325a0 con 0x7fe22c15c270 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.185+0000 7fe22b400640 1 -- 172.21.15.33:0/2814801161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220032930 con 0x7fe22c15c270 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 -- 172.21.15.33:0/2814801161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 msgr2=0x7fe22c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c070950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe22002a270 comp rx=0 tx=0).stop 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 -- 172.21.15.33:0/2814801161 shutdown_connections 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06c310 0x7fe22c0b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 --2- 172.21.15.33:0/2814801161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c070950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 -- 172.21.15.33:0/2814801161 >> 172.21.15.33:0/2814801161 conn(0x7fe22c0b0510 msgr2=0x7fe22c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 -- 172.21.15.33:0/2814801161 shutdown_connections 2024-09-13T18:58:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.186+0000 7fe233800640 1 -- 172.21.15.33:0/2814801161 wait complete. 2024-09-13T18:58:15.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.188+0000 7fe233800640 1 Processor -- start 2024-09-13T18:58:15.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.189+0000 7fe233800640 1 -- start start 2024-09-13T18:58:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06ffb0 0x7fe22c1e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c15a070 con 0x7fe22c15c270 2024-09-13T18:58:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1e67e0 con 0x7fe22c06c310 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe233800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c153db0 con 0x7fe22c06ffb0 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe231800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe230e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe230e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:51306/0 (socket says 172.21.15.33:51306) 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe22be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06ffb0 0x7fe22c1e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.190+0000 7fe230e00640 1 -- 172.21.15.33:0/1944637991 learned_addr learned my addr 172.21.15.33:0/1944637991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 -- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06ffb0 msgr2=0x7fe22c1e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06ffb0 0x7fe22c1e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 -- 172.21.15.33:0/1944637991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 msgr2=0x7fe22c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 -- 172.21.15.33:0/1944637991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200094d0 con 0x7fe22c06c310 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe231800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:15.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe230e00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe220000c00 tx=0x7fe2200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220032440 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe220030b80 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22003d440 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.191+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c1593f0 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.192+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c1599b0 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.193+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c070950 con 0x7fe22c06c310 2024-09-13T18:58:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.194+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe220039040 con 0x7fe22c06c310 2024-09-13T18:58:15.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.194+0000 7fe228c00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.195+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2200a9a00 con 0x7fe22c06c310 2024-09-13T18:58:15.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.195+0000 7fe22be00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.196+0000 7fe22be00640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 0x7fe20c06d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0ad940 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.200+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe220074fd0 con 0x7fe22c06c310 2024-09-13T18:58:15.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.414+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe22c15b380 con 0x7fe22c06c310 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.415+0000 7fe228c00640 1 -- 172.21.15.33:0/1944637991 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe2200785f0 con 0x7fe22c06c310 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T18:58:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T18:58:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:15.419 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 msgr2=0x7fe20c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 0x7fe20c06d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0ad940 tx=0x7fe218009040 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 msgr2=0x7fe22c154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe220000c00 tx=0x7fe2200046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 shutdown_connections 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22c15c270 0x7fe22c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22c06ffb0 0x7fe22c1e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 --2- 172.21.15.33:0/1944637991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe22c06c310 0x7fe22c154880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 >> 172.21.15.33:0/1944637991 conn(0x7fe22c0b0510 msgr2=0x7fe22c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 shutdown_connections 2024-09-13T18:58:15.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.417+0000 7fe233800640 1 -- 172.21.15.33:0/1944637991 wait complete. 2024-09-13T18:58:15.436 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:58:15.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:58:15.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.592+0000 7f91dae00640 1 Processor -- start 2024-09-13T18:58:15.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.592+0000 7f91dae00640 1 -- start start 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.593+0000 7f91dae00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f91d406cd60 0x7f91d40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.593+0000 7f91dae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91d40cd870 0x7f91d40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.593+0000 7f91dae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d4151a20 con 0x7f91d415b770 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.593+0000 7f91dae00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40cc430 con 0x7f91d406cd60 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.593+0000 7f91dae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40b1bb0 con 0x7f91d40cd870 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f91d415b770 0x7f91d40cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58790/0 (socket says 172.21.15.33:58790) 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3400640 1 -- 172.21.15.33:0/659610305 learned_addr learned my addr 172.21.15.33:0/659610305 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3e00640 1 --2- 172.21.15.33:0/659610305 >> v2:172.21.15.33:3300/0 conn(0x7f91d406cd60 0x7f91d40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d8e00640 1 --2- 172.21.15.33:0/659610305 >> v2:172.21.15.103:3300/0 conn(0x7f91d40cd870 0x7f91d40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d2a00640 1 -- 172.21.15.33:0/659610305 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292961506 0 0) 0x7f91d4151a20 con 0x7f91d415b770 2024-09-13T18:58:15.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3e00640 1 -- 172.21.15.33:0/659610305 >> v2:172.21.15.103:3300/0 conn(0x7f91d40cd870 msgr2=0x7f91d40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:15.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3e00640 1 --2- 172.21.15.33:0/659610305 >> v2:172.21.15.103:3300/0 conn(0x7f91d40cd870 0x7f91d40cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3e00640 1 -- 172.21.15.33:0/659610305 >> v1:172.21.15.33:6789/0 conn(0x7f91d415b770 legacy=0x7f91d40cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.594+0000 7f91d3e00640 1 -- 172.21.15.33:0/659610305 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40b1e70 con 0x7f91d406cd60 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.595+0000 7f91d3e00640 1 --2- 172.21.15.33:0/659610305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d40b2950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f91d4158690 tx=0x7f91c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6024a7628c69f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.595+0000 7f91d2a00640 1 -- 172.21.15.33:0/659610305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4032440 con 0x7f91d406cd60 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.595+0000 7f91d2a00640 1 -- 172.21.15.33:0/659610305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c40325a0 con 0x7f91d406cd60 2024-09-13T18:58:15.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.595+0000 7f91d2a00640 1 -- 172.21.15.33:0/659610305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4032930 con 0x7f91d406cd60 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 -- 172.21.15.33:0/659610305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 msgr2=0x7f91d40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 --2- 172.21.15.33:0/659610305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d40b2950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f91d4158690 tx=0x7f91c402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 -- 172.21.15.33:0/659610305 shutdown_connections 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 --2- 172.21.15.33:0/659610305 >> v2:172.21.15.103:3300/0 conn(0x7f91d40cd870 0x7f91d40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 --2- 172.21.15.33:0/659610305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d40b2950 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 -- 172.21.15.33:0/659610305 >> 172.21.15.33:0/659610305 conn(0x7f91d40b0510 msgr2=0x7f91d40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 -- 172.21.15.33:0/659610305 shutdown_connections 2024-09-13T18:58:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.596+0000 7f91dae00640 1 -- 172.21.15.33:0/659610305 wait complete. 2024-09-13T18:58:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.598+0000 7f91dae00640 1 Processor -- start 2024-09-13T18:58:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.598+0000 7f91dae00640 1 -- start start 2024-09-13T18:58:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 0x7f91d4146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 0x7f91d406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40716d0 con 0x7f91d406cd60 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4070d00 con 0x7f91d415b770 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91dae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4146550 con 0x7f91d40cd870 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34580/0 (socket says 172.21.15.33:34580) 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 -- 172.21.15.33:0/3512802173 learned_addr learned my addr 172.21.15.33:0/3512802173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3400640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 0x7f91d4146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d8e00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 0x7f91d406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 -- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 msgr2=0x7f91d4146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 0x7f91d4146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 -- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 msgr2=0x7f91d406f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 0x7f91d406f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3e00640 1 -- 172.21.15.33:0/3512802173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4009400 con 0x7f91d406cd60 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d3400640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 0x7f91d4146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.599+0000 7f91d8e00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 0x7f91d406f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91d3e00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000c00 tx=0x7f91c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4030b80 con 0x7f91d406cd60 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4032e90 con 0x7f91d406cd60 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4006e10 con 0x7f91d406cd60 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40700f0 con 0x7f91d406cd60 2024-09-13T18:58:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.600+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d40706b0 con 0x7f91d406cd60 2024-09-13T18:58:15.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.601+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d40668d0 con 0x7f91d406cd60 2024-09-13T18:58:15.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.602+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91c4039040 con 0x7f91d406cd60 2024-09-13T18:58:15.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.603+0000 7f91cbe00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 0x7f91b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:15.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.603+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91c40a9b10 con 0x7f91d406cd60 2024-09-13T18:58:15.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.603+0000 7f91d3400640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 0x7f91b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:15.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.604+0000 7f91d3400640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 0x7f91b406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91d406f780 tx=0x7f91c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:15.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.607+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91c4074f10 con 0x7f91d406cd60 2024-09-13T18:58:15.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.787+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f91d41584e0 con 0x7f91d406cd60 2024-09-13T18:58:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.961+0000 7f91cbe00640 1 -- 172.21.15.33:0/3512802173 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f91c40370b0 con 0x7f91d406cd60 2024-09-13T18:58:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T18:58:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 msgr2=0x7f91b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 0x7f91b406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91d406f780 tx=0x7f91c0009040 comp rx=0 tx=0).stop 2024-09-13T18:58:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 msgr2=0x7f91d4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000c00 tx=0x7f91c40046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 shutdown_connections 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f91b406ac00 0x7f91b406d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d415b770 0x7f91d406f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91d40cd870 0x7f91d4146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 --2- 172.21.15.33:0/3512802173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d406cd60 0x7f91d4071190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.964+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 >> 172.21.15.33:0/3512802173 conn(0x7f91d40b0510 msgr2=0x7f91d40afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:15.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.965+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 shutdown_connections 2024-09-13T18:58:15.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:15.965+0000 7f91dae00640 1 -- 172.21.15.33:0/3512802173 wait complete. 2024-09-13T18:58:15.987 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:58:16.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.145+0000 7f8f7de00640 1 Processor -- start 2024-09-13T18:58:16.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.145+0000 7f8f7de00640 1 -- start start 2024-09-13T18:58:16.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.146+0000 7f8f7de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f78156f60 0x7f8f7815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.146+0000 7f8f7de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f78070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.146+0000 7f8f7de00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7806f5f0 con 0x7f8f780714c0 2024-09-13T18:58:16.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.146+0000 7f8f7de00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7815aa30 con 0x7f8f78156f60 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.146+0000 7f8f7de00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78071930 con 0x7f8f780cafa0 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f78156f60 0x7f8f7815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f78156f60 0x7f8f7815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34594/0 (socket says 172.21.15.33:34594) 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 -- 172.21.15.33:0/3148456780 learned_addr learned my addr 172.21.15.33:0/3148456780 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76000640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f78070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 -- 172.21.15.33:0/3148456780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 msgr2=0x7f8f78070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:16.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f78070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 -- 172.21.15.33:0/3148456780 >> v1:172.21.15.103:6789/0 conn(0x7f8f780714c0 legacy=0x7f8f7815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.147+0000 7f8f76a00640 1 -- 172.21.15.33:0/3148456780 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78070450 con 0x7f8f78156f60 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.148+0000 7f8f76a00640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815a4f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009870 tx=0x7f8f6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae85644ab4e3dd3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.148+0000 7f8f75600640 1 -- 172.21.15.33:0/3148456780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68032440 con 0x7f8f78156f60 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f75600640 1 -- 172.21.15.33:0/3148456780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680325a0 con 0x7f8f78156f60 2024-09-13T18:58:16.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f75600640 1 -- 172.21.15.33:0/3148456780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68032930 con 0x7f8f78156f60 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 -- 172.21.15.33:0/3148456780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 msgr2=0x7f8f7815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815a4f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009870 tx=0x7f8f6802a270 comp rx=0 tx=0).stop 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 -- 172.21.15.33:0/3148456780 shutdown_connections 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f78070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3148456780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815a4f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 -- 172.21.15.33:0/3148456780 >> 172.21.15.33:0/3148456780 conn(0x7f8f780b0580 msgr2=0x7f8f780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 -- 172.21.15.33:0/3148456780 shutdown_connections 2024-09-13T18:58:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.149+0000 7f8f7de00640 1 -- 172.21.15.33:0/3148456780 wait complete. 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.151+0000 7f8f7de00640 1 Processor -- start 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.151+0000 7f8f7de00640 1 -- start start 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f780714c0 0x7f8f78145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f7814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78146100 con 0x7f8f78156f60 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78159160 con 0x7f8f780714c0 2024-09-13T18:58:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f7de00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f781465c0 con 0x7f8f780cafa0 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34606/0 (socket says 172.21.15.33:34606) 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f77400640 1 -- 172.21.15.33:0/3487930644 learned_addr learned my addr 172.21.15.33:0/3487930644 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f76000640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f7814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.152+0000 7f8f76a00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f780714c0 0x7f8f78145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 -- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 msgr2=0x7f8f7814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f7814a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 -- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f780714c0 msgr2=0x7f8f78145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f780714c0 0x7f8f78145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 -- 172.21.15.33:0/3487930644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680094d0 con 0x7f8f78156f60 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f77400640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c7d0 tx=0x7f8f7000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70003b70 con 0x7f8f78156f60 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70003cf0 con 0x7f8f78156f60 2024-09-13T18:58:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000aa90 con 0x7f8f78156f60 2024-09-13T18:58:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f781580c0 con 0x7f8f78156f60 2024-09-13T18:58:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.153+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f78158680 con 0x7f8f78156f60 2024-09-13T18:58:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.154+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78070970 con 0x7f8f78156f60 2024-09-13T18:58:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.156+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f7000abf0 con 0x7f8f78156f60 2024-09-13T18:58:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.157+0000 7f8f6f400640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 0x7f8f5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.157+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8f70089920 con 0x7f8f78156f60 2024-09-13T18:58:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.157+0000 7f8f76a00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 0x7f8f5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.158+0000 7f8f76a00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 0x7f8f5806d0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f68034000 tx=0x7f8f6802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:16.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.160+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f70054e00 con 0x7f8f78156f60 2024-09-13T18:58:16.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.342+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f780cd290 con 0x7f8f78156f60 2024-09-13T18:58:16.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.966+0000 7f8f6f400640 1 -- 172.21.15.33:0/3487930644 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8f70003e60 con 0x7f8f78156f60 2024-09-13T18:58:16.970 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T18:58:16.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.971+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 msgr2=0x7f8f5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.971+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 0x7f8f5806d0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f68034000 tx=0x7f8f6802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:16.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 msgr2=0x7f8f7815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:16.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000c7d0 tx=0x7f8f7000cc90 comp rx=0 tx=0).stop 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 shutdown_connections 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f5806ac30 0x7f8f5806d0f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f78156f60 0x7f8f7815bc20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f780cafa0 0x7f8f7814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.972+0000 7f8f7de00640 1 --2- 172.21.15.33:0/3487930644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f780714c0 0x7f8f78145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.973+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 >> 172.21.15.33:0/3487930644 conn(0x7f8f780b0580 msgr2=0x7f8f7814bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.973+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 shutdown_connections 2024-09-13T18:58:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:16.973+0000 7f8f7de00640 1 -- 172.21.15.33:0/3487930644 wait complete. 2024-09-13T18:58:17.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:58:17.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.162+0000 7fb7d3e00640 1 Processor -- start 2024-09-13T18:58:17.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.162+0000 7fb7d3e00640 1 -- start start 2024-09-13T18:58:17.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c330 0x7fb7d40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7d4071cc0 0x7fb7d40b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d40b3f20 con 0x7fb7d415c710 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d40b3d30 con 0x7fb7d4071cc0 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d41602b0 con 0x7fb7d415c330 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7d4071cc0 0x7fb7d40b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7d4071cc0 0x7fb7d40b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34616/0 (socket says 172.21.15.33:34616) 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d3400640 1 -- 172.21.15.33:0/1358251829 learned_addr learned my addr 172.21.15.33:0/1358251829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.163+0000 7fb7d2a00640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c330 0x7fb7d40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.164+0000 7fb7d3400640 1 -- 172.21.15.33:0/1358251829 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c330 msgr2=0x7fb7d40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.164+0000 7fb7d3400640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c330 0x7fb7d40afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.164+0000 7fb7d3400640 1 -- 172.21.15.33:0/1358251829 >> v1:172.21.15.103:6789/0 conn(0x7fb7d415c710 legacy=0x7fb7d40715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.164+0000 7fb7d3400640 1 -- 172.21.15.33:0/1358251829 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4160590 con 0x7fb7d4071cc0 2024-09-13T18:58:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.165+0000 7fb7d3400640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40b37f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009e50 tx=0x7fb7cc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f12a540261ec9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.165+0000 7fb7d2000640 1 -- 172.21.15.33:0/1358251829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc02aea0 con 0x7fb7d4071cc0 2024-09-13T18:58:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.165+0000 7fb7d2000640 1 -- 172.21.15.33:0/1358251829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc02d050 con 0x7fb7d4071cc0 2024-09-13T18:58:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.165+0000 7fb7d2000640 1 -- 172.21.15.33:0/1358251829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc031820 con 0x7fb7d4071cc0 2024-09-13T18:58:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 -- 172.21.15.33:0/1358251829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d4071cc0 msgr2=0x7fb7d40b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40b37f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009e50 tx=0x7fb7cc02a680 comp rx=0 tx=0).stop 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 -- 172.21.15.33:0/1358251829 shutdown_connections 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40b37f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/1358251829 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c330 0x7fb7d40afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 -- 172.21.15.33:0/1358251829 >> 172.21.15.33:0/1358251829 conn(0x7fb7d406d6c0 msgr2=0x7fb7d406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 -- 172.21.15.33:0/1358251829 shutdown_connections 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.166+0000 7fb7d3e00640 1 -- 172.21.15.33:0/1358251829 wait complete. 2024-09-13T18:58:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.167+0000 7fb7d3e00640 1 Processor -- start 2024-09-13T18:58:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.168+0000 7fb7d3e00640 1 -- start start 2024-09-13T18:58:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.168+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.168+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 0x7fb7d40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40b0bd0 con 0x7fb7d415c330 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40affc0 con 0x7fb7d4071cc0 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40b02a0 con 0x7fb7d415c710 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34620/0 (socket says 172.21.15.33:34620) 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 -- 172.21.15.33:0/778092457 learned_addr learned my addr 172.21.15.33:0/778092457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d2a00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3400640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 0x7fb7d40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 -- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 msgr2=0x7fb7d40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 0x7fb7d40b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 -- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7d4071cc0 msgr2=0x7fb7d40a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7cbe00640 1 -- 172.21.15.33:0/778092457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc009b30 con 0x7fb7d415c330 2024-09-13T18:58:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.169+0000 7fb7d3400640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 0x7fb7d40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7cbe00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c3c0 tx=0x7fb7bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0052d0 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc005450 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc007260 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d40b0580 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.170+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d40aa530 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.171+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d4067360 con 0x7fb7d415c330 2024-09-13T18:58:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.172+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7bc0073c0 con 0x7fb7d415c330 2024-09-13T18:58:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.173+0000 7fb7caa00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 0x7fb7b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.173+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb7bc0886b0 con 0x7fb7d415c330 2024-09-13T18:58:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.173+0000 7fb7d2a00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 0x7fb7b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.174+0000 7fb7d2a00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 0x7fb7b006d110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009b40 tx=0x7fb7c4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.178+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7bc0538f0 con 0x7fb7d415c330 2024-09-13T18:58:17.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.392+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7d40aa6f0 con 0x7fb7d415c330 2024-09-13T18:58:17.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.399+0000 7fb7caa00640 1 -- 172.21.15.33:0/778092457 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb7bc056f10 con 0x7fb7d415c330 2024-09-13T18:58:17.402 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 msgr2=0x7fb7b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 0x7fb7b006d110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009b40 tx=0x7fb7c4009190 comp rx=0 tx=0).stop 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 msgr2=0x7fb7d414dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c3c0 tx=0x7fb7bc00c880 comp rx=0 tx=0).stop 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 shutdown_connections 2024-09-13T18:58:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb7b006ac50 0x7fb7b006d110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb7d415c710 0x7fb7d40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d415c330 0x7fb7d414dc60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 --2- 172.21.15.33:0/778092457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7d4071cc0 0x7fb7d40a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.404+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 >> 172.21.15.33:0/778092457 conn(0x7fb7d406d6c0 msgr2=0x7fb7d40cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.406+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 shutdown_connections 2024-09-13T18:58:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.406+0000 7fb7d3e00640 1 -- 172.21.15.33:0/778092457 wait complete. 2024-09-13T18:58:17.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.593+0000 7f035ba00640 1 Processor -- start 2024-09-13T18:58:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.593+0000 7f035ba00640 1 -- start start 2024-09-13T18:58:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.594+0000 7f035ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f035415a520 0x7f035406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.594+0000 7f035ba00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03540ce020 0x7f035415a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.594+0000 7f035ba00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035406bc00 con 0x7f03540b1b00 2024-09-13T18:58:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.594+0000 7f035ba00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035406bea0 con 0x7f03540ce020 2024-09-13T18:58:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.594+0000 7f035ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035406c180 con 0x7f035415a520 2024-09-13T18:58:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03540ce020 0x7f035415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03540ce020 0x7f035415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34634/0 (socket says 172.21.15.33:34634) 2024-09-13T18:58:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 -- 172.21.15.33:0/4169885272 learned_addr learned my addr 172.21.15.33:0/4169885272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359000640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f035415a520 0x7f035406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 -- 172.21.15.33:0/4169885272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f035415a520 msgr2=0x7f035406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f035415a520 0x7f035406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 -- 172.21.15.33:0/4169885272 >> v1:172.21.15.103:6789/0 conn(0x7f03540b1b00 legacy=0x7f03540cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.595+0000 7f0359a00640 1 -- 172.21.15.33:0/4169885272 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035406c460 con 0x7f03540ce020 2024-09-13T18:58:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.596+0000 7f0359a00640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03540ce020 0x7f035415a900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e50 tx=0x7f034c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa863080759e82c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.596+0000 7f0353400640 1 -- 172.21.15.33:0/4169885272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c031600 con 0x7f03540ce020 2024-09-13T18:58:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f0353400640 1 -- 172.21.15.33:0/4169885272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c02d050 con 0x7f03540ce020 2024-09-13T18:58:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f0353400640 1 -- 172.21.15.33:0/4169885272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c031980 con 0x7f03540ce020 2024-09-13T18:58:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 -- 172.21.15.33:0/4169885272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03540ce020 msgr2=0x7f035415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03540ce020 0x7f035415a900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e50 tx=0x7f034c02a710 comp rx=0 tx=0).stop 2024-09-13T18:58:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 -- 172.21.15.33:0/4169885272 shutdown_connections 2024-09-13T18:58:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03540ce020 0x7f035415a900 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 --2- 172.21.15.33:0/4169885272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f035415a520 0x7f035406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 -- 172.21.15.33:0/4169885272 >> 172.21.15.33:0/4169885272 conn(0x7f03540b0510 msgr2=0x7f03540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 -- 172.21.15.33:0/4169885272 shutdown_connections 2024-09-13T18:58:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.597+0000 7f035ba00640 1 -- 172.21.15.33:0/4169885272 wait complete. 2024-09-13T18:58:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.599+0000 7f035ba00640 1 Processor -- start 2024-09-13T18:58:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.599+0000 7f035ba00640 1 -- start start 2024-09-13T18:58:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03540b1b00 0x7f03541e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03540ce020 0x7f03541f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03541e23b0 con 0x7f035415a520 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03541f3690 con 0x7f03540ce020 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f035ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03541e0fe0 con 0x7f03540b1b00 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f0359a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f0359a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34648/0 (socket says 172.21.15.33:34648) 2024-09-13T18:58:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f0359a00640 1 -- 172.21.15.33:0/427494849 learned_addr learned my addr 172.21.15.33:0/427494849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f0359000640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03540b1b00 0x7f03541e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.600+0000 7f0353e00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03540ce020 0x7f03541f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 -- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03540b1b00 msgr2=0x7f03541e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03540b1b00 0x7f03541e6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 -- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03540ce020 msgr2=0x7f03541f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03540ce020 0x7f03541f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 -- 172.21.15.33:0/427494849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009b30 con 0x7f035415a520 2024-09-13T18:58:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0359a00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f034c034040 tx=0x7f034c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c03d860 con 0x7f035415a520 2024-09-13T18:58:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c03d9c0 con 0x7f035415a520 2024-09-13T18:58:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c03dd70 con 0x7f035415a520 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03541e12c0 con 0x7f035415a520 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.601+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03541e1880 con 0x7f035415a520 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.603+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0354071670 con 0x7f035415a520 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.603+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f034c03b400 con 0x7f035415a520 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.604+0000 7f0350c00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 0x7f033406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.604+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f034c0aa070 con 0x7f035415a520 2024-09-13T18:58:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.605+0000 7f0359000640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 0x7f033406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.606+0000 7f0359000640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 0x7f033406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03541f0310 tx=0x7f0348009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.609+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f034c0dd9c0 con 0x7f035415a520 2024-09-13T18:58:17.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.790+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f035415a900 con 0x7f035415a520 2024-09-13T18:58:17.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.791+0000 7f0350c00640 1 -- 172.21.15.33:0/427494849 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f034c0752f0 con 0x7f035415a520 2024-09-13T18:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:17.394743+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:17.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.793+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 msgr2=0x7f033406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.793+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 0x7f033406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03541f0310 tx=0x7f0348009190 comp rx=0 tx=0).stop 2024-09-13T18:58:17.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.793+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 msgr2=0x7f03541563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.793+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f034c034040 tx=0x7f034c004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:17.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 shutdown_connections 2024-09-13T18:58:17.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f033406ac00 0x7f033406d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f035415a520 0x7f03541563e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03540ce020 0x7f03541f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 --2- 172.21.15.33:0/427494849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03540b1b00 0x7f03541e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 >> 172.21.15.33:0/427494849 conn(0x7f03540b0510 msgr2=0x7f0354158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 shutdown_connections 2024-09-13T18:58:17.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.794+0000 7f035ba00640 1 -- 172.21.15.33:0/427494849 wait complete. 2024-09-13T18:58:17.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:17.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.965+0000 7f1653e00640 1 Processor -- start 2024-09-13T18:58:17.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.965+0000 7f1653e00640 1 -- start start 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1654159480 0x7f16540ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f1654070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1654071390 0x7f165415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540717c0 con 0x7f1654071390 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540cd850 con 0x7f1654159480 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16540cd570 con 0x7f165406f4b0 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1654071390 0x7f165415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1654071390 0x7f165415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34660/0 (socket says 172.21.15.33:34660) 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1653400640 1 -- 172.21.15.33:0/1055027173 learned_addr learned my addr 172.21.15.33:0/1055027173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f1652a00640 1 --2- 172.21.15.33:0/1055027173 >> v2:172.21.15.103:3300/0 conn(0x7f1654159480 0x7f16540ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.967+0000 7f164a000640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f1654070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.968+0000 7f1653400640 1 -- 172.21.15.33:0/1055027173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 msgr2=0x7f1654070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.968+0000 7f1653400640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f1654070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.968+0000 7f1653400640 1 -- 172.21.15.33:0/1055027173 >> v2:172.21.15.103:3300/0 conn(0x7f1654159480 msgr2=0x7f16540ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.968+0000 7f1653400640 1 --2- 172.21.15.33:0/1055027173 >> v2:172.21.15.103:3300/0 conn(0x7f1654159480 0x7f16540ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.968+0000 7f1653400640 1 -- 172.21.15.33:0/1055027173 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540b1740 con 0x7f1654071390 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653400640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654071390 0x7f165415ce80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1654071960 tx=0x7f164c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683c4e447d7d6077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1652000640 1 -- 172.21.15.33:0/1055027173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c031600 con 0x7f1654071390 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1652000640 1 -- 172.21.15.33:0/1055027173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c02d050 con 0x7f1654071390 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1652000640 1 -- 172.21.15.33:0/1055027173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c031980 con 0x7f1654071390 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 -- 172.21.15.33:0/1055027173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654071390 msgr2=0x7f165415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654071390 0x7f165415ce80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1654071960 tx=0x7f164c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 -- 172.21.15.33:0/1055027173 shutdown_connections 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f1654070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 --2- 172.21.15.33:0/1055027173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654071390 0x7f165415ce80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 --2- 172.21.15.33:0/1055027173 >> v2:172.21.15.103:3300/0 conn(0x7f1654159480 0x7f16540ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.969+0000 7f1653e00640 1 -- 172.21.15.33:0/1055027173 >> 172.21.15.33:0/1055027173 conn(0x7f16540ae310 msgr2=0x7f16540ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.970+0000 7f1653e00640 1 -- 172.21.15.33:0/1055027173 shutdown_connections 2024-09-13T18:58:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.970+0000 7f1653e00640 1 -- 172.21.15.33:0/1055027173 wait complete. 2024-09-13T18:58:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.971+0000 7f1653e00640 1 Processor -- start 2024-09-13T18:58:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.971+0000 7f1653e00640 1 -- start start 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.972+0000 7f1653e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1654071390 0x7f16541574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654159480 0x7f1654157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654158d10 con 0x7f1654159480 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541f01a0 con 0x7f1654071390 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16541e4dc0 con 0x7f165406f4b0 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:60006/0 (socket says 172.21.15.33:60006) 2024-09-13T18:58:17.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f164a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1654071390 0x7f16541574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 -- 172.21.15.33:0/619433627 learned_addr learned my addr 172.21.15.33:0/619433627 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1653400640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654159480 0x7f1654157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 -- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1654071390 msgr2=0x7f16541574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1654071390 0x7f16541574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 -- 172.21.15.33:0/619433627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654159480 msgr2=0x7f1654157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654159480 0x7f1654157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.973+0000 7f1652a00640 1 -- 172.21.15.33:0/619433627 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009b30 con 0x7f165406f4b0 2024-09-13T18:58:17.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.974+0000 7f1652a00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f164400e8a0 tx=0x7f164400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.976+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440094f0 con 0x7f165406f4b0 2024-09-13T18:58:17.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.976+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400c940 con 0x7f165406f4b0 2024-09-13T18:58:17.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.976+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541e50a0 con 0x7f165406f4b0 2024-09-13T18:58:17.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.976+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400ccf0 con 0x7f165406f4b0 2024-09-13T18:58:17.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.976+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541efd20 con 0x7f165406f4b0 2024-09-13T18:58:17.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.977+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654067360 con 0x7f165406f4b0 2024-09-13T18:58:17.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.978+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1644013470 con 0x7f165406f4b0 2024-09-13T18:58:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.979+0000 7f164b400640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 0x7f163006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:17.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.979+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1644089310 con 0x7f165406f4b0 2024-09-13T18:58:17.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.980+0000 7f164a000640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 0x7f163006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:17.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.980+0000 7f164a000640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 0x7f163006d110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f165406d7e0 tx=0x7f163c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:17.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:17.985+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1644054610 con 0x7f165406f4b0 2024-09-13T18:58:18.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.169+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16541eff40 con 0x7f165406f4b0 2024-09-13T18:58:18.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.172+0000 7f164b400640 1 -- 172.21.15.33:0/619433627 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f1644057c30 con 0x7f165406f4b0 2024-09-13T18:58:18.174 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:18.175 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:17.394743+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 msgr2=0x7f163006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 0x7f163006d110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f165406d7e0 tx=0x7f163c009190 comp rx=0 tx=0).stop 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 msgr2=0x7f16541e46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f164400e8a0 tx=0x7f164400ed60 comp rx=0 tx=0).stop 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 shutdown_connections 2024-09-13T18:58:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f163006ac50 0x7f163006d110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1654159480 0x7f1654157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1654071390 0x7f16541574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 --2- 172.21.15.33:0/619433627 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f165406f4b0 0x7f16541e46c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.173+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 >> 172.21.15.33:0/619433627 conn(0x7f16540ae310 msgr2=0x7f165406fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.174+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 shutdown_connections 2024-09-13T18:58:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.174+0000 7f1653e00640 1 -- 172.21.15.33:0/619433627 wait complete. 2024-09-13T18:58:18.192 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:58:18.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.347+0000 7ff363000640 1 Processor -- start 2024-09-13T18:58:18.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.347+0000 7ff363000640 1 -- start start 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff363000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff35c071690 0x7ff35c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff363000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff35c0cafa0 0x7ff35c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff363000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c06f5f0 con 0x7ff35c156f60 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff363000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c15aa30 con 0x7ff35c071690 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff363000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c070450 con 0x7ff35c0cafa0 2024-09-13T18:58:18.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff35b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff35c071690 0x7ff35c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff35be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff35c156f60 0x7ff35c070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58796/0 (socket says 172.21.15.33:58796) 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.348+0000 7ff35be00640 1 -- 172.21.15.33:0/772170420 learned_addr learned my addr 172.21.15.33:0/772170420 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff361000640 1 --2- 172.21.15.33:0/772170420 >> v2:172.21.15.103:3300/0 conn(0x7ff35c0cafa0 0x7ff35c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff35b400640 1 -- 172.21.15.33:0/772170420 >> v2:172.21.15.103:3300/0 conn(0x7ff35c0cafa0 msgr2=0x7ff35c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff35b400640 1 --2- 172.21.15.33:0/772170420 >> v2:172.21.15.103:3300/0 conn(0x7ff35c0cafa0 0x7ff35c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff35b400640 1 -- 172.21.15.33:0/772170420 >> v1:172.21.15.33:6789/0 conn(0x7ff35c156f60 legacy=0x7ff35c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff35b400640 1 -- 172.21.15.33:0/772170420 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c06f840 con 0x7ff35c071690 2024-09-13T18:58:18.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.349+0000 7ff35aa00640 1 -- 172.21.15.33:0/772170420 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396616519 0 0) 0x7ff35c06f5f0 con 0x7ff35c156f60 2024-09-13T18:58:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.350+0000 7ff35b400640 1 --2- 172.21.15.33:0/772170420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c15a4f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff35c159a70 tx=0x7ff34802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6711957a4a94553b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.350+0000 7ff35aa00640 1 -- 172.21.15.33:0/772170420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348032440 con 0x7ff35c071690 2024-09-13T18:58:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.350+0000 7ff35aa00640 1 -- 172.21.15.33:0/772170420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3480325a0 con 0x7ff35c071690 2024-09-13T18:58:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.350+0000 7ff35aa00640 1 -- 172.21.15.33:0/772170420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348032930 con 0x7ff35c071690 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 -- 172.21.15.33:0/772170420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 msgr2=0x7ff35c15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 --2- 172.21.15.33:0/772170420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c15a4f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff35c159a70 tx=0x7ff34802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 -- 172.21.15.33:0/772170420 shutdown_connections 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 --2- 172.21.15.33:0/772170420 >> v2:172.21.15.103:3300/0 conn(0x7ff35c0cafa0 0x7ff35c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 --2- 172.21.15.33:0/772170420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c15a4f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 -- 172.21.15.33:0/772170420 >> 172.21.15.33:0/772170420 conn(0x7ff35c0b0580 msgr2=0x7ff35c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 -- 172.21.15.33:0/772170420 shutdown_connections 2024-09-13T18:58:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.351+0000 7ff363000640 1 -- 172.21.15.33:0/772170420 wait complete. 2024-09-13T18:58:18.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.353+0000 7ff363000640 1 Processor -- start 2024-09-13T18:58:18.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.353+0000 7ff363000640 1 -- start start 2024-09-13T18:58:18.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff35c0cafa0 0x7ff35c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 0x7ff35c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c15b4a0 con 0x7ff35c071690 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c15bfe0 con 0x7ff35c156f60 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff363000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c15b740 con 0x7ff35c0cafa0 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34690/0 (socket says 172.21.15.33:34690) 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 -- 172.21.15.33:0/34473771 learned_addr learned my addr 172.21.15.33:0/34473771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35b400640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff35c0cafa0 0x7ff35c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff361000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 0x7ff35c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 -- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff35c0cafa0 msgr2=0x7ff35c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff35c0cafa0 0x7ff35c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 -- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 msgr2=0x7ff35c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:18.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 0x7ff35c15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff35be00640 1 -- 172.21.15.33:0/34473771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009400 con 0x7ff35c071690 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.354+0000 7ff361000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 0x7ff35c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff35be00640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c430 tx=0x7ff34c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0074e0 con 0x7ff35c071690 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c007660 con 0x7ff35c071690 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c004a20 con 0x7ff35c071690 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c15ba20 con 0x7ff35c071690 2024-09-13T18:58:18.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.355+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c15cb80 con 0x7ff35c071690 2024-09-13T18:58:18.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.356+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c0708c0 con 0x7ff35c071690 2024-09-13T18:58:18.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.357+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff34c004b80 con 0x7ff35c071690 2024-09-13T18:58:18.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.358+0000 7ff353e00640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:18.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.358+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff34c089200 con 0x7ff35c071690 2024-09-13T18:58:18.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.359+0000 7ff35b400640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:18.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.360+0000 7ff35b400640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 0x7ff33c06d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff348034000 tx=0x7ff34802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.363+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff35c0708c0 con 0x7ff35c071690 2024-09-13T18:58:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:18.578+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff35c0708c0 con 0x7ff35c071690 2024-09-13T18:58:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.408+0000 7ff353e00640 1 -- 172.21.15.33:0/34473771 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff35c0708c0 con 0x7ff35c071690 2024-09-13T18:58:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 msgr2=0x7ff33c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 0x7ff33c06d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff348034000 tx=0x7ff34802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 msgr2=0x7ff35c1f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c430 tx=0x7ff34c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 shutdown_connections 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff33c06ac00 0x7ff33c06d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff35c156f60 0x7ff35c15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff35c0cafa0 0x7ff35c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 --2- 172.21.15.33:0/34473771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff35c071690 0x7ff35c1f2a50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 >> 172.21.15.33:0/34473771 conn(0x7ff35c0b0580 msgr2=0x7ff35c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 shutdown_connections 2024-09-13T18:58:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.411+0000 7ff363000640 1 -- 172.21.15.33:0/34473771 wait complete. 2024-09-13T18:58:19.434 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:58:19.434 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:58:19.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.594+0000 7f2f8f800640 1 Processor -- start 2024-09-13T18:58:19.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.594+0000 7f2f8f800640 1 -- start start 2024-09-13T18:58:19.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.595+0000 7f2f8f800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f8806f830 0x7f2f8806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.595+0000 7f2f8f800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f880cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.595+0000 7f2f8f800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880ce490 con 0x7f2f88154ad0 2024-09-13T18:58:19.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.595+0000 7f2f8f800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8806b5b0 con 0x7f2f8806f830 2024-09-13T18:58:19.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.595+0000 7f2f8f800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8806b7c0 con 0x7f2f88070420 2024-09-13T18:58:19.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f8806f830 0x7f2f8806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f8806f830 0x7f2f8806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:51378/0 (socket says 172.21.15.33:51378) 2024-09-13T18:58:19.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 -- 172.21.15.33:0/452036029 learned_addr learned my addr 172.21.15.33:0/452036029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:19.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f8d800640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f880cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 -- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 msgr2=0x7f2f880cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f880cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 -- 172.21.15.33:0/452036029 >> v1:172.21.15.103:6789/0 conn(0x7f2f88154ad0 legacy=0x7f2f880cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.596+0000 7f2f87e00640 1 -- 172.21.15.33:0/452036029 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8806baa0 con 0x7f2f8806f830 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.597+0000 7f2f87e00640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8806f830 0x7f2f8806fee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009870 tx=0x7f2f7402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b923569d198c2b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f87400640 1 -- 172.21.15.33:0/452036029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74032440 con 0x7f2f8806f830 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f87400640 1 -- 172.21.15.33:0/452036029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f740325a0 con 0x7f2f8806f830 2024-09-13T18:58:19.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f87400640 1 -- 172.21.15.33:0/452036029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74032930 con 0x7f2f8806f830 2024-09-13T18:58:19.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 -- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8806f830 msgr2=0x7f2f8806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8806f830 0x7f2f8806fee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009870 tx=0x7f2f7402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 -- 172.21.15.33:0/452036029 shutdown_connections 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f880cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 --2- 172.21.15.33:0/452036029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8806f830 0x7f2f8806fee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 -- 172.21.15.33:0/452036029 >> 172.21.15.33:0/452036029 conn(0x7f2f880b0580 msgr2=0x7f2f880b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 -- 172.21.15.33:0/452036029 shutdown_connections 2024-09-13T18:58:19.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.598+0000 7f2f8f800640 1 -- 172.21.15.33:0/452036029 wait complete. 2024-09-13T18:58:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.600+0000 7f2f8f800640 1 Processor -- start 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.600+0000 7f2f8f800640 1 -- start start 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f8813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8814bfd0 0x7f2f88153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8813f460 con 0x7f2f88154ad0 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8814c4d0 con 0x7f2f8814bfd0 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8f800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8814c7b0 con 0x7f2f88070420 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34706/0 (socket says 172.21.15.33:34706) 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f87e00640 1 -- 172.21.15.33:0/1150751641 learned_addr learned my addr 172.21.15.33:0/1150751641 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8d800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8814bfd0 0x7f2f88153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.601+0000 7f2f8ce00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f8813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 -- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 msgr2=0x7f2f8813ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f8813ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 -- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8814bfd0 msgr2=0x7f2f88153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8814bfd0 0x7f2f88153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 -- 172.21.15.33:0/1150751641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f740094d0 con 0x7f2f88154ad0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f87e00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74032440 con 0x7f2f88154ad0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f74030980 con 0x7f2f88154ad0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74030d30 con 0x7f2f88154ad0 2024-09-13T18:58:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.602+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8814ca90 con 0x7f2f88154ad0 2024-09-13T18:58:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.603+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8814d050 con 0x7f2f88154ad0 2024-09-13T18:58:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.604+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8814c8f0 con 0x7f2f88154ad0 2024-09-13T18:58:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.605+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f74039040 con 0x7f2f88154ad0 2024-09-13T18:58:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.605+0000 7f2f84c00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 0x7f2f6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.605+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f740a9b70 con 0x7f2f88154ad0 2024-09-13T18:58:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.606+0000 7f2f8ce00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 0x7f2f6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:19.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.607+0000 7f2f8ce00640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 0x7f2f6806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c000f60 tx=0x7f2f7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.609+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f8814c8f0 con 0x7f2f88154ad0 2024-09-13T18:58:19.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:19.825+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2f8814c8f0 con 0x7f2f88154ad0 2024-09-13T18:58:20.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.409+0000 7f2f84c00640 1 -- 172.21.15.33:0/1150751641 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f8814c8f0 con 0x7f2f88154ad0 2024-09-13T18:58:20.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 msgr2=0x7f2f6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 0x7f2f6806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c000f60 tx=0x7f2f7c009040 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 msgr2=0x7f2f880b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f740046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 shutdown_connections 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2f6806ac00 0x7f2f6806d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f8814bfd0 0x7f2f88153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f88154ad0 0x7f2f880b2a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 --2- 172.21.15.33:0/1150751641 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f88070420 0x7f2f8813ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 >> 172.21.15.33:0/1150751641 conn(0x7f2f880b0580 msgr2=0x7f2f8814eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 shutdown_connections 2024-09-13T18:58:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.412+0000 7f2f8f800640 1 -- 172.21.15.33:0/1150751641 wait complete. 2024-09-13T18:58:20.433 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:58:20.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:20.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.588+0000 7f1f22c00640 1 Processor -- start 2024-09-13T18:58:20.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.588+0000 7f1f22c00640 1 -- start start 2024-09-13T18:58:20.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f22c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f22c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 0x7f1f1c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f22c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c06bea0 con 0x7f1f1c15a520 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f22c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c06c180 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f22c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c06c460 con 0x7f1f1c0cde50 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f1b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.589+0000 7f1f1b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34722/0 (socket says 172.21.15.33:34722) 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f1b400640 1 -- 172.21.15.33:0/929313499 learned_addr learned my addr 172.21.15.33:0/929313499 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f20c00640 1 --2- 172.21.15.33:0/929313499 >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 0x7f1f1c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f1b400640 1 -- 172.21.15.33:0/929313499 >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 msgr2=0x7f1f1c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f1b400640 1 --2- 172.21.15.33:0/929313499 >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 0x7f1f1c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f1b400640 1 -- 172.21.15.33:0/929313499 >> v1:172.21.15.103:6789/0 conn(0x7f1f1c15a520 legacy=0x7f1f1c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f1b400640 1 -- 172.21.15.33:0/929313499 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c06c740 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.590+0000 7f1f20c00640 1 --2- 172.21.15.33:0/929313499 >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 0x7f1f1c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:20.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.591+0000 7f1f1b400640 1 --2- 172.21.15.33:0/929313499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0cc5f0 tx=0x7f1f0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f230b454f0d1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:20.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.591+0000 7f1f1aa00640 1 -- 172.21.15.33:0/929313499 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08032440 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.591+0000 7f1f1aa00640 1 -- 172.21.15.33:0/929313499 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f080325a0 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.591+0000 7f1f1aa00640 1 -- 172.21.15.33:0/929313499 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08032930 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 -- 172.21.15.33:0/929313499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c0b1b00 msgr2=0x7f1f1c0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 --2- 172.21.15.33:0/929313499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0cc5f0 tx=0x7f1f0802a270 comp rx=0 tx=0).stop 2024-09-13T18:58:20.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 -- 172.21.15.33:0/929313499 shutdown_connections 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 --2- 172.21.15.33:0/929313499 >> v2:172.21.15.103:3300/0 conn(0x7f1f1c0cde50 0x7f1f1c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 --2- 172.21.15.33:0/929313499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c0b1b00 0x7f1f1c0cd910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 -- 172.21.15.33:0/929313499 >> 172.21.15.33:0/929313499 conn(0x7f1f1c0b0510 msgr2=0x7f1f1c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 -- 172.21.15.33:0/929313499 shutdown_connections 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.592+0000 7f1f22c00640 1 -- 172.21.15.33:0/929313499 wait complete. 2024-09-13T18:58:20.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.593+0000 7f1f22c00640 1 Processor -- start 2024-09-13T18:58:20.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.594+0000 7f1f22c00640 1 -- start start 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.594+0000 7f1f22c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 0x7f1f1c1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.594+0000 7f1f22c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 0x7f1f1c13e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f22c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f22c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c155bb0 con 0x7f1f1c15a520 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f22c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c155fd0 con 0x7f1f1c0cde50 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f22c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c141bf0 con 0x7f1f1c0b1b00 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34738/0 (socket says 172.21.15.33:34738) 2024-09-13T18:58:20.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 -- 172.21.15.33:0/19798728 learned_addr learned my addr 172.21.15.33:0/19798728 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f1be00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 0x7f1f1c1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f1b400640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 0x7f1f1c13e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 -- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 msgr2=0x7f1f1c1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 0x7f1f1c1416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 -- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 msgr2=0x7f1f1c13e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 0x7f1f1c13e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f20c00640 1 -- 172.21.15.33:0/19798728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080094d0 con 0x7f1f1c15a520 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f1b400640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 0x7f1f1c13e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.595+0000 7f1f1be00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 0x7f1f1c1416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f20c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1f14007f20 tx=0x7f1f1400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400dee0 con 0x7f1f1c15a520 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1400f040 con 0x7f1f1c15a520 2024-09-13T18:58:20.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14003dd0 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c13e910 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.596+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c155210 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.597+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c155cf0 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.598+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f14004030 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.599+0000 7f1f13e00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 0x7f1efc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.599+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f14089740 con 0x7f1f1c15a520 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.599+0000 7f1f1be00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 0x7f1efc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.600+0000 7f1f1be00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 0x7f1efc06d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007fd0 tx=0x7f1f0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:20.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.603+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f1c155cf0 con 0x7f1f1c15a520 2024-09-13T18:58:20.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.815+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f1c155cf0 con 0x7f1f1c15a520 2024-09-13T18:58:20.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.816+0000 7f1f13e00640 1 -- 172.21.15.33:0/19798728 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f1f1c155cf0 con 0x7f1f1c15a520 2024-09-13T18:58:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:20.820 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:20.820 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:20.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 msgr2=0x7f1efc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 0x7f1efc06d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007fd0 tx=0x7f1f0c009040 comp rx=0 tx=0).stop 2024-09-13T18:58:20.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 msgr2=0x7f1f1c0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1f14007f20 tx=0x7f1f1400d560 comp rx=0 tx=0).stop 2024-09-13T18:58:20.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 shutdown_connections 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1efc06ac00 0x7f1efc06d0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f1c15a520 0x7f1f1c0cb320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f1c0cde50 0x7f1f1c13e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 --2- 172.21.15.33:0/19798728 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f1c0b1b00 0x7f1f1c1416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.818+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 >> 172.21.15.33:0/19798728 conn(0x7f1f1c0b0510 msgr2=0x7f1f1c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.819+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 shutdown_connections 2024-09-13T18:58:20.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.819+0000 7f1f22c00640 1 -- 172.21.15.33:0/19798728 wait complete. 2024-09-13T18:58:20.837 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:20.909 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T18:58:20.906+0000 7f0602a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:58:20.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.990+0000 7f6070a00640 1 Processor -- start 2024-09-13T18:58:20.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.990+0000 7f6070a00640 1 -- start start 2024-09-13T18:58:20.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f6070a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f606c15a520 0x7f606c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f6070a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c06bc00 con 0x7f606c0ce020 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f6070a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c06bea0 con 0x7f606c0b1b00 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f6070a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c06c180 con 0x7f606c15a520 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f606a800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f606c0ce020 0x7f606c15a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58798/0 (socket says 172.21.15.33:58798) 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.991+0000 7f606a800640 1 -- 172.21.15.33:0/4239398900 learned_addr learned my addr 172.21.15.33:0/4239398900 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:20.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6069e00640 1 --2- 172.21.15.33:0/4239398900 >> v2:172.21.15.103:3300/0 conn(0x7f606c15a520 0x7f606c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625163190 0 0) 0x7f606c06bc00 con 0x7f606c0ce020 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6050003520 con 0x7f606c0ce020 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6069e00640 1 -- 172.21.15.33:0/4239398900 >> v1:172.21.15.103:6789/0 conn(0x7f606c0b1b00 legacy=0x7f606c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6069e00640 1 -- 172.21.15.33:0/4239398900 >> v1:172.21.15.33:6789/0 conn(0x7f606c0ce020 legacy=0x7f606c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019216053 0 0) 0x7f6050003520 con 0x7f606c0ce020 2024-09-13T18:58:20.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.992+0000 7f6069e00640 1 -- 172.21.15.33:0/4239398900 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c06c460 con 0x7f606c15a520 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.993+0000 7f6069e00640 1 --2- 172.21.15.33:0/4239398900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c15a520 0x7f606c06b6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f605c0097a0 tx=0x7f605c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322971743509de48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640019f0 con 0x7f606c15a520 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c02ac50 con 0x7f606c15a520 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6068a00640 1 -- 172.21.15.33:0/4239398900 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c032440 con 0x7f606c15a520 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 -- 172.21.15.33:0/4239398900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c15a520 msgr2=0x7f606c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 --2- 172.21.15.33:0/4239398900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c15a520 0x7f606c06b6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f605c0097a0 tx=0x7f605c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 -- 172.21.15.33:0/4239398900 shutdown_connections 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 --2- 172.21.15.33:0/4239398900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c15a520 0x7f606c06b6c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 -- 172.21.15.33:0/4239398900 >> 172.21.15.33:0/4239398900 conn(0x7f606c0b0510 msgr2=0x7f606c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:20.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 -- 172.21.15.33:0/4239398900 shutdown_connections 2024-09-13T18:58:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.994+0000 7f6070a00640 1 -- 172.21.15.33:0/4239398900 wait complete. 2024-09-13T18:58:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.996+0000 7f6070a00640 1 Processor -- start 2024-09-13T18:58:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.996+0000 7f6070a00640 1 -- start start 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 0x7f606c070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 0x7f606c0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c071730 con 0x7f606c0ce020 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0c3780 con 0x7f606c0b1b00 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6070a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c071450 con 0x7f606c15a520 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6069400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6069400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34740/0 (socket says 172.21.15.33:34740) 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.997+0000 7f6069400640 1 -- 172.21.15.33:0/3608858261 learned_addr learned my addr 172.21.15.33:0/3608858261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069e00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 0x7f606c070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f606a800640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 0x7f606c0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 -- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 msgr2=0x7f606c0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 0x7f606c0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 -- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 msgr2=0x7f606c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 0x7f606c070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 -- 172.21.15.33:0/3608858261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009400 con 0x7f606c0ce020 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f606a800640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 0x7f606c0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069e00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 0x7f606c070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6069400640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f605800c450 tx=0x7f605800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580052d0 con 0x7f606c0ce020 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058005430 con 0x7f606c0ce020 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058012870 con 0x7f606c0ce020 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.998+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c1480c0 con 0x7f606c0ce020 2024-09-13T18:58:21.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:20.999+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c148680 con 0x7f606c0ce020 2024-09-13T18:58:21.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.000+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c147f20 con 0x7f606c0ce020 2024-09-13T18:58:21.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.000+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f60580129d0 con 0x7f606c0ce020 2024-09-13T18:58:21.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.001+0000 7f6062000640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 0x7f604c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.001+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6058088f30 con 0x7f606c0ce020 2024-09-13T18:58:21.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.002+0000 7f6069e00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 0x7f604c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.002+0000 7f6069e00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 0x7f604c06d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f605c034000 tx=0x7f605c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.005+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f606c147f20 con 0x7f606c0ce020 2024-09-13T18:58:21.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.186+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f606c147f20 con 0x7f606c0ce020 2024-09-13T18:58:21.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.187+0000 7f6062000640 1 -- 172.21.15.33:0/3608858261 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f606c147f20 con 0x7f606c0ce020 2024-09-13T18:58:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:21.191 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.189+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 msgr2=0x7f604c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.189+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 0x7f604c06d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f605c034000 tx=0x7f605c02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.189+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 msgr2=0x7f606c14aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.189+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f605800c450 tx=0x7f605800c910 comp rx=0 tx=0).stop 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 shutdown_connections 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f604c06ac00 0x7f604c06d0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f606c15a520 0x7f606c0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f606c0ce020 0x7f606c14aa10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 --2- 172.21.15.33:0/3608858261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f606c0b1b00 0x7f606c070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 >> 172.21.15.33:0/3608858261 conn(0x7f606c0b0510 msgr2=0x7f606c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:21.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 shutdown_connections 2024-09-13T18:58:21.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.190+0000 7f6070a00640 1 -- 172.21.15.33:0/3608858261 wait complete. 2024-09-13T18:58:21.210 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:58:21.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:58:21.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.363+0000 7f046ca00640 1 Processor -- start 2024-09-13T18:58:21.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.363+0000 7f046ca00640 1 -- start start 2024-09-13T18:58:21.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.364+0000 7f046ca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0468153b20 0x7f04680b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.364+0000 7f046ca00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0468159a80 0x7f04680b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.364+0000 7f046ca00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0468153f00 con 0x7f04680b2410 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.364+0000 7f046ca00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04680ce600 con 0x7f0468159a80 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.364+0000 7f046ca00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0468070f90 con 0x7f0468153b20 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0468159a80 0x7f04680b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0468159a80 0x7f04680b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34756/0 (socket says 172.21.15.33:34756) 2024-09-13T18:58:21.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 -- 172.21.15.33:0/264109344 learned_addr learned my addr 172.21.15.33:0/264109344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:21.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465e00640 1 --2- 172.21.15.33:0/264109344 >> v2:172.21.15.103:3300/0 conn(0x7f0468153b20 0x7f04680b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 -- 172.21.15.33:0/264109344 >> v2:172.21.15.103:3300/0 conn(0x7f0468153b20 msgr2=0x7f04680b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:21.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 --2- 172.21.15.33:0/264109344 >> v2:172.21.15.103:3300/0 conn(0x7f0468153b20 0x7f04680b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 -- 172.21.15.33:0/264109344 >> v1:172.21.15.103:6789/0 conn(0x7f04680b2410 legacy=0x7f046806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.365+0000 7f0465400640 1 -- 172.21.15.33:0/264109344 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04680b1a40 con 0x7f0468159a80 2024-09-13T18:58:21.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.366+0000 7f0465400640 1 --2- 172.21.15.33:0/264109344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0468159a80 0x7f04680b1ed0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f04680b14f0 tx=0x7f045402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3a2d2899efd511 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.366+0000 7f0464a00640 1 -- 172.21.15.33:0/264109344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454032440 con 0x7f0468159a80 2024-09-13T18:58:21.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.366+0000 7f0464a00640 1 -- 172.21.15.33:0/264109344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04540325a0 con 0x7f0468159a80 2024-09-13T18:58:21.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.366+0000 7f0464a00640 1 -- 172.21.15.33:0/264109344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454032930 con 0x7f0468159a80 2024-09-13T18:58:21.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 -- 172.21.15.33:0/264109344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0468159a80 msgr2=0x7f04680b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 --2- 172.21.15.33:0/264109344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0468159a80 0x7f04680b1ed0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f04680b14f0 tx=0x7f045402a2a0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 -- 172.21.15.33:0/264109344 shutdown_connections 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 --2- 172.21.15.33:0/264109344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0468159a80 0x7f04680b1ed0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 --2- 172.21.15.33:0/264109344 >> v2:172.21.15.103:3300/0 conn(0x7f0468153b20 0x7f04680b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 -- 172.21.15.33:0/264109344 >> 172.21.15.33:0/264109344 conn(0x7f04680b0510 msgr2=0x7f04680b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 -- 172.21.15.33:0/264109344 shutdown_connections 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.367+0000 7f046ca00640 1 -- 172.21.15.33:0/264109344 wait complete. 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.369+0000 7f046ca00640 1 Processor -- start 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.369+0000 7f046ca00640 1 -- start start 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0468153b20 0x7f046815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 0x7f046815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046815bf00 con 0x7f04680b2410 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0468146570 con 0x7f0468153b20 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f046ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046815b2f0 con 0x7f0468159a80 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34758/0 (socket says 172.21.15.33:34758) 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 -- 172.21.15.33:0/2243804816 learned_addr learned my addr 172.21.15.33:0/2243804816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465400640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0468153b20 0x7f046815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0466800640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 0x7f046815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 -- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 msgr2=0x7f046815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 0x7f046815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 -- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0468153b20 msgr2=0x7f046815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0468153b20 0x7f046815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.370+0000 7f0465e00640 1 -- 172.21.15.33:0/2243804816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540094d0 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f0466800640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 0x7f046815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f0465e00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f045800e870 tx=0x7f045800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580094f0 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800c940 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800ccf0 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046815b5d0 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.371+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046815bb90 con 0x7f04680b2410 2024-09-13T18:58:21.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.372+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04680b3990 con 0x7f04680b2410 2024-09-13T18:58:21.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.373+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0458013470 con 0x7f04680b2410 2024-09-13T18:58:21.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.374+0000 7f045e000640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 0x7f044806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.374+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0458089510 con 0x7f04680b2410 2024-09-13T18:58:21.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.374+0000 7f0465400640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 0x7f044806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.375+0000 7f0465400640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 0x7f044806d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0454034000 tx=0x7f045402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.378+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0458054670 con 0x7f04680b2410 2024-09-13T18:58:21.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.552+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f046815a7b0 con 0x7f044806ac00 2024-09-13T18:58:21.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.561+0000 7f045e000640 1 -- 172.21.15.33:0/2243804816 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288875 (secure 0 0 0) 0x7f04540329c0 con 0x7f044806ac00 2024-09-13T18:58:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:21.569 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 msgr2=0x7f044806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 0x7f044806d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0454034000 tx=0x7f045402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 msgr2=0x7f0468146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f045800e870 tx=0x7f045800ed30 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 shutdown_connections 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f044806ac00 0x7f044806d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0468159a80 0x7f046815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0468153b20 0x7f046815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 --2- 172.21.15.33:0/2243804816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04680b2410 0x7f0468146030 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 >> 172.21.15.33:0/2243804816 conn(0x7f04680b0510 msgr2=0x7f046806ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 shutdown_connections 2024-09-13T18:58:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.565+0000 7f046ca00640 1 -- 172.21.15.33:0/2243804816 wait complete. 2024-09-13T18:58:21.585 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:58:21.110667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220320,"kb_used_data":4104,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754400,"statfs":{"total":773094113280,"available":772868505600,"internally_reserved":0,"allocated":4202496,"data_stored":2335990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.149958"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431428+0000","last_change":"2024-09-13T18:58:17.427509+0000","last_active":"2024-09-13T18:58:17.431428+0000","last_peered":"2024-09-13T18:58:17.431428+0000","last_clean":"2024-09-13T18:58:17.431428+0000","last_became_active":"2024-09-13T18:58:17.427262+0000","last_became_peered":"2024-09-13T18:58:17.427262+0000","last_unstale":"2024-09-13T18:58:17.431428+0000","last_undegraded":"2024-09-13T18:58:17.431428+0000","last_fullsized":"2024-09-13T18:58:17.431428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:28.837539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430645+0000","last_change":"2024-09-13T18:58:17.421513+0000","last_active":"2024-09-13T18:58:17.430645+0000","last_peered":"2024-09-13T18:58:17.430645+0000","last_clean":"2024-09-13T18:58:17.430645+0000","last_became_active":"2024-09-13T18:58:17.419945+0000","last_became_peered":"2024-09-13T18:58:17.419945+0000","last_unstale":"2024-09-13T18:58:17.430645+0000","last_undegraded":"2024-09-13T18:58:17.430645+0000","last_fullsized":"2024-09-13T18:58:17.430645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:52.252700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438408+0000","last_change":"2024-09-13T18:58:17.435218+0000","last_active":"2024-09-13T18:58:17.438408+0000","last_peered":"2024-09-13T18:58:17.438408+0000","last_clean":"2024-09-13T18:58:17.438408+0000","last_became_active":"2024-09-13T18:58:17.434943+0000","last_became_peered":"2024-09-13T18:58:17.434943+0000","last_unstale":"2024-09-13T18:58:17.438408+0000","last_undegraded":"2024-09-13T18:58:17.438408+0000","last_fullsized":"2024-09-13T18:58:17.438408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432959+0000","last_change":"2024-09-13T18:58:17.426140+0000","last_active":"2024-09-13T18:58:17.432959+0000","last_peered":"2024-09-13T18:58:17.432959+0000","last_clean":"2024-09-13T18:58:17.432959+0000","last_became_active":"2024-09-13T18:58:17.425550+0000","last_became_peered":"2024-09-13T18:58:17.425550+0000","last_unstale":"2024-09-13T18:58:17.432959+0000","last_undegraded":"2024-09-13T18:58:17.432959+0000","last_fullsized":"2024-09-13T18:58:17.432959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.426187+0000","last_change":"2024-09-13T18:58:17.422437+0000","last_active":"2024-09-13T18:58:17.426187+0000","last_peered":"2024-09-13T18:58:17.426187+0000","last_clean":"2024-09-13T18:58:17.426187+0000","last_became_active":"2024-09-13T18:58:17.422175+0000","last_became_peered":"2024-09-13T18:58:17.422175+0000","last_unstale":"2024-09-13T18:58:17.426187+0000","last_undegraded":"2024-09-13T18:58:17.426187+0000","last_fullsized":"2024-09-13T18:58:17.426187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:56.898206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433183+0000","last_change":"2024-09-13T18:58:17.431777+0000","last_active":"2024-09-13T18:58:17.433183+0000","last_peered":"2024-09-13T18:58:17.433183+0000","last_clean":"2024-09-13T18:58:17.433183+0000","last_became_active":"2024-09-13T18:58:17.431508+0000","last_became_peered":"2024-09-13T18:58:17.431508+0000","last_unstale":"2024-09-13T18:58:17.433183+0000","last_undegraded":"2024-09-13T18:58:17.433183+0000","last_fullsized":"2024-09-13T18:58:17.433183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422565+0000","last_change":"2024-09-13T18:58:17.417971+0000","last_active":"2024-09-13T18:58:17.422565+0000","last_peered":"2024-09-13T18:58:17.422565+0000","last_clean":"2024-09-13T18:58:17.422565+0000","last_became_active":"2024-09-13T18:58:17.417528+0000","last_became_peered":"2024-09-13T18:58:17.417528+0000","last_unstale":"2024-09-13T18:58:17.422565+0000","last_undegraded":"2024-09-13T18:58:17.422565+0000","last_fullsized":"2024-09-13T18:58:17.422565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.415463+0000","last_change":"2024-09-13T18:58:17.408811+0000","last_active":"2024-09-13T18:58:17.415463+0000","last_peered":"2024-09-13T18:58:17.415463+0000","last_clean":"2024-09-13T18:58:17.415463+0000","last_became_active":"2024-09-13T18:58:17.408535+0000","last_became_peered":"2024-09-13T18:58:17.408535+0000","last_unstale":"2024-09-13T18:58:17.415463+0000","last_undegraded":"2024-09-13T18:58:17.415463+0000","last_fullsized":"2024-09-13T18:58:17.415463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:52.252700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438800+0000","last_change":"2024-09-13T18:58:17.437687+0000","last_active":"2024-09-13T18:58:17.438800+0000","last_peered":"2024-09-13T18:58:17.438800+0000","last_clean":"2024-09-13T18:58:17.438800+0000","last_became_active":"2024-09-13T18:58:17.437326+0000","last_became_peered":"2024-09-13T18:58:17.437326+0000","last_unstale":"2024-09-13T18:58:17.438800+0000","last_undegraded":"2024-09-13T18:58:17.438800+0000","last_fullsized":"2024-09-13T18:58:17.438800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:09.498649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430502+0000","last_change":"2024-09-13T18:58:17.424599+0000","last_active":"2024-09-13T18:58:17.430502+0000","last_peered":"2024-09-13T18:58:17.430502+0000","last_clean":"2024-09-13T18:58:17.430502+0000","last_became_active":"2024-09-13T18:58:17.424306+0000","last_became_peered":"2024-09-13T18:58:17.424306+0000","last_unstale":"2024-09-13T18:58:17.430502+0000","last_undegraded":"2024-09-13T18:58:17.430502+0000","last_fullsized":"2024-09-13T18:58:17.430502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437417+0000","last_change":"2024-09-13T18:58:17.432798+0000","last_active":"2024-09-13T18:58:17.437417+0000","last_peered":"2024-09-13T18:58:17.437417+0000","last_clean":"2024-09-13T18:58:17.437417+0000","last_became_active":"2024-09-13T18:58:17.432389+0000","last_became_peered":"2024-09-13T18:58:17.432389+0000","last_unstale":"2024-09-13T18:58:17.437417+0000","last_undegraded":"2024-09-13T18:58:17.437417+0000","last_fullsized":"2024-09-13T18:58:17.437417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428749+0000","last_change":"2024-09-13T18:58:17.425218+0000","last_active":"2024-09-13T18:58:17.428749+0000","last_peered":"2024-09-13T18:58:17.428749+0000","last_clean":"2024-09-13T18:58:17.428749+0000","last_became_active":"2024-09-13T18:58:17.424967+0000","last_became_peered":"2024-09-13T18:58:17.424967+0000","last_unstale":"2024-09-13T18:58:17.428749+0000","last_undegraded":"2024-09-13T18:58:17.428749+0000","last_fullsized":"2024-09-13T18:58:17.428749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:17.559950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429367+0000","last_change":"2024-09-13T18:58:17.425686+0000","last_active":"2024-09-13T18:58:17.429367+0000","last_peered":"2024-09-13T18:58:17.429367+0000","last_clean":"2024-09-13T18:58:17.429367+0000","last_became_active":"2024-09-13T18:58:17.425365+0000","last_became_peered":"2024-09-13T18:58:17.425365+0000","last_unstale":"2024-09-13T18:58:17.429367+0000","last_undegraded":"2024-09-13T18:58:17.429367+0000","last_fullsized":"2024-09-13T18:58:17.429367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:33.234923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422621+0000","last_change":"2024-09-13T18:58:17.417390+0000","last_active":"2024-09-13T18:58:17.422621+0000","last_peered":"2024-09-13T18:58:17.422621+0000","last_clean":"2024-09-13T18:58:17.422621+0000","last_became_active":"2024-09-13T18:58:17.417143+0000","last_became_peered":"2024-09-13T18:58:17.417143+0000","last_unstale":"2024-09-13T18:58:17.422621+0000","last_undegraded":"2024-09-13T18:58:17.422621+0000","last_fullsized":"2024-09-13T18:58:17.422621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:05.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429044+0000","last_change":"2024-09-13T18:58:17.423775+0000","last_active":"2024-09-13T18:58:17.429044+0000","last_peered":"2024-09-13T18:58:17.429044+0000","last_clean":"2024-09-13T18:58:17.429044+0000","last_became_active":"2024-09-13T18:58:17.422163+0000","last_became_peered":"2024-09-13T18:58:17.422163+0000","last_unstale":"2024-09-13T18:58:17.429044+0000","last_undegraded":"2024-09-13T18:58:17.429044+0000","last_fullsized":"2024-09-13T18:58:17.429044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:33.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423743+0000","last_change":"2024-09-13T18:58:17.420364+0000","last_active":"2024-09-13T18:58:17.423743+0000","last_peered":"2024-09-13T18:58:17.423743+0000","last_clean":"2024-09-13T18:58:17.423743+0000","last_became_active":"2024-09-13T18:58:17.416443+0000","last_became_peered":"2024-09-13T18:58:17.416443+0000","last_unstale":"2024-09-13T18:58:17.423743+0000","last_undegraded":"2024-09-13T18:58:17.423743+0000","last_fullsized":"2024-09-13T18:58:17.423743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.424642+0000","last_change":"2024-09-13T18:58:17.417973+0000","last_active":"2024-09-13T18:58:17.424642+0000","last_peered":"2024-09-13T18:58:17.424642+0000","last_clean":"2024-09-13T18:58:17.424642+0000","last_became_active":"2024-09-13T18:58:17.417461+0000","last_became_peered":"2024-09-13T18:58:17.417461+0000","last_unstale":"2024-09-13T18:58:17.424642+0000","last_undegraded":"2024-09-13T18:58:17.424642+0000","last_fullsized":"2024-09-13T18:58:17.424642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430682+0000","last_change":"2024-09-13T18:58:17.424899+0000","last_active":"2024-09-13T18:58:17.430682+0000","last_peered":"2024-09-13T18:58:17.430682+0000","last_clean":"2024-09-13T18:58:17.430682+0000","last_became_active":"2024-09-13T18:58:17.424615+0000","last_became_peered":"2024-09-13T18:58:17.424615+0000","last_unstale":"2024-09-13T18:58:17.430682+0000","last_undegraded":"2024-09-13T18:58:17.430682+0000","last_fullsized":"2024-09-13T18:58:17.430682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440257+0000","last_change":"2024-09-13T18:58:17.438931+0000","last_active":"2024-09-13T18:58:17.440257+0000","last_peered":"2024-09-13T18:58:17.440257+0000","last_clean":"2024-09-13T18:58:17.440257+0000","last_became_active":"2024-09-13T18:58:17.438333+0000","last_became_peered":"2024-09-13T18:58:17.438333+0000","last_unstale":"2024-09-13T18:58:17.440257+0000","last_undegraded":"2024-09-13T18:58:17.440257+0000","last_fullsized":"2024-09-13T18:58:17.440257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428446+0000","last_change":"2024-09-13T18:58:17.424057+0000","last_active":"2024-09-13T18:58:17.428446+0000","last_peered":"2024-09-13T18:58:17.428446+0000","last_clean":"2024-09-13T18:58:17.428446+0000","last_became_active":"2024-09-13T18:58:17.423623+0000","last_became_peered":"2024-09-13T18:58:17.423623+0000","last_unstale":"2024-09-13T18:58:17.428446+0000","last_undegraded":"2024-09-13T18:58:17.428446+0000","last_fullsized":"2024-09-13T18:58:17.428446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418483+0000","last_change":"2024-09-13T18:58:17.408131+0000","last_active":"2024-09-13T18:58:17.418483+0000","last_peered":"2024-09-13T18:58:17.418483+0000","last_clean":"2024-09-13T18:58:17.418483+0000","last_became_active":"2024-09-13T18:58:17.407846+0000","last_became_peered":"2024-09-13T18:58:17.407846+0000","last_unstale":"2024-09-13T18:58:17.418483+0000","last_undegraded":"2024-09-13T18:58:17.418483+0000","last_fullsized":"2024-09-13T18:58:17.418483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:56.973524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428114+0000","last_change":"2024-09-13T18:58:17.419033+0000","last_active":"2024-09-13T18:58:17.428114+0000","last_peered":"2024-09-13T18:58:17.428114+0000","last_clean":"2024-09-13T18:58:17.428114+0000","last_became_active":"2024-09-13T18:58:17.418746+0000","last_became_peered":"2024-09-13T18:58:17.418746+0000","last_unstale":"2024-09-13T18:58:17.428114+0000","last_undegraded":"2024-09-13T18:58:17.428114+0000","last_fullsized":"2024-09-13T18:58:17.428114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:33.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416977+0000","last_change":"2024-09-13T18:58:17.407112+0000","last_active":"2024-09-13T18:58:17.416977+0000","last_peered":"2024-09-13T18:58:17.416977+0000","last_clean":"2024-09-13T18:58:17.416977+0000","last_became_active":"2024-09-13T18:58:17.406832+0000","last_became_peered":"2024-09-13T18:58:17.406832+0000","last_unstale":"2024-09-13T18:58:17.416977+0000","last_undegraded":"2024-09-13T18:58:17.416977+0000","last_fullsized":"2024-09-13T18:58:17.416977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:56.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423342+0000","last_change":"2024-09-13T18:58:17.419294+0000","last_active":"2024-09-13T18:58:17.423342+0000","last_peered":"2024-09-13T18:58:17.423342+0000","last_clean":"2024-09-13T18:58:17.423342+0000","last_became_active":"2024-09-13T18:58:17.418951+0000","last_became_peered":"2024-09-13T18:58:17.418951+0000","last_unstale":"2024-09-13T18:58:17.423342+0000","last_undegraded":"2024-09-13T18:58:17.423342+0000","last_fullsized":"2024-09-13T18:58:17.423342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436297+0000","last_change":"2024-09-13T18:58:17.430331+0000","last_active":"2024-09-13T18:58:17.436297+0000","last_peered":"2024-09-13T18:58:17.436297+0000","last_clean":"2024-09-13T18:58:17.436297+0000","last_became_active":"2024-09-13T18:58:17.430065+0000","last_became_peered":"2024-09-13T18:58:17.430065+0000","last_unstale":"2024-09-13T18:58:17.436297+0000","last_undegraded":"2024-09-13T18:58:17.436297+0000","last_fullsized":"2024-09-13T18:58:17.436297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430665+0000","last_change":"2024-09-13T18:58:17.422187+0000","last_active":"2024-09-13T18:58:17.430665+0000","last_peered":"2024-09-13T18:58:17.430665+0000","last_clean":"2024-09-13T18:58:17.430665+0000","last_became_active":"2024-09-13T18:58:17.421870+0000","last_became_peered":"2024-09-13T18:58:17.421870+0000","last_unstale":"2024-09-13T18:58:17.430665+0000","last_undegraded":"2024-09-13T18:58:17.430665+0000","last_fullsized":"2024-09-13T18:58:17.430665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436461+0000","last_change":"2024-09-13T18:58:17.428886+0000","last_active":"2024-09-13T18:58:17.436461+0000","last_peered":"2024-09-13T18:58:17.436461+0000","last_clean":"2024-09-13T18:58:17.436461+0000","last_became_active":"2024-09-13T18:58:17.428672+0000","last_became_peered":"2024-09-13T18:58:17.428672+0000","last_unstale":"2024-09-13T18:58:17.436461+0000","last_undegraded":"2024-09-13T18:58:17.436461+0000","last_fullsized":"2024-09-13T18:58:17.436461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432015+0000","last_change":"2024-09-13T18:58:17.427370+0000","last_active":"2024-09-13T18:58:17.432015+0000","last_peered":"2024-09-13T18:58:17.432015+0000","last_clean":"2024-09-13T18:58:17.432015+0000","last_became_active":"2024-09-13T18:58:17.427063+0000","last_became_peered":"2024-09-13T18:58:17.427063+0000","last_unstale":"2024-09-13T18:58:17.432015+0000","last_undegraded":"2024-09-13T18:58:17.432015+0000","last_fullsized":"2024-09-13T18:58:17.432015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:56.973524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418497+0000","last_change":"2024-09-13T18:58:17.410958+0000","last_active":"2024-09-13T18:58:17.418497+0000","last_peered":"2024-09-13T18:58:17.418497+0000","last_clean":"2024-09-13T18:58:17.418497+0000","last_became_active":"2024-09-13T18:58:17.410657+0000","last_became_peered":"2024-09-13T18:58:17.410657+0000","last_unstale":"2024-09-13T18:58:17.418497+0000","last_undegraded":"2024-09-13T18:58:17.418497+0000","last_fullsized":"2024-09-13T18:58:17.418497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:36.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.419894+0000","last_change":"2024-09-13T18:58:17.414945+0000","last_active":"2024-09-13T18:58:17.419894+0000","last_peered":"2024-09-13T18:58:17.419894+0000","last_clean":"2024-09-13T18:58:17.419894+0000","last_became_active":"2024-09-13T18:58:17.414677+0000","last_became_peered":"2024-09-13T18:58:17.414677+0000","last_unstale":"2024-09-13T18:58:17.419894+0000","last_undegraded":"2024-09-13T18:58:17.419894+0000","last_fullsized":"2024-09-13T18:58:17.419894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416140+0000","last_change":"2024-09-13T18:58:17.411115+0000","last_active":"2024-09-13T18:58:17.416140+0000","last_peered":"2024-09-13T18:58:17.416140+0000","last_clean":"2024-09-13T18:58:17.416140+0000","last_became_active":"2024-09-13T18:58:17.410726+0000","last_became_peered":"2024-09-13T18:58:17.410726+0000","last_unstale":"2024-09-13T18:58:17.416140+0000","last_undegraded":"2024-09-13T18:58:17.416140+0000","last_fullsized":"2024-09-13T18:58:17.416140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:54.221322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427086+0000","last_change":"2024-09-13T18:58:17.421150+0000","last_active":"2024-09-13T18:58:17.427086+0000","last_peered":"2024-09-13T18:58:17.427086+0000","last_clean":"2024-09-13T18:58:17.427086+0000","last_became_active":"2024-09-13T18:58:17.420900+0000","last_became_peered":"2024-09-13T18:58:17.420900+0000","last_unstale":"2024-09-13T18:58:17.427086+0000","last_undegraded":"2024-09-13T18:58:17.427086+0000","last_fullsized":"2024-09-13T18:58:17.427086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416739+0000","last_change":"2024-09-13T18:58:17.408067+0000","last_active":"2024-09-13T18:58:17.416739+0000","last_peered":"2024-09-13T18:58:17.416739+0000","last_clean":"2024-09-13T18:58:17.416739+0000","last_became_active":"2024-09-13T18:58:17.407839+0000","last_became_peered":"2024-09-13T18:58:17.407839+0000","last_unstale":"2024-09-13T18:58:17.416739+0000","last_undegraded":"2024-09-13T18:58:17.416739+0000","last_fullsized":"2024-09-13T18:58:17.416739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:36.699011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.434805+0000","last_change":"2024-09-13T18:58:16.980897+0000","last_active":"2024-09-13T18:58:17.434805+0000","last_peered":"2024-09-13T18:58:17.434805+0000","last_clean":"2024-09-13T18:58:17.434805+0000","last_became_active":"2024-09-13T18:58:16.980557+0000","last_became_peered":"2024-09-13T18:58:16.980557+0000","last_unstale":"2024-09-13T18:58:17.434805+0000","last_undegraded":"2024-09-13T18:58:17.434805+0000","last_fullsized":"2024-09-13T18:58:17.434805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:58.182996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428305+0000","last_change":"2024-09-13T18:58:17.420415+0000","last_active":"2024-09-13T18:58:17.428305+0000","last_peered":"2024-09-13T18:58:17.428305+0000","last_clean":"2024-09-13T18:58:17.428305+0000","last_became_active":"2024-09-13T18:58:17.420111+0000","last_became_peered":"2024-09-13T18:58:17.420111+0000","last_unstale":"2024-09-13T18:58:17.428305+0000","last_undegraded":"2024-09-13T18:58:17.428305+0000","last_fullsized":"2024-09-13T18:58:17.428305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:42.948766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429879+0000","last_change":"2024-09-13T18:58:16.994507+0000","last_active":"2024-09-13T18:58:17.429879+0000","last_peered":"2024-09-13T18:58:17.429879+0000","last_clean":"2024-09-13T18:58:17.429879+0000","last_became_active":"2024-09-13T18:58:16.991701+0000","last_became_peered":"2024-09-13T18:58:16.991701+0000","last_unstale":"2024-09-13T18:58:17.429879+0000","last_undegraded":"2024-09-13T18:58:17.429879+0000","last_fullsized":"2024-09-13T18:58:17.429879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418357+0000","last_change":"2024-09-13T18:58:17.410251+0000","last_active":"2024-09-13T18:58:17.418357+0000","last_peered":"2024-09-13T18:58:17.418357+0000","last_clean":"2024-09-13T18:58:17.418357+0000","last_became_active":"2024-09-13T18:58:17.409993+0000","last_became_peered":"2024-09-13T18:58:17.409993+0000","last_unstale":"2024-09-13T18:58:17.418357+0000","last_undegraded":"2024-09-13T18:58:17.418357+0000","last_fullsized":"2024-09-13T18:58:17.418357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:17.559950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.441718+0000","last_change":"2024-09-13T18:58:16.979028+0000","last_active":"2024-09-13T18:58:17.441718+0000","last_peered":"2024-09-13T18:58:17.441718+0000","last_clean":"2024-09-13T18:58:17.441718+0000","last_became_active":"2024-09-13T18:58:16.977430+0000","last_became_peered":"2024-09-13T18:58:16.977430+0000","last_unstale":"2024-09-13T18:58:17.441718+0000","last_undegraded":"2024-09-13T18:58:17.441718+0000","last_fullsized":"2024-09-13T18:58:17.441718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436441+0000","last_change":"2024-09-13T18:58:17.428799+0000","last_active":"2024-09-13T18:58:17.436441+0000","last_peered":"2024-09-13T18:58:17.436441+0000","last_clean":"2024-09-13T18:58:17.436441+0000","last_became_active":"2024-09-13T18:58:17.428378+0000","last_became_peered":"2024-09-13T18:58:17.428378+0000","last_unstale":"2024-09-13T18:58:17.436441+0000","last_undegraded":"2024-09-13T18:58:17.436441+0000","last_fullsized":"2024-09-13T18:58:17.436441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437968+0000","last_change":"2024-09-13T18:58:16.993590+0000","last_active":"2024-09-13T18:58:17.437968+0000","last_peered":"2024-09-13T18:58:17.437968+0000","last_clean":"2024-09-13T18:58:17.437968+0000","last_became_active":"2024-09-13T18:58:16.993114+0000","last_became_peered":"2024-09-13T18:58:16.993114+0000","last_unstale":"2024-09-13T18:58:17.437968+0000","last_undegraded":"2024-09-13T18:58:17.437968+0000","last_fullsized":"2024-09-13T18:58:17.437968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427797+0000","last_change":"2024-09-13T18:58:17.420896+0000","last_active":"2024-09-13T18:58:17.427797+0000","last_peered":"2024-09-13T18:58:17.427797+0000","last_clean":"2024-09-13T18:58:17.427797+0000","last_became_active":"2024-09-13T18:58:17.420594+0000","last_became_peered":"2024-09-13T18:58:17.420594+0000","last_unstale":"2024-09-13T18:58:17.427797+0000","last_undegraded":"2024-09-13T18:58:17.427797+0000","last_fullsized":"2024-09-13T18:58:17.427797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:14.120222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433280+0000","last_change":"2024-09-13T18:58:16.994723+0000","last_active":"2024-09-13T18:58:17.433280+0000","last_peered":"2024-09-13T18:58:17.433280+0000","last_clean":"2024-09-13T18:58:17.433280+0000","last_became_active":"2024-09-13T18:58:16.994461+0000","last_became_peered":"2024-09-13T18:58:16.994461+0000","last_unstale":"2024-09-13T18:58:17.433280+0000","last_undegraded":"2024-09-13T18:58:17.433280+0000","last_fullsized":"2024-09-13T18:58:17.433280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:30.301727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432501+0000","last_change":"2024-09-13T18:58:17.427707+0000","last_active":"2024-09-13T18:58:17.432501+0000","last_peered":"2024-09-13T18:58:17.432501+0000","last_clean":"2024-09-13T18:58:17.432501+0000","last_became_active":"2024-09-13T18:58:17.427393+0000","last_became_peered":"2024-09-13T18:58:17.427393+0000","last_unstale":"2024-09-13T18:58:17.432501+0000","last_undegraded":"2024-09-13T18:58:17.432501+0000","last_fullsized":"2024-09-13T18:58:17.432501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432050+0000","last_change":"2024-09-13T18:58:16.994727+0000","last_active":"2024-09-13T18:58:17.432050+0000","last_peered":"2024-09-13T18:58:17.432050+0000","last_clean":"2024-09-13T18:58:17.432050+0000","last_became_active":"2024-09-13T18:58:16.994387+0000","last_became_peered":"2024-09-13T18:58:16.994387+0000","last_unstale":"2024-09-13T18:58:17.432050+0000","last_undegraded":"2024-09-13T18:58:17.432050+0000","last_fullsized":"2024-09-13T18:58:17.432050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:58.182996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.421845+0000","last_change":"2024-09-13T18:58:17.414959+0000","last_active":"2024-09-13T18:58:17.421845+0000","last_peered":"2024-09-13T18:58:17.421845+0000","last_clean":"2024-09-13T18:58:17.421845+0000","last_became_active":"2024-09-13T18:58:17.413891+0000","last_became_peered":"2024-09-13T18:58:17.413891+0000","last_unstale":"2024-09-13T18:58:17.421845+0000","last_undegraded":"2024-09-13T18:58:17.421845+0000","last_fullsized":"2024-09-13T18:58:17.421845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:56.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403698+0000","last_change":"2024-09-13T18:58:16.990134+0000","last_active":"2024-09-13T18:58:17.403698+0000","last_peered":"2024-09-13T18:58:17.403698+0000","last_clean":"2024-09-13T18:58:17.403698+0000","last_became_active":"2024-09-13T18:58:16.989910+0000","last_became_peered":"2024-09-13T18:58:16.989910+0000","last_unstale":"2024-09-13T18:58:17.403698+0000","last_undegraded":"2024-09-13T18:58:17.403698+0000","last_fullsized":"2024-09-13T18:58:17.403698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:46.100424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427038+0000","last_change":"2024-09-13T18:58:17.422720+0000","last_active":"2024-09-13T18:58:17.427038+0000","last_peered":"2024-09-13T18:58:17.427038+0000","last_clean":"2024-09-13T18:58:17.427038+0000","last_became_active":"2024-09-13T18:58:17.422427+0000","last_became_peered":"2024-09-13T18:58:17.422427+0000","last_unstale":"2024-09-13T18:58:17.427038+0000","last_undegraded":"2024-09-13T18:58:17.427038+0000","last_fullsized":"2024-09-13T18:58:17.427038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403251+0000","last_change":"2024-09-13T18:58:16.992246+0000","last_active":"2024-09-13T18:58:17.403251+0000","last_peered":"2024-09-13T18:58:17.403251+0000","last_clean":"2024-09-13T18:58:17.403251+0000","last_became_active":"2024-09-13T18:58:16.991365+0000","last_became_peered":"2024-09-13T18:58:16.991365+0000","last_unstale":"2024-09-13T18:58:17.403251+0000","last_undegraded":"2024-09-13T18:58:17.403251+0000","last_fullsized":"2024-09-13T18:58:17.403251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:39.109449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431954+0000","last_change":"2024-09-13T18:58:17.426476+0000","last_active":"2024-09-13T18:58:17.431954+0000","last_peered":"2024-09-13T18:58:17.431954+0000","last_clean":"2024-09-13T18:58:17.431954+0000","last_became_active":"2024-09-13T18:58:17.423199+0000","last_became_peered":"2024-09-13T18:58:17.423199+0000","last_unstale":"2024-09-13T18:58:17.431954+0000","last_undegraded":"2024-09-13T18:58:17.431954+0000","last_fullsized":"2024-09-13T18:58:17.431954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:36.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.405706+0000","last_change":"2024-09-13T18:58:16.978090+0000","last_active":"2024-09-13T18:58:17.405706+0000","last_peered":"2024-09-13T18:58:17.405706+0000","last_clean":"2024-09-13T18:58:17.405706+0000","last_became_active":"2024-09-13T18:58:16.977836+0000","last_became_peered":"2024-09-13T18:58:16.977836+0000","last_unstale":"2024-09-13T18:58:17.405706+0000","last_undegraded":"2024-09-13T18:58:17.405706+0000","last_fullsized":"2024-09-13T18:58:17.405706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:41.943413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440265+0000","last_change":"2024-09-13T18:58:17.438474+0000","last_active":"2024-09-13T18:58:17.440265+0000","last_peered":"2024-09-13T18:58:17.440265+0000","last_clean":"2024-09-13T18:58:17.440265+0000","last_became_active":"2024-09-13T18:58:17.437060+0000","last_became_peered":"2024-09-13T18:58:17.437060+0000","last_unstale":"2024-09-13T18:58:17.440265+0000","last_undegraded":"2024-09-13T18:58:17.440265+0000","last_fullsized":"2024-09-13T18:58:17.440265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.400969+0000","last_change":"2024-09-13T18:58:16.990007+0000","last_active":"2024-09-13T18:58:17.400969+0000","last_peered":"2024-09-13T18:58:17.400969+0000","last_clean":"2024-09-13T18:58:17.400969+0000","last_became_active":"2024-09-13T18:58:16.983719+0000","last_became_peered":"2024-09-13T18:58:16.983719+0000","last_unstale":"2024-09-13T18:58:17.400969+0000","last_undegraded":"2024-09-13T18:58:17.400969+0000","last_fullsized":"2024-09-13T18:58:17.400969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427246+0000","last_change":"2024-09-13T18:58:17.418259+0000","last_active":"2024-09-13T18:58:17.427246+0000","last_peered":"2024-09-13T18:58:17.427246+0000","last_clean":"2024-09-13T18:58:17.427246+0000","last_became_active":"2024-09-13T18:58:17.418007+0000","last_became_peered":"2024-09-13T18:58:17.418007+0000","last_unstale":"2024-09-13T18:58:17.427246+0000","last_undegraded":"2024-09-13T18:58:17.427246+0000","last_fullsized":"2024-09-13T18:58:17.427246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:15.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437730+0000","last_change":"2024-09-13T18:58:16.984598+0000","last_active":"2024-09-13T18:58:17.437730+0000","last_peered":"2024-09-13T18:58:17.437730+0000","last_clean":"2024-09-13T18:58:17.437730+0000","last_became_active":"2024-09-13T18:58:16.984351+0000","last_became_peered":"2024-09-13T18:58:16.984351+0000","last_unstale":"2024-09-13T18:58:17.437730+0000","last_undegraded":"2024-09-13T18:58:17.437730+0000","last_fullsized":"2024-09-13T18:58:17.437730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438428+0000","last_change":"2024-09-13T18:58:17.435243+0000","last_active":"2024-09-13T18:58:17.438428+0000","last_peered":"2024-09-13T18:58:17.438428+0000","last_clean":"2024-09-13T18:58:17.438428+0000","last_became_active":"2024-09-13T18:58:17.434942+0000","last_became_peered":"2024-09-13T18:58:17.434942+0000","last_unstale":"2024-09-13T18:58:17.438428+0000","last_undegraded":"2024-09-13T18:58:17.438428+0000","last_fullsized":"2024-09-13T18:58:17.438428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.443367+0000","last_change":"2024-09-13T18:58:16.984583+0000","last_active":"2024-09-13T18:58:17.443367+0000","last_peered":"2024-09-13T18:58:17.443367+0000","last_clean":"2024-09-13T18:58:17.443367+0000","last_became_active":"2024-09-13T18:58:16.984250+0000","last_became_peered":"2024-09-13T18:58:16.984250+0000","last_unstale":"2024-09-13T18:58:17.443367+0000","last_undegraded":"2024-09-13T18:58:17.443367+0000","last_fullsized":"2024-09-13T18:58:17.443367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427699+0000","last_change":"2024-09-13T18:58:17.422719+0000","last_active":"2024-09-13T18:58:17.427699+0000","last_peered":"2024-09-13T18:58:17.427699+0000","last_clean":"2024-09-13T18:58:17.427699+0000","last_became_active":"2024-09-13T18:58:17.422378+0000","last_became_peered":"2024-09-13T18:58:17.422378+0000","last_unstale":"2024-09-13T18:58:17.427699+0000","last_undegraded":"2024-09-13T18:58:17.427699+0000","last_fullsized":"2024-09-13T18:58:17.427699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431223+0000","last_change":"2024-09-13T18:58:16.992234+0000","last_active":"2024-09-13T18:58:17.431223+0000","last_peered":"2024-09-13T18:58:17.431223+0000","last_clean":"2024-09-13T18:58:17.431223+0000","last_became_active":"2024-09-13T18:58:16.991970+0000","last_became_peered":"2024-09-13T18:58:16.991970+0000","last_unstale":"2024-09-13T18:58:17.431223+0000","last_undegraded":"2024-09-13T18:58:17.431223+0000","last_fullsized":"2024-09-13T18:58:17.431223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:07.043148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432501+0000","last_change":"2024-09-13T18:58:17.425018+0000","last_active":"2024-09-13T18:58:17.432501+0000","last_peered":"2024-09-13T18:58:17.432501+0000","last_clean":"2024-09-13T18:58:17.432501+0000","last_became_active":"2024-09-13T18:58:17.424785+0000","last_became_peered":"2024-09-13T18:58:17.424785+0000","last_unstale":"2024-09-13T18:58:17.432501+0000","last_undegraded":"2024-09-13T18:58:17.432501+0000","last_fullsized":"2024-09-13T18:58:17.432501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:14.120222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428076+0000","last_change":"2024-09-13T18:58:16.988637+0000","last_active":"2024-09-13T18:58:17.428076+0000","last_peered":"2024-09-13T18:58:17.428076+0000","last_clean":"2024-09-13T18:58:17.428076+0000","last_became_active":"2024-09-13T18:58:16.988240+0000","last_became_peered":"2024-09-13T18:58:16.988240+0000","last_unstale":"2024-09-13T18:58:17.428076+0000","last_undegraded":"2024-09-13T18:58:17.428076+0000","last_fullsized":"2024-09-13T18:58:17.428076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:12.031496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423727+0000","last_change":"2024-09-13T18:58:17.419317+0000","last_active":"2024-09-13T18:58:17.423727+0000","last_peered":"2024-09-13T18:58:17.423727+0000","last_clean":"2024-09-13T18:58:17.423727+0000","last_became_active":"2024-09-13T18:58:17.416836+0000","last_became_peered":"2024-09-13T18:58:17.416836+0000","last_unstale":"2024-09-13T18:58:17.423727+0000","last_undegraded":"2024-09-13T18:58:17.423727+0000","last_fullsized":"2024-09-13T18:58:17.423727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403701+0000","last_change":"2024-09-13T18:58:16.977199+0000","last_active":"2024-09-13T18:58:17.403701+0000","last_peered":"2024-09-13T18:58:17.403701+0000","last_clean":"2024-09-13T18:58:17.403701+0000","last_became_active":"2024-09-13T18:58:16.976918+0000","last_became_peered":"2024-09-13T18:58:16.976918+0000","last_unstale":"2024-09-13T18:58:17.403701+0000","last_undegraded":"2024-09-13T18:58:17.403701+0000","last_fullsized":"2024-09-13T18:58:17.403701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.420986+0000","last_change":"2024-09-13T18:58:17.416796+0000","last_active":"2024-09-13T18:58:17.420986+0000","last_peered":"2024-09-13T18:58:17.420986+0000","last_clean":"2024-09-13T18:58:17.420986+0000","last_became_active":"2024-09-13T18:58:17.416436+0000","last_became_peered":"2024-09-13T18:58:17.416436+0000","last_unstale":"2024-09-13T18:58:17.420986+0000","last_undegraded":"2024-09-13T18:58:17.420986+0000","last_fullsized":"2024-09-13T18:58:17.420986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.442303+0000","last_change":"2024-09-13T18:58:16.977060+0000","last_active":"2024-09-13T18:58:17.442303+0000","last_peered":"2024-09-13T18:58:17.442303+0000","last_clean":"2024-09-13T18:58:17.442303+0000","last_became_active":"2024-09-13T18:58:16.976333+0000","last_became_peered":"2024-09-13T18:58:16.976333+0000","last_unstale":"2024-09-13T18:58:17.442303+0000","last_undegraded":"2024-09-13T18:58:17.442303+0000","last_fullsized":"2024-09-13T18:58:17.442303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:55.892852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431382+0000","last_change":"2024-09-13T18:58:17.429973+0000","last_active":"2024-09-13T18:58:17.431382+0000","last_peered":"2024-09-13T18:58:17.431382+0000","last_clean":"2024-09-13T18:58:17.431382+0000","last_became_active":"2024-09-13T18:58:17.429655+0000","last_became_peered":"2024-09-13T18:58:17.429655+0000","last_unstale":"2024-09-13T18:58:17.431382+0000","last_undegraded":"2024-09-13T18:58:17.431382+0000","last_fullsized":"2024-09-13T18:58:17.431382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:31.581999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440839+0000","last_change":"2024-09-13T18:58:16.987223+0000","last_active":"2024-09-13T18:58:17.440839+0000","last_peered":"2024-09-13T18:58:17.440839+0000","last_clean":"2024-09-13T18:58:17.440839+0000","last_became_active":"2024-09-13T18:58:16.985063+0000","last_became_peered":"2024-09-13T18:58:16.985063+0000","last_unstale":"2024-09-13T18:58:17.440839+0000","last_undegraded":"2024-09-13T18:58:17.440839+0000","last_fullsized":"2024-09-13T18:58:17.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:32.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432402+0000","last_change":"2024-09-13T18:58:17.426221+0000","last_active":"2024-09-13T18:58:17.432402+0000","last_peered":"2024-09-13T18:58:17.432402+0000","last_clean":"2024-09-13T18:58:17.432402+0000","last_became_active":"2024-09-13T18:58:17.425544+0000","last_became_peered":"2024-09-13T18:58:17.425544+0000","last_unstale":"2024-09-13T18:58:17.432402+0000","last_undegraded":"2024-09-13T18:58:17.432402+0000","last_fullsized":"2024-09-13T18:58:17.432402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431687+0000","last_change":"2024-09-13T18:58:16.991954+0000","last_active":"2024-09-13T18:58:17.431687+0000","last_peered":"2024-09-13T18:58:17.431687+0000","last_clean":"2024-09-13T18:58:17.431687+0000","last_became_active":"2024-09-13T18:58:16.991720+0000","last_became_peered":"2024-09-13T18:58:16.991720+0000","last_unstale":"2024-09-13T18:58:17.431687+0000","last_undegraded":"2024-09-13T18:58:17.431687+0000","last_fullsized":"2024-09-13T18:58:17.431687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:33.678817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432941+0000","last_change":"2024-09-13T18:58:17.425995+0000","last_active":"2024-09-13T18:58:17.432941+0000","last_peered":"2024-09-13T18:58:17.432941+0000","last_clean":"2024-09-13T18:58:17.432941+0000","last_became_active":"2024-09-13T18:58:17.425221+0000","last_became_peered":"2024-09-13T18:58:17.425221+0000","last_unstale":"2024-09-13T18:58:17.432941+0000","last_undegraded":"2024-09-13T18:58:17.432941+0000","last_fullsized":"2024-09-13T18:58:17.432941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431185+0000","last_change":"2024-09-13T18:58:16.986087+0000","last_active":"2024-09-13T18:58:17.431185+0000","last_peered":"2024-09-13T18:58:17.431185+0000","last_clean":"2024-09-13T18:58:17.431185+0000","last_became_active":"2024-09-13T18:58:16.985094+0000","last_became_peered":"2024-09-13T18:58:16.985094+0000","last_unstale":"2024-09-13T18:58:17.431185+0000","last_undegraded":"2024-09-13T18:58:17.431185+0000","last_fullsized":"2024-09-13T18:58:17.431185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428328+0000","last_change":"2024-09-13T18:58:17.425133+0000","last_active":"2024-09-13T18:58:17.428328+0000","last_peered":"2024-09-13T18:58:17.428328+0000","last_clean":"2024-09-13T18:58:17.428328+0000","last_became_active":"2024-09-13T18:58:17.424666+0000","last_became_peered":"2024-09-13T18:58:17.424666+0000","last_unstale":"2024-09-13T18:58:17.428328+0000","last_undegraded":"2024-09-13T18:58:17.428328+0000","last_fullsized":"2024-09-13T18:58:17.428328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:54.221322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.402034+0000","last_change":"2024-09-13T18:58:16.994714+0000","last_active":"2024-09-13T18:58:17.402034+0000","last_peered":"2024-09-13T18:58:17.402034+0000","last_clean":"2024-09-13T18:58:17.402034+0000","last_became_active":"2024-09-13T18:58:16.994404+0000","last_became_peered":"2024-09-13T18:58:16.994404+0000","last_unstale":"2024-09-13T18:58:17.402034+0000","last_undegraded":"2024-09-13T18:58:17.402034+0000","last_fullsized":"2024-09-13T18:58:17.402034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:25.284310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428295+0000","last_change":"2024-09-13T18:58:17.425543+0000","last_active":"2024-09-13T18:58:17.428295+0000","last_peered":"2024-09-13T18:58:17.428295+0000","last_clean":"2024-09-13T18:58:17.428295+0000","last_became_active":"2024-09-13T18:58:17.425232+0000","last_became_peered":"2024-09-13T18:58:17.425232+0000","last_unstale":"2024-09-13T18:58:17.428295+0000","last_undegraded":"2024-09-13T18:58:17.428295+0000","last_fullsized":"2024-09-13T18:58:17.428295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:42.948766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437988+0000","last_change":"2024-09-13T18:58:16.994495+0000","last_active":"2024-09-13T18:58:17.437988+0000","last_peered":"2024-09-13T18:58:17.437988+0000","last_clean":"2024-09-13T18:58:17.437988+0000","last_became_active":"2024-09-13T18:58:16.991766+0000","last_became_peered":"2024-09-13T18:58:16.991766+0000","last_unstale":"2024-09-13T18:58:17.437988+0000","last_undegraded":"2024-09-13T18:58:17.437988+0000","last_fullsized":"2024-09-13T18:58:17.437988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:46.100424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.426169+0000","last_change":"2024-09-13T18:58:17.421171+0000","last_active":"2024-09-13T18:58:17.426169+0000","last_peered":"2024-09-13T18:58:17.426169+0000","last_clean":"2024-09-13T18:58:17.426169+0000","last_became_active":"2024-09-13T18:58:17.420937+0000","last_became_peered":"2024-09-13T18:58:17.420937+0000","last_unstale":"2024-09-13T18:58:17.426169+0000","last_undegraded":"2024-09-13T18:58:17.426169+0000","last_fullsized":"2024-09-13T18:58:17.426169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.105777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.406109+0000","last_change":"2024-09-13T18:58:16.994111+0000","last_active":"2024-09-13T18:58:17.406109+0000","last_peered":"2024-09-13T18:58:17.406109+0000","last_clean":"2024-09-13T18:58:17.406109+0000","last_became_active":"2024-09-13T18:58:16.993264+0000","last_became_peered":"2024-09-13T18:58:16.993264+0000","last_unstale":"2024-09-13T18:58:17.406109+0000","last_undegraded":"2024-09-13T18:58:17.406109+0000","last_fullsized":"2024-09-13T18:58:17.406109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428547+0000","last_change":"2024-09-13T18:58:17.422939+0000","last_active":"2024-09-13T18:58:17.428547+0000","last_peered":"2024-09-13T18:58:17.428547+0000","last_clean":"2024-09-13T18:58:17.428547+0000","last_became_active":"2024-09-13T18:58:17.419827+0000","last_became_peered":"2024-09-13T18:58:17.419827+0000","last_unstale":"2024-09-13T18:58:17.428547+0000","last_undegraded":"2024-09-13T18:58:17.428547+0000","last_fullsized":"2024-09-13T18:58:17.428547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:12.094322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403542+0000","last_change":"2024-09-13T18:58:16.993296+0000","last_active":"2024-09-13T18:58:17.403542+0000","last_peered":"2024-09-13T18:58:17.403542+0000","last_clean":"2024-09-13T18:58:17.403542+0000","last_became_active":"2024-09-13T18:58:16.993016+0000","last_became_peered":"2024-09-13T18:58:16.993016+0000","last_unstale":"2024-09-13T18:58:17.403542+0000","last_undegraded":"2024-09-13T18:58:17.403542+0000","last_fullsized":"2024-09-13T18:58:17.403542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:46.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422546+0000","last_change":"2024-09-13T18:58:17.417972+0000","last_active":"2024-09-13T18:58:17.422546+0000","last_peered":"2024-09-13T18:58:17.422546+0000","last_clean":"2024-09-13T18:58:17.422546+0000","last_became_active":"2024-09-13T18:58:17.417555+0000","last_became_peered":"2024-09-13T18:58:17.417555+0000","last_unstale":"2024-09-13T18:58:17.422546+0000","last_undegraded":"2024-09-13T18:58:17.422546+0000","last_fullsized":"2024-09-13T18:58:17.422546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.408387+0000","last_change":"2024-09-13T18:58:16.983958+0000","last_active":"2024-09-13T18:58:17.408387+0000","last_peered":"2024-09-13T18:58:17.408387+0000","last_clean":"2024-09-13T18:58:17.408387+0000","last_became_active":"2024-09-13T18:58:16.982777+0000","last_became_peered":"2024-09-13T18:58:16.982777+0000","last_unstale":"2024-09-13T18:58:17.408387+0000","last_undegraded":"2024-09-13T18:58:17.408387+0000","last_fullsized":"2024-09-13T18:58:17.408387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430192+0000","last_change":"2024-09-13T18:58:17.427642+0000","last_active":"2024-09-13T18:58:17.430192+0000","last_peered":"2024-09-13T18:58:17.430192+0000","last_clean":"2024-09-13T18:58:17.430192+0000","last_became_active":"2024-09-13T18:58:17.427374+0000","last_became_peered":"2024-09-13T18:58:17.427374+0000","last_unstale":"2024-09-13T18:58:17.430192+0000","last_undegraded":"2024-09-13T18:58:17.430192+0000","last_fullsized":"2024-09-13T18:58:17.430192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:13.036849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440919+0000","last_change":"2024-09-13T18:58:16.982056+0000","last_active":"2024-09-13T18:58:17.440919+0000","last_peered":"2024-09-13T18:58:17.440919+0000","last_clean":"2024-09-13T18:58:17.440919+0000","last_became_active":"2024-09-13T18:58:16.981654+0000","last_became_peered":"2024-09-13T18:58:16.981654+0000","last_unstale":"2024-09-13T18:58:17.440919+0000","last_undegraded":"2024-09-13T18:58:17.440919+0000","last_fullsized":"2024-09-13T18:58:17.440919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:55.892852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.434615+0000","last_change":"2024-09-13T18:58:17.432499+0000","last_active":"2024-09-13T18:58:17.434615+0000","last_peered":"2024-09-13T18:58:17.434615+0000","last_clean":"2024-09-13T18:58:17.434615+0000","last_became_active":"2024-09-13T18:58:17.432252+0000","last_became_peered":"2024-09-13T18:58:17.432252+0000","last_unstale":"2024-09-13T18:58:17.434615+0000","last_undegraded":"2024-09-13T18:58:17.434615+0000","last_fullsized":"2024-09-13T18:58:17.434615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.401055+0000","last_change":"2024-09-13T18:58:16.994629+0000","last_active":"2024-09-13T18:58:17.401055+0000","last_peered":"2024-09-13T18:58:17.401055+0000","last_clean":"2024-09-13T18:58:17.401055+0000","last_became_active":"2024-09-13T18:58:16.991170+0000","last_became_peered":"2024-09-13T18:58:16.991170+0000","last_unstale":"2024-09-13T18:58:17.401055+0000","last_undegraded":"2024-09-13T18:58:17.401055+0000","last_fullsized":"2024-09-13T18:58:17.401055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.439592+0000","last_change":"2024-09-13T18:58:17.435120+0000","last_active":"2024-09-13T18:58:17.439592+0000","last_peered":"2024-09-13T18:58:17.439592+0000","last_clean":"2024-09-13T18:58:17.439592+0000","last_became_active":"2024-09-13T18:58:17.434845+0000","last_became_peered":"2024-09-13T18:58:17.434845+0000","last_unstale":"2024-09-13T18:58:17.439592+0000","last_undegraded":"2024-09-13T18:58:17.439592+0000","last_fullsized":"2024-09-13T18:58:17.439592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:09.498649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433281+0000","last_change":"2024-09-13T18:58:16.991405+0000","last_active":"2024-09-13T18:58:17.433281+0000","last_peered":"2024-09-13T18:58:17.433281+0000","last_clean":"2024-09-13T18:58:17.433281+0000","last_became_active":"2024-09-13T18:58:16.991084+0000","last_became_peered":"2024-09-13T18:58:16.991084+0000","last_unstale":"2024-09-13T18:58:17.433281+0000","last_undegraded":"2024-09-13T18:58:17.433281+0000","last_fullsized":"2024-09-13T18:58:17.433281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.424285+0000","last_change":"2024-09-13T18:58:17.419284+0000","last_active":"2024-09-13T18:58:17.424285+0000","last_peered":"2024-09-13T18:58:17.424285+0000","last_clean":"2024-09-13T18:58:17.424285+0000","last_became_active":"2024-09-13T18:58:17.418575+0000","last_became_peered":"2024-09-13T18:58:17.418575+0000","last_unstale":"2024-09-13T18:58:17.424285+0000","last_undegraded":"2024-09-13T18:58:17.424285+0000","last_fullsized":"2024-09-13T18:58:17.424285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.105777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.400137+0000","last_change":"2024-09-13T18:58:16.986291+0000","last_active":"2024-09-13T18:58:17.400137+0000","last_peered":"2024-09-13T18:58:17.400137+0000","last_clean":"2024-09-13T18:58:17.400137+0000","last_became_active":"2024-09-13T18:58:16.985975+0000","last_became_peered":"2024-09-13T18:58:16.985975+0000","last_unstale":"2024-09-13T18:58:17.400137+0000","last_undegraded":"2024-09-13T18:58:17.400137+0000","last_fullsized":"2024-09-13T18:58:17.400137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:33.678817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422659+0000","last_change":"2024-09-13T18:58:17.412534+0000","last_active":"2024-09-13T18:58:17.422659+0000","last_peered":"2024-09-13T18:58:17.422659+0000","last_clean":"2024-09-13T18:58:17.422659+0000","last_became_active":"2024-09-13T18:58:17.412270+0000","last_became_peered":"2024-09-13T18:58:17.412270+0000","last_unstale":"2024-09-13T18:58:17.422659+0000","last_undegraded":"2024-09-13T18:58:17.422659+0000","last_fullsized":"2024-09-13T18:58:17.422659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:31.581999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428160+0000","last_change":"2024-09-13T18:58:16.980188+0000","last_active":"2024-09-13T18:58:17.428160+0000","last_peered":"2024-09-13T18:58:17.428160+0000","last_clean":"2024-09-13T18:58:17.428160+0000","last_became_active":"2024-09-13T18:58:16.979900+0000","last_became_peered":"2024-09-13T18:58:16.979900+0000","last_unstale":"2024-09-13T18:58:17.428160+0000","last_undegraded":"2024-09-13T18:58:17.428160+0000","last_fullsized":"2024-09-13T18:58:17.428160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:41.943413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.415647+0000","last_change":"2024-09-13T18:58:17.411894+0000","last_active":"2024-09-13T18:58:17.415647+0000","last_peered":"2024-09-13T18:58:17.415647+0000","last_clean":"2024-09-13T18:58:17.415647+0000","last_became_active":"2024-09-13T18:58:17.411664+0000","last_became_peered":"2024-09-13T18:58:17.411664+0000","last_unstale":"2024-09-13T18:58:17.415647+0000","last_undegraded":"2024-09-13T18:58:17.415647+0000","last_fullsized":"2024-09-13T18:58:17.415647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403651+0000","last_change":"2024-09-13T18:58:16.981787+0000","last_active":"2024-09-13T18:58:17.403651+0000","last_peered":"2024-09-13T18:58:17.403651+0000","last_clean":"2024-09-13T18:58:17.403651+0000","last_became_active":"2024-09-13T18:58:16.981507+0000","last_became_peered":"2024-09-13T18:58:16.981507+0000","last_unstale":"2024-09-13T18:58:17.403651+0000","last_undegraded":"2024-09-13T18:58:17.403651+0000","last_fullsized":"2024-09-13T18:58:17.403651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:50.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418435+0000","last_change":"2024-09-13T18:58:17.411382+0000","last_active":"2024-09-13T18:58:17.418435+0000","last_peered":"2024-09-13T18:58:17.418435+0000","last_clean":"2024-09-13T18:58:17.418435+0000","last_became_active":"2024-09-13T18:58:17.409343+0000","last_became_peered":"2024-09-13T18:58:17.409343+0000","last_unstale":"2024-09-13T18:58:17.418435+0000","last_undegraded":"2024-09-13T18:58:17.418435+0000","last_fullsized":"2024-09-13T18:58:17.418435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:36.699011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403795+0000","last_change":"2024-09-13T18:58:16.977539+0000","last_active":"2024-09-13T18:58:17.403795+0000","last_peered":"2024-09-13T18:58:17.403795+0000","last_clean":"2024-09-13T18:58:17.403795+0000","last_became_active":"2024-09-13T18:58:16.977132+0000","last_became_peered":"2024-09-13T18:58:16.977132+0000","last_unstale":"2024-09-13T18:58:17.403795+0000","last_undegraded":"2024-09-13T18:58:17.403795+0000","last_fullsized":"2024-09-13T18:58:17.403795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:32.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.421366+0000","last_change":"2024-09-13T18:58:17.414651+0000","last_active":"2024-09-13T18:58:17.421366+0000","last_peered":"2024-09-13T18:58:17.421366+0000","last_clean":"2024-09-13T18:58:17.421366+0000","last_became_active":"2024-09-13T18:58:17.414357+0000","last_became_peered":"2024-09-13T18:58:17.414357+0000","last_unstale":"2024-09-13T18:58:17.421366+0000","last_undegraded":"2024-09-13T18:58:17.421366+0000","last_fullsized":"2024-09-13T18:58:17.421366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:15.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.406529+0000","last_change":"2024-09-13T18:58:16.993785+0000","last_active":"2024-09-13T18:58:17.406529+0000","last_peered":"2024-09-13T18:58:17.406529+0000","last_clean":"2024-09-13T18:58:17.406529+0000","last_became_active":"2024-09-13T18:58:16.992848+0000","last_became_peered":"2024-09-13T18:58:16.992848+0000","last_unstale":"2024-09-13T18:58:17.406529+0000","last_undegraded":"2024-09-13T18:58:17.406529+0000","last_fullsized":"2024-09-13T18:58:17.406529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:50.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:58:16.977256+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:58:16.977256+0000","last_peered":"2024-09-13T18:58:16.977256+0000","last_clean":"2024-09-13T18:58:16.977256+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:58:16.977256+0000","last_undegraded":"2024-09-13T18:58:16.977256+0000","last_fullsized":"2024-09-13T18:58:16.977256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":736045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.75},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.90000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.622}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.753},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.62}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.77200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.747},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.495},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.442},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.374},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.441}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.433}]},{"osd":2,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:58:21.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:58:21.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.776+0000 7f784f200640 1 Processor -- start 2024-09-13T18:58:21.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.777+0000 7f784f200640 1 -- start start 2024-09-13T18:58:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f785015a5c0 0x7f78500b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 0x7f78500b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 0x7f785006f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78500cce20 con 0x7f785015a5c0 2024-09-13T18:58:21.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78500cbfc0 con 0x7f78500cbac0 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78500707a0 con 0x7f78500afe10 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f785015a5c0 0x7f78500b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f785015a5c0 0x7f78500b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34762/0 (socket says 172.21.15.33:34762) 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.778+0000 7f784de00640 1 -- 172.21.15.33:0/3885162068 learned_addr learned my addr 172.21.15.33:0/3885162068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784e800640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 0x7f785006f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f7847e00640 1 --2- 172.21.15.33:0/3885162068 >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 0x7f78500b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784de00640 1 -- 172.21.15.33:0/3885162068 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 msgr2=0x7f785006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784de00640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 0x7f785006f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784de00640 1 -- 172.21.15.33:0/3885162068 >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 msgr2=0x7f78500b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784de00640 1 --2- 172.21.15.33:0/3885162068 >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 0x7f78500b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784de00640 1 -- 172.21.15.33:0/3885162068 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850070a80 con 0x7f785015a5c0 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f7847e00640 1 --2- 172.21.15.33:0/3885162068 >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 0x7f78500b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:21.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.779+0000 7f784e800640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 0x7f785006f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.780+0000 7f784de00640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f785015a5c0 0x7f78500b39b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7850061c10 tx=0x7f784002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84b09666b83997b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.780+0000 7f784d400640 1 -- 172.21.15.33:0/3885162068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840032440 con 0x7f785015a5c0 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.780+0000 7f784d400640 1 -- 172.21.15.33:0/3885162068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400325a0 con 0x7f785015a5c0 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.780+0000 7f784d400640 1 -- 172.21.15.33:0/3885162068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840032930 con 0x7f785015a5c0 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 -- 172.21.15.33:0/3885162068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f785015a5c0 msgr2=0x7f78500b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f785015a5c0 0x7f78500b39b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7850061c10 tx=0x7f784002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 -- 172.21.15.33:0/3885162068 shutdown_connections 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78500afe10 0x7f785006f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 --2- 172.21.15.33:0/3885162068 >> v2:172.21.15.103:3300/0 conn(0x7f78500cbac0 0x7f78500b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 --2- 172.21.15.33:0/3885162068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f785015a5c0 0x7f78500b39b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 -- 172.21.15.33:0/3885162068 >> 172.21.15.33:0/3885162068 conn(0x7f78500ae310 msgr2=0x7f78500ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 -- 172.21.15.33:0/3885162068 shutdown_connections 2024-09-13T18:58:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.781+0000 7f784f200640 1 -- 172.21.15.33:0/3885162068 wait complete. 2024-09-13T18:58:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.782+0000 7f784f200640 1 Processor -- start 2024-09-13T18:58:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 -- start start 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78500cbac0 0x7f7850153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f785015a5c0 0x7f78501e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7850153680 con 0x7f78500afe10 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78501f1fc0 con 0x7f78500cbac0 2024-09-13T18:58:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.783+0000 7f784f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78501f22a0 con 0x7f785015a5c0 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34764/0 (socket says 172.21.15.33:34764) 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 -- 172.21.15.33:0/174754569 learned_addr learned my addr 172.21.15.33:0/174754569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f7847e00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78500cbac0 0x7f7850153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784e800640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f785015a5c0 0x7f78501e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 -- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f785015a5c0 msgr2=0x7f78501e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f785015a5c0 0x7f78501e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 -- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78500cbac0 msgr2=0x7f7850153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78500cbac0 0x7f7850153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.784+0000 7f784de00640 1 -- 172.21.15.33:0/174754569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400094d0 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f784de00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f784002a220 tx=0x7f78400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840030b80 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840030ce0 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784003d680 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78501f2580 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.785+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78501f1ac0 con 0x7f78500afe10 2024-09-13T18:58:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.786+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7850067360 con 0x7f78500afe10 2024-09-13T18:58:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.787+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7840039040 con 0x7f78500afe10 2024-09-13T18:58:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.788+0000 7f7846000640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 0x7f782c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.788+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78400aa0f0 con 0x7f78500afe10 2024-09-13T18:58:21.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.789+0000 7f7847e00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 0x7f782c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:21.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.790+0000 7f7847e00640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 0x7f782c06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7850156910 tx=0x7f7838008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:21.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.793+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f78400752c0 con 0x7f78500afe10 2024-09-13T18:58:21.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.967+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7850071280 con 0x7f782c06ac00 2024-09-13T18:58:21.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.975+0000 7f7846000640 1 -- 172.21.15.33:0/174754569 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288875 (secure 0 0 0) 0x7f783800a660 con 0x7f782c06ac00 2024-09-13T18:58:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 msgr2=0x7f782c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 0x7f782c06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7850156910 tx=0x7f7838008040 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 msgr2=0x7f7850153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f784002a220 tx=0x7f78400046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 shutdown_connections 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f782c06ac00 0x7f782c06d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f785015a5c0 0x7f78501e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78500cbac0 0x7f7850153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 --2- 172.21.15.33:0/174754569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78500afe10 0x7f7850153bd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 >> 172.21.15.33:0/174754569 conn(0x7f78500ae310 msgr2=0x7f78501596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 shutdown_connections 2024-09-13T18:58:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:21.979+0000 7f784f200640 1 -- 172.21.15.33:0/174754569 wait complete. 2024-09-13T18:58:21.998 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:58:21.110667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220320,"kb_used_data":4104,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754400,"statfs":{"total":773094113280,"available":772868505600,"internally_reserved":0,"allocated":4202496,"data_stored":2335990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.149958"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431428+0000","last_change":"2024-09-13T18:58:17.427509+0000","last_active":"2024-09-13T18:58:17.431428+0000","last_peered":"2024-09-13T18:58:17.431428+0000","last_clean":"2024-09-13T18:58:17.431428+0000","last_became_active":"2024-09-13T18:58:17.427262+0000","last_became_peered":"2024-09-13T18:58:17.427262+0000","last_unstale":"2024-09-13T18:58:17.431428+0000","last_undegraded":"2024-09-13T18:58:17.431428+0000","last_fullsized":"2024-09-13T18:58:17.431428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:28.837539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430645+0000","last_change":"2024-09-13T18:58:17.421513+0000","last_active":"2024-09-13T18:58:17.430645+0000","last_peered":"2024-09-13T18:58:17.430645+0000","last_clean":"2024-09-13T18:58:17.430645+0000","last_became_active":"2024-09-13T18:58:17.419945+0000","last_became_peered":"2024-09-13T18:58:17.419945+0000","last_unstale":"2024-09-13T18:58:17.430645+0000","last_undegraded":"2024-09-13T18:58:17.430645+0000","last_fullsized":"2024-09-13T18:58:17.430645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:52.252700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438408+0000","last_change":"2024-09-13T18:58:17.435218+0000","last_active":"2024-09-13T18:58:17.438408+0000","last_peered":"2024-09-13T18:58:17.438408+0000","last_clean":"2024-09-13T18:58:17.438408+0000","last_became_active":"2024-09-13T18:58:17.434943+0000","last_became_peered":"2024-09-13T18:58:17.434943+0000","last_unstale":"2024-09-13T18:58:17.438408+0000","last_undegraded":"2024-09-13T18:58:17.438408+0000","last_fullsized":"2024-09-13T18:58:17.438408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432959+0000","last_change":"2024-09-13T18:58:17.426140+0000","last_active":"2024-09-13T18:58:17.432959+0000","last_peered":"2024-09-13T18:58:17.432959+0000","last_clean":"2024-09-13T18:58:17.432959+0000","last_became_active":"2024-09-13T18:58:17.425550+0000","last_became_peered":"2024-09-13T18:58:17.425550+0000","last_unstale":"2024-09-13T18:58:17.432959+0000","last_undegraded":"2024-09-13T18:58:17.432959+0000","last_fullsized":"2024-09-13T18:58:17.432959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.426187+0000","last_change":"2024-09-13T18:58:17.422437+0000","last_active":"2024-09-13T18:58:17.426187+0000","last_peered":"2024-09-13T18:58:17.426187+0000","last_clean":"2024-09-13T18:58:17.426187+0000","last_became_active":"2024-09-13T18:58:17.422175+0000","last_became_peered":"2024-09-13T18:58:17.422175+0000","last_unstale":"2024-09-13T18:58:17.426187+0000","last_undegraded":"2024-09-13T18:58:17.426187+0000","last_fullsized":"2024-09-13T18:58:17.426187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:56.898206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433183+0000","last_change":"2024-09-13T18:58:17.431777+0000","last_active":"2024-09-13T18:58:17.433183+0000","last_peered":"2024-09-13T18:58:17.433183+0000","last_clean":"2024-09-13T18:58:17.433183+0000","last_became_active":"2024-09-13T18:58:17.431508+0000","last_became_peered":"2024-09-13T18:58:17.431508+0000","last_unstale":"2024-09-13T18:58:17.433183+0000","last_undegraded":"2024-09-13T18:58:17.433183+0000","last_fullsized":"2024-09-13T18:58:17.433183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422565+0000","last_change":"2024-09-13T18:58:17.417971+0000","last_active":"2024-09-13T18:58:17.422565+0000","last_peered":"2024-09-13T18:58:17.422565+0000","last_clean":"2024-09-13T18:58:17.422565+0000","last_became_active":"2024-09-13T18:58:17.417528+0000","last_became_peered":"2024-09-13T18:58:17.417528+0000","last_unstale":"2024-09-13T18:58:17.422565+0000","last_undegraded":"2024-09-13T18:58:17.422565+0000","last_fullsized":"2024-09-13T18:58:17.422565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.415463+0000","last_change":"2024-09-13T18:58:17.408811+0000","last_active":"2024-09-13T18:58:17.415463+0000","last_peered":"2024-09-13T18:58:17.415463+0000","last_clean":"2024-09-13T18:58:17.415463+0000","last_became_active":"2024-09-13T18:58:17.408535+0000","last_became_peered":"2024-09-13T18:58:17.408535+0000","last_unstale":"2024-09-13T18:58:17.415463+0000","last_undegraded":"2024-09-13T18:58:17.415463+0000","last_fullsized":"2024-09-13T18:58:17.415463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:52.252700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438800+0000","last_change":"2024-09-13T18:58:17.437687+0000","last_active":"2024-09-13T18:58:17.438800+0000","last_peered":"2024-09-13T18:58:17.438800+0000","last_clean":"2024-09-13T18:58:17.438800+0000","last_became_active":"2024-09-13T18:58:17.437326+0000","last_became_peered":"2024-09-13T18:58:17.437326+0000","last_unstale":"2024-09-13T18:58:17.438800+0000","last_undegraded":"2024-09-13T18:58:17.438800+0000","last_fullsized":"2024-09-13T18:58:17.438800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:09.498649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430502+0000","last_change":"2024-09-13T18:58:17.424599+0000","last_active":"2024-09-13T18:58:17.430502+0000","last_peered":"2024-09-13T18:58:17.430502+0000","last_clean":"2024-09-13T18:58:17.430502+0000","last_became_active":"2024-09-13T18:58:17.424306+0000","last_became_peered":"2024-09-13T18:58:17.424306+0000","last_unstale":"2024-09-13T18:58:17.430502+0000","last_undegraded":"2024-09-13T18:58:17.430502+0000","last_fullsized":"2024-09-13T18:58:17.430502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437417+0000","last_change":"2024-09-13T18:58:17.432798+0000","last_active":"2024-09-13T18:58:17.437417+0000","last_peered":"2024-09-13T18:58:17.437417+0000","last_clean":"2024-09-13T18:58:17.437417+0000","last_became_active":"2024-09-13T18:58:17.432389+0000","last_became_peered":"2024-09-13T18:58:17.432389+0000","last_unstale":"2024-09-13T18:58:17.437417+0000","last_undegraded":"2024-09-13T18:58:17.437417+0000","last_fullsized":"2024-09-13T18:58:17.437417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428749+0000","last_change":"2024-09-13T18:58:17.425218+0000","last_active":"2024-09-13T18:58:17.428749+0000","last_peered":"2024-09-13T18:58:17.428749+0000","last_clean":"2024-09-13T18:58:17.428749+0000","last_became_active":"2024-09-13T18:58:17.424967+0000","last_became_peered":"2024-09-13T18:58:17.424967+0000","last_unstale":"2024-09-13T18:58:17.428749+0000","last_undegraded":"2024-09-13T18:58:17.428749+0000","last_fullsized":"2024-09-13T18:58:17.428749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:17.559950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429367+0000","last_change":"2024-09-13T18:58:17.425686+0000","last_active":"2024-09-13T18:58:17.429367+0000","last_peered":"2024-09-13T18:58:17.429367+0000","last_clean":"2024-09-13T18:58:17.429367+0000","last_became_active":"2024-09-13T18:58:17.425365+0000","last_became_peered":"2024-09-13T18:58:17.425365+0000","last_unstale":"2024-09-13T18:58:17.429367+0000","last_undegraded":"2024-09-13T18:58:17.429367+0000","last_fullsized":"2024-09-13T18:58:17.429367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:33.234923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422621+0000","last_change":"2024-09-13T18:58:17.417390+0000","last_active":"2024-09-13T18:58:17.422621+0000","last_peered":"2024-09-13T18:58:17.422621+0000","last_clean":"2024-09-13T18:58:17.422621+0000","last_became_active":"2024-09-13T18:58:17.417143+0000","last_became_peered":"2024-09-13T18:58:17.417143+0000","last_unstale":"2024-09-13T18:58:17.422621+0000","last_undegraded":"2024-09-13T18:58:17.422621+0000","last_fullsized":"2024-09-13T18:58:17.422621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:05.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429044+0000","last_change":"2024-09-13T18:58:17.423775+0000","last_active":"2024-09-13T18:58:17.429044+0000","last_peered":"2024-09-13T18:58:17.429044+0000","last_clean":"2024-09-13T18:58:17.429044+0000","last_became_active":"2024-09-13T18:58:17.422163+0000","last_became_peered":"2024-09-13T18:58:17.422163+0000","last_unstale":"2024-09-13T18:58:17.429044+0000","last_undegraded":"2024-09-13T18:58:17.429044+0000","last_fullsized":"2024-09-13T18:58:17.429044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:33.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423743+0000","last_change":"2024-09-13T18:58:17.420364+0000","last_active":"2024-09-13T18:58:17.423743+0000","last_peered":"2024-09-13T18:58:17.423743+0000","last_clean":"2024-09-13T18:58:17.423743+0000","last_became_active":"2024-09-13T18:58:17.416443+0000","last_became_peered":"2024-09-13T18:58:17.416443+0000","last_unstale":"2024-09-13T18:58:17.423743+0000","last_undegraded":"2024-09-13T18:58:17.423743+0000","last_fullsized":"2024-09-13T18:58:17.423743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.424642+0000","last_change":"2024-09-13T18:58:17.417973+0000","last_active":"2024-09-13T18:58:17.424642+0000","last_peered":"2024-09-13T18:58:17.424642+0000","last_clean":"2024-09-13T18:58:17.424642+0000","last_became_active":"2024-09-13T18:58:17.417461+0000","last_became_peered":"2024-09-13T18:58:17.417461+0000","last_unstale":"2024-09-13T18:58:17.424642+0000","last_undegraded":"2024-09-13T18:58:17.424642+0000","last_fullsized":"2024-09-13T18:58:17.424642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430682+0000","last_change":"2024-09-13T18:58:17.424899+0000","last_active":"2024-09-13T18:58:17.430682+0000","last_peered":"2024-09-13T18:58:17.430682+0000","last_clean":"2024-09-13T18:58:17.430682+0000","last_became_active":"2024-09-13T18:58:17.424615+0000","last_became_peered":"2024-09-13T18:58:17.424615+0000","last_unstale":"2024-09-13T18:58:17.430682+0000","last_undegraded":"2024-09-13T18:58:17.430682+0000","last_fullsized":"2024-09-13T18:58:17.430682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440257+0000","last_change":"2024-09-13T18:58:17.438931+0000","last_active":"2024-09-13T18:58:17.440257+0000","last_peered":"2024-09-13T18:58:17.440257+0000","last_clean":"2024-09-13T18:58:17.440257+0000","last_became_active":"2024-09-13T18:58:17.438333+0000","last_became_peered":"2024-09-13T18:58:17.438333+0000","last_unstale":"2024-09-13T18:58:17.440257+0000","last_undegraded":"2024-09-13T18:58:17.440257+0000","last_fullsized":"2024-09-13T18:58:17.440257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428446+0000","last_change":"2024-09-13T18:58:17.424057+0000","last_active":"2024-09-13T18:58:17.428446+0000","last_peered":"2024-09-13T18:58:17.428446+0000","last_clean":"2024-09-13T18:58:17.428446+0000","last_became_active":"2024-09-13T18:58:17.423623+0000","last_became_peered":"2024-09-13T18:58:17.423623+0000","last_unstale":"2024-09-13T18:58:17.428446+0000","last_undegraded":"2024-09-13T18:58:17.428446+0000","last_fullsized":"2024-09-13T18:58:17.428446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418483+0000","last_change":"2024-09-13T18:58:17.408131+0000","last_active":"2024-09-13T18:58:17.418483+0000","last_peered":"2024-09-13T18:58:17.418483+0000","last_clean":"2024-09-13T18:58:17.418483+0000","last_became_active":"2024-09-13T18:58:17.407846+0000","last_became_peered":"2024-09-13T18:58:17.407846+0000","last_unstale":"2024-09-13T18:58:17.418483+0000","last_undegraded":"2024-09-13T18:58:17.418483+0000","last_fullsized":"2024-09-13T18:58:17.418483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:56.973524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428114+0000","last_change":"2024-09-13T18:58:17.419033+0000","last_active":"2024-09-13T18:58:17.428114+0000","last_peered":"2024-09-13T18:58:17.428114+0000","last_clean":"2024-09-13T18:58:17.428114+0000","last_became_active":"2024-09-13T18:58:17.418746+0000","last_became_peered":"2024-09-13T18:58:17.418746+0000","last_unstale":"2024-09-13T18:58:17.428114+0000","last_undegraded":"2024-09-13T18:58:17.428114+0000","last_fullsized":"2024-09-13T18:58:17.428114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:33.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416977+0000","last_change":"2024-09-13T18:58:17.407112+0000","last_active":"2024-09-13T18:58:17.416977+0000","last_peered":"2024-09-13T18:58:17.416977+0000","last_clean":"2024-09-13T18:58:17.416977+0000","last_became_active":"2024-09-13T18:58:17.406832+0000","last_became_peered":"2024-09-13T18:58:17.406832+0000","last_unstale":"2024-09-13T18:58:17.416977+0000","last_undegraded":"2024-09-13T18:58:17.416977+0000","last_fullsized":"2024-09-13T18:58:17.416977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:56.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423342+0000","last_change":"2024-09-13T18:58:17.419294+0000","last_active":"2024-09-13T18:58:17.423342+0000","last_peered":"2024-09-13T18:58:17.423342+0000","last_clean":"2024-09-13T18:58:17.423342+0000","last_became_active":"2024-09-13T18:58:17.418951+0000","last_became_peered":"2024-09-13T18:58:17.418951+0000","last_unstale":"2024-09-13T18:58:17.423342+0000","last_undegraded":"2024-09-13T18:58:17.423342+0000","last_fullsized":"2024-09-13T18:58:17.423342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436297+0000","last_change":"2024-09-13T18:58:17.430331+0000","last_active":"2024-09-13T18:58:17.436297+0000","last_peered":"2024-09-13T18:58:17.436297+0000","last_clean":"2024-09-13T18:58:17.436297+0000","last_became_active":"2024-09-13T18:58:17.430065+0000","last_became_peered":"2024-09-13T18:58:17.430065+0000","last_unstale":"2024-09-13T18:58:17.436297+0000","last_undegraded":"2024-09-13T18:58:17.436297+0000","last_fullsized":"2024-09-13T18:58:17.436297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430665+0000","last_change":"2024-09-13T18:58:17.422187+0000","last_active":"2024-09-13T18:58:17.430665+0000","last_peered":"2024-09-13T18:58:17.430665+0000","last_clean":"2024-09-13T18:58:17.430665+0000","last_became_active":"2024-09-13T18:58:17.421870+0000","last_became_peered":"2024-09-13T18:58:17.421870+0000","last_unstale":"2024-09-13T18:58:17.430665+0000","last_undegraded":"2024-09-13T18:58:17.430665+0000","last_fullsized":"2024-09-13T18:58:17.430665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436461+0000","last_change":"2024-09-13T18:58:17.428886+0000","last_active":"2024-09-13T18:58:17.436461+0000","last_peered":"2024-09-13T18:58:17.436461+0000","last_clean":"2024-09-13T18:58:17.436461+0000","last_became_active":"2024-09-13T18:58:17.428672+0000","last_became_peered":"2024-09-13T18:58:17.428672+0000","last_unstale":"2024-09-13T18:58:17.436461+0000","last_undegraded":"2024-09-13T18:58:17.436461+0000","last_fullsized":"2024-09-13T18:58:17.436461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432015+0000","last_change":"2024-09-13T18:58:17.427370+0000","last_active":"2024-09-13T18:58:17.432015+0000","last_peered":"2024-09-13T18:58:17.432015+0000","last_clean":"2024-09-13T18:58:17.432015+0000","last_became_active":"2024-09-13T18:58:17.427063+0000","last_became_peered":"2024-09-13T18:58:17.427063+0000","last_unstale":"2024-09-13T18:58:17.432015+0000","last_undegraded":"2024-09-13T18:58:17.432015+0000","last_fullsized":"2024-09-13T18:58:17.432015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:56.973524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418497+0000","last_change":"2024-09-13T18:58:17.410958+0000","last_active":"2024-09-13T18:58:17.418497+0000","last_peered":"2024-09-13T18:58:17.418497+0000","last_clean":"2024-09-13T18:58:17.418497+0000","last_became_active":"2024-09-13T18:58:17.410657+0000","last_became_peered":"2024-09-13T18:58:17.410657+0000","last_unstale":"2024-09-13T18:58:17.418497+0000","last_undegraded":"2024-09-13T18:58:17.418497+0000","last_fullsized":"2024-09-13T18:58:17.418497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:36.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.419894+0000","last_change":"2024-09-13T18:58:17.414945+0000","last_active":"2024-09-13T18:58:17.419894+0000","last_peered":"2024-09-13T18:58:17.419894+0000","last_clean":"2024-09-13T18:58:17.419894+0000","last_became_active":"2024-09-13T18:58:17.414677+0000","last_became_peered":"2024-09-13T18:58:17.414677+0000","last_unstale":"2024-09-13T18:58:17.419894+0000","last_undegraded":"2024-09-13T18:58:17.419894+0000","last_fullsized":"2024-09-13T18:58:17.419894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:24.072563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416140+0000","last_change":"2024-09-13T18:58:17.411115+0000","last_active":"2024-09-13T18:58:17.416140+0000","last_peered":"2024-09-13T18:58:17.416140+0000","last_clean":"2024-09-13T18:58:17.416140+0000","last_became_active":"2024-09-13T18:58:17.410726+0000","last_became_peered":"2024-09-13T18:58:17.410726+0000","last_unstale":"2024-09-13T18:58:17.416140+0000","last_undegraded":"2024-09-13T18:58:17.416140+0000","last_fullsized":"2024-09-13T18:58:17.416140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:54.221322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427086+0000","last_change":"2024-09-13T18:58:17.421150+0000","last_active":"2024-09-13T18:58:17.427086+0000","last_peered":"2024-09-13T18:58:17.427086+0000","last_clean":"2024-09-13T18:58:17.427086+0000","last_became_active":"2024-09-13T18:58:17.420900+0000","last_became_peered":"2024-09-13T18:58:17.420900+0000","last_unstale":"2024-09-13T18:58:17.427086+0000","last_undegraded":"2024-09-13T18:58:17.427086+0000","last_fullsized":"2024-09-13T18:58:17.427086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.416739+0000","last_change":"2024-09-13T18:58:17.408067+0000","last_active":"2024-09-13T18:58:17.416739+0000","last_peered":"2024-09-13T18:58:17.416739+0000","last_clean":"2024-09-13T18:58:17.416739+0000","last_became_active":"2024-09-13T18:58:17.407839+0000","last_became_peered":"2024-09-13T18:58:17.407839+0000","last_unstale":"2024-09-13T18:58:17.416739+0000","last_undegraded":"2024-09-13T18:58:17.416739+0000","last_fullsized":"2024-09-13T18:58:17.416739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:36.699011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.434805+0000","last_change":"2024-09-13T18:58:16.980897+0000","last_active":"2024-09-13T18:58:17.434805+0000","last_peered":"2024-09-13T18:58:17.434805+0000","last_clean":"2024-09-13T18:58:17.434805+0000","last_became_active":"2024-09-13T18:58:16.980557+0000","last_became_peered":"2024-09-13T18:58:16.980557+0000","last_unstale":"2024-09-13T18:58:17.434805+0000","last_undegraded":"2024-09-13T18:58:17.434805+0000","last_fullsized":"2024-09-13T18:58:17.434805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:58.182996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428305+0000","last_change":"2024-09-13T18:58:17.420415+0000","last_active":"2024-09-13T18:58:17.428305+0000","last_peered":"2024-09-13T18:58:17.428305+0000","last_clean":"2024-09-13T18:58:17.428305+0000","last_became_active":"2024-09-13T18:58:17.420111+0000","last_became_peered":"2024-09-13T18:58:17.420111+0000","last_unstale":"2024-09-13T18:58:17.428305+0000","last_undegraded":"2024-09-13T18:58:17.428305+0000","last_fullsized":"2024-09-13T18:58:17.428305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:42.948766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.429879+0000","last_change":"2024-09-13T18:58:16.994507+0000","last_active":"2024-09-13T18:58:17.429879+0000","last_peered":"2024-09-13T18:58:17.429879+0000","last_clean":"2024-09-13T18:58:17.429879+0000","last_became_active":"2024-09-13T18:58:16.991701+0000","last_became_peered":"2024-09-13T18:58:16.991701+0000","last_unstale":"2024-09-13T18:58:17.429879+0000","last_undegraded":"2024-09-13T18:58:17.429879+0000","last_fullsized":"2024-09-13T18:58:17.429879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418357+0000","last_change":"2024-09-13T18:58:17.410251+0000","last_active":"2024-09-13T18:58:17.418357+0000","last_peered":"2024-09-13T18:58:17.418357+0000","last_clean":"2024-09-13T18:58:17.418357+0000","last_became_active":"2024-09-13T18:58:17.409993+0000","last_became_peered":"2024-09-13T18:58:17.409993+0000","last_unstale":"2024-09-13T18:58:17.418357+0000","last_undegraded":"2024-09-13T18:58:17.418357+0000","last_fullsized":"2024-09-13T18:58:17.418357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:17.559950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.441718+0000","last_change":"2024-09-13T18:58:16.979028+0000","last_active":"2024-09-13T18:58:17.441718+0000","last_peered":"2024-09-13T18:58:17.441718+0000","last_clean":"2024-09-13T18:58:17.441718+0000","last_became_active":"2024-09-13T18:58:16.977430+0000","last_became_peered":"2024-09-13T18:58:16.977430+0000","last_unstale":"2024-09-13T18:58:17.441718+0000","last_undegraded":"2024-09-13T18:58:17.441718+0000","last_fullsized":"2024-09-13T18:58:17.441718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.436441+0000","last_change":"2024-09-13T18:58:17.428799+0000","last_active":"2024-09-13T18:58:17.436441+0000","last_peered":"2024-09-13T18:58:17.436441+0000","last_clean":"2024-09-13T18:58:17.436441+0000","last_became_active":"2024-09-13T18:58:17.428378+0000","last_became_peered":"2024-09-13T18:58:17.428378+0000","last_unstale":"2024-09-13T18:58:17.436441+0000","last_undegraded":"2024-09-13T18:58:17.436441+0000","last_fullsized":"2024-09-13T18:58:17.436441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:29.098083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437968+0000","last_change":"2024-09-13T18:58:16.993590+0000","last_active":"2024-09-13T18:58:17.437968+0000","last_peered":"2024-09-13T18:58:17.437968+0000","last_clean":"2024-09-13T18:58:17.437968+0000","last_became_active":"2024-09-13T18:58:16.993114+0000","last_became_peered":"2024-09-13T18:58:16.993114+0000","last_unstale":"2024-09-13T18:58:17.437968+0000","last_undegraded":"2024-09-13T18:58:17.437968+0000","last_fullsized":"2024-09-13T18:58:17.437968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427797+0000","last_change":"2024-09-13T18:58:17.420896+0000","last_active":"2024-09-13T18:58:17.427797+0000","last_peered":"2024-09-13T18:58:17.427797+0000","last_clean":"2024-09-13T18:58:17.427797+0000","last_became_active":"2024-09-13T18:58:17.420594+0000","last_became_peered":"2024-09-13T18:58:17.420594+0000","last_unstale":"2024-09-13T18:58:17.427797+0000","last_undegraded":"2024-09-13T18:58:17.427797+0000","last_fullsized":"2024-09-13T18:58:17.427797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:14.120222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433280+0000","last_change":"2024-09-13T18:58:16.994723+0000","last_active":"2024-09-13T18:58:17.433280+0000","last_peered":"2024-09-13T18:58:17.433280+0000","last_clean":"2024-09-13T18:58:17.433280+0000","last_became_active":"2024-09-13T18:58:16.994461+0000","last_became_peered":"2024-09-13T18:58:16.994461+0000","last_unstale":"2024-09-13T18:58:17.433280+0000","last_undegraded":"2024-09-13T18:58:17.433280+0000","last_fullsized":"2024-09-13T18:58:17.433280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:30.301727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432501+0000","last_change":"2024-09-13T18:58:17.427707+0000","last_active":"2024-09-13T18:58:17.432501+0000","last_peered":"2024-09-13T18:58:17.432501+0000","last_clean":"2024-09-13T18:58:17.432501+0000","last_became_active":"2024-09-13T18:58:17.427393+0000","last_became_peered":"2024-09-13T18:58:17.427393+0000","last_unstale":"2024-09-13T18:58:17.432501+0000","last_undegraded":"2024-09-13T18:58:17.432501+0000","last_fullsized":"2024-09-13T18:58:17.432501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432050+0000","last_change":"2024-09-13T18:58:16.994727+0000","last_active":"2024-09-13T18:58:17.432050+0000","last_peered":"2024-09-13T18:58:17.432050+0000","last_clean":"2024-09-13T18:58:17.432050+0000","last_became_active":"2024-09-13T18:58:16.994387+0000","last_became_peered":"2024-09-13T18:58:16.994387+0000","last_unstale":"2024-09-13T18:58:17.432050+0000","last_undegraded":"2024-09-13T18:58:17.432050+0000","last_fullsized":"2024-09-13T18:58:17.432050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:58.182996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.421845+0000","last_change":"2024-09-13T18:58:17.414959+0000","last_active":"2024-09-13T18:58:17.421845+0000","last_peered":"2024-09-13T18:58:17.421845+0000","last_clean":"2024-09-13T18:58:17.421845+0000","last_became_active":"2024-09-13T18:58:17.413891+0000","last_became_peered":"2024-09-13T18:58:17.413891+0000","last_unstale":"2024-09-13T18:58:17.421845+0000","last_undegraded":"2024-09-13T18:58:17.421845+0000","last_fullsized":"2024-09-13T18:58:17.421845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:56.727284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403698+0000","last_change":"2024-09-13T18:58:16.990134+0000","last_active":"2024-09-13T18:58:17.403698+0000","last_peered":"2024-09-13T18:58:17.403698+0000","last_clean":"2024-09-13T18:58:17.403698+0000","last_became_active":"2024-09-13T18:58:16.989910+0000","last_became_peered":"2024-09-13T18:58:16.989910+0000","last_unstale":"2024-09-13T18:58:17.403698+0000","last_undegraded":"2024-09-13T18:58:17.403698+0000","last_fullsized":"2024-09-13T18:58:17.403698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:46.100424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427038+0000","last_change":"2024-09-13T18:58:17.422720+0000","last_active":"2024-09-13T18:58:17.427038+0000","last_peered":"2024-09-13T18:58:17.427038+0000","last_clean":"2024-09-13T18:58:17.427038+0000","last_became_active":"2024-09-13T18:58:17.422427+0000","last_became_peered":"2024-09-13T18:58:17.422427+0000","last_unstale":"2024-09-13T18:58:17.427038+0000","last_undegraded":"2024-09-13T18:58:17.427038+0000","last_fullsized":"2024-09-13T18:58:17.427038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:16.238525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403251+0000","last_change":"2024-09-13T18:58:16.992246+0000","last_active":"2024-09-13T18:58:17.403251+0000","last_peered":"2024-09-13T18:58:17.403251+0000","last_clean":"2024-09-13T18:58:17.403251+0000","last_became_active":"2024-09-13T18:58:16.991365+0000","last_became_peered":"2024-09-13T18:58:16.991365+0000","last_unstale":"2024-09-13T18:58:17.403251+0000","last_undegraded":"2024-09-13T18:58:17.403251+0000","last_fullsized":"2024-09-13T18:58:17.403251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:39.109449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431954+0000","last_change":"2024-09-13T18:58:17.426476+0000","last_active":"2024-09-13T18:58:17.431954+0000","last_peered":"2024-09-13T18:58:17.431954+0000","last_clean":"2024-09-13T18:58:17.431954+0000","last_became_active":"2024-09-13T18:58:17.423199+0000","last_became_peered":"2024-09-13T18:58:17.423199+0000","last_unstale":"2024-09-13T18:58:17.431954+0000","last_undegraded":"2024-09-13T18:58:17.431954+0000","last_fullsized":"2024-09-13T18:58:17.431954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:36.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.405706+0000","last_change":"2024-09-13T18:58:16.978090+0000","last_active":"2024-09-13T18:58:17.405706+0000","last_peered":"2024-09-13T18:58:17.405706+0000","last_clean":"2024-09-13T18:58:17.405706+0000","last_became_active":"2024-09-13T18:58:16.977836+0000","last_became_peered":"2024-09-13T18:58:16.977836+0000","last_unstale":"2024-09-13T18:58:17.405706+0000","last_undegraded":"2024-09-13T18:58:17.405706+0000","last_fullsized":"2024-09-13T18:58:17.405706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:41.943413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440265+0000","last_change":"2024-09-13T18:58:17.438474+0000","last_active":"2024-09-13T18:58:17.440265+0000","last_peered":"2024-09-13T18:58:17.440265+0000","last_clean":"2024-09-13T18:58:17.440265+0000","last_became_active":"2024-09-13T18:58:17.437060+0000","last_became_peered":"2024-09-13T18:58:17.437060+0000","last_unstale":"2024-09-13T18:58:17.440265+0000","last_undegraded":"2024-09-13T18:58:17.440265+0000","last_fullsized":"2024-09-13T18:58:17.440265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.400969+0000","last_change":"2024-09-13T18:58:16.990007+0000","last_active":"2024-09-13T18:58:17.400969+0000","last_peered":"2024-09-13T18:58:17.400969+0000","last_clean":"2024-09-13T18:58:17.400969+0000","last_became_active":"2024-09-13T18:58:16.983719+0000","last_became_peered":"2024-09-13T18:58:16.983719+0000","last_unstale":"2024-09-13T18:58:17.400969+0000","last_undegraded":"2024-09-13T18:58:17.400969+0000","last_fullsized":"2024-09-13T18:58:17.400969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427246+0000","last_change":"2024-09-13T18:58:17.418259+0000","last_active":"2024-09-13T18:58:17.427246+0000","last_peered":"2024-09-13T18:58:17.427246+0000","last_clean":"2024-09-13T18:58:17.427246+0000","last_became_active":"2024-09-13T18:58:17.418007+0000","last_became_peered":"2024-09-13T18:58:17.418007+0000","last_unstale":"2024-09-13T18:58:17.427246+0000","last_undegraded":"2024-09-13T18:58:17.427246+0000","last_fullsized":"2024-09-13T18:58:17.427246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:15.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437730+0000","last_change":"2024-09-13T18:58:16.984598+0000","last_active":"2024-09-13T18:58:17.437730+0000","last_peered":"2024-09-13T18:58:17.437730+0000","last_clean":"2024-09-13T18:58:17.437730+0000","last_became_active":"2024-09-13T18:58:16.984351+0000","last_became_peered":"2024-09-13T18:58:16.984351+0000","last_unstale":"2024-09-13T18:58:17.437730+0000","last_undegraded":"2024-09-13T18:58:17.437730+0000","last_fullsized":"2024-09-13T18:58:17.437730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.438428+0000","last_change":"2024-09-13T18:58:17.435243+0000","last_active":"2024-09-13T18:58:17.438428+0000","last_peered":"2024-09-13T18:58:17.438428+0000","last_clean":"2024-09-13T18:58:17.438428+0000","last_became_active":"2024-09-13T18:58:17.434942+0000","last_became_peered":"2024-09-13T18:58:17.434942+0000","last_unstale":"2024-09-13T18:58:17.438428+0000","last_undegraded":"2024-09-13T18:58:17.438428+0000","last_fullsized":"2024-09-13T18:58:17.438428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:23.935554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.443367+0000","last_change":"2024-09-13T18:58:16.984583+0000","last_active":"2024-09-13T18:58:17.443367+0000","last_peered":"2024-09-13T18:58:17.443367+0000","last_clean":"2024-09-13T18:58:17.443367+0000","last_became_active":"2024-09-13T18:58:16.984250+0000","last_became_peered":"2024-09-13T18:58:16.984250+0000","last_unstale":"2024-09-13T18:58:17.443367+0000","last_undegraded":"2024-09-13T18:58:17.443367+0000","last_fullsized":"2024-09-13T18:58:17.443367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.427699+0000","last_change":"2024-09-13T18:58:17.422719+0000","last_active":"2024-09-13T18:58:17.427699+0000","last_peered":"2024-09-13T18:58:17.427699+0000","last_clean":"2024-09-13T18:58:17.427699+0000","last_became_active":"2024-09-13T18:58:17.422378+0000","last_became_peered":"2024-09-13T18:58:17.422378+0000","last_unstale":"2024-09-13T18:58:17.427699+0000","last_undegraded":"2024-09-13T18:58:17.427699+0000","last_fullsized":"2024-09-13T18:58:17.427699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431223+0000","last_change":"2024-09-13T18:58:16.992234+0000","last_active":"2024-09-13T18:58:17.431223+0000","last_peered":"2024-09-13T18:58:17.431223+0000","last_clean":"2024-09-13T18:58:17.431223+0000","last_became_active":"2024-09-13T18:58:16.991970+0000","last_became_peered":"2024-09-13T18:58:16.991970+0000","last_unstale":"2024-09-13T18:58:17.431223+0000","last_undegraded":"2024-09-13T18:58:17.431223+0000","last_fullsized":"2024-09-13T18:58:17.431223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:07.043148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432501+0000","last_change":"2024-09-13T18:58:17.425018+0000","last_active":"2024-09-13T18:58:17.432501+0000","last_peered":"2024-09-13T18:58:17.432501+0000","last_clean":"2024-09-13T18:58:17.432501+0000","last_became_active":"2024-09-13T18:58:17.424785+0000","last_became_peered":"2024-09-13T18:58:17.424785+0000","last_unstale":"2024-09-13T18:58:17.432501+0000","last_undegraded":"2024-09-13T18:58:17.432501+0000","last_fullsized":"2024-09-13T18:58:17.432501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:14.120222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428076+0000","last_change":"2024-09-13T18:58:16.988637+0000","last_active":"2024-09-13T18:58:17.428076+0000","last_peered":"2024-09-13T18:58:17.428076+0000","last_clean":"2024-09-13T18:58:17.428076+0000","last_became_active":"2024-09-13T18:58:16.988240+0000","last_became_peered":"2024-09-13T18:58:16.988240+0000","last_unstale":"2024-09-13T18:58:17.428076+0000","last_undegraded":"2024-09-13T18:58:17.428076+0000","last_fullsized":"2024-09-13T18:58:17.428076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:12.031496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.423727+0000","last_change":"2024-09-13T18:58:17.419317+0000","last_active":"2024-09-13T18:58:17.423727+0000","last_peered":"2024-09-13T18:58:17.423727+0000","last_clean":"2024-09-13T18:58:17.423727+0000","last_became_active":"2024-09-13T18:58:17.416836+0000","last_became_peered":"2024-09-13T18:58:17.416836+0000","last_unstale":"2024-09-13T18:58:17.423727+0000","last_undegraded":"2024-09-13T18:58:17.423727+0000","last_fullsized":"2024-09-13T18:58:17.423727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:06.163698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403701+0000","last_change":"2024-09-13T18:58:16.977199+0000","last_active":"2024-09-13T18:58:17.403701+0000","last_peered":"2024-09-13T18:58:17.403701+0000","last_clean":"2024-09-13T18:58:17.403701+0000","last_became_active":"2024-09-13T18:58:16.976918+0000","last_became_peered":"2024-09-13T18:58:16.976918+0000","last_unstale":"2024-09-13T18:58:17.403701+0000","last_undegraded":"2024-09-13T18:58:17.403701+0000","last_fullsized":"2024-09-13T18:58:17.403701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.420986+0000","last_change":"2024-09-13T18:58:17.416796+0000","last_active":"2024-09-13T18:58:17.420986+0000","last_peered":"2024-09-13T18:58:17.420986+0000","last_clean":"2024-09-13T18:58:17.420986+0000","last_became_active":"2024-09-13T18:58:17.416436+0000","last_became_peered":"2024-09-13T18:58:17.416436+0000","last_unstale":"2024-09-13T18:58:17.420986+0000","last_undegraded":"2024-09-13T18:58:17.420986+0000","last_fullsized":"2024-09-13T18:58:17.420986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.442303+0000","last_change":"2024-09-13T18:58:16.977060+0000","last_active":"2024-09-13T18:58:17.442303+0000","last_peered":"2024-09-13T18:58:17.442303+0000","last_clean":"2024-09-13T18:58:17.442303+0000","last_became_active":"2024-09-13T18:58:16.976333+0000","last_became_peered":"2024-09-13T18:58:16.976333+0000","last_unstale":"2024-09-13T18:58:17.442303+0000","last_undegraded":"2024-09-13T18:58:17.442303+0000","last_fullsized":"2024-09-13T18:58:17.442303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:55.892852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431382+0000","last_change":"2024-09-13T18:58:17.429973+0000","last_active":"2024-09-13T18:58:17.431382+0000","last_peered":"2024-09-13T18:58:17.431382+0000","last_clean":"2024-09-13T18:58:17.431382+0000","last_became_active":"2024-09-13T18:58:17.429655+0000","last_became_peered":"2024-09-13T18:58:17.429655+0000","last_unstale":"2024-09-13T18:58:17.431382+0000","last_undegraded":"2024-09-13T18:58:17.431382+0000","last_fullsized":"2024-09-13T18:58:17.431382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:31.581999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440839+0000","last_change":"2024-09-13T18:58:16.987223+0000","last_active":"2024-09-13T18:58:17.440839+0000","last_peered":"2024-09-13T18:58:17.440839+0000","last_clean":"2024-09-13T18:58:17.440839+0000","last_became_active":"2024-09-13T18:58:16.985063+0000","last_became_peered":"2024-09-13T18:58:16.985063+0000","last_unstale":"2024-09-13T18:58:17.440839+0000","last_undegraded":"2024-09-13T18:58:17.440839+0000","last_fullsized":"2024-09-13T18:58:17.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:32.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432402+0000","last_change":"2024-09-13T18:58:17.426221+0000","last_active":"2024-09-13T18:58:17.432402+0000","last_peered":"2024-09-13T18:58:17.432402+0000","last_clean":"2024-09-13T18:58:17.432402+0000","last_became_active":"2024-09-13T18:58:17.425544+0000","last_became_peered":"2024-09-13T18:58:17.425544+0000","last_unstale":"2024-09-13T18:58:17.432402+0000","last_undegraded":"2024-09-13T18:58:17.432402+0000","last_fullsized":"2024-09-13T18:58:17.432402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431687+0000","last_change":"2024-09-13T18:58:16.991954+0000","last_active":"2024-09-13T18:58:17.431687+0000","last_peered":"2024-09-13T18:58:17.431687+0000","last_clean":"2024-09-13T18:58:17.431687+0000","last_became_active":"2024-09-13T18:58:16.991720+0000","last_became_peered":"2024-09-13T18:58:16.991720+0000","last_unstale":"2024-09-13T18:58:17.431687+0000","last_undegraded":"2024-09-13T18:58:17.431687+0000","last_fullsized":"2024-09-13T18:58:17.431687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:33.678817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.432941+0000","last_change":"2024-09-13T18:58:17.425995+0000","last_active":"2024-09-13T18:58:17.432941+0000","last_peered":"2024-09-13T18:58:17.432941+0000","last_clean":"2024-09-13T18:58:17.432941+0000","last_became_active":"2024-09-13T18:58:17.425221+0000","last_became_peered":"2024-09-13T18:58:17.425221+0000","last_unstale":"2024-09-13T18:58:17.432941+0000","last_undegraded":"2024-09-13T18:58:17.432941+0000","last_fullsized":"2024-09-13T18:58:17.432941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:54.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.431185+0000","last_change":"2024-09-13T18:58:16.986087+0000","last_active":"2024-09-13T18:58:17.431185+0000","last_peered":"2024-09-13T18:58:17.431185+0000","last_clean":"2024-09-13T18:58:17.431185+0000","last_became_active":"2024-09-13T18:58:16.985094+0000","last_became_peered":"2024-09-13T18:58:16.985094+0000","last_unstale":"2024-09-13T18:58:17.431185+0000","last_undegraded":"2024-09-13T18:58:17.431185+0000","last_fullsized":"2024-09-13T18:58:17.431185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428328+0000","last_change":"2024-09-13T18:58:17.425133+0000","last_active":"2024-09-13T18:58:17.428328+0000","last_peered":"2024-09-13T18:58:17.428328+0000","last_clean":"2024-09-13T18:58:17.428328+0000","last_became_active":"2024-09-13T18:58:17.424666+0000","last_became_peered":"2024-09-13T18:58:17.424666+0000","last_unstale":"2024-09-13T18:58:17.428328+0000","last_undegraded":"2024-09-13T18:58:17.428328+0000","last_fullsized":"2024-09-13T18:58:17.428328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:54.221322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.402034+0000","last_change":"2024-09-13T18:58:16.994714+0000","last_active":"2024-09-13T18:58:17.402034+0000","last_peered":"2024-09-13T18:58:17.402034+0000","last_clean":"2024-09-13T18:58:17.402034+0000","last_became_active":"2024-09-13T18:58:16.994404+0000","last_became_peered":"2024-09-13T18:58:16.994404+0000","last_unstale":"2024-09-13T18:58:17.402034+0000","last_undegraded":"2024-09-13T18:58:17.402034+0000","last_fullsized":"2024-09-13T18:58:17.402034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:25.284310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428295+0000","last_change":"2024-09-13T18:58:17.425543+0000","last_active":"2024-09-13T18:58:17.428295+0000","last_peered":"2024-09-13T18:58:17.428295+0000","last_clean":"2024-09-13T18:58:17.428295+0000","last_became_active":"2024-09-13T18:58:17.425232+0000","last_became_peered":"2024-09-13T18:58:17.425232+0000","last_unstale":"2024-09-13T18:58:17.428295+0000","last_undegraded":"2024-09-13T18:58:17.428295+0000","last_fullsized":"2024-09-13T18:58:17.428295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:42.948766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.437988+0000","last_change":"2024-09-13T18:58:16.994495+0000","last_active":"2024-09-13T18:58:17.437988+0000","last_peered":"2024-09-13T18:58:17.437988+0000","last_clean":"2024-09-13T18:58:17.437988+0000","last_became_active":"2024-09-13T18:58:16.991766+0000","last_became_peered":"2024-09-13T18:58:16.991766+0000","last_unstale":"2024-09-13T18:58:17.437988+0000","last_undegraded":"2024-09-13T18:58:17.437988+0000","last_fullsized":"2024-09-13T18:58:17.437988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:46.100424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.426169+0000","last_change":"2024-09-13T18:58:17.421171+0000","last_active":"2024-09-13T18:58:17.426169+0000","last_peered":"2024-09-13T18:58:17.426169+0000","last_clean":"2024-09-13T18:58:17.426169+0000","last_became_active":"2024-09-13T18:58:17.420937+0000","last_became_peered":"2024-09-13T18:58:17.420937+0000","last_unstale":"2024-09-13T18:58:17.426169+0000","last_undegraded":"2024-09-13T18:58:17.426169+0000","last_fullsized":"2024-09-13T18:58:17.426169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.105777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.406109+0000","last_change":"2024-09-13T18:58:16.994111+0000","last_active":"2024-09-13T18:58:17.406109+0000","last_peered":"2024-09-13T18:58:17.406109+0000","last_clean":"2024-09-13T18:58:17.406109+0000","last_became_active":"2024-09-13T18:58:16.993264+0000","last_became_peered":"2024-09-13T18:58:16.993264+0000","last_unstale":"2024-09-13T18:58:17.406109+0000","last_undegraded":"2024-09-13T18:58:17.406109+0000","last_fullsized":"2024-09-13T18:58:17.406109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:12.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428547+0000","last_change":"2024-09-13T18:58:17.422939+0000","last_active":"2024-09-13T18:58:17.428547+0000","last_peered":"2024-09-13T18:58:17.428547+0000","last_clean":"2024-09-13T18:58:17.428547+0000","last_became_active":"2024-09-13T18:58:17.419827+0000","last_became_peered":"2024-09-13T18:58:17.419827+0000","last_unstale":"2024-09-13T18:58:17.428547+0000","last_undegraded":"2024-09-13T18:58:17.428547+0000","last_fullsized":"2024-09-13T18:58:17.428547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:12.094322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403542+0000","last_change":"2024-09-13T18:58:16.993296+0000","last_active":"2024-09-13T18:58:17.403542+0000","last_peered":"2024-09-13T18:58:17.403542+0000","last_clean":"2024-09-13T18:58:17.403542+0000","last_became_active":"2024-09-13T18:58:16.993016+0000","last_became_peered":"2024-09-13T18:58:16.993016+0000","last_unstale":"2024-09-13T18:58:17.403542+0000","last_undegraded":"2024-09-13T18:58:17.403542+0000","last_fullsized":"2024-09-13T18:58:17.403542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:46.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422546+0000","last_change":"2024-09-13T18:58:17.417972+0000","last_active":"2024-09-13T18:58:17.422546+0000","last_peered":"2024-09-13T18:58:17.422546+0000","last_clean":"2024-09-13T18:58:17.422546+0000","last_became_active":"2024-09-13T18:58:17.417555+0000","last_became_peered":"2024-09-13T18:58:17.417555+0000","last_unstale":"2024-09-13T18:58:17.422546+0000","last_undegraded":"2024-09-13T18:58:17.422546+0000","last_fullsized":"2024-09-13T18:58:17.422546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.773327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.408387+0000","last_change":"2024-09-13T18:58:16.983958+0000","last_active":"2024-09-13T18:58:17.408387+0000","last_peered":"2024-09-13T18:58:17.408387+0000","last_clean":"2024-09-13T18:58:17.408387+0000","last_became_active":"2024-09-13T18:58:16.982777+0000","last_became_peered":"2024-09-13T18:58:16.982777+0000","last_unstale":"2024-09-13T18:58:17.408387+0000","last_undegraded":"2024-09-13T18:58:17.408387+0000","last_fullsized":"2024-09-13T18:58:17.408387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.832185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.430192+0000","last_change":"2024-09-13T18:58:17.427642+0000","last_active":"2024-09-13T18:58:17.430192+0000","last_peered":"2024-09-13T18:58:17.430192+0000","last_clean":"2024-09-13T18:58:17.430192+0000","last_became_active":"2024-09-13T18:58:17.427374+0000","last_became_peered":"2024-09-13T18:58:17.427374+0000","last_unstale":"2024-09-13T18:58:17.430192+0000","last_undegraded":"2024-09-13T18:58:17.430192+0000","last_fullsized":"2024-09-13T18:58:17.430192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:13.036849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.440919+0000","last_change":"2024-09-13T18:58:16.982056+0000","last_active":"2024-09-13T18:58:17.440919+0000","last_peered":"2024-09-13T18:58:17.440919+0000","last_clean":"2024-09-13T18:58:17.440919+0000","last_became_active":"2024-09-13T18:58:16.981654+0000","last_became_peered":"2024-09-13T18:58:16.981654+0000","last_unstale":"2024-09-13T18:58:17.440919+0000","last_undegraded":"2024-09-13T18:58:17.440919+0000","last_fullsized":"2024-09-13T18:58:17.440919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:55.892852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.434615+0000","last_change":"2024-09-13T18:58:17.432499+0000","last_active":"2024-09-13T18:58:17.434615+0000","last_peered":"2024-09-13T18:58:17.434615+0000","last_clean":"2024-09-13T18:58:17.434615+0000","last_became_active":"2024-09-13T18:58:17.432252+0000","last_became_peered":"2024-09-13T18:58:17.432252+0000","last_unstale":"2024-09-13T18:58:17.434615+0000","last_undegraded":"2024-09-13T18:58:17.434615+0000","last_fullsized":"2024-09-13T18:58:17.434615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.401055+0000","last_change":"2024-09-13T18:58:16.994629+0000","last_active":"2024-09-13T18:58:17.401055+0000","last_peered":"2024-09-13T18:58:17.401055+0000","last_clean":"2024-09-13T18:58:17.401055+0000","last_became_active":"2024-09-13T18:58:16.991170+0000","last_became_peered":"2024-09-13T18:58:16.991170+0000","last_unstale":"2024-09-13T18:58:17.401055+0000","last_undegraded":"2024-09-13T18:58:17.401055+0000","last_fullsized":"2024-09-13T18:58:17.401055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.088969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.439592+0000","last_change":"2024-09-13T18:58:17.435120+0000","last_active":"2024-09-13T18:58:17.439592+0000","last_peered":"2024-09-13T18:58:17.439592+0000","last_clean":"2024-09-13T18:58:17.439592+0000","last_became_active":"2024-09-13T18:58:17.434845+0000","last_became_peered":"2024-09-13T18:58:17.434845+0000","last_unstale":"2024-09-13T18:58:17.439592+0000","last_undegraded":"2024-09-13T18:58:17.439592+0000","last_fullsized":"2024-09-13T18:58:17.439592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:09.498649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.433281+0000","last_change":"2024-09-13T18:58:16.991405+0000","last_active":"2024-09-13T18:58:17.433281+0000","last_peered":"2024-09-13T18:58:17.433281+0000","last_clean":"2024-09-13T18:58:17.433281+0000","last_became_active":"2024-09-13T18:58:16.991084+0000","last_became_peered":"2024-09-13T18:58:16.991084+0000","last_unstale":"2024-09-13T18:58:17.433281+0000","last_undegraded":"2024-09-13T18:58:17.433281+0000","last_fullsized":"2024-09-13T18:58:17.433281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:53.215968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.424285+0000","last_change":"2024-09-13T18:58:17.419284+0000","last_active":"2024-09-13T18:58:17.424285+0000","last_peered":"2024-09-13T18:58:17.424285+0000","last_clean":"2024-09-13T18:58:17.424285+0000","last_became_active":"2024-09-13T18:58:17.418575+0000","last_became_peered":"2024-09-13T18:58:17.418575+0000","last_unstale":"2024-09-13T18:58:17.424285+0000","last_undegraded":"2024-09-13T18:58:17.424285+0000","last_fullsized":"2024-09-13T18:58:17.424285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.105777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.400137+0000","last_change":"2024-09-13T18:58:16.986291+0000","last_active":"2024-09-13T18:58:17.400137+0000","last_peered":"2024-09-13T18:58:17.400137+0000","last_clean":"2024-09-13T18:58:17.400137+0000","last_became_active":"2024-09-13T18:58:16.985975+0000","last_became_peered":"2024-09-13T18:58:16.985975+0000","last_unstale":"2024-09-13T18:58:17.400137+0000","last_undegraded":"2024-09-13T18:58:17.400137+0000","last_fullsized":"2024-09-13T18:58:17.400137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:33.678817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.422659+0000","last_change":"2024-09-13T18:58:17.412534+0000","last_active":"2024-09-13T18:58:17.422659+0000","last_peered":"2024-09-13T18:58:17.422659+0000","last_clean":"2024-09-13T18:58:17.422659+0000","last_became_active":"2024-09-13T18:58:17.412270+0000","last_became_peered":"2024-09-13T18:58:17.412270+0000","last_unstale":"2024-09-13T18:58:17.422659+0000","last_undegraded":"2024-09-13T18:58:17.422659+0000","last_fullsized":"2024-09-13T18:58:17.422659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:31.581999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.428160+0000","last_change":"2024-09-13T18:58:16.980188+0000","last_active":"2024-09-13T18:58:17.428160+0000","last_peered":"2024-09-13T18:58:17.428160+0000","last_clean":"2024-09-13T18:58:17.428160+0000","last_became_active":"2024-09-13T18:58:16.979900+0000","last_became_peered":"2024-09-13T18:58:16.979900+0000","last_unstale":"2024-09-13T18:58:17.428160+0000","last_undegraded":"2024-09-13T18:58:17.428160+0000","last_fullsized":"2024-09-13T18:58:17.428160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:41.943413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.415647+0000","last_change":"2024-09-13T18:58:17.411894+0000","last_active":"2024-09-13T18:58:17.415647+0000","last_peered":"2024-09-13T18:58:17.415647+0000","last_clean":"2024-09-13T18:58:17.415647+0000","last_became_active":"2024-09-13T18:58:17.411664+0000","last_became_peered":"2024-09-13T18:58:17.411664+0000","last_unstale":"2024-09-13T18:58:17.415647+0000","last_undegraded":"2024-09-13T18:58:17.415647+0000","last_fullsized":"2024-09-13T18:58:17.415647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:03.518899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403651+0000","last_change":"2024-09-13T18:58:16.981787+0000","last_active":"2024-09-13T18:58:17.403651+0000","last_peered":"2024-09-13T18:58:17.403651+0000","last_clean":"2024-09-13T18:58:17.403651+0000","last_became_active":"2024-09-13T18:58:16.981507+0000","last_became_peered":"2024-09-13T18:58:16.981507+0000","last_unstale":"2024-09-13T18:58:17.403651+0000","last_undegraded":"2024-09-13T18:58:17.403651+0000","last_fullsized":"2024-09-13T18:58:17.403651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:50.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.418435+0000","last_change":"2024-09-13T18:58:17.411382+0000","last_active":"2024-09-13T18:58:17.418435+0000","last_peered":"2024-09-13T18:58:17.418435+0000","last_clean":"2024-09-13T18:58:17.418435+0000","last_became_active":"2024-09-13T18:58:17.409343+0000","last_became_peered":"2024-09-13T18:58:17.409343+0000","last_unstale":"2024-09-13T18:58:17.418435+0000","last_undegraded":"2024-09-13T18:58:17.418435+0000","last_fullsized":"2024-09-13T18:58:17.418435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:36.699011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.403795+0000","last_change":"2024-09-13T18:58:16.977539+0000","last_active":"2024-09-13T18:58:17.403795+0000","last_peered":"2024-09-13T18:58:17.403795+0000","last_clean":"2024-09-13T18:58:17.403795+0000","last_became_active":"2024-09-13T18:58:16.977132+0000","last_became_peered":"2024-09-13T18:58:16.977132+0000","last_unstale":"2024-09-13T18:58:17.403795+0000","last_undegraded":"2024-09-13T18:58:17.403795+0000","last_fullsized":"2024-09-13T18:58:17.403795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:32.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.421366+0000","last_change":"2024-09-13T18:58:17.414651+0000","last_active":"2024-09-13T18:58:17.421366+0000","last_peered":"2024-09-13T18:58:17.421366+0000","last_clean":"2024-09-13T18:58:17.421366+0000","last_became_active":"2024-09-13T18:58:17.414357+0000","last_became_peered":"2024-09-13T18:58:17.414357+0000","last_unstale":"2024-09-13T18:58:17.421366+0000","last_undegraded":"2024-09-13T18:58:17.421366+0000","last_fullsized":"2024-09-13T18:58:17.421366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:16.960186+0000","last_clean_scrub_stamp":"2024-09-13T18:58:16.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:15.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:58:17.406529+0000","last_change":"2024-09-13T18:58:16.993785+0000","last_active":"2024-09-13T18:58:17.406529+0000","last_peered":"2024-09-13T18:58:17.406529+0000","last_clean":"2024-09-13T18:58:17.406529+0000","last_became_active":"2024-09-13T18:58:16.992848+0000","last_became_peered":"2024-09-13T18:58:16.992848+0000","last_unstale":"2024-09-13T18:58:17.406529+0000","last_undegraded":"2024-09-13T18:58:17.406529+0000","last_fullsized":"2024-09-13T18:58:17.406529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:15.954832+0000","last_clean_scrub_stamp":"2024-09-13T18:58:15.954832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:50.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:58:16.977256+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:58:16.977256+0000","last_peered":"2024-09-13T18:58:16.977256+0000","last_clean":"2024-09-13T18:58:16.977256+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:58:16.977256+0000","last_undegraded":"2024-09-13T18:58:16.977256+0000","last_fullsized":"2024-09-13T18:58:16.977256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":736045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.75},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.90000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.622}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.753},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.62}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.77200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.747},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.495},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.442},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.374},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.441}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.433}]},{"osd":2,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:58:22.003 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:58:22.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:58:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.198+0000 7f4d75000640 1 Processor -- start 2024-09-13T18:58:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.198+0000 7f4d75000640 1 -- start start 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d75000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d701591b0 0x7f4d700adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d75000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d700cd050 0x7f4d700b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d75000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7006b5c0 con 0x7f4d700cd4e0 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d75000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700ae0d0 con 0x7f4d700cd050 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d75000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700cc600 con 0x7f4d701591b0 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d67e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d700cd050 0x7f4d700b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d6fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4d700cd4e0 0x7f4d700b2f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58808/0 (socket says 172.21.15.33:58808) 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d6fe00640 1 -- 172.21.15.33:0/4013025616 learned_addr learned my addr 172.21.15.33:0/4013025616 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:22.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.199+0000 7f4d6f400640 1 --2- 172.21.15.33:0/4013025616 >> v2:172.21.15.103:3300/0 conn(0x7f4d701591b0 0x7f4d700adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.200+0000 7f4d67e00640 1 -- 172.21.15.33:0/4013025616 >> v2:172.21.15.103:3300/0 conn(0x7f4d701591b0 msgr2=0x7f4d700adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.200+0000 7f4d67e00640 1 --2- 172.21.15.33:0/4013025616 >> v2:172.21.15.103:3300/0 conn(0x7f4d701591b0 0x7f4d700adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.200+0000 7f4d67e00640 1 -- 172.21.15.33:0/4013025616 >> v1:172.21.15.33:6789/0 conn(0x7f4d700cd4e0 legacy=0x7f4d700b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.200+0000 7f4d6ea00640 1 -- 172.21.15.33:0/4013025616 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654851443 0 0) 0x7f4d7006b5c0 con 0x7f4d700cd4e0 2024-09-13T18:58:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.200+0000 7f4d67e00640 1 -- 172.21.15.33:0/4013025616 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7006b810 con 0x7f4d700cd050 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.201+0000 7f4d67e00640 1 --2- 172.21.15.33:0/4013025616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d700cd050 0x7f4d700b16a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d7006d630 tx=0x7f4d5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd05ae988c011c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.201+0000 7f4d6ea00640 1 -- 172.21.15.33:0/4013025616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58032440 con 0x7f4d700cd050 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.201+0000 7f4d6ea00640 1 -- 172.21.15.33:0/4013025616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d580325a0 con 0x7f4d700cd050 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.201+0000 7f4d6ea00640 1 -- 172.21.15.33:0/4013025616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58032930 con 0x7f4d700cd050 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 -- 172.21.15.33:0/4013025616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d700cd050 msgr2=0x7f4d700b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 --2- 172.21.15.33:0/4013025616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d700cd050 0x7f4d700b16a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d7006d630 tx=0x7f4d5802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 -- 172.21.15.33:0/4013025616 shutdown_connections 2024-09-13T18:58:22.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 --2- 172.21.15.33:0/4013025616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d700cd050 0x7f4d700b16a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 --2- 172.21.15.33:0/4013025616 >> v2:172.21.15.103:3300/0 conn(0x7f4d701591b0 0x7f4d700adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 -- 172.21.15.33:0/4013025616 >> 172.21.15.33:0/4013025616 conn(0x7f4d70069ed0 msgr2=0x7f4d7006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:22.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 -- 172.21.15.33:0/4013025616 shutdown_connections 2024-09-13T18:58:22.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.202+0000 7f4d75000640 1 -- 172.21.15.33:0/4013025616 wait complete. 2024-09-13T18:58:22.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.204+0000 7f4d75000640 1 Processor -- start 2024-09-13T18:58:22.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.204+0000 7f4d75000640 1 -- start start 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d700cd050 0x7f4d7014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d700cd4e0 0x7f4d7014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701e0780 con 0x7f4d701591b0 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7014f840 con 0x7f4d700cd4e0 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d75000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701dfb00 con 0x7f4d700cd050 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34776/0 (socket says 172.21.15.33:34776) 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 -- 172.21.15.33:0/1766279380 learned_addr learned my addr 172.21.15.33:0/1766279380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d67e00640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d700cd4e0 0x7f4d7014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6f400640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d700cd050 0x7f4d7014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 -- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d700cd050 msgr2=0x7f4d7014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d700cd050 0x7f4d7014fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 -- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d700cd4e0 msgr2=0x7f4d7014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.205+0000 7f4d6fe00640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d700cd4e0 0x7f4d7014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d6fe00640 1 -- 172.21.15.33:0/1766279380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009400 con 0x7f4d701591b0 2024-09-13T18:58:22.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d6fe00640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c7a0 tx=0x7f4d6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800a5e0 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6800a740 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800ab30 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d701dfde0 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.206+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701e03a0 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.207+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d701e08c0 con 0x7f4d701591b0 2024-09-13T18:58:22.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.208+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d6800ac90 con 0x7f4d701591b0 2024-09-13T18:58:22.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.209+0000 7f4d67400640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 0x7f4d4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.209+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d680888d0 con 0x7f4d701591b0 2024-09-13T18:58:22.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.210+0000 7f4d6f400640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 0x7f4d4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.210+0000 7f4d6f400640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 0x7f4d4c06d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d701e3880 tx=0x7f4d60009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.214+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d701e08c0 con 0x7f4d701591b0 2024-09-13T18:58:22.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.457+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4d701e08c0 con 0x7f4d701591b0 2024-09-13T18:58:22.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.461+0000 7f4d67400640 1 -- 172.21.15.33:0/1766279380 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4d701e08c0 con 0x7f4d701591b0 2024-09-13T18:58:22.465 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T18:58:22.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 msgr2=0x7f4d4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 0x7f4d4c06d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d701e3880 tx=0x7f4d60009190 comp rx=0 tx=0).stop 2024-09-13T18:58:22.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 msgr2=0x7f4d701e0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c7a0 tx=0x7f4d6800cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:22.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 shutdown_connections 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d4c06ac00 0x7f4d4c06d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d701591b0 0x7f4d701e0ba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d700cd4e0 0x7f4d7014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 --2- 172.21.15.33:0/1766279380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d700cd050 0x7f4d7014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 >> 172.21.15.33:0/1766279380 conn(0x7f4d70069ed0 msgr2=0x7f4d700b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 shutdown_connections 2024-09-13T18:58:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.464+0000 7f4d75000640 1 -- 172.21.15.33:0/1766279380 wait complete. 2024-09-13T18:58:22.483 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.634+0000 7f38d4800640 1 Processor -- start 2024-09-13T18:58:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.634+0000 7f38d4800640 1 -- start start 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.635+0000 7f38d4800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc153b20 0x7f38cc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d4800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f38cc159a80 0x7f38cc0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d4800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc153f00 con 0x7f38cc0b2410 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d4800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0ce600 con 0x7f38cc159a80 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d4800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc070f90 con 0x7f38cc153b20 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f38cc159a80 0x7f38cc0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f38cc159a80 0x7f38cc0b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34790/0 (socket says 172.21.15.33:34790) 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 -- 172.21.15.33:0/1177445194 learned_addr learned my addr 172.21.15.33:0/1177445194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1e00640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc153b20 0x7f38cc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 -- 172.21.15.33:0/1177445194 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc153b20 msgr2=0x7f38cc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc153b20 0x7f38cc0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d0a00640 1 -- 172.21.15.33:0/1177445194 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809651093 0 0) 0x7f38cc153f00 con 0x7f38cc0b2410 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 -- 172.21.15.33:0/1177445194 >> v1:172.21.15.103:6789/0 conn(0x7f38cc0b2410 legacy=0x7f38cc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.636+0000 7f38d1400640 1 -- 172.21.15.33:0/1177445194 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0b1a40 con 0x7f38cc159a80 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.637+0000 7f38d1400640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc159a80 0x7f38cc0b1ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098a0 tx=0x7f38bc02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa8e0c211d7f5a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d0a00640 1 -- 172.21.15.33:0/1177445194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc032440 con 0x7f38cc159a80 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d0a00640 1 -- 172.21.15.33:0/1177445194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0325a0 con 0x7f38cc159a80 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d0a00640 1 -- 172.21.15.33:0/1177445194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc032930 con 0x7f38cc159a80 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 -- 172.21.15.33:0/1177445194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc159a80 msgr2=0x7f38cc0b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc159a80 0x7f38cc0b1ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098a0 tx=0x7f38bc02a290 comp rx=0 tx=0).stop 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 -- 172.21.15.33:0/1177445194 shutdown_connections 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc159a80 0x7f38cc0b1ed0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 --2- 172.21.15.33:0/1177445194 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc153b20 0x7f38cc0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 -- 172.21.15.33:0/1177445194 >> 172.21.15.33:0/1177445194 conn(0x7f38cc0b0510 msgr2=0x7f38cc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 -- 172.21.15.33:0/1177445194 shutdown_connections 2024-09-13T18:58:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.638+0000 7f38d4800640 1 -- 172.21.15.33:0/1177445194 wait complete. 2024-09-13T18:58:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.640+0000 7f38d4800640 1 Processor -- start 2024-09-13T18:58:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.640+0000 7f38d4800640 1 -- start start 2024-09-13T18:58:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc0b2410 0x7f38cc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38cc159a80 0x7f38cc0ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f6950 con 0x7f38cc153b20 2024-09-13T18:58:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc14a1b0 con 0x7f38cc159a80 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d4800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc14a490 con 0x7f38cc0b2410 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.641+0000 7f38d1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34806/0 (socket says 172.21.15.33:34806) 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 -- 172.21.15.33:0/1815232649 learned_addr learned my addr 172.21.15.33:0/1815232649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1e00640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc0b2410 0x7f38cc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d2800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38cc159a80 0x7f38cc0ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 -- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc0b2410 msgr2=0x7f38cc15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc0b2410 0x7f38cc15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 -- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38cc159a80 msgr2=0x7f38cc0ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38cc159a80 0x7f38cc0ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 -- 172.21.15.33:0/1815232649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc0094d0 con 0x7f38cc153b20 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.642+0000 7f38d1400640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0090b0 tx=0x7f38bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.643+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc032440 con 0x7f38cc153b20 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.643+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc030ba0 con 0x7f38cc153b20 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.643+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc03d440 con 0x7f38cc153b20 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.643+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc14a770 con 0x7f38cc153b20 2024-09-13T18:58:22.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.643+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc14ad30 con 0x7f38cc153b20 2024-09-13T18:58:22.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.644+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc0b3990 con 0x7f38cc153b20 2024-09-13T18:58:22.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.645+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f38bc039040 con 0x7f38cc153b20 2024-09-13T18:58:22.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.646+0000 7f38c6000640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 0x7f38b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:22.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.646+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38bc0a9d80 con 0x7f38cc153b20 2024-09-13T18:58:22.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.646+0000 7f38d1e00640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 0x7f38b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:22.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.647+0000 7f38d1e00640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 0x7f38b006d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009aa0 tx=0x7f38c0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.650+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f38bc075000 con 0x7f38cc153b20 2024-09-13T18:58:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.863+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38cc1540b0 con 0x7f38cc153b20 2024-09-13T18:58:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.863+0000 7f38c6000640 1 -- 172.21.15.33:0/1815232649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f38bc078620 con 0x7f38cc153b20 2024-09-13T18:58:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:22.867 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 msgr2=0x7f38b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 0x7f38b006d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009aa0 tx=0x7f38c0009190 comp rx=0 tx=0).stop 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 msgr2=0x7f38cc1f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0090b0 tx=0x7f38bc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 shutdown_connections 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f38b006ac00 0x7f38b006d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38cc159a80 0x7f38cc0ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38cc153b20 0x7f38cc1f6410 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 --2- 172.21.15.33:0/1815232649 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38cc0b2410 0x7f38cc15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.865+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 >> 172.21.15.33:0/1815232649 conn(0x7f38cc0b0510 msgr2=0x7f38cc0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.866+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 shutdown_connections 2024-09-13T18:58:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:22.866+0000 7f38d4800640 1 -- 172.21.15.33:0/1815232649 wait complete. 2024-09-13T18:58:23.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:58:17.395076+0000', 'modified': '2024-09-13T18:58:20.407536+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5082': {'gid': 5082, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6835/2809270165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6833', 'nonce': 2809270165}, {'type': 'v1', 'addr': '172.21.15.33:6835', 'nonce': 2809270165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:58:23.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:58:23.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:58:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.443+0000 7f774cc00640 1 Processor -- start 2024-09-13T18:58:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.443+0000 7f774cc00640 1 -- start start 2024-09-13T18:58:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.444+0000 7f774cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.444+0000 7f774cc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77480b3bb0 0x7f774806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.444+0000 7f774cc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774806cb40 con 0x7f7748145670 2024-09-13T18:58:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.444+0000 7f774cc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774806ae10 con 0x7f77480b3bb0 2024-09-13T18:58:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.444+0000 7f774cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774806a8b0 con 0x7f7748145a50 2024-09-13T18:58:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f773fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7746800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77480b3bb0 0x7f774806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f773fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:48464/0 (socket says 172.21.15.33:48464) 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f773fe00640 1 -- 172.21.15.33:0/3674857930 learned_addr learned my addr 172.21.15.33:0/3674857930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7746800640 1 -- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 msgr2=0x7f774806cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7746800640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7746800640 1 -- 172.21.15.33:0/3674857930 >> v1:172.21.15.103:6789/0 conn(0x7f7748145670 legacy=0x7f77480b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7746800640 1 -- 172.21.15.33:0/3674857930 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774806ab30 con 0x7f77480b3bb0 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f7745400640 1 -- 172.21.15.33:0/3674857930 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112758162 0 0) 0x7f774806cb40 con 0x7f7748145670 2024-09-13T18:58:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.445+0000 7f773fe00640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.446+0000 7f7746800640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774806d510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a592ca2dfa00573 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.446+0000 7f7745400640 1 -- 172.21.15.33:0/3674857930 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740031600 con 0x7f77480b3bb0 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f7745400640 1 -- 172.21.15.33:0/3674857930 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774002d050 con 0x7f77480b3bb0 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f7745400640 1 -- 172.21.15.33:0/3674857930 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740031980 con 0x7f77480b3bb0 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 -- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 msgr2=0x7f774806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774806d510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 -- 172.21.15.33:0/3674857930 shutdown_connections 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774806d510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 --2- 172.21.15.33:0/3674857930 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145a50 0x7f774806cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 -- 172.21.15.33:0/3674857930 >> 172.21.15.33:0/3674857930 conn(0x7f774806afe0 msgr2=0x7f774806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 -- 172.21.15.33:0/3674857930 shutdown_connections 2024-09-13T18:58:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.447+0000 7f774cc00640 1 -- 172.21.15.33:0/3674857930 wait complete. 2024-09-13T18:58:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.449+0000 7f774cc00640 1 Processor -- start 2024-09-13T18:58:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.449+0000 7f774cc00640 1 -- start start 2024-09-13T18:58:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145670 0x7f7748144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748143f60 con 0x7f7748145a50 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774815c820 con 0x7f77480b3bb0 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f774cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77481432e0 con 0x7f7748145670 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36570/0 (socket says 172.21.15.33:36570) 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f7746800640 1 -- 172.21.15.33:0/1471006831 learned_addr learned my addr 172.21.15.33:0/1471006831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f773fe00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145670 0x7f7748144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.450+0000 7f7745e00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 -- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145670 msgr2=0x7f7748144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145670 0x7f7748144380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 -- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 msgr2=0x7f774815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 -- 172.21.15.33:0/1471006831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300094d0 con 0x7f7748145a50 2024-09-13T18:58:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f7746800640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f7740004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f773e000640 1 -- 172.21.15.33:0/1471006831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774003b820 con 0x7f7748145a50 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f773e000640 1 -- 172.21.15.33:0/1471006831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774003b980 con 0x7f7748145a50 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f773e000640 1 -- 172.21.15.33:0/1471006831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774003bcf0 con 0x7f7748145a50 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7740009a70 con 0x7f7748145a50 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.451+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77481438a0 con 0x7f7748145a50 2024-09-13T18:58:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.453+0000 7f773e000640 1 -- 172.21.15.33:0/1471006831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f774003a3a0 con 0x7f7748145a50 2024-09-13T18:58:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.454+0000 7f773e000640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 0x7f772406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.454+0000 7f773e000640 1 -- 172.21.15.33:0/1471006831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77400aa5b0 con 0x7f7748145a50 2024-09-13T18:58:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.455+0000 7f7745e00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 0x7f772406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.455+0000 7f774fa5a740 1 Processor -- start 2024-09-13T18:58:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.455+0000 7f774fa5a740 1 -- start start 2024-09-13T18:58:23.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.455+0000 7f7745e00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 0x7f772406d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7738000f60 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 0x564c616f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c6160dab0 con 0x564c616cbb80 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c6160b240 con 0x564c616a46d0 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c61606b30 con 0x564c616a1e90 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.456+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36586/0 (socket says 172.21.15.33:36586) 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 -- 172.21.15.33:0/456147979 learned_addr learned my addr 172.21.15.33:0/456147979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7745e00640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f773fe00640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 0x564c616f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 -- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 msgr2=0x564c616f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 0x564c616f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 -- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 msgr2=0x564c616a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 -- 172.21.15.33:0/456147979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c615d1bd0 con 0x564c616cbb80 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7745e00640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f773fe00640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 0x564c616f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7746800640 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7740081270 tx=0x7f7740079520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b01464cf55a23cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7736a00640 1 -- 172.21.15.33:0/456147979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400a8ea0 con 0x564c616cbb80 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7736a00640 1 -- 172.21.15.33:0/456147979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740077800 con 0x564c616cbb80 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.457+0000 7f7736a00640 1 -- 172.21.15.33:0/456147979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400796c0 con 0x564c616cbb80 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 -- 172.21.15.33:0/456147979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 msgr2=0x564c616f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7740081270 tx=0x7f7740079520 comp rx=0 tx=0).stop 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 -- 172.21.15.33:0/456147979 shutdown_connections 2024-09-13T18:58:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616cbb80 0x564c616f20e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a1e90 0x564c616f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 --2- 172.21.15.33:0/456147979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 -- 172.21.15.33:0/456147979 >> 172.21.15.33:0/456147979 conn(0x564c616a0e00 msgr2=0x564c616e92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 -- 172.21.15.33:0/456147979 shutdown_connections 2024-09-13T18:58:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.458+0000 7f774fa5a740 1 -- 172.21.15.33:0/456147979 wait complete. 2024-09-13T18:58:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.459+0000 7f774fa5a740 1 -- start start 2024-09-13T18:58:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.459+0000 7f774fa5a740 1 Processor -- start 2024-09-13T18:58:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a46d0 0x564c616c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c6169ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c615a8260 con 0x564c6169f170 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c615a7f00 con 0x564c616cbb80 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c6136df20 con 0x564c616a46d0 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f774fa5a740 10 client.0 _ll_register_callbacks cb 0x564c616001a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f7746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36602/0 (socket says 172.21.15.33:36602) 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f7746800640 1 -- 172.21.15.33:0/2281559088 learned_addr learned my addr 172.21.15.33:0/2281559088 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f7745e00640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a46d0 0x564c616c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.460+0000 7f773fe00640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c6169ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 -- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a46d0 msgr2=0x564c616c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a46d0 0x564c616c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 -- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 msgr2=0x564c6169ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c6169ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 -- 172.21.15.33:0/2281559088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77481438a0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f7746800640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7740081270 tx=0x7f7740009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b31044fd16496b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f772b400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400a8ea0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77400796c0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c61630cd0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7740079880 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f774fa5a740 10 client.5253 fetch_fsmap learned FSMap version 16 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564c616051b0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.461+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c61630cd0 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f774004b070 con 0x564c6169f170 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 10 client.5253 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 10 client.5253 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:58:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 20 client.5253 populate_metadata read hostname 'smithi033' 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616eed30 0x564c617060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 4 client.5253 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 --> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c612fa3c0 con 0x564c616eed30 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.462+0000 7f7745e00640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616eed30 0x564c617060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.463+0000 7f7745e00640 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616eed30 0x564c617060b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e98b8657e82a578 server_cookie=8adddcd12c232166 in_seq=0 out_seq=0 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.463+0000 7f772b400640 10 client.5253 ms_handle_connect on v2:172.21.15.33:6833/2809270165 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.463+0000 7f772b400640 1 -- 172.21.15.33:0/2281559088 <== mds.0 v2:172.21.15.33:6833/2809270165 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564c612fa3c0 con 0x564c616eed30 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.463+0000 7f772b400640 10 client.5253 handle_command_reply: tid=0 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.463+0000 7f774fa5a740 1 client.5253 shutdown 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 msgr2=0x564c616ee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7740081270 tx=0x7f7740009750 comp rx=0 tx=0).stop 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 shutdown_connections 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ee320 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c6169ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616eed30 0x564c617060b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 --2- 172.21.15.33:0/2281559088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616a46d0 0x564c616c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 >> 172.21.15.33:0/2281559088 conn(0x564c616a1e90 msgr2=0x564c616e75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f772b400640 0 client.5253 ms_handle_reset on v2:172.21.15.33:6833/2809270165 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 shutdown_connections 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 1 -- 172.21.15.33:0/2281559088 wait complete. 2024-09-13T18:58:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.464+0000 7f774fa5a740 20 client.5253 trim_cache size 0 max 16384 2024-09-13T18:58:23.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 Processor -- start 2024-09-13T18:58:23.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 -- start start 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c6169f170 0x564c616ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c616ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c616ede00 con 0x564c616a46d0 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c617023c0 con 0x564c616cbb80 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.480+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c616c0b40 con 0x564c6169f170 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36610/0 (socket says 172.21.15.33:36610) 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 -- 172.21.15.33:0/561812292 learned_addr learned my addr 172.21.15.33:0/561812292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f7745e00640 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c6169f170 0x564c616ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f7746800640 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c616ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 -- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c6169f170 msgr2=0x564c616ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c6169f170 0x564c616ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 -- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 msgr2=0x564c616ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c616ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 -- 172.21.15.33:0/561812292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c6163a170 con 0x564c616a46d0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.481+0000 7f773fe00640 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7730009cd0 tx=0x7f7730009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debae23c03cd8e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f7737400640 1 -- 172.21.15.33:0/561812292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730020460 con 0x564c616a46d0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f7737400640 1 -- 172.21.15.33:0/561812292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300205c0 con 0x564c616a46d0 2024-09-13T18:58:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f7737400640 1 -- 172.21.15.33:0/561812292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730020930 con 0x564c616a46d0 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 -- 172.21.15.33:0/561812292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 msgr2=0x564c616a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7730009cd0 tx=0x7f7730009240 comp rx=0 tx=0).stop 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 -- 172.21.15.33:0/561812292 shutdown_connections 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616cbb80 0x564c616ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c616a46d0 0x564c616a4ab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 --2- 172.21.15.33:0/561812292 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c6169f170 0x564c616ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 -- 172.21.15.33:0/561812292 >> 172.21.15.33:0/561812292 conn(0x564c616a1e90 msgr2=0x564c616cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 -- 172.21.15.33:0/561812292 shutdown_connections 2024-09-13T18:58:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.482+0000 7f774fa5a740 1 -- 172.21.15.33:0/561812292 wait complete. 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.483+0000 7f774fa5a740 1 -- start start 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.483+0000 7f774fa5a740 1 Processor -- start 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c6174cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616cbb80 0x564c6174b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c6170a700 con 0x564c6169f170 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c6174d980 con 0x564c616a46d0 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c6170a870 con 0x564c616cbb80 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f774fa5a740 10 client.0 _ll_register_callbacks cb 0x7f7740009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f7745e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.484+0000 7f7745e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36614/0 (socket says 172.21.15.33:36614) 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 -- 172.21.15.33:0/473029890 learned_addr learned my addr 172.21.15.33:0/473029890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 -- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616cbb80 msgr2=0x564c6174b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616cbb80 0x564c6174b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 -- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 msgr2=0x564c6174cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c6174cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 -- 172.21.15.33:0/473029890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77300099b0 con 0x564c6169f170 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f7745e00640 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77380011e0 tx=0x7f7738001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7bad03ef4cd4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f772b400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738023660 con 0x564c6169f170 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77380237c0 con 0x564c6169f170 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.485+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7740077800 con 0x564c6169f170 2024-09-13T18:58:23.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7738023980 con 0x564c6169f170 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 10 client.5259 fetch_fsmap learned FSMap version 16 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564c615a7470 con 0x564c6169f170 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740077800 con 0x564c6169f170 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7738012070 con 0x564c6169f170 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 10 client.5259 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 10 client.5259 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 20 client.5259 populate_metadata read hostname 'smithi033' 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616e73a0 0x564c616e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 4 client.5259 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 --> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564c6130b6c0 con 0x564c616e73a0 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.486+0000 7f773fe00640 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616e73a0 0x564c616e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f773fe00640 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616e73a0 0x564c616e77a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61303abc4600da47 server_cookie=fb4420707e4ec5e4 in_seq=0 out_seq=0 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f772b400640 10 client.5259 ms_handle_connect on v2:172.21.15.33:6833/2809270165 2024-09-13T18:58:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f772b400640 1 -- 172.21.15.33:0/473029890 <== mds.0 v2:172.21.15.33:6833/2809270165 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564c6130b6c0 con 0x564c616e73a0 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f772b400640 10 client.5259 handle_command_reply: tid=0 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 client.5259 shutdown 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 msgr2=0x564c616ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77380011e0 tx=0x7f7738001080 comp rx=0 tx=0).stop 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 shutdown_connections 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:6833/2809270165,v1:172.21.15.33:6835/2809270165] conn(0x564c616e73a0 0x564c616e77a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x564c616cbb80 0x564c6174b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564c616a46d0 0x564c6174cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 --2- 172.21.15.33:0/473029890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c6169f170 0x564c616ce4d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f772b400640 0 client.5259 ms_handle_reset on v2:172.21.15.33:6833/2809270165 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.487+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 >> 172.21.15.33:0/473029890 conn(0x564c616a1e90 msgr2=0x564c616a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 shutdown_connections 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774fa5a740 1 -- 172.21.15.33:0/473029890 wait complete. 2024-09-13T18:58:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774fa5a740 20 client.5259 trim_cache size 0 max 16384 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5082, 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 6.0909994440000004, 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 16, 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 34, 2024-09-13T18:58:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 34, 2024-09-13T18:58:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 13.369751038 2024-09-13T18:58:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:58:23.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 msgr2=0x7f772406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 0x7f772406d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7738000f60 tx=0x7f7738009040 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 msgr2=0x7f77480b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f7740004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 shutdown_connections 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f772406ac00 0x7f772406d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7748145a50 0x7f77480b02b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7748145670 0x7f7748144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 --2- 172.21.15.33:0/1471006831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77480b3bb0 0x7f774815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 >> 172.21.15.33:0/1471006831 conn(0x7f774806afe0 msgr2=0x7f77480ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.488+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 shutdown_connections 2024-09-13T18:58:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.489+0000 7f774cc00640 1 -- 172.21.15.33:0/1471006831 wait complete. 2024-09-13T18:58:23.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:58:23.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.658+0000 7f8fe3a00640 1 Processor -- start 2024-09-13T18:58:23.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.658+0000 7f8fe3a00640 1 -- start start 2024-09-13T18:58:23.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fdc15a520 0x7f8fdc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc0b1b00 0x7f8fdc0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cde50 0x7f8fdc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc06bc00 con 0x7f8fdc0cde50 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc06bea0 con 0x7f8fdc15a520 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe3a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc06c180 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.659+0000 7f8fe1a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cde50 0x7f8fdc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cde50 0x7f8fdc0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36624/0 (socket says 172.21.15.33:36624) 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3083556893 learned_addr learned my addr 172.21.15.33:0/3083556893 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fdbe00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc0b1b00 0x7f8fdc0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1000640 1 --2- 172.21.15.33:0/3083556893 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc15a520 0x7f8fdc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3083556893 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc0b1b00 msgr2=0x7f8fdc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc0b1b00 0x7f8fdc0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3083556893 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc15a520 msgr2=0x7f8fdc06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3083556893 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc15a520 0x7f8fdc06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.660+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3083556893 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc06c460 con 0x7f8fdc0cde50 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.661+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc0b2490 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009e50 tx=0x7f8fd402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33297c5f84a389e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.661+0000 7f8fdb400640 1 -- 172.21.15.33:0/3083556893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4031600 con 0x7f8fdc0cde50 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.661+0000 7f8fdb400640 1 -- 172.21.15.33:0/3083556893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd402d050 con 0x7f8fdc0cde50 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.661+0000 7f8fdb400640 1 -- 172.21.15.33:0/3083556893 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4031980 con 0x7f8fdc0cde50 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 -- 172.21.15.33:0/3083556893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cde50 msgr2=0x7f8fdc0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc0b2490 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009e50 tx=0x7f8fd402a6d0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 -- 172.21.15.33:0/3083556893 shutdown_connections 2024-09-13T18:58:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc0b1b00 0x7f8fdc0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/3083556893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc0b2490 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/3083556893 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc15a520 0x7f8fdc06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 -- 172.21.15.33:0/3083556893 >> 172.21.15.33:0/3083556893 conn(0x7f8fdc0b0510 msgr2=0x7f8fdc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 -- 172.21.15.33:0/3083556893 shutdown_connections 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.662+0000 7f8fe3a00640 1 -- 172.21.15.33:0/3083556893 wait complete. 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.663+0000 7f8fe3a00640 1 Processor -- start 2024-09-13T18:58:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.664+0000 7f8fe3a00640 1 -- start start 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.664+0000 7f8fe3a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe3a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe3a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a520 0x7f8fdc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe3a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14a4f0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe3a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc15bad0 con 0x7f8fdc0cde50 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe3a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc06fd60 con 0x7f8fdc15a520 2024-09-13T18:58:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36636/0 (socket says 172.21.15.33:36636) 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 -- 172.21.15.33:0/2428309996 learned_addr learned my addr 172.21.15.33:0/2428309996 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fdbe00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a520 0x7f8fdc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 -- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a520 msgr2=0x7f8fdc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a520 0x7f8fdc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 -- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 msgr2=0x7f8fdc149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fe1000640 1 -- 172.21.15.33:0/2428309996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009b30 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.665+0000 7f8fdbe00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fe1000640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d5f0 tx=0x7f8fd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00125f0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0012750 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0012b00 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc070040 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.666+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc070600 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.667+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc0cd910 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.668+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd0012c60 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.669+0000 7f8fd8c00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 0x7f8fbc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.669+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd00897f0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.669+0000 7f8fdbe00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 0x7f8fbc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.670+0000 7f8fdbe00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 0x7f8fbc06d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0adbd0 tx=0x7f8fc8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:23.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.673+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8fd00549c0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.892+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fdc0cc1f0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.893+0000 7f8fd8c00640 1 -- 172.21.15.33:0/2428309996 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8fd0057fe0 con 0x7f8fdc0b1b00 2024-09-13T18:58:23.896 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 msgr2=0x7f8fbc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 0x7f8fbc06d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0adbd0 tx=0x7f8fc8008040 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 msgr2=0x7f8fdc06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d5f0 tx=0x7f8fd000dab0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 shutdown_connections 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac30 0x7f8fbc06d0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a520 0x7f8fdc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cde50 0x7f8fdc149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 --2- 172.21.15.33:0/2428309996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0b1b00 0x7f8fdc06f660 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 >> 172.21.15.33:0/2428309996 conn(0x7f8fdc0b0510 msgr2=0x7f8fdc0afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 shutdown_connections 2024-09-13T18:58:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:23.895+0000 7f8fe3a00640 1 -- 172.21.15.33:0/2428309996 wait complete. 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:58:23.915 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:23.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:23.915 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:58:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42628sec preferred_lft 42628sec 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T18:58:23.953 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T18:58:23.954 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.955 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:58:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T18:58:23.955 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:23.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:23.955 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:58:24.047 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T18:58:24.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.050 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T18:58:24.086 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T18:58:24.086 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:58:24.086 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:58:24.086 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:58:24.086 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:58:24.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:58:24.087 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:58:24.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.270 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:58:24.305 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:58:24.305 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:58:24.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:24.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T18:58:24.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:24.403 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:24.438 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:24.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:24.439 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:24.513 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:58:24.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:24.643 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:24.643 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:24.643 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:24.658 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:24.658 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:24.658 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:24.658 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:24.658 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:24.680 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:24.680 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:58:24.681 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:58:24.682 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:58:24.682 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:58:24.683 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:58:24.683 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:58:24.683 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:58:24.686 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:58:24.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.686 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:24.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:24.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:58:24.786 INFO:teuthology.orchestra.run.smithi033.stdout:client5268 2024-09-13T18:58:24.786 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:24.787 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:24.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:58:25.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.057+0000 7ff52b400640 1 Processor -- start 2024-09-13T18:58:25.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.057+0000 7ff52b400640 1 -- start start 2024-09-13T18:58:25.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.058+0000 7ff52b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5240b3990 0x7ff524159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.058+0000 7ff52b400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff52406f660 0x7ff52406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.058+0000 7ff52b400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff524159fc0 con 0x7ff524153b20 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.058+0000 7ff52b400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240b3df0 con 0x7ff52406f660 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.058+0000 7ff52b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240ce600 con 0x7ff5240b3990 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff528a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff524153b20 0x7ff5240b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57704/0 (socket says 172.21.15.33:57704) 2024-09-13T18:58:25.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff528a00640 1 -- 172.21.15.33:0/3047496013 learned_addr learned my addr 172.21.15.33:0/3047496013 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff523e00640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5240b3990 0x7ff524159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff529400640 1 --2- 172.21.15.33:0/3047496013 >> v2:172.21.15.103:3300/0 conn(0x7ff52406f660 0x7ff52406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff523400640 1 -- 172.21.15.33:0/3047496013 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419917007 0 0) 0x7ff524159fc0 con 0x7ff524153b20 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff523400640 1 -- 172.21.15.33:0/3047496013 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff50c003520 con 0x7ff524153b20 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff529400640 1 -- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5240b3990 msgr2=0x7ff524159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff529400640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5240b3990 0x7ff524159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff529400640 1 -- 172.21.15.33:0/3047496013 >> v1:172.21.15.33:6789/0 conn(0x7ff524153b20 legacy=0x7ff5240b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.059+0000 7ff529400640 1 -- 172.21.15.33:0/3047496013 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524153f00 con 0x7ff52406f660 2024-09-13T18:58:25.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff529400640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff52406f660 0x7ff52406faf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009d90 tx=0x7ff51c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e07782e80ca3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:25.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff523400640 1 -- 172.21.15.33:0/3047496013 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c007740 con 0x7ff52406f660 2024-09-13T18:58:25.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff523400640 1 -- 172.21.15.33:0/3047496013 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c02d050 con 0x7ff52406f660 2024-09-13T18:58:25.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff523400640 1 -- 172.21.15.33:0/3047496013 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c007ac0 con 0x7ff52406f660 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 -- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff52406f660 msgr2=0x7ff52406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff52406f660 0x7ff52406faf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009d90 tx=0x7ff51c02a660 comp rx=0 tx=0).stop 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 -- 172.21.15.33:0/3047496013 shutdown_connections 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5240b3990 0x7ff524159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 --2- 172.21.15.33:0/3047496013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff52406f660 0x7ff52406faf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.061+0000 7ff52b400640 1 -- 172.21.15.33:0/3047496013 >> 172.21.15.33:0/3047496013 conn(0x7ff5240b0510 msgr2=0x7ff5240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:25.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.062+0000 7ff52b400640 1 -- 172.21.15.33:0/3047496013 shutdown_connections 2024-09-13T18:58:25.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.062+0000 7ff52b400640 1 -- 172.21.15.33:0/3047496013 wait complete. 2024-09-13T18:58:25.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.063+0000 7ff52b400640 1 Processor -- start 2024-09-13T18:58:25.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.063+0000 7ff52b400640 1 -- start start 2024-09-13T18:58:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b3990 0x7ff524158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff524153b20 0x7ff52414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524141d20 con 0x7ff52406f660 2024-09-13T18:58:25.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524157bd0 con 0x7ff5240b3990 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff52b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff524157eb0 con 0x7ff524153b20 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff528a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff528a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36640/0 (socket says 172.21.15.33:36640) 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.064+0000 7ff528a00640 1 -- 172.21.15.33:0/2651908124 learned_addr learned my addr 172.21.15.33:0/2651908124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff523e00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b3990 0x7ff524158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff529400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff524153b20 0x7ff52414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 -- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff524153b20 msgr2=0x7ff52414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff524153b20 0x7ff52414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 -- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b3990 msgr2=0x7ff524158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b3990 0x7ff524158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 -- 172.21.15.33:0/2651908124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c009a70 con 0x7ff52406f660 2024-09-13T18:58:25.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff528a00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c500 tx=0x7ff51800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:25.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.065+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518005ce0 con 0x7ff52406f660 2024-09-13T18:58:25.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.066+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518005e40 con 0x7ff52406f660 2024-09-13T18:58:25.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.066+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518007330 con 0x7ff52406f660 2024-09-13T18:58:25.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.066+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff524158190 con 0x7ff52406f660 2024-09-13T18:58:25.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.066+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff524158750 con 0x7ff52406f660 2024-09-13T18:58:25.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.067+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52415a7b0 con 0x7ff52406f660 2024-09-13T18:58:25.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.068+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff518007550 con 0x7ff52406f660 2024-09-13T18:58:25.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.068+0000 7ff520c00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:25.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.069+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5180889a0 con 0x7ff52406f660 2024-09-13T18:58:25.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.069+0000 7ff523e00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:25.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.070+0000 7ff523e00640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 0x7ff50406d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5240cb4a0 tx=0x7ff510009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:25.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.073+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff518053ce0 con 0x7ff52406f660 2024-09-13T18:58:25.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.289+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff52415d4f0 con 0x7ff52406f660 2024-09-13T18:58:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.290+0000 7ff520c00640 1 -- 172.21.15.33:0/2651908124 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff518017020 con 0x7ff52406f660 2024-09-13T18:58:25.293 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:58:25.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 msgr2=0x7ff50406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 0x7ff50406d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5240cb4a0 tx=0x7ff510009190 comp rx=0 tx=0).stop 2024-09-13T18:58:25.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 msgr2=0x7ff5241417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c500 tx=0x7ff51800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 shutdown_connections 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff524153b20 0x7ff52414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b3990 0x7ff524158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 --2- 172.21.15.33:0/2651908124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406f660 0x7ff5241417e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 >> 172.21.15.33:0/2651908124 conn(0x7ff5240b0510 msgr2=0x7ff5240b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 shutdown_connections 2024-09-13T18:58:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:25.292+0000 7ff52b400640 1 -- 172.21.15.33:0/2651908124 wait complete. 2024-09-13T18:58:25.311 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:58:25.311 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:58:25.312 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:25.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.312 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:25.353 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42644sec preferred_lft 42644sec 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:58:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:25.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.356 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:58:25.454 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:58:25.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.460 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T18:58:25.497 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T18:58:25.498 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:58:25.498 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:58:25.498 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:58:25.498 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:58:25.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.498 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:58:25.498 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:58:25.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:58:25.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:58:25.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:58:25.499 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:58:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.644 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:58:25.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:58:25.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:58:25.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:25.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T18:58:25.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:25.775 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:25.810 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:25.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:25.810 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:25.885 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:58:25.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:25.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:26.014 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:26.014 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:26.014 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:26.029 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:26.030 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:26.030 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:26.030 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:26.030 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:26.052 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:58:26.053 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:58:26.055 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:58:26.055 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:58:26.055 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:58:26.055 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:58:26.056 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:58:26.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:58:26.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:26.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.113 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:58:26.151 INFO:teuthology.orchestra.run.smithi103.stdout:client5191 2024-09-13T18:58:26.152 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:26.152 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:26.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.228 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T18:58:26.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.275 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2024-09-13T18:58:26.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.324 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:58:26.360 INFO:teuthology.orchestra.run.smithi033.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T18:58:26.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:26.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.362 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2024-09-13T18:58:26.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.441 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:58:26.517 INFO:teuthology.orchestra.run.smithi033.stdout:1024 2024-09-13T18:58:26.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0M ./subdir) 2024-09-13T18:58:26.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:26.597 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:58:26.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T18:58:26.673 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:58:26.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:26.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:26.902 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:58:26.902 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:26.902 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:26.938 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:26.938 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:27.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:27.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.205+0000 7fac2aa00640 1 Processor -- start 2024-09-13T18:58:27.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.205+0000 7fac2aa00640 1 -- start start 2024-09-13T18:58:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 0x7fac2415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2aa00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b1e00 con 0x7fac240acf80 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2aa00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b3230 con 0x7fac2415fa70 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2415dbe0 con 0x7fac240afe10 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac28c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fac240acf80 0x7fac240b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57720/0 (socket says 172.21.15.33:57720) 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac28c00640 1 -- 172.21.15.33:0/49881693 learned_addr learned my addr 172.21.15.33:0/49881693 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2a000640 1 --2- 172.21.15.33:0/49881693 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 0x7fac2415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337934161 0 0) 0x7fac240b1e00 con 0x7fac240acf80 2024-09-13T18:58:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c003520 con 0x7fac240acf80 2024-09-13T18:58:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2a000640 1 -- 172.21.15.33:0/49881693 >> v1:172.21.15.103:6789/0 conn(0x7fac2415fa70 legacy=0x7fac240ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012677110 0 0) 0x7fac240b3230 con 0x7fac2415fa70 2024-09-13T18:58:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2a000640 1 -- 172.21.15.33:0/49881693 >> v1:172.21.15.33:6789/0 conn(0x7fac240acf80 legacy=0x7fac240b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.208+0000 7fac2a000640 1 -- 172.21.15.33:0/49881693 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240b1840 con 0x7fac240afe10 2024-09-13T18:58:27.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac2a000640 1 --2- 172.21.15.33:0/49881693 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 0x7fac2415d600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009dc0 tx=0x7fac1c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d14eab09c5fc4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007740 con 0x7fac240afe10 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c02d050 con 0x7fac240afe10 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac23e00640 1 -- 172.21.15.33:0/49881693 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007ac0 con 0x7fac240afe10 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac2aa00640 1 -- 172.21.15.33:0/49881693 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 msgr2=0x7fac2415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.209+0000 7fac2aa00640 1 --2- 172.21.15.33:0/49881693 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 0x7fac2415d600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009dc0 tx=0x7fac1c02a640 comp rx=0 tx=0).stop 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.210+0000 7fac2aa00640 1 -- 172.21.15.33:0/49881693 shutdown_connections 2024-09-13T18:58:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.210+0000 7fac2aa00640 1 --2- 172.21.15.33:0/49881693 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240afe10 0x7fac2415d600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.210+0000 7fac2aa00640 1 -- 172.21.15.33:0/49881693 >> 172.21.15.33:0/49881693 conn(0x7fac240ae310 msgr2=0x7fac240ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.210+0000 7fac2aa00640 1 -- 172.21.15.33:0/49881693 shutdown_connections 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.210+0000 7fac2aa00640 1 -- 172.21.15.33:0/49881693 wait complete. 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 Processor -- start 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 -- start start 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240acf80 0x7fac24154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac240afe10 0x7fac24150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24151a70 con 0x7fac2415fa70 2024-09-13T18:58:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24151d20 con 0x7fac240afe10 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.212+0000 7fac2aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24152000 con 0x7fac240acf80 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36656/0 (socket says 172.21.15.33:36656) 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac28c00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac240afe10 0x7fac24150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac29600640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240acf80 0x7fac24154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 -- 172.21.15.33:0/2051476982 learned_addr learned my addr 172.21.15.33:0/2051476982 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 -- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240acf80 msgr2=0x7fac24154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240acf80 0x7fac24154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 -- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac240afe10 msgr2=0x7fac24150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac240afe10 0x7fac24150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.213+0000 7fac2a000640 1 -- 172.21.15.33:0/2051476982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009a70 con 0x7fac2415fa70 2024-09-13T18:58:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac2a000640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ee0 tx=0x7fac1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c03c830 con 0x7fac2415fa70 2024-09-13T18:58:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c03c990 con 0x7fac2415fa70 2024-09-13T18:58:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac241522e0 con 0x7fac2415fa70 2024-09-13T18:58:27.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c03cd00 con 0x7fac2415fa70 2024-09-13T18:58:27.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.214+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac241528a0 con 0x7fac2415fa70 2024-09-13T18:58:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.216+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24067360 con 0x7fac2415fa70 2024-09-13T18:58:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.216+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac1c031400 con 0x7fac2415fa70 2024-09-13T18:58:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.218+0000 7fac21600640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 0x7fac0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.218+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac1c0aad00 con 0x7fac2415fa70 2024-09-13T18:58:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.218+0000 7fac29600640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 0x7fac0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.218+0000 7fac29600640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 0x7fac0406d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.221+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac1c075f90 con 0x7fac2415fa70 2024-09-13T18:58:27.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.400+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac2415d600 con 0x7fac2415fa70 2024-09-13T18:58:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.401+0000 7fac21600640 1 -- 172.21.15.33:0/2051476982 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fac1c040090 con 0x7fac2415fa70 2024-09-13T18:58:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:27.404 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 msgr2=0x7fac0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 0x7fac0406d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac18009040 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 msgr2=0x7fac24151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ee0 tx=0x7fac1c004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 shutdown_connections 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac0406ac00 0x7fac0406d0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2415fa70 0x7fac24151530 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac240afe10 0x7fac24150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 --2- 172.21.15.33:0/2051476982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac240acf80 0x7fac24154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 >> 172.21.15.33:0/2051476982 conn(0x7fac240ae310 msgr2=0x7fac240ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 shutdown_connections 2024-09-13T18:58:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.403+0000 7fac2aa00640 1 -- 172.21.15.33:0/2051476982 wait complete. 2024-09-13T18:58:27.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:15.830061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:16.385610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:27.423 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:27.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.581+0000 7fb9d6a00640 1 Processor -- start 2024-09-13T18:58:27.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.581+0000 7fb9d6a00640 1 -- start start 2024-09-13T18:58:27.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9d0154ad0 0x7fb9d00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d006f830 0x7fb9d006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d6a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d006b7c0 con 0x7fb9d00ce2c0 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d6a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d006b5b0 con 0x7fb9d0154ad0 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d006baa0 con 0x7fb9d006f830 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9cfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9d0154ad0 0x7fb9d00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb9d00ce2c0 0x7fb9d00cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57730/0 (socket says 172.21.15.33:57730) 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.582+0000 7fb9d4a00640 1 -- 172.21.15.33:0/2494044454 learned_addr learned my addr 172.21.15.33:0/2494044454 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:27.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.583+0000 7fb9c7400640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d006f830 0x7fb9d006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.583+0000 7fb9cfe00640 1 -- 172.21.15.33:0/2494044454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d006f830 msgr2=0x7fb9d006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.583+0000 7fb9cfe00640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d006f830 0x7fb9d006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.583+0000 7fb9cfe00640 1 -- 172.21.15.33:0/2494044454 >> v1:172.21.15.33:6789/0 conn(0x7fb9d00ce2c0 legacy=0x7fb9d00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.583+0000 7fb9cfe00640 1 -- 172.21.15.33:0/2494044454 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d006bd80 con 0x7fb9d0154ad0 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.584+0000 7fb9cfe00640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0154ad0 0x7fb9d00cdd80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00097a0 tx=0x7fb9c002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42e35f13af9f8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.584+0000 7fb9cf400640 1 -- 172.21.15.33:0/2494044454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c002ae50 con 0x7fb9d0154ad0 2024-09-13T18:58:27.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.584+0000 7fb9cf400640 1 -- 172.21.15.33:0/2494044454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0032440 con 0x7fb9d0154ad0 2024-09-13T18:58:27.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.584+0000 7fb9cf400640 1 -- 172.21.15.33:0/2494044454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c00327d0 con 0x7fb9d0154ad0 2024-09-13T18:58:27.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 -- 172.21.15.33:0/2494044454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0154ad0 msgr2=0x7fb9d00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0154ad0 0x7fb9d00cdd80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00097a0 tx=0x7fb9c002a100 comp rx=0 tx=0).stop 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 -- 172.21.15.33:0/2494044454 shutdown_connections 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d006f830 0x7fb9d006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/2494044454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0154ad0 0x7fb9d00cdd80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 -- 172.21.15.33:0/2494044454 >> 172.21.15.33:0/2494044454 conn(0x7fb9d00b0580 msgr2=0x7fb9d00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 -- 172.21.15.33:0/2494044454 shutdown_connections 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.585+0000 7fb9d6a00640 1 -- 172.21.15.33:0/2494044454 wait complete. 2024-09-13T18:58:27.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.586+0000 7fb9d6a00640 1 Processor -- start 2024-09-13T18:58:27.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.586+0000 7fb9d6a00640 1 -- start start 2024-09-13T18:58:27.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9d0154ad0 0x7fb9d0136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d01e6ea0 0x7fb9d01e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d014a7e0 con 0x7fb9d0152810 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d01e7860 con 0x7fb9d0154ad0 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.587+0000 7fb9d6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0137c60 con 0x7fb9d01e6ea0 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36668/0 (socket says 172.21.15.33:36668) 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 -- 172.21.15.33:0/1406454090 learned_addr learned my addr 172.21.15.33:0/1406454090 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9c7400640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d01e6ea0 0x7fb9d01e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9cfe00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9d0154ad0 0x7fb9d0136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 -- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d01e6ea0 msgr2=0x7fb9d01e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d01e6ea0 0x7fb9d01e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 -- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9d0154ad0 msgr2=0x7fb9d0136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9d0154ad0 0x7fb9d0136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 -- 172.21.15.33:0/1406454090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0009400 con 0x7fb9d0152810 2024-09-13T18:58:27.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9d4a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800cbf0 tx=0x7fb9c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.588+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800ace0 con 0x7fb9d0152810 2024-09-13T18:58:27.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.589+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800ae40 con 0x7fb9d0152810 2024-09-13T18:58:27.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.589+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8012600 con 0x7fb9d0152810 2024-09-13T18:58:27.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.589+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d01535d0 con 0x7fb9d0152810 2024-09-13T18:58:27.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.589+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0137610 con 0x7fb9d0152810 2024-09-13T18:58:27.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.590+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d00cb070 con 0x7fb9d0152810 2024-09-13T18:58:27.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.591+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9c8007070 con 0x7fb9d0152810 2024-09-13T18:58:27.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.591+0000 7fb9ccc00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 0x7fb9ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.592+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c8089150 con 0x7fb9d0152810 2024-09-13T18:58:27.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.592+0000 7fb9cfe00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 0x7fb9ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.593+0000 7fb9cfe00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 0x7fb9ac06d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.596+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb9c80543e0 con 0x7fb9d0152810 2024-09-13T18:58:27.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.774+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9d00cdd80 con 0x7fb9d0152810 2024-09-13T18:58:27.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.775+0000 7fb9ccc00640 1 -- 172.21.15.33:0/1406454090 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9c8057a00 con 0x7fb9d0152810 2024-09-13T18:58:27.777 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 msgr2=0x7fb9ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 0x7fb9ac06d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0034000 tx=0x7fb9c002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 msgr2=0x7fb9d0152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800cbf0 tx=0x7fb9c800a430 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 shutdown_connections 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb9ac06ac30 0x7fb9ac06d0f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9d0152810 0x7fb9d0152cc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9d01e6ea0 0x7fb9d01e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 --2- 172.21.15.33:0/1406454090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9d0154ad0 0x7fb9d0136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 >> 172.21.15.33:0/1406454090 conn(0x7fb9d00b0580 msgr2=0x7fb9d015e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 shutdown_connections 2024-09-13T18:58:27.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.777+0000 7fb9d6a00640 1 -- 172.21.15.33:0/1406454090 wait complete. 2024-09-13T18:58:27.795 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:27.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.951+0000 7fc660000640 1 Processor -- start 2024-09-13T18:58:27.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.951+0000 7fc660000640 1 -- start start 2024-09-13T18:58:27.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.952+0000 7fc660000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc658154ad0 0x7fc6580cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.952+0000 7fc660000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 0x7fc65806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.952+0000 7fc660000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65806b7c0 con 0x7fc6580ce2c0 2024-09-13T18:58:27.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.952+0000 7fc660000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65806b5b0 con 0x7fc658154ad0 2024-09-13T18:58:27.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.952+0000 7fc660000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65806baa0 con 0x7fc65806f830 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc658154ad0 0x7fc6580cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 0x7fc65806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc658154ad0 0x7fc6580cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:39346/0 (socket says 172.21.15.33:39346) 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 -- 172.21.15.33:0/1736941476 learned_addr learned my addr 172.21.15.33:0/1736941476 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 0x7fc65806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:48574/0 (socket says 172.21.15.33:48574) 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 -- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 msgr2=0x7fc65806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 --2- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 0x7fc65806fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 -- 172.21.15.33:0/1736941476 >> v1:172.21.15.103:6789/0 conn(0x7fc6580ce2c0 legacy=0x7fc6580cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc65d600640 1 -- 172.21.15.33:0/1736941476 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65806bd80 con 0x7fc658154ad0 2024-09-13T18:58:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.953+0000 7fc657e00640 1 -- 172.21.15.33:0/1736941476 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331191122 0 0) 0x7fc65806b7c0 con 0x7fc6580ce2c0 2024-09-13T18:58:27.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc65d600640 1 --2- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6580cdd80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009870 tx=0x7fc64c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78343d20fa635215 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc657e00640 1 -- 172.21.15.33:0/1736941476 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032440 con 0x7fc658154ad0 2024-09-13T18:58:27.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc657e00640 1 -- 172.21.15.33:0/1736941476 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0325a0 con 0x7fc658154ad0 2024-09-13T18:58:27.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc657e00640 1 -- 172.21.15.33:0/1736941476 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032930 con 0x7fc658154ad0 2024-09-13T18:58:27.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 -- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 msgr2=0x7fc6580cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 --2- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6580cdd80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009870 tx=0x7fc64c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 -- 172.21.15.33:0/1736941476 shutdown_connections 2024-09-13T18:58:27.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 --2- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc65806f830 0x7fc65806fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 --2- 172.21.15.33:0/1736941476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6580cdd80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 -- 172.21.15.33:0/1736941476 >> 172.21.15.33:0/1736941476 conn(0x7fc6580b0580 msgr2=0x7fc6580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:27.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 -- 172.21.15.33:0/1736941476 shutdown_connections 2024-09-13T18:58:27.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.955+0000 7fc660000640 1 -- 172.21.15.33:0/1736941476 wait complete. 2024-09-13T18:58:27.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.957+0000 7fc660000640 1 Processor -- start 2024-09-13T18:58:27.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.957+0000 7fc660000640 1 -- start start 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6581403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc658142610 0x7fc6580b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581f5860 con 0x7fc658152cd0 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658140930 con 0x7fc658154ad0 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc660000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc658142a90 con 0x7fc658142610 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc65cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc65cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36674/0 (socket says 172.21.15.33:36674) 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.958+0000 7fc65cc00640 1 -- 172.21.15.33:0/2781502490 learned_addr learned my addr 172.21.15.33:0/2781502490 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65e000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc658142610 0x7fc6580b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65d600640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6581403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 -- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc658142610 msgr2=0x7fc6580b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc658142610 0x7fc6580b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 -- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 msgr2=0x7fc6581403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6581403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 -- 172.21.15.33:0/2781502490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0094d0 con 0x7fc658152cd0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65d600640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6581403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc65cc00640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e9b0 tx=0x7fc64400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644009670 con 0x7fc658152cd0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64400c9a0 con 0x7fc658152cd0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400cd50 con 0x7fc658152cd0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.959+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6581f6650 con 0x7fc658152cd0 2024-09-13T18:58:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.960+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6581f5d20 con 0x7fc658152cd0 2024-09-13T18:58:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.961+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580cdd80 con 0x7fc658152cd0 2024-09-13T18:58:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.962+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc644013470 con 0x7fc658152cd0 2024-09-13T18:58:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.962+0000 7fc655600640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 0x7fc63806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.963+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6440895e0 con 0x7fc658152cd0 2024-09-13T18:58:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.963+0000 7fc65d600640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 0x7fc63806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:27.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.964+0000 7fc65d600640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 0x7fc63806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc64c034000 tx=0x7fc64c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:27.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:27.967+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc644054720 con 0x7fc658152cd0 2024-09-13T18:58:28.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.144+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc658154310 con 0x7fc658152cd0 2024-09-13T18:58:28.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.144+0000 7fc655600640 1 -- 172.21.15.33:0/2781502490 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc644057d40 con 0x7fc658152cd0 2024-09-13T18:58:28.146 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 msgr2=0x7fc63806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 0x7fc63806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc64c034000 tx=0x7fc64c02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 msgr2=0x7fc6581420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e9b0 tx=0x7fc64400ee70 comp rx=0 tx=0).stop 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 shutdown_connections 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc63806ac00 0x7fc63806d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc658142610 0x7fc6580b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc658152cd0 0x7fc6581420d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 --2- 172.21.15.33:0/2781502490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc658154ad0 0x7fc6581403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 >> 172.21.15.33:0/2781502490 conn(0x7fc6580b0580 msgr2=0x7fc658070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:28.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.146+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 shutdown_connections 2024-09-13T18:58:28.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.147+0000 7fc660000640 1 -- 172.21.15.33:0/2781502490 wait complete. 2024-09-13T18:58:28.164 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:28.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.320+0000 7fa616c00640 1 Processor -- start 2024-09-13T18:58:28.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.320+0000 7fa616c00640 1 -- start start 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.321+0000 7fa616c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa610156f60 0x7fa61015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.321+0000 7fa616c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa610071690 0x7fa6100cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.321+0000 7fa616c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61006f5f0 con 0x7fa6100cafa0 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.321+0000 7fa616c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61015aa30 con 0x7fa610156f60 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.321+0000 7fa616c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa610070450 con 0x7fa610071690 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60f400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa6100cafa0 0x7fa610070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57744/0 (socket says 172.21.15.33:57744) 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60f400640 1 -- 172.21.15.33:0/636958801 learned_addr learned my addr 172.21.15.33:0/636958801 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60fe00640 1 --2- 172.21.15.33:0/636958801 >> v2:172.21.15.103:3300/0 conn(0x7fa610156f60 0x7fa61015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa614c00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa610071690 0x7fa6100cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60ea00640 1 -- 172.21.15.33:0/636958801 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41794356 0 0) 0x7fa61006f5f0 con 0x7fa6100cafa0 2024-09-13T18:58:28.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60ea00640 1 -- 172.21.15.33:0/636958801 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f4003520 con 0x7fa6100cafa0 2024-09-13T18:58:28.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60fe00640 1 -- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa610071690 msgr2=0x7fa6100cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:28.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60fe00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa610071690 0x7fa6100cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60fe00640 1 -- 172.21.15.33:0/636958801 >> v1:172.21.15.33:6789/0 conn(0x7fa6100cafa0 legacy=0x7fa610070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.322+0000 7fa60fe00640 1 -- 172.21.15.33:0/636958801 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61006f840 con 0x7fa610156f60 2024-09-13T18:58:28.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.323+0000 7fa60fe00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61015a4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097a0 tx=0x7fa60002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ef4cb0bf6bcce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.324+0000 7fa60ea00640 1 -- 172.21.15.33:0/636958801 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600032440 con 0x7fa610156f60 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.324+0000 7fa60ea00640 1 -- 172.21.15.33:0/636958801 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000325a0 con 0x7fa610156f60 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.324+0000 7fa60ea00640 1 -- 172.21.15.33:0/636958801 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600032930 con 0x7fa610156f60 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 -- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 msgr2=0x7fa61015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61015a4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097a0 tx=0x7fa60002a180 comp rx=0 tx=0).stop 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 -- 172.21.15.33:0/636958801 shutdown_connections 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa610071690 0x7fa6100cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 --2- 172.21.15.33:0/636958801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61015a4f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 -- 172.21.15.33:0/636958801 >> 172.21.15.33:0/636958801 conn(0x7fa6100b0580 msgr2=0x7fa6100b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 -- 172.21.15.33:0/636958801 shutdown_connections 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.325+0000 7fa616c00640 1 -- 172.21.15.33:0/636958801 wait complete. 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.326+0000 7fa616c00640 1 Processor -- start 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.326+0000 7fa616c00640 1 -- start start 2024-09-13T18:58:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6100cafa0 0x7fa61014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610133d10 con 0x7fa610071690 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610132df0 con 0x7fa610156f60 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa616c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa610135d80 con 0x7fa6100cafa0 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.327+0000 7fa60fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36690/0 (socket says 172.21.15.33:36690) 2024-09-13T18:58:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 -- 172.21.15.33:0/1118699659 learned_addr learned my addr 172.21.15.33:0/1118699659 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 -- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6100cafa0 msgr2=0x7fa61014fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6100cafa0 0x7fa61014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 -- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 msgr2=0x7fa61014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 -- 172.21.15.33:0/1118699659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600009400 con 0x7fa610071690 2024-09-13T18:58:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa60fe00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa600035040 tx=0x7fa6000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60003d8f0 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60003da70 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.328+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa610133090 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.329+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60003de20 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.329+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa610133650 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.330+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6101584c0 con 0x7fa610071690 2024-09-13T18:58:28.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.331+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa600039040 con 0x7fa610071690 2024-09-13T18:58:28.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.331+0000 7fa607e00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.331+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6000a9b70 con 0x7fa610071690 2024-09-13T18:58:28.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.332+0000 7fa60f400640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.332+0000 7fa60f400640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 0x7fa5f006d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa610139500 tx=0x7fa5fc007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.336+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa600074dd0 con 0x7fa610071690 2024-09-13T18:58:28.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.513+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6100aee30 con 0x7fa610071690 2024-09-13T18:58:28.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.514+0000 7fa607e00640 1 -- 172.21.15.33:0/1118699659 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6000783f0 con 0x7fa610071690 2024-09-13T18:58:28.516 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 msgr2=0x7fa5f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 0x7fa5f006d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa610139500 tx=0x7fa5fc007930 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 msgr2=0x7fa610135840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa600035040 tx=0x7fa6000046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 shutdown_connections 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa610156f60 0x7fa61014dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6100cafa0 0x7fa61014fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 --2- 172.21.15.33:0/1118699659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa610071690 0x7fa610135840 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 >> 172.21.15.33:0/1118699659 conn(0x7fa6100b0580 msgr2=0x7fa610070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 shutdown_connections 2024-09-13T18:58:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.516+0000 7fa616c00640 1 -- 172.21.15.33:0/1118699659 wait complete. 2024-09-13T18:58:28.535 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:58:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.688+0000 7fa747200640 1 Processor -- start 2024-09-13T18:58:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.689+0000 7fa747200640 1 -- start start 2024-09-13T18:58:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa747200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 0x7fa7480b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa747200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7481596a0 0x7fa748069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa747200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480b1670 con 0x7fa74806f330 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa747200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480b1950 con 0x7fa7481596a0 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa747200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480b1c30 con 0x7fa7481592c0 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa73fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7481596a0 0x7fa748069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa745e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 0x7fa7480b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa745e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 0x7fa7480b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:39378/0 (socket says 172.21.15.33:39378) 2024-09-13T18:58:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.690+0000 7fa745e00640 1 -- 172.21.15.33:0/465826761 learned_addr learned my addr 172.21.15.33:0/465826761 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.691+0000 7fa73fe00640 1 -- 172.21.15.33:0/465826761 >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 msgr2=0x7fa7480b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.691+0000 7fa73fe00640 1 --2- 172.21.15.33:0/465826761 >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 0x7fa7480b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.691+0000 7fa73fe00640 1 -- 172.21.15.33:0/465826761 >> v1:172.21.15.103:6789/0 conn(0x7fa74806f330 legacy=0x7fa74815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.691+0000 7fa73fe00640 1 -- 172.21.15.33:0/465826761 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480b1f10 con 0x7fa7481596a0 2024-09-13T18:58:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.692+0000 7fa73fe00640 1 --2- 172.21.15.33:0/465826761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa748069ed0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa748066ca0 tx=0x7fa73002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ba9db02ea5b239 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.692+0000 7fa745400640 1 -- 172.21.15.33:0/465826761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730032440 con 0x7fa7481596a0 2024-09-13T18:58:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.692+0000 7fa745400640 1 -- 172.21.15.33:0/465826761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300325a0 con 0x7fa7481596a0 2024-09-13T18:58:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.692+0000 7fa745400640 1 -- 172.21.15.33:0/465826761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730032930 con 0x7fa7481596a0 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 -- 172.21.15.33:0/465826761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 msgr2=0x7fa748069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 --2- 172.21.15.33:0/465826761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa748069ed0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa748066ca0 tx=0x7fa73002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 -- 172.21.15.33:0/465826761 shutdown_connections 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 --2- 172.21.15.33:0/465826761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa748069ed0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 --2- 172.21.15.33:0/465826761 >> v2:172.21.15.103:3300/0 conn(0x7fa7481592c0 0x7fa7480b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 -- 172.21.15.33:0/465826761 >> 172.21.15.33:0/465826761 conn(0x7fa7480affd0 msgr2=0x7fa7480b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 -- 172.21.15.33:0/465826761 shutdown_connections 2024-09-13T18:58:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.693+0000 7fa747200640 1 -- 172.21.15.33:0/465826761 wait complete. 2024-09-13T18:58:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.694+0000 7fa747200640 1 Processor -- start 2024-09-13T18:58:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 -- start start 2024-09-13T18:58:28.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa74806f330 0x7fa748152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7481592c0 0x7fa7480aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815a870 con 0x7fa7481596a0 2024-09-13T18:58:28.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481f2190 con 0x7fa7481592c0 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.695+0000 7fa747200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481f2470 con 0x7fa74806f330 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36714/0 (socket says 172.21.15.33:36714) 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 -- 172.21.15.33:0/20625624 learned_addr learned my addr 172.21.15.33:0/20625624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa73fe00640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7481592c0 0x7fa7480aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa745e00640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa74806f330 0x7fa748152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 -- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa74806f330 msgr2=0x7fa748152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa74806f330 0x7fa748152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 -- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7481592c0 msgr2=0x7fa7480aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7481592c0 0x7fa7480aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.696+0000 7fa746800640 1 -- 172.21.15.33:0/20625624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009400 con 0x7fa7481596a0 2024-09-13T18:58:28.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa746800640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c7a0 tx=0x7fa74000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740003b70 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740003cf0 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740003ea0 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7481f2750 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.697+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa748152590 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.698+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa748067320 con 0x7fa7481596a0 2024-09-13T18:58:28.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.699+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa74000aa90 con 0x7fa7481596a0 2024-09-13T18:58:28.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.700+0000 7fa73e000640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:28.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.700+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa740089120 con 0x7fa7481596a0 2024-09-13T18:58:28.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.700+0000 7fa745e00640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:28.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.701+0000 7fa745e00640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa7481efc70 tx=0x7fa73800b450 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:28.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.704+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa740054310 con 0x7fa7481596a0 2024-09-13T18:58:28.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.897+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa74806c2e0 con 0x7fa7481596a0 2024-09-13T18:58:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.898+0000 7fa73e000640 1 -- 172.21.15.33:0/20625624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa740057930 con 0x7fa7481596a0 2024-09-13T18:58:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:58:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 msgr2=0x7fa72406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa7481efc70 tx=0x7fa73800b450 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 msgr2=0x7fa7480af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c7a0 tx=0x7fa74000cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 shutdown_connections 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7481596a0 0x7fa7480af3e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7481592c0 0x7fa7480aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 --2- 172.21.15.33:0/20625624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa74806f330 0x7fa748152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 >> 172.21.15.33:0/20625624 conn(0x7fa7480affd0 msgr2=0x7fa7480ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 shutdown_connections 2024-09-13T18:58:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:28.900+0000 7fa747200640 1 -- 172.21.15.33:0/20625624 wait complete. 2024-09-13T18:58:28.918 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:58:28.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:28.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:28.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:58:28.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:28.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:58:29.016 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:29.016 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:29.056 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:29.056 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:29.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:29.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.288+0000 7f29ce600640 1 Processor -- start 2024-09-13T18:58:29.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.288+0000 7f29ce600640 1 -- start start 2024-09-13T18:58:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29ce600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 0x7f29c806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29ce600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 0x7f29c80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29ce600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c806bc00 con 0x7f29c80cde50 2024-09-13T18:58:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29ce600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c806bea0 con 0x7f29c80b1b00 2024-09-13T18:58:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29ce600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c806c180 con 0x7f29c815a520 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29c7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f29c80cde50 0x7f29c80b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57754/0 (socket says 172.21.15.33:57754) 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29c7e00640 1 -- 172.21.15.33:0/2720502173 learned_addr learned my addr 172.21.15.33:0/2720502173 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29bfe00640 1 --2- 172.21.15.33:0/2720502173 >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 0x7f29c80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29c7400640 1 --2- 172.21.15.33:0/2720502173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 0x7f29c806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29c6a00640 1 -- 172.21.15.33:0/2720502173 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637765135 0 0) 0x7f29c806bc00 con 0x7f29c80cde50 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.290+0000 7f29c6a00640 1 -- 172.21.15.33:0/2720502173 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29ac003520 con 0x7f29c80cde50 2024-09-13T18:58:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.291+0000 7f29c7400640 1 -- 172.21.15.33:0/2720502173 >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 msgr2=0x7f29c80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.291+0000 7f29c7400640 1 --2- 172.21.15.33:0/2720502173 >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 0x7f29c80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.291+0000 7f29c7400640 1 -- 172.21.15.33:0/2720502173 >> v1:172.21.15.33:6789/0 conn(0x7f29c80cde50 legacy=0x7f29c80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.291+0000 7f29c7400640 1 -- 172.21.15.33:0/2720502173 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c806c460 con 0x7f29c815a520 2024-09-13T18:58:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.291+0000 7f29bfe00640 1 --2- 172.21.15.33:0/2720502173 >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 0x7f29c80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.292+0000 7f29c7400640 1 --2- 172.21.15.33:0/2720502173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 0x7f29c806b6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097d0 tx=0x7f29b802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2427461b8c3afed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.292+0000 7f29c6a00640 1 -- 172.21.15.33:0/2720502173 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8032440 con 0x7f29c815a520 2024-09-13T18:58:29.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.292+0000 7f29c6a00640 1 -- 172.21.15.33:0/2720502173 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b80325a0 con 0x7f29c815a520 2024-09-13T18:58:29.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.292+0000 7f29c6a00640 1 -- 172.21.15.33:0/2720502173 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8032930 con 0x7f29c815a520 2024-09-13T18:58:29.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 -- 172.21.15.33:0/2720502173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 msgr2=0x7f29c806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 --2- 172.21.15.33:0/2720502173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 0x7f29c806b6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097d0 tx=0x7f29b802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 -- 172.21.15.33:0/2720502173 shutdown_connections 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 --2- 172.21.15.33:0/2720502173 >> v2:172.21.15.103:3300/0 conn(0x7f29c80b1b00 0x7f29c80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 --2- 172.21.15.33:0/2720502173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c815a520 0x7f29c806b6c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 -- 172.21.15.33:0/2720502173 >> 172.21.15.33:0/2720502173 conn(0x7f29c80b0510 msgr2=0x7f29c80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 -- 172.21.15.33:0/2720502173 shutdown_connections 2024-09-13T18:58:29.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.293+0000 7f29ce600640 1 -- 172.21.15.33:0/2720502173 wait complete. 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.295+0000 7f29ce600640 1 Processor -- start 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.295+0000 7f29ce600640 1 -- start start 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 0x7f29c8148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 0x7f29c81486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8158090 con 0x7f29c815a520 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8159990 con 0x7f29c80cde50 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29ce600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8159c70 con 0x7f29c80b1b00 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36728/0 (socket says 172.21.15.33:36728) 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 -- 172.21.15.33:0/3019146850 learned_addr learned my addr 172.21.15.33:0/3019146850 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7400640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 0x7f29c8148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29bfe00640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 0x7f29c81486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 -- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 msgr2=0x7f29c8148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 0x7f29c8148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 -- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 msgr2=0x7f29c81486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 0x7f29c81486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7e00640 1 -- 172.21.15.33:0/3019146850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0009400 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29bfe00640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 0x7f29c81486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.296+0000 7f29c7400640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 0x7f29c8148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29c7e00640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29c000cb40 tx=0x7f29c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000aca0 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c000ae00 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0012620 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8009400 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.297+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c81e4dd0 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.298+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c81597f0 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.299+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29c0007070 con 0x7f29c815a520 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.300+0000 7f29bf400640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 0x7f29a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.300+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29c0089410 con 0x7f29c815a520 2024-09-13T18:58:29.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.300+0000 7f29c7400640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 0x7f29a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.301+0000 7f29c7400640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 0x7f29a406d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8034000 tx=0x7f29b802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.304+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f29c81597f0 con 0x7f29c815a520 2024-09-13T18:58:29.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.486+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c81e53f0 con 0x7f29c815a520 2024-09-13T18:58:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.487+0000 7f29bf400640 1 -- 172.21.15.33:0/3019146850 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f29c81e53f0 con 0x7f29c815a520 2024-09-13T18:58:29.490 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:29.490 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 msgr2=0x7f29a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 0x7f29a406d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8034000 tx=0x7f29b802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 msgr2=0x7f29c814d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29c000cb40 tx=0x7f29c000a060 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 shutdown_connections 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29a406ac00 0x7f29a406d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c815a520 0x7f29c814d930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29c80cde50 0x7f29c81486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 --2- 172.21.15.33:0/3019146850 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29c80b1b00 0x7f29c8148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 >> 172.21.15.33:0/3019146850 conn(0x7f29c80b0510 msgr2=0x7f29c80cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:29.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 shutdown_connections 2024-09-13T18:58:29.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.490+0000 7f29ce600640 1 -- 172.21.15.33:0/3019146850 wait complete. 2024-09-13T18:58:29.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:15.830061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:16.385610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:29.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:29.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.664+0000 7fce6b400640 1 Processor -- start 2024-09-13T18:58:29.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.665+0000 7fce6b400640 1 -- start start 2024-09-13T18:58:29.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce6b400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce64154ad0 0x7fce640cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce6b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce6406f830 0x7fce6406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce6b400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6406b7c0 con 0x7fce640ce2c0 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce6b400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6406b5b0 con 0x7fce6406f830 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce6b400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6406baa0 con 0x7fce64154ad0 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce63e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce6406f830 0x7fce6406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce68a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce64154ad0 0x7fce640cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce69400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fce640ce2c0 0x7fce640cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57760/0 (socket says 172.21.15.33:57760) 2024-09-13T18:58:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.666+0000 7fce69400640 1 -- 172.21.15.33:0/273663306 learned_addr learned my addr 172.21.15.33:0/273663306 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:29.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.667+0000 7fce63e00640 1 -- 172.21.15.33:0/273663306 >> v2:172.21.15.103:3300/0 conn(0x7fce64154ad0 msgr2=0x7fce640cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:29.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.667+0000 7fce63e00640 1 --2- 172.21.15.33:0/273663306 >> v2:172.21.15.103:3300/0 conn(0x7fce64154ad0 0x7fce640cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.667+0000 7fce63e00640 1 -- 172.21.15.33:0/273663306 >> v1:172.21.15.33:6789/0 conn(0x7fce640ce2c0 legacy=0x7fce640cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.667+0000 7fce63e00640 1 -- 172.21.15.33:0/273663306 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6406bd80 con 0x7fce6406f830 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.667+0000 7fce63400640 1 -- 172.21.15.33:0/273663306 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642294267 0 0) 0x7fce6406b7c0 con 0x7fce640ce2c0 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.668+0000 7fce63e00640 1 --2- 172.21.15.33:0/273663306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6406f830 0x7fce6406fee0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fce640b1340 tx=0x7fce5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c9661a5b776b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.668+0000 7fce63400640 1 -- 172.21.15.33:0/273663306 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5002ae60 con 0x7fce6406f830 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.668+0000 7fce63400640 1 -- 172.21.15.33:0/273663306 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50032440 con 0x7fce6406f830 2024-09-13T18:58:29.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.668+0000 7fce63400640 1 -- 172.21.15.33:0/273663306 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500327d0 con 0x7fce6406f830 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 -- 172.21.15.33:0/273663306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6406f830 msgr2=0x7fce6406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 --2- 172.21.15.33:0/273663306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6406f830 0x7fce6406fee0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fce640b1340 tx=0x7fce5002a110 comp rx=0 tx=0).stop 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 -- 172.21.15.33:0/273663306 shutdown_connections 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 --2- 172.21.15.33:0/273663306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6406f830 0x7fce6406fee0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 --2- 172.21.15.33:0/273663306 >> v2:172.21.15.103:3300/0 conn(0x7fce64154ad0 0x7fce640cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 -- 172.21.15.33:0/273663306 >> 172.21.15.33:0/273663306 conn(0x7fce640b0580 msgr2=0x7fce640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 -- 172.21.15.33:0/273663306 shutdown_connections 2024-09-13T18:58:29.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.669+0000 7fce6b400640 1 -- 172.21.15.33:0/273663306 wait complete. 2024-09-13T18:58:29.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.670+0000 7fce6b400640 1 Processor -- start 2024-09-13T18:58:29.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.671+0000 7fce6b400640 1 -- start start 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.671+0000 7fce6b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce64154ad0 0x7fce64150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.671+0000 7fce6b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce6b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce641f5320 0x7fce641f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce6b400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415d3d0 con 0x7fce64151b60 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce6b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce641f5d10 con 0x7fce64154ad0 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce6b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce64151100 con 0x7fce641f5320 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36750/0 (socket says 172.21.15.33:36750) 2024-09-13T18:58:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 -- 172.21.15.33:0/3656391722 learned_addr learned my addr 172.21.15.33:0/3656391722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 -- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce641f5320 msgr2=0x7fce641f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce641f5320 0x7fce641f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 -- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce64154ad0 msgr2=0x7fce64150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce64154ad0 0x7fce64150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 -- 172.21.15.33:0/3656391722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009400 con 0x7fce64151b60 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.672+0000 7fce63e00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.673+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50030850 con 0x7fce64151b60 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.673+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500309d0 con 0x7fce64151b60 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.673+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6415c750 con 0x7fce64151b60 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.673+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50030d80 con 0x7fce64151b60 2024-09-13T18:58:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.673+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6415cd10 con 0x7fce64151b60 2024-09-13T18:58:29.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.674+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640cdd80 con 0x7fce64151b60 2024-09-13T18:58:29.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.675+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce50039040 con 0x7fce64151b60 2024-09-13T18:58:29.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.675+0000 7fce60c00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 0x7fce4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:29.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.676+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce500a9ec0 con 0x7fce64151b60 2024-09-13T18:58:29.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.676+0000 7fce68a00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 0x7fce4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.677+0000 7fce68a00640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 0x7fce4406d0f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fce58006a90 tx=0x7fce58006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.680+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce50075090 con 0x7fce64151b60 2024-09-13T18:58:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.855+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce64148580 con 0x7fce64151b60 2024-09-13T18:58:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.856+0000 7fce60c00640 1 -- 172.21.15.33:0/3656391722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce500786b0 con 0x7fce64151b60 2024-09-13T18:58:29.858 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 msgr2=0x7fce4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 0x7fce4406d0f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fce58006a90 tx=0x7fce58006a20 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 msgr2=0x7fce64148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce500046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 shutdown_connections 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce4406ac30 0x7fce4406d0f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce641f5320 0x7fce641f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce64151b60 0x7fce64148040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 --2- 172.21.15.33:0/3656391722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce64154ad0 0x7fce64150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 >> 172.21.15.33:0/3656391722 conn(0x7fce640b0580 msgr2=0x7fce640708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:29.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 shutdown_connections 2024-09-13T18:58:29.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:29.858+0000 7fce6b400640 1 -- 172.21.15.33:0/3656391722 wait complete. 2024-09-13T18:58:29.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.032+0000 7f46f0a00640 1 Processor -- start 2024-09-13T18:58:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.032+0000 7f46f0a00640 1 -- start start 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.033+0000 7f46f0a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.033+0000 7f46f0a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46ec0cafa0 0x7f46ec070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.033+0000 7f46f0a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec06f5f0 con 0x7f46ec0714c0 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.033+0000 7f46f0a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec15aa30 con 0x7f46ec0cafa0 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.033+0000 7f46f0a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec071930 con 0x7f46ec156f60 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46ec0cafa0 0x7f46ec070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46ec0cafa0 0x7f46ec070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:39442/0 (socket says 172.21.15.33:39442) 2024-09-13T18:58:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 -- 172.21.15.33:0/853212861 learned_addr learned my addr 172.21.15.33:0/853212861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:48634/0 (socket says 172.21.15.33:48634) 2024-09-13T18:58:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46ea800640 1 --1- 172.21.15.33:0/853212861 >> v1:172.21.15.103:6789/0 conn(0x7f46ec0714c0 0x7f46ec15d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:39234/0 (socket says 172.21.15.33:39234) 2024-09-13T18:58:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 -- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 msgr2=0x7f46ec15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 -- 172.21.15.33:0/853212861 >> v1:172.21.15.103:6789/0 conn(0x7f46ec0714c0 legacy=0x7f46ec15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e3e00640 1 -- 172.21.15.33:0/853212861 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec070450 con 0x7f46ec0cafa0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e9400640 1 -- 172.21.15.33:0/853212861 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645653213 0 0) 0x7f46ec06f5f0 con 0x7f46ec0714c0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.034+0000 7f46e9e00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.035+0000 7f46e3e00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec0cafa0 0x7f46ec070f80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ddd9fa64aea58a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.035+0000 7f46e9400640 1 -- 172.21.15.33:0/853212861 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4032440 con 0x7f46ec0cafa0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46e9400640 1 -- 172.21.15.33:0/853212861 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40325a0 con 0x7f46ec0cafa0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46e9400640 1 -- 172.21.15.33:0/853212861 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4032930 con 0x7f46ec0cafa0 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 -- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec0cafa0 msgr2=0x7f46ec070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec0cafa0 0x7f46ec070f80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d402a250 comp rx=0 tx=0).stop 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 -- 172.21.15.33:0/853212861 shutdown_connections 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec0cafa0 0x7f46ec070f80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 --2- 172.21.15.33:0/853212861 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec156f60 0x7f46ec15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 -- 172.21.15.33:0/853212861 >> 172.21.15.33:0/853212861 conn(0x7f46ec0b0580 msgr2=0x7f46ec0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 -- 172.21.15.33:0/853212861 shutdown_connections 2024-09-13T18:58:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.036+0000 7f46f0a00640 1 -- 172.21.15.33:0/853212861 wait complete. 2024-09-13T18:58:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.038+0000 7f46f0a00640 1 Processor -- start 2024-09-13T18:58:30.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.038+0000 7f46f0a00640 1 -- start start 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 0x7f46ec14a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec156f60 0x7f46ec15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0c8be0 con 0x7f46ec0cafa0 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0c91a0 con 0x7f46ec156f60 2024-09-13T18:58:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46f0a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0cdf80 con 0x7f46ec0714c0 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 0x7f46ec14a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:48644/0 (socket says 172.21.15.33:48644) 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46e9e00640 1 -- 172.21.15.33:0/2487594788 learned_addr learned my addr 172.21.15.33:0/2487594788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.039+0000 7f46ea800640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec156f60 0x7f46ec15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 -- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec156f60 msgr2=0x7f46ec15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec156f60 0x7f46ec15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 -- 172.21.15.33:0/2487594788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 msgr2=0x7f46ec14a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 0x7f46ec14a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 -- 172.21.15.33:0/2487594788 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009400 con 0x7f46ec0714c0 2024-09-13T18:58:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 0x7f46ec14a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e9e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e990 tx=0x7f46dc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00c9e0 con 0x7f46ec0714c0 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00cb40 con 0x7f46ec0714c0 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00ced0 con 0x7f46ec0714c0 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d40094d0 con 0x7f46ec0714c0 2024-09-13T18:58:30.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.040+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0c8e30 con 0x7f46ec0714c0 2024-09-13T18:58:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.041+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec070970 con 0x7f46ec0714c0 2024-09-13T18:58:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.043+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46dc013470 con 0x7f46ec0714c0 2024-09-13T18:58:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.043+0000 7f46e2000640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 0x7f46c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.044+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46dc089c40 con 0x7f46ec0714c0 2024-09-13T18:58:30.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.044+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 0x7f46c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.045+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 0x7f46c806d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f46d4034000 tx=0x7f46d402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.048+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f46dc054fb0 con 0x7f46ec0714c0 2024-09-13T18:58:30.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.224+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46ec0710b0 con 0x7f46ec0714c0 2024-09-13T18:58:30.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.225+0000 7f46e2000640 1 -- 172.21.15.33:0/2487594788 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46dc0585d0 con 0x7f46ec0714c0 2024-09-13T18:58:30.228 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:30.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 msgr2=0x7f46c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 0x7f46c806d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f46d4034000 tx=0x7f46d402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 msgr2=0x7f46ec0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e990 tx=0x7f46dc00ee50 comp rx=0 tx=0).stop 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 shutdown_connections 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46c806ac00 0x7f46c806d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46ec156f60 0x7f46ec15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46ec0cafa0 0x7f46ec14a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 --2- 172.21.15.33:0/2487594788 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46ec0714c0 0x7f46ec0cd9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 >> 172.21.15.33:0/2487594788 conn(0x7f46ec0b0580 msgr2=0x7f46ec15a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 shutdown_connections 2024-09-13T18:58:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.227+0000 7f46f0a00640 1 -- 172.21.15.33:0/2487594788 wait complete. 2024-09-13T18:58:30.246 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.402+0000 7f5ee3a00640 1 Processor -- start 2024-09-13T18:58:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.402+0000 7f5ee3a00640 1 -- start start 2024-09-13T18:58:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee3a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5edc071690 0x7f5edc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee3a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5edc0cafa0 0x7f5edc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee3a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06f5f0 con 0x7f5edc156f60 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee3a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc15aa30 con 0x7f5edc071690 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee3a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc070450 con 0x7f5edc0cafa0 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5edbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5edc071690 0x7f5edc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.403+0000 7f5ee1000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5edc156f60 0x7f5edc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57772/0 (socket says 172.21.15.33:57772) 2024-09-13T18:58:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5ee1000640 1 -- 172.21.15.33:0/377642199 learned_addr learned my addr 172.21.15.33:0/377642199 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5ee1a00640 1 --2- 172.21.15.33:0/377642199 >> v2:172.21.15.103:3300/0 conn(0x7f5edc0cafa0 0x7f5edc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5edbe00640 1 -- 172.21.15.33:0/377642199 >> v2:172.21.15.103:3300/0 conn(0x7f5edc0cafa0 msgr2=0x7f5edc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5edbe00640 1 --2- 172.21.15.33:0/377642199 >> v2:172.21.15.103:3300/0 conn(0x7f5edc0cafa0 0x7f5edc0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5edbe00640 1 -- 172.21.15.33:0/377642199 >> v1:172.21.15.33:6789/0 conn(0x7f5edc156f60 legacy=0x7f5edc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5edbe00640 1 -- 172.21.15.33:0/377642199 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc06f840 con 0x7f5edc071690 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.404+0000 7f5edb400640 1 -- 172.21.15.33:0/377642199 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508364298 0 0) 0x7f5edc06f5f0 con 0x7f5edc156f60 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.405+0000 7f5edbe00640 1 --2- 172.21.15.33:0/377642199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15a4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5edc159a70 tx=0x7f5ec802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337c0dcd5cecde03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.405+0000 7f5edb400640 1 -- 172.21.15.33:0/377642199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8032440 con 0x7f5edc071690 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.405+0000 7f5edb400640 1 -- 172.21.15.33:0/377642199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec80325a0 con 0x7f5edc071690 2024-09-13T18:58:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.405+0000 7f5edb400640 1 -- 172.21.15.33:0/377642199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8032930 con 0x7f5edc071690 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 -- 172.21.15.33:0/377642199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 msgr2=0x7f5edc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/377642199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15a4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5edc159a70 tx=0x7f5ec802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 -- 172.21.15.33:0/377642199 shutdown_connections 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/377642199 >> v2:172.21.15.103:3300/0 conn(0x7f5edc0cafa0 0x7f5edc0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/377642199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15a4f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 -- 172.21.15.33:0/377642199 >> 172.21.15.33:0/377642199 conn(0x7f5edc0b0580 msgr2=0x7f5edc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 -- 172.21.15.33:0/377642199 shutdown_connections 2024-09-13T18:58:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.406+0000 7f5ee3a00640 1 -- 172.21.15.33:0/377642199 wait complete. 2024-09-13T18:58:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.408+0000 7f5ee3a00640 1 Processor -- start 2024-09-13T18:58:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.408+0000 7f5ee3a00640 1 -- start start 2024-09-13T18:58:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 0x7f5edc15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5edc156f60 0x7f5edc0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15be90 con 0x7f5edc071690 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15b8d0 con 0x7f5edc0cafa0 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee3a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15bbb0 con 0x7f5edc156f60 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36762/0 (socket says 172.21.15.33:36762) 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 -- 172.21.15.33:0/3065856043 learned_addr learned my addr 172.21.15.33:0/3065856043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5edc156f60 0x7f5edc0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5edbe00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 0x7f5edc15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 -- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5edc156f60 msgr2=0x7f5edc0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5edc156f60 0x7f5edc0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 -- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 msgr2=0x7f5edc15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 0x7f5edc15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5ee1000640 1 -- 172.21.15.33:0/3065856043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8009400 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.409+0000 7f5edbe00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 0x7f5edc15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ee1000640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c430 tx=0x7f5ed000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00074e0 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0007660 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc15cb00 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0004a20 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.410+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc15d840 con 0x7f5edc071690 2024-09-13T18:58:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.411+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc0708c0 con 0x7f5edc071690 2024-09-13T18:58:30.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.413+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ed0004b80 con 0x7f5edc071690 2024-09-13T18:58:30.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.414+0000 7f5ed8c00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 0x7f5ebc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.414+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ed00891a0 con 0x7f5edc071690 2024-09-13T18:58:30.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.414+0000 7f5edbe00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 0x7f5ebc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.415+0000 7f5edbe00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 0x7f5ebc06d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8034000 tx=0x7f5ec802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.419+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5edc0708c0 con 0x7f5edc071690 2024-09-13T18:58:30.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.599+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5edc0708c0 con 0x7f5edc071690 2024-09-13T18:58:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.600+0000 7f5ed8c00640 1 -- 172.21.15.33:0/3065856043 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5edc0708c0 con 0x7f5edc071690 2024-09-13T18:58:30.602 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 msgr2=0x7f5ebc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 0x7f5ebc06d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8034000 tx=0x7f5ec802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 msgr2=0x7f5edc15d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c430 tx=0x7f5ed000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 shutdown_connections 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5ebc06ac00 0x7f5ebc06d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5edc156f60 0x7f5edc0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5edc0cafa0 0x7f5edc15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 --2- 172.21.15.33:0/3065856043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5edc071690 0x7f5edc15d300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 >> 172.21.15.33:0/3065856043 conn(0x7f5edc0b0580 msgr2=0x7f5edc06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 shutdown_connections 2024-09-13T18:58:30.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.602+0000 7f5ee3a00640 1 -- 172.21.15.33:0/3065856043 wait complete. 2024-09-13T18:58:30.619 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:58:30.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.773+0000 7f79c4000640 1 Processor -- start 2024-09-13T18:58:30.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.773+0000 7f79c4000640 1 -- start start 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.774+0000 7f79c4000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79bc159610 0x7f79bc070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.774+0000 7f79c4000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 0x7f79bc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c4000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0709e0 con 0x7f79bc0b35c0 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c4000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc0b3a50 con 0x7f79bc159610 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c4000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc1599f0 con 0x7f79bc070540 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c1600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79bc159610 0x7f79bc070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c2000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f79bc0b35c0 0x7f79bc0b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57774/0 (socket says 172.21.15.33:57774) 2024-09-13T18:58:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c2000640 1 -- 172.21.15.33:0/3563550452 learned_addr learned my addr 172.21.15.33:0/3563550452 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c0c00640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 0x7f79bc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c1600640 1 -- 172.21.15.33:0/3563550452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 msgr2=0x7f79bc0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c1600640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 0x7f79bc0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c1600640 1 -- 172.21.15.33:0/3563550452 >> v1:172.21.15.33:6789/0 conn(0x7f79bc0b35c0 legacy=0x7f79bc0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c1600640 1 -- 172.21.15.33:0/3563550452 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc070cc0 con 0x7f79bc159610 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79bbe00640 1 -- 172.21.15.33:0/3563550452 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804221686 0 0) 0x7f79bc0709e0 con 0x7f79bc0b35c0 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.775+0000 7f79c0c00640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 0x7f79bc0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.776+0000 7f79c1600640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc070000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da054e643ca986ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.776+0000 7f79bbe00640 1 -- 172.21.15.33:0/3563550452 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0032440 con 0x7f79bc159610 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79bbe00640 1 -- 172.21.15.33:0/3563550452 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00325a0 con 0x7f79bc159610 2024-09-13T18:58:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79bbe00640 1 -- 172.21.15.33:0/3563550452 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0032930 con 0x7f79bc159610 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 -- 172.21.15.33:0/3563550452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 msgr2=0x7f79bc070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc070000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b002a180 comp rx=0 tx=0).stop 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 -- 172.21.15.33:0/3563550452 shutdown_connections 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc070540 0x7f79bc0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 --2- 172.21.15.33:0/3563550452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc070000 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 -- 172.21.15.33:0/3563550452 >> 172.21.15.33:0/3563550452 conn(0x7f79bc0b0510 msgr2=0x7f79bc0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 -- 172.21.15.33:0/3563550452 shutdown_connections 2024-09-13T18:58:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.777+0000 7f79c4000640 1 -- 172.21.15.33:0/3563550452 wait complete. 2024-09-13T18:58:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.779+0000 7f79c4000640 1 Processor -- start 2024-09-13T18:58:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.779+0000 7f79c4000640 1 -- start start 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc070540 0x7f79bc143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc0b35c0 0x7f79bc0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc142910 con 0x7f79bc159610 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0ae9a0 con 0x7f79bc070540 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c4000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc144090 con 0x7f79bc0b35c0 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36792/0 (socket says 172.21.15.33:36792) 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c2000640 1 -- 172.21.15.33:0/804130455 learned_addr learned my addr 172.21.15.33:0/804130455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c1600640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc070540 0x7f79bc143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.780+0000 7f79c0c00640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc0b35c0 0x7f79bc0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 -- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc0b35c0 msgr2=0x7f79bc0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc0b35c0 0x7f79bc0ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 -- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc070540 msgr2=0x7f79bc143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc070540 0x7f79bc143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 -- 172.21.15.33:0/804130455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009400 con 0x7f79bc159610 2024-09-13T18:58:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c2000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7a0 tx=0x7f79b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400a640 con 0x7f79bc159610 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400a7a0 con 0x7f79bc159610 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400abd0 con 0x7f79bc159610 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc142b40 con 0x7f79bc159610 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.781+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc143100 con 0x7f79bc159610 2024-09-13T18:58:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.782+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc06d010 con 0x7f79bc159610 2024-09-13T18:58:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.783+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f79b400ad30 con 0x7f79bc159610 2024-09-13T18:58:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.784+0000 7f79b9600640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.784+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b4088900 con 0x7f79bc159610 2024-09-13T18:58:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.784+0000 7f79c1600640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.785+0000 7f79c1600640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79b0034000 tx=0x7f79b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.788+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f79b4053af0 con 0x7f79bc159610 2024-09-13T18:58:30.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.980+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79bc164ed0 con 0x7f79bc159610 2024-09-13T18:58:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.980+0000 7f79b9600640 1 -- 172.21.15.33:0/804130455 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f79b4018070 con 0x7f79bc159610 2024-09-13T18:58:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 msgr2=0x7f799c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79b0034000 tx=0x7f79b002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 msgr2=0x7f79bc13ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7a0 tx=0x7f79b400cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 shutdown_connections 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f799c06ac00 0x7f799c06d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79bc159610 0x7f79bc13ec00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79bc0b35c0 0x7f79bc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.982+0000 7f79c4000640 1 --2- 172.21.15.33:0/804130455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79bc070540 0x7f79bc143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:30.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.983+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 >> 172.21.15.33:0/804130455 conn(0x7f79bc0b0510 msgr2=0x7f79bc06fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:30.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.983+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 shutdown_connections 2024-09-13T18:58:30.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:30.983+0000 7f79c4000640 1 -- 172.21.15.33:0/804130455 wait complete. 2024-09-13T18:58:31.000 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:58:31.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:31.000 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:31.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:58:31.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:31.070 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:58:31.107 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:31.107 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:31.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:58:31.143 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:31.143 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:31.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:58:31.184 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.338+0000 7f941bc00640 1 Processor -- start 2024-09-13T18:58:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.338+0000 7f941bc00640 1 -- start start 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.339+0000 7f941bc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f94140b3990 0x7f9414159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.339+0000 7f941bc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9414159fc0 con 0x7f941406f660 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f941bc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9414153f00 con 0x7f9414153b20 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f941bc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140ce600 con 0x7f94140b3990 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9413e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f94140b3990 0x7f9414159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9419c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f941406f660 0x7f941406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57782/0 (socket says 172.21.15.33:57782) 2024-09-13T18:58:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9419c00640 1 -- 172.21.15.33:0/3200038572 learned_addr learned my addr 172.21.15.33:0/3200038572 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9413e00640 1 -- 172.21.15.33:0/3200038572 >> v1:172.21.15.103:6789/0 conn(0x7f9414153b20 legacy=0x7f94140b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9413e00640 1 -- 172.21.15.33:0/3200038572 >> v1:172.21.15.33:6789/0 conn(0x7f941406f660 legacy=0x7f941406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.340+0000 7f9413e00640 1 -- 172.21.15.33:0/3200038572 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140b1a40 con 0x7f94140b3990 2024-09-13T18:58:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.341+0000 7f9413e00640 1 --2- 172.21.15.33:0/3200038572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140b3990 0x7f9414159a80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f940002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329727a4f8fb9be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f9413400640 1 -- 172.21.15.33:0/3200038572 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400032440 con 0x7f94140b3990 2024-09-13T18:58:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f9413400640 1 -- 172.21.15.33:0/3200038572 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000325a0 con 0x7f94140b3990 2024-09-13T18:58:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f9413400640 1 -- 172.21.15.33:0/3200038572 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400032930 con 0x7f94140b3990 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 -- 172.21.15.33:0/3200038572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140b3990 msgr2=0x7f9414159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 --2- 172.21.15.33:0/3200038572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140b3990 0x7f9414159a80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f940002a230 comp rx=0 tx=0).stop 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 -- 172.21.15.33:0/3200038572 shutdown_connections 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 --2- 172.21.15.33:0/3200038572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140b3990 0x7f9414159a80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 -- 172.21.15.33:0/3200038572 >> 172.21.15.33:0/3200038572 conn(0x7f94140b0510 msgr2=0x7f94140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 -- 172.21.15.33:0/3200038572 shutdown_connections 2024-09-13T18:58:31.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.342+0000 7f941bc00640 1 -- 172.21.15.33:0/3200038572 wait complete. 2024-09-13T18:58:31.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.344+0000 7f941bc00640 1 Processor -- start 2024-09-13T18:58:31.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.344+0000 7f941bc00640 1 -- start start 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94140b3990 0x7f9414156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 0x7f9414150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414151990 con 0x7f941406f660 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414151c70 con 0x7f94140b3990 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f941bc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414151f50 con 0x7f9414153b20 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f9419200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f9419200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36812/0 (socket says 172.21.15.33:36812) 2024-09-13T18:58:31.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.345+0000 7f9419200640 1 -- 172.21.15.33:0/1929544567 learned_addr learned my addr 172.21.15.33:0/1929544567 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419c00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 0x7f9414150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9413e00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94140b3990 0x7f9414156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 -- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 msgr2=0x7f9414150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 0x7f9414150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 -- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94140b3990 msgr2=0x7f9414156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94140b3990 0x7f9414156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 -- 172.21.15.33:0/1929544567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9400009400 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419c00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 0x7f9414150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9419200640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f940800c450 tx=0x7f940800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94080052d0 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9408005430 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414152230 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.346+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408012870 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.347+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141571c0 con 0x7f941406f660 2024-09-13T18:58:31.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.348+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414159a80 con 0x7f941406f660 2024-09-13T18:58:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.348+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94080129d0 con 0x7f941406f660 2024-09-13T18:58:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.350+0000 7f9410c00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.350+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9408088f20 con 0x7f941406f660 2024-09-13T18:58:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.350+0000 7f9413e00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.351+0000 7f9413e00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 0x7f93f406d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9400034000 tx=0x7f940002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.354+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9408054060 con 0x7f941406f660 2024-09-13T18:58:31.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.571+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94140b30d0 con 0x7f941406f660 2024-09-13T18:58:31.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.571+0000 7f9410c00640 1 -- 172.21.15.33:0/1929544567 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f9408057680 con 0x7f941406f660 2024-09-13T18:58:31.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:31.574 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:31.574 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.573+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 msgr2=0x7f93f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.573+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 0x7f93f406d0c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9400034000 tx=0x7f940002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.573+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 msgr2=0x7f9414152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.573+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f940800c450 tx=0x7f940800c910 comp rx=0 tx=0).stop 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 shutdown_connections 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9414153b20 0x7f9414150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94140b3990 0x7f9414156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 --2- 172.21.15.33:0/1929544567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f941406f660 0x7f9414152a10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 >> 172.21.15.33:0/1929544567 conn(0x7f94140b0510 msgr2=0x7f94140cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:31.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 shutdown_connections 2024-09-13T18:58:31.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.574+0000 7f941bc00640 1 -- 172.21.15.33:0/1929544567 wait complete. 2024-09-13T18:58:31.592 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:31.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.744+0000 7f97b3e00640 1 Processor -- start 2024-09-13T18:58:31.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.744+0000 7f97b3e00640 1 -- start start 2024-09-13T18:58:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f97b415b9b0 0x7f97b40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40cbfc0 con 0x7f97b40cbac0 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40cce20 con 0x7f97b415b9b0 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40707a0 con 0x7f97b415a5c0 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b2000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f97b40cbac0 0x7f97b406f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57790/0 (socket says 172.21.15.33:57790) 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b2000640 1 -- 172.21.15.33:0/1002724260 learned_addr learned my addr 172.21.15.33:0/1002724260 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b3400640 1 --2- 172.21.15.33:0/1002724260 >> v2:172.21.15.33:3300/0 conn(0x7f97b415b9b0 0x7f97b40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.745+0000 7f97b2a00640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b1600640 1 -- 172.21.15.33:0/1002724260 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446344612 0 0) 0x7f97b40cbfc0 con 0x7f97b40cbac0 2024-09-13T18:58:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b1600640 1 -- 172.21.15.33:0/1002724260 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9798003520 con 0x7f97b40cbac0 2024-09-13T18:58:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b3400640 1 -- 172.21.15.33:0/1002724260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 msgr2=0x7f97b40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b3400640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b40b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b3400640 1 -- 172.21.15.33:0/1002724260 >> v1:172.21.15.33:6789/0 conn(0x7f97b40cbac0 legacy=0x7f97b406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.746+0000 7f97b3400640 1 -- 172.21.15.33:0/1002724260 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4070a80 con 0x7f97b415b9b0 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.747+0000 7f97b3400640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b40b3ef0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009d90 tx=0x7f97ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722b71adbbbca3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.747+0000 7f97b1600640 1 -- 172.21.15.33:0/1002724260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac031600 con 0x7f97b415b9b0 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.747+0000 7f97b1600640 1 -- 172.21.15.33:0/1002724260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac02d050 con 0x7f97b415b9b0 2024-09-13T18:58:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.747+0000 7f97b1600640 1 -- 172.21.15.33:0/1002724260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac031960 con 0x7f97b415b9b0 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 -- 172.21.15.33:0/1002724260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 msgr2=0x7f97b40b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b40b3ef0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009d90 tx=0x7f97ac02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 -- 172.21.15.33:0/1002724260 shutdown_connections 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b40b3ef0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 --2- 172.21.15.33:0/1002724260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 -- 172.21.15.33:0/1002724260 >> 172.21.15.33:0/1002724260 conn(0x7f97b40ae310 msgr2=0x7f97b40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 -- 172.21.15.33:0/1002724260 shutdown_connections 2024-09-13T18:58:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.748+0000 7f97b3e00640 1 -- 172.21.15.33:0/1002724260 wait complete. 2024-09-13T18:58:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.750+0000 7f97b3e00640 1 Processor -- start 2024-09-13T18:58:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.750+0000 7f97b3e00640 1 -- start start 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.750+0000 7f97b3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b40cbac0 0x7f97b4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40ab360 con 0x7f97b415b9b0 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40aa6e0 con 0x7f97b40cbac0 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40aa9c0 con 0x7f97b415a5c0 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36822/0 (socket says 172.21.15.33:36822) 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 -- 172.21.15.33:0/4233982545 learned_addr learned my addr 172.21.15.33:0/4233982545 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b2000640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b2a00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b40cbac0 0x7f97b4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 -- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 msgr2=0x7f97b414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 -- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b40cbac0 msgr2=0x7f97b4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b40cbac0 0x7f97b4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.751+0000 7f97b3400640 1 -- 172.21.15.33:0/4233982545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac009a70 con 0x7f97b415b9b0 2024-09-13T18:58:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97b3400640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009eb0 tx=0x7f97ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac03b820 con 0x7f97b415b9b0 2024-09-13T18:58:31.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac03b9a0 con 0x7f97b415b9b0 2024-09-13T18:58:31.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40aaca0 con 0x7f97b415b9b0 2024-09-13T18:58:31.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac03bd50 con 0x7f97b415b9b0 2024-09-13T18:58:31.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.752+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b40ab780 con 0x7f97b415b9b0 2024-09-13T18:58:31.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.753+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b4067360 con 0x7f97b415b9b0 2024-09-13T18:58:31.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.754+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f97ac043410 con 0x7f97b415b9b0 2024-09-13T18:58:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.755+0000 7f97aaa00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 0x7f979406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.755+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97ac0aa400 con 0x7f97b415b9b0 2024-09-13T18:58:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.755+0000 7f97b2a00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 0x7f979406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.756+0000 7f97b2a00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 0x7f979406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009b40 tx=0x7f97a4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.759+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f97ac075680 con 0x7f97b415b9b0 2024-09-13T18:58:31.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.939+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97b40ab4a0 con 0x7f97b415b9b0 2024-09-13T18:58:31.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.940+0000 7f97aaa00640 1 -- 172.21.15.33:0/4233982545 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f97b40ab4a0 con 0x7f97b415b9b0 2024-09-13T18:58:31.943 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:31.943 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 msgr2=0x7f979406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 0x7f979406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009b40 tx=0x7f97a4009190 comp rx=0 tx=0).stop 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 msgr2=0x7f97b414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009eb0 tx=0x7f97ac004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 shutdown_connections 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f979406ac00 0x7f979406d0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b415b9b0 0x7f97b414b090 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97b415a5c0 0x7f97b414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 --2- 172.21.15.33:0/4233982545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b40cbac0 0x7f97b4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.942+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 >> 172.21.15.33:0/4233982545 conn(0x7f97b40ae310 msgr2=0x7f97b40aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.943+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 shutdown_connections 2024-09-13T18:58:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:31.943+0000 7f97b3e00640 1 -- 172.21.15.33:0/4233982545 wait complete. 2024-09-13T18:58:31.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:15.830061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:16.385610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:31.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:32.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.117+0000 7f3c89600640 1 Processor -- start 2024-09-13T18:58:32.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.118+0000 7f3c89600640 1 -- start start 2024-09-13T18:58:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c89600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 0x7f3c840b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c89600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c840b2a80 con 0x7f3c840ae2f0 2024-09-13T18:58:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c89600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8415ff80 con 0x7f3c8415fba0 2024-09-13T18:58:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c89600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8415e4b0 con 0x7f3c840b2120 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c7be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3c840ae2f0 0x7f3c8415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57804/0 (socket says 172.21.15.33:57804) 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c7be00640 1 -- 172.21.15.33:0/1315817171 learned_addr learned my addr 172.21.15.33:0/1315817171 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.119+0000 7f3c88c00640 1 --2- 172.21.15.33:0/1315817171 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 0x7f3c840b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123312332 0 0) 0x7f3c840b2a80 con 0x7f3c840ae2f0 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c68003520 con 0x7f3c840ae2f0 2024-09-13T18:58:32.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488883332 0 0) 0x7f3c8415ff80 con 0x7f3c8415fba0 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c88c00640 1 -- 172.21.15.33:0/1315817171 >> v1:172.21.15.103:6789/0 conn(0x7f3c8415fba0 legacy=0x7f3c8415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c88c00640 1 -- 172.21.15.33:0/1315817171 >> v1:172.21.15.33:6789/0 conn(0x7f3c840ae2f0 legacy=0x7f3c8415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.120+0000 7f3c88c00640 1 -- 172.21.15.33:0/1315817171 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840ae890 con 0x7f3c840b2120 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.121+0000 7f3c88c00640 1 --2- 172.21.15.33:0/1315817171 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 0x7f3c840b2540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009dc0 tx=0x7f3c7c02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb43c0906d35b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.121+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007740 con 0x7f3c840b2120 2024-09-13T18:58:32.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.121+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c02d050 con 0x7f3c840b2120 2024-09-13T18:58:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.121+0000 7f3c83400640 1 -- 172.21.15.33:0/1315817171 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007aa0 con 0x7f3c840b2120 2024-09-13T18:58:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 -- 172.21.15.33:0/1315817171 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 msgr2=0x7f3c840b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 --2- 172.21.15.33:0/1315817171 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 0x7f3c840b2540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009dc0 tx=0x7f3c7c02a5b0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 -- 172.21.15.33:0/1315817171 shutdown_connections 2024-09-13T18:58:32.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 --2- 172.21.15.33:0/1315817171 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c840b2120 0x7f3c840b2540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 -- 172.21.15.33:0/1315817171 >> 172.21.15.33:0/1315817171 conn(0x7f3c840cc6b0 msgr2=0x7f3c84069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:32.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 -- 172.21.15.33:0/1315817171 shutdown_connections 2024-09-13T18:58:32.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.122+0000 7f3c89600640 1 -- 172.21.15.33:0/1315817171 wait complete. 2024-09-13T18:58:32.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.124+0000 7f3c89600640 1 Processor -- start 2024-09-13T18:58:32.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.124+0000 7f3c89600640 1 -- start start 2024-09-13T18:58:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 0x7f3c841558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c8415fba0 0x7f3c841f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840706a0 con 0x7f3c840b2120 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c841f2530 con 0x7f3c840ae2f0 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c89600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c84158810 con 0x7f3c8415fba0 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36830/0 (socket says 172.21.15.33:36830) 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 -- 172.21.15.33:0/3155361462 learned_addr learned my addr 172.21.15.33:0/3155361462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c88c00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c8415fba0 0x7f3c841f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c83e00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 0x7f3c841558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 -- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c8415fba0 msgr2=0x7f3c841f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c8415fba0 0x7f3c841f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 -- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 msgr2=0x7f3c841558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 0x7f3c841558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c7be00640 1 -- 172.21.15.33:0/3155361462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009a70 con 0x7f3c840b2120 2024-09-13T18:58:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.125+0000 7f3c83e00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 0x7f3c841558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c7be00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0010e0 tx=0x7f3c6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c005ce0 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c005e60 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0072f0 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8406fd00 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.126+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c840702c0 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.127+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c840b2540 con 0x7f3c840b2120 2024-09-13T18:58:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.128+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c6c007450 con 0x7f3c840b2120 2024-09-13T18:58:32.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.129+0000 7f3c80c00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 0x7f3c6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.129+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c088920 con 0x7f3c840b2120 2024-09-13T18:58:32.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.130+0000 7f3c83e00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 0x7f3c6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.130+0000 7f3c83e00640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 0x7f3c6006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c74000f60 tx=0x7f3c74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.133+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c6c053af0 con 0x7f3c840b2120 2024-09-13T18:58:32.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.312+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c84157550 con 0x7f3c840b2120 2024-09-13T18:58:32.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.312+0000 7f3c80c00640 1 -- 172.21.15.33:0/3155361462 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c6c0170a0 con 0x7f3c840b2120 2024-09-13T18:58:32.315 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:32.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 msgr2=0x7f3c6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 0x7f3c6006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c74000f60 tx=0x7f3c74009040 comp rx=0 tx=0).stop 2024-09-13T18:58:32.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 msgr2=0x7f3c84158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0010e0 tx=0x7f3c6c00c890 comp rx=0 tx=0).stop 2024-09-13T18:58:32.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 shutdown_connections 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c6006ac00 0x7f3c6006d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c8415fba0 0x7f3c841f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c840b2120 0x7f3c84158120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 --2- 172.21.15.33:0/3155361462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c840ae2f0 0x7f3c841558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 >> 172.21.15.33:0/3155361462 conn(0x7f3c840cc6b0 msgr2=0x7f3c840aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 shutdown_connections 2024-09-13T18:58:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.315+0000 7f3c89600640 1 -- 172.21.15.33:0/3155361462 wait complete. 2024-09-13T18:58:32.333 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:32.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.488+0000 7f8437000640 1 Processor -- start 2024-09-13T18:58:32.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.489+0000 7f8437000640 1 -- start start 2024-09-13T18:58:32.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8437000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84300b1db0 0x7f843015a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8437000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f843006b630 0x7f84300cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8437000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8430157310 con 0x7f8430156f30 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8437000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843006bae0 con 0x7f843006b630 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8437000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300b29c0 con 0x7f84300b1db0 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8436600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f843006b630 0x7f84300cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8436600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f843006b630 0x7f84300cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36836/0 (socket says 172.21.15.33:36836) 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8436600640 1 -- 172.21.15.33:0/4196070682 learned_addr learned my addr 172.21.15.33:0/4196070682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:32.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.490+0000 7f8435200640 1 --2- 172.21.15.33:0/4196070682 >> v2:172.21.15.103:3300/0 conn(0x7f84300b1db0 0x7f843015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.491+0000 7f8436600640 1 -- 172.21.15.33:0/4196070682 >> v2:172.21.15.103:3300/0 conn(0x7f84300b1db0 msgr2=0x7f843015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.491+0000 7f8436600640 1 --2- 172.21.15.33:0/4196070682 >> v2:172.21.15.103:3300/0 conn(0x7f84300b1db0 0x7f843015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.491+0000 7f8436600640 1 -- 172.21.15.33:0/4196070682 >> v1:172.21.15.103:6789/0 conn(0x7f8430156f30 legacy=0x7f84300b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.491+0000 7f8436600640 1 -- 172.21.15.33:0/4196070682 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300b2ca0 con 0x7f843006b630 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8436600640 1 --2- 172.21.15.33:0/4196070682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843006b630 0x7f84300cc4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f842800d150 tx=0x7f842802c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761cada2d127a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f842fe00640 1 -- 172.21.15.33:0/4196070682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428009600 con 0x7f843006b630 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f842fe00640 1 -- 172.21.15.33:0/4196070682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428009760 con 0x7f843006b630 2024-09-13T18:58:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f842fe00640 1 -- 172.21.15.33:0/4196070682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428009af0 con 0x7f843006b630 2024-09-13T18:58:32.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 -- 172.21.15.33:0/4196070682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843006b630 msgr2=0x7f84300cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 --2- 172.21.15.33:0/4196070682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843006b630 0x7f84300cc4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f842800d150 tx=0x7f842802c970 comp rx=0 tx=0).stop 2024-09-13T18:58:32.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 -- 172.21.15.33:0/4196070682 shutdown_connections 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 --2- 172.21.15.33:0/4196070682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843006b630 0x7f84300cc4a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 --2- 172.21.15.33:0/4196070682 >> v2:172.21.15.103:3300/0 conn(0x7f84300b1db0 0x7f843015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.492+0000 7f8437000640 1 -- 172.21.15.33:0/4196070682 >> 172.21.15.33:0/4196070682 conn(0x7f8430069ed0 msgr2=0x7f843006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.493+0000 7f8437000640 1 -- 172.21.15.33:0/4196070682 shutdown_connections 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.493+0000 7f8437000640 1 -- 172.21.15.33:0/4196070682 wait complete. 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.494+0000 7f8437000640 1 Processor -- start 2024-09-13T18:58:32.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.494+0000 7f8437000640 1 -- start start 2024-09-13T18:58:32.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f843006b630 0x7f84301f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84300b1db0 0x7f84301552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301f2200 con 0x7f8430156f30 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84300c55d0 con 0x7f843006b630 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8437000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84300c6170 con 0x7f84300b1db0 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8436600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8435c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f843006b630 0x7f84301f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.495+0000 7f8436600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36838/0 (socket says 172.21.15.33:36838) 2024-09-13T18:58:32.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 -- 172.21.15.33:0/2870123835 learned_addr learned my addr 172.21.15.33:0/2870123835 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8435200640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84300b1db0 0x7f84301552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 -- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84300b1db0 msgr2=0x7f84301552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84300b1db0 0x7f84301552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 -- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f843006b630 msgr2=0x7f84301f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f843006b630 0x7f84301f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 -- 172.21.15.33:0/2870123835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842800bd40 con 0x7f8430156f30 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.496+0000 7f8436600640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f842800d270 tx=0x7f8428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.497+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428032620 con 0x7f8430156f30 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.497+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428009e90 con 0x7f8430156f30 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.497+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280329c0 con 0x7f8430156f30 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.497+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84300c5840 con 0x7f8430156f30 2024-09-13T18:58:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.497+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84300c5e00 con 0x7f8430156f30 2024-09-13T18:58:32.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.498+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84301f2340 con 0x7f8430156f30 2024-09-13T18:58:32.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.499+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8428032b20 con 0x7f8430156f30 2024-09-13T18:58:32.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.500+0000 7f842d600640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 0x7f841006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.500+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84280aa5b0 con 0x7f8430156f30 2024-09-13T18:58:32.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.500+0000 7f8435c00640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 0x7f841006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.501+0000 7f8435c00640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 0x7f841006d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8424000f60 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.504+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f84280758d0 con 0x7f8430156f30 2024-09-13T18:58:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.682+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8430071780 con 0x7f8430156f30 2024-09-13T18:58:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.683+0000 7f842d600640 1 -- 172.21.15.33:0/2870123835 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8428078ef0 con 0x7f8430156f30 2024-09-13T18:58:32.685 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 msgr2=0x7f841006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 0x7f841006d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8424000f60 tx=0x7f8424009040 comp rx=0 tx=0).stop 2024-09-13T18:58:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 msgr2=0x7f84300c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f842800d270 tx=0x7f8428004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 shutdown_connections 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f841006ac00 0x7f841006d0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8430156f30 0x7f84300c4ac0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84300b1db0 0x7f84301552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 --2- 172.21.15.33:0/2870123835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f843006b630 0x7f84301f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 >> 172.21.15.33:0/2870123835 conn(0x7f8430069ed0 msgr2=0x7f84300cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 shutdown_connections 2024-09-13T18:58:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.685+0000 7f8437000640 1 -- 172.21.15.33:0/2870123835 wait complete. 2024-09-13T18:58:32.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:32.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.858+0000 7f33e8a00640 1 Processor -- start 2024-09-13T18:58:32.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.858+0000 7f33e8a00640 1 -- start start 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33e8a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33e40cafa0 0x7f33e415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33e8a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e406f5f0 con 0x7f33e4071690 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33e8a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4070450 con 0x7f33e4156f60 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33e8a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e415aa30 con 0x7f33e40cafa0 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33dbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f33e4071690 0x7f33e40cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38472/0 (socket says 172.21.15.33:38472) 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.859+0000 7f33dbe00640 1 -- 172.21.15.33:0/3076443825 learned_addr learned my addr 172.21.15.33:0/3076443825 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e2800640 1 --2- 172.21.15.33:0/3076443825 >> v2:172.21.15.33:3300/0 conn(0x7f33e40cafa0 0x7f33e415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195781336 0 0) 0x7f33e406f5f0 con 0x7f33e4071690 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c8005730 con 0x7f33e4071690 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e2800640 1 -- 172.21.15.33:0/3076443825 >> v1:172.21.15.103:6789/0 conn(0x7f33e4156f60 legacy=0x7f33e4070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788114606 0 0) 0x7f33e4070450 con 0x7f33e4156f60 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e2800640 1 -- 172.21.15.33:0/3076443825 >> v1:172.21.15.33:6789/0 conn(0x7f33e4071690 legacy=0x7f33e40cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.860+0000 7f33e2800640 1 -- 172.21.15.33:0/3076443825 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e406f840 con 0x7f33e40cafa0 2024-09-13T18:58:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.861+0000 7f33e2800640 1 --2- 172.21.15.33:0/3076443825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e40cafa0 0x7f33e415a4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635ae2c43a524bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.861+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc007740 con 0x7f33e40cafa0 2024-09-13T18:58:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.861+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc02d050 con 0x7f33e40cafa0 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.861+0000 7f33e1400640 1 -- 172.21.15.33:0/3076443825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc007ac0 con 0x7f33e40cafa0 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 -- 172.21.15.33:0/3076443825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e40cafa0 msgr2=0x7f33e415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 --2- 172.21.15.33:0/3076443825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e40cafa0 0x7f33e415a4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 -- 172.21.15.33:0/3076443825 shutdown_connections 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 --2- 172.21.15.33:0/3076443825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e40cafa0 0x7f33e415a4f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 -- 172.21.15.33:0/3076443825 >> 172.21.15.33:0/3076443825 conn(0x7f33e40b0580 msgr2=0x7f33e40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 -- 172.21.15.33:0/3076443825 shutdown_connections 2024-09-13T18:58:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.862+0000 7f33e8a00640 1 -- 172.21.15.33:0/3076443825 wait complete. 2024-09-13T18:58:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.864+0000 7f33e8a00640 1 Processor -- start 2024-09-13T18:58:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.864+0000 7f33e8a00640 1 -- start start 2024-09-13T18:58:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.864+0000 7f33e8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e4071690 0x7f33e4143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 0x7f33e41538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4154610 con 0x7f33e4156f60 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e41548f0 con 0x7f33e40cafa0 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4154bd0 con 0x7f33e4071690 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46110/0 (socket says 172.21.15.33:46110) 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 -- 172.21.15.33:0/579746684 learned_addr learned my addr 172.21.15.33:0/579746684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33dbe00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 0x7f33e41538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e1e00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e4071690 0x7f33e4143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 -- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e4071690 msgr2=0x7f33e4143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e4071690 0x7f33e4143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 -- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 msgr2=0x7f33e41538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 0x7f33e41538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33e2800640 1 -- 172.21.15.33:0/579746684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a70 con 0x7f33e4156f60 2024-09-13T18:58:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.865+0000 7f33dbe00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 0x7f33e41538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33e2800640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc03c8f0 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc03ca50 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4154eb0 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc03cde0 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.866+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4154320 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.867+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e41553d0 con 0x7f33e4156f60 2024-09-13T18:58:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.868+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33dc031400 con 0x7f33e4156f60 2024-09-13T18:58:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.869+0000 7f33da000640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 0x7f33c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.869+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33dc0aad20 con 0x7f33e4156f60 2024-09-13T18:58:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.869+0000 7f33e1e00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 0x7f33c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.870+0000 7f33e1e00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 0x7f33c006d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:32.873+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33e41553d0 con 0x7f33e4156f60 2024-09-13T18:58:33.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.052+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33e41553d0 con 0x7f33e4156f60 2024-09-13T18:58:33.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.052+0000 7f33da000640 1 -- 172.21.15.33:0/579746684 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33e41553d0 con 0x7f33e4156f60 2024-09-13T18:58:33.057 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.054+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 msgr2=0x7f33c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.054+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 0x7f33c006d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4009040 comp rx=0 tx=0).stop 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.054+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 msgr2=0x7f33e4153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.054+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 shutdown_connections 2024-09-13T18:58:33.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33c006ac00 0x7f33c006d0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e4156f60 0x7f33e4153de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e40cafa0 0x7f33e41538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 --2- 172.21.15.33:0/579746684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e4071690 0x7f33e4143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 >> 172.21.15.33:0/579746684 conn(0x7f33e40b0580 msgr2=0x7f33e40af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 shutdown_connections 2024-09-13T18:58:33.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.055+0000 7f33e8a00640 1 -- 172.21.15.33:0/579746684 wait complete. 2024-09-13T18:58:33.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:33.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.230+0000 7f8d81e00640 1 Processor -- start 2024-09-13T18:58:33.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.230+0000 7f8d81e00640 1 -- start start 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.231+0000 7f8d81e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d7c159a80 0x7f8d7c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.231+0000 7f8d81e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c153f00 con 0x7f8d7c153b20 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.231+0000 7f8d81e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0b1a40 con 0x7f8d7c0b3990 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.231+0000 7f8d81e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0ce600 con 0x7f8d7c159a80 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8d7c153b20 0x7f8d7c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38480/0 (socket says 172.21.15.33:38480) 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7aa00640 1 -- 172.21.15.33:0/249852402 learned_addr learned my addr 172.21.15.33:0/249852402 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:33.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7b400640 1 --2- 172.21.15.33:0/249852402 >> v2:172.21.15.33:3300/0 conn(0x7f8d7c159a80 0x7f8d7c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d79600640 1 -- 172.21.15.33:0/249852402 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747987878 0 0) 0x7f8d7c153f00 con 0x7f8d7c153b20 2024-09-13T18:58:33.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d79600640 1 -- 172.21.15.33:0/249852402 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d60003520 con 0x7f8d7c153b20 2024-09-13T18:58:33.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7b400640 1 -- 172.21.15.33:0/249852402 >> v1:172.21.15.103:6789/0 conn(0x7f8d7c0b3990 legacy=0x7f8d7c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7b400640 1 -- 172.21.15.33:0/249852402 >> v1:172.21.15.33:6789/0 conn(0x7f8d7c153b20 legacy=0x7f8d7c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.232+0000 7f8d7b400640 1 -- 172.21.15.33:0/249852402 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c15a1f0 con 0x7f8d7c159a80 2024-09-13T18:58:33.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.233+0000 7f8d7b400640 1 --2- 172.21.15.33:0/249852402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c06d060 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009d90 tx=0x7f8d7402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c993229492982d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.233+0000 7f8d79600640 1 -- 172.21.15.33:0/249852402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74007740 con 0x7f8d7c159a80 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d79600640 1 -- 172.21.15.33:0/249852402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7402d050 con 0x7f8d7c159a80 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d79600640 1 -- 172.21.15.33:0/249852402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74007aa0 con 0x7f8d7c159a80 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 -- 172.21.15.33:0/249852402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 msgr2=0x7f8d7c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 --2- 172.21.15.33:0/249852402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c06d060 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009d90 tx=0x7f8d7402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 -- 172.21.15.33:0/249852402 shutdown_connections 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 --2- 172.21.15.33:0/249852402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c06d060 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 -- 172.21.15.33:0/249852402 >> 172.21.15.33:0/249852402 conn(0x7f8d7c0b0510 msgr2=0x7f8d7c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 -- 172.21.15.33:0/249852402 shutdown_connections 2024-09-13T18:58:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.234+0000 7f8d81e00640 1 -- 172.21.15.33:0/249852402 wait complete. 2024-09-13T18:58:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.236+0000 7f8d81e00640 1 Processor -- start 2024-09-13T18:58:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.236+0000 7f8d81e00640 1 -- start start 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c0b3990 0x7f8d7c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 0x7f8d7c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c155a30 con 0x7f8d7c159a80 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c152980 con 0x7f8d7c0b3990 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d81e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c151d70 con 0x7f8d7c153b20 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d7b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d7aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c0b3990 0x7f8d7c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d7b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46126/0 (socket says 172.21.15.33:46126) 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d7b400640 1 -- 172.21.15.33:0/4062059342 learned_addr learned my addr 172.21.15.33:0/4062059342 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.237+0000 7f8d7a000640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 0x7f8d7c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 -- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 msgr2=0x7f8d7c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 0x7f8d7c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 -- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c0b3990 msgr2=0x7f8d7c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c0b3990 0x7f8d7c1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 -- 172.21.15.33:0/4062059342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009a70 con 0x7f8d7c159a80 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7a000640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 0x7f8d7c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d7b400640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009eb0 tx=0x7f8d74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74007740 con 0x7f8d7c159a80 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d740078a0 con 0x7f8d7c159a80 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74007c50 con 0x7f8d7c159a80 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.238+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c152050 con 0x7f8d7c159a80 2024-09-13T18:58:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.239+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c152610 con 0x7f8d7c159a80 2024-09-13T18:58:33.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.240+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c152b10 con 0x7f8d7c159a80 2024-09-13T18:58:33.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.240+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d7403c420 con 0x7f8d7c159a80 2024-09-13T18:58:33.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.241+0000 7f8d73400640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 0x7f8d5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.241+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d740aa740 con 0x7f8d7c159a80 2024-09-13T18:58:33.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.242+0000 7f8d7aa00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 0x7f8d5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.242+0000 7f8d7aa00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 0x7f8d5c06d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0011e0 tx=0x7f8d6c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.245+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d740759f0 con 0x7f8d7c159a80 2024-09-13T18:58:33.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.465+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d7c0b1ed0 con 0x7f8d7c159a80 2024-09-13T18:58:33.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.466+0000 7f8d73400640 1 -- 172.21.15.33:0/4062059342 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8d74009450 con 0x7f8d7c159a80 2024-09-13T18:58:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:33.468 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:33.469 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 msgr2=0x7f8d5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 0x7f8d5c06d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0011e0 tx=0x7f8d6c007d30 comp rx=0 tx=0).stop 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 msgr2=0x7f8d7c142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009eb0 tx=0x7f8d74004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 shutdown_connections 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d5c06ac30 0x7f8d5c06d0f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7c159a80 0x7f8d7c142f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d7c153b20 0x7f8d7c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 --2- 172.21.15.33:0/4062059342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c0b3990 0x7f8d7c1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.468+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 >> 172.21.15.33:0/4062059342 conn(0x7f8d7c0b0510 msgr2=0x7f8d7c06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.469+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 shutdown_connections 2024-09-13T18:58:33.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.469+0000 7f8d81e00640 1 -- 172.21.15.33:0/4062059342 wait complete. 2024-09-13T18:58:33.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:33.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.641+0000 7f97d8a00640 1 Processor -- start 2024-09-13T18:58:33.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.641+0000 7f97d8a00640 1 -- start start 2024-09-13T18:58:33.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.642+0000 7f97d8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f97d40b3990 0x7f97d4159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.642+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97d406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.642+0000 7f97d8a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4159fc0 con 0x7f97d4153b20 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.642+0000 7f97d8a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40ce600 con 0x7f97d40b3990 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.642+0000 7f97d8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4070f90 con 0x7f97d406f660 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d1e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f97d4153b20 0x7f97d40b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38482/0 (socket says 172.21.15.33:38482) 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d1e00640 1 -- 172.21.15.33:0/997540960 learned_addr learned my addr 172.21.15.33:0/997540960 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544438283 0 0) 0x7f97d4159fc0 con 0x7f97d4153b20 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b8003520 con 0x7f97d4153b20 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d2800640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97d406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d1400640 1 --2- 172.21.15.33:0/997540960 >> v2:172.21.15.103:3300/0 conn(0x7f97d40b3990 0x7f97d4159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832715461 0 0) 0x7f97b8003520 con 0x7f97d4153b20 2024-09-13T18:58:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 msgr2=0x7f97d406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97d406fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 >> v2:172.21.15.103:3300/0 conn(0x7f97d40b3990 msgr2=0x7f97d4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 --2- 172.21.15.33:0/997540960 >> v2:172.21.15.103:3300/0 conn(0x7f97d40b3990 0x7f97d4159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4153f00 con 0x7f97d4153b20 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f97c4001670 con 0x7f97d4153b20 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d1400640 1 --2- 172.21.15.33:0/997540960 >> v2:172.21.15.103:3300/0 conn(0x7f97d40b3990 0x7f97d4159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 >> v1:172.21.15.33:6789/0 conn(0x7f97d4153b20 legacy=0x7f97d40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.643+0000 7f97d0a00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d0a00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b8003ef0 0x7f97b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d0a00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40ce600 con 0x7f97b8004d00 2024-09-13T18:58:33.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4070f90 con 0x7f97b8003ef0 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b800dbe0 con 0x7f97d406f660 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d1e00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d1400640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b8003ef0 0x7f97b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 -- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 msgr2=0x7f97b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d406f660 0x7f97b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 -- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b8003ef0 msgr2=0x7f97b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b8003ef0 0x7f97b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.644+0000 7f97d2800640 1 -- 172.21.15.33:0/997540960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8003520 con 0x7f97b8004d00 2024-09-13T18:58:33.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.645+0000 7f97d2800640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009fc0 tx=0x7f97b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e7638d92d4d88e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.645+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc031640 con 0x7f97b8004d00 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc02d070 con 0x7f97b8004d00 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d0a00640 1 -- 172.21.15.33:0/997540960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0319e0 con 0x7f97b8004d00 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 -- 172.21.15.33:0/997540960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 msgr2=0x7f97b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 --2- 172.21.15.33:0/997540960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97b8005180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009fc0 tx=0x7f97b80057f0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d2800640 1 -- 172.21.15.33:0/997540960 reap_dead start 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 -- 172.21.15.33:0/997540960 shutdown_connections 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 -- 172.21.15.33:0/997540960 >> 172.21.15.33:0/997540960 conn(0x7f97d40b0510 msgr2=0x7f97d40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 -- 172.21.15.33:0/997540960 shutdown_connections 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.646+0000 7f97d8a00640 1 -- 172.21.15.33:0/997540960 wait complete. 2024-09-13T18:58:33.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.648+0000 7f97d8a00640 1 Processor -- start 2024-09-13T18:58:33.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.648+0000 7f97d8a00640 1 -- start start 2024-09-13T18:58:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4140c20 0x7f97d41543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d4143270 0x7f97d4143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415c730 con 0x7f97b8004d00 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4142130 con 0x7f97d4140c20 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4143c40 con 0x7f97d4143270 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46156/0 (socket says 172.21.15.33:46156) 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d1e00640 1 -- 172.21.15.33:0/4187401601 learned_addr learned my addr 172.21.15.33:0/4187401601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d2800640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d4143270 0x7f97d4143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.649+0000 7f97d1400640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4140c20 0x7f97d41543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 -- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d4143270 msgr2=0x7f97d4143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d4143270 0x7f97d4143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 -- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4140c20 msgr2=0x7f97d41543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4140c20 0x7f97d41543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 -- 172.21.15.33:0/4187401601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4141240 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d1e00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007310 tx=0x7f97c40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4001450 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400f960 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400fd10 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d4141520 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.650+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4141ae0 con 0x7f97b8004d00 2024-09-13T18:58:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.652+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d406fad0 con 0x7f97b8004d00 2024-09-13T18:58:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.652+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f97c401d460 con 0x7f97b8004d00 2024-09-13T18:58:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.653+0000 7f97ca000640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 0x7f97b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.653+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97c40894f0 con 0x7f97b8004d00 2024-09-13T18:58:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.654+0000 7f97d1400640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 0x7f97b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.654+0000 7f97d1400640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 0x7f97b406d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006fd0 tx=0x7f97c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:33.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.657+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f97c4054650 con 0x7f97b8004d00 2024-09-13T18:58:33.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.836+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97d4157320 con 0x7f97b8004d00 2024-09-13T18:58:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.837+0000 7f97ca000640 1 -- 172.21.15.33:0/4187401601 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f97c4057c70 con 0x7f97b8004d00 2024-09-13T18:58:33.840 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:33.840 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.839+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 msgr2=0x7f97b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.839+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 0x7f97b406d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006fd0 tx=0x7f97c0008040 comp rx=0 tx=0).stop 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.839+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 msgr2=0x7f97d4156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.839+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007310 tx=0x7f97c40077d0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 shutdown_connections 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f97b406ac30 0x7f97b406d0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f97d4143270 0x7f97d4143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4140c20 0x7f97d41543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 --2- 172.21.15.33:0/4187401601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97b8004d00 0x7f97d4156de0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 >> 172.21.15.33:0/4187401601 conn(0x7f97d40b0510 msgr2=0x7f97d406bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 shutdown_connections 2024-09-13T18:58:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:33.840+0000 7f97d8a00640 1 -- 172.21.15.33:0/4187401601 wait complete. 2024-09-13T18:58:33.857 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:58:33.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:34.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.011+0000 7ff73d200640 1 Processor -- start 2024-09-13T18:58:34.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.011+0000 7ff73d200640 1 -- start start 2024-09-13T18:58:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff73d200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff738071560 0x7ff7380ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff73d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff7380b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff73d200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380cd850 con 0x7ff738159480 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff73d200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380cd570 con 0x7ff738071560 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff73d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b1740 con 0x7ff73806f4b0 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff72fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff738071560 0x7ff7380ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff72fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff738071560 0x7ff7380ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46160/0 (socket says 172.21.15.33:46160) 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff72fe00640 1 -- 172.21.15.33:0/3869951780 learned_addr learned my addr 172.21.15.33:0/3869951780 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.012+0000 7ff737e00640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff7380b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.013+0000 7ff72fe00640 1 -- 172.21.15.33:0/3869951780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 msgr2=0x7ff7380b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.013+0000 7ff72fe00640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff7380b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.013+0000 7ff72fe00640 1 -- 172.21.15.33:0/3869951780 >> v1:172.21.15.103:6789/0 conn(0x7ff738159480 legacy=0x7ff738070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.013+0000 7ff72fe00640 1 -- 172.21.15.33:0/3869951780 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380b1a20 con 0x7ff738071560 2024-09-13T18:58:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.014+0000 7ff72fe00640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738071560 0x7ff7380ccf90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff72000bb10 tx=0x7ff72002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc041a0b128689f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.014+0000 7ff736a00640 1 -- 172.21.15.33:0/3869951780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720032790 con 0x7ff738071560 2024-09-13T18:58:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.014+0000 7ff736a00640 1 -- 172.21.15.33:0/3869951780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7200328f0 con 0x7ff738071560 2024-09-13T18:58:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.014+0000 7ff736a00640 1 -- 172.21.15.33:0/3869951780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720032c80 con 0x7ff738071560 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 -- 172.21.15.33:0/3869951780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738071560 msgr2=0x7ff7380ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738071560 0x7ff7380ccf90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff72000bb10 tx=0x7ff72002c890 comp rx=0 tx=0).stop 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 -- 172.21.15.33:0/3869951780 shutdown_connections 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff7380b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 --2- 172.21.15.33:0/3869951780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738071560 0x7ff7380ccf90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 -- 172.21.15.33:0/3869951780 >> 172.21.15.33:0/3869951780 conn(0x7ff7380ae310 msgr2=0x7ff7380ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 -- 172.21.15.33:0/3869951780 shutdown_connections 2024-09-13T18:58:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.015+0000 7ff73d200640 1 -- 172.21.15.33:0/3869951780 wait complete. 2024-09-13T18:58:34.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.016+0000 7ff73d200640 1 Processor -- start 2024-09-13T18:58:34.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 -- start start 2024-09-13T18:58:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff738140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 0x7ff7381428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73814e3c0 con 0x7ff738159480 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff738141840 con 0x7ff738071560 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.017+0000 7ff73d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff738141b20 con 0x7ff73806f4b0 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46174/0 (socket says 172.21.15.33:46174) 2024-09-13T18:58:34.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 -- 172.21.15.33:0/584249804 learned_addr learned my addr 172.21.15.33:0/584249804 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff72fe00640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 0x7ff7381428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737400640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff738140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 -- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 msgr2=0x7ff738140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff738140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 -- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 msgr2=0x7ff7381428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 0x7ff7381428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737e00640 1 -- 172.21.15.33:0/584249804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72000b770 con 0x7ff738159480 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff72fe00640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 0x7ff7381428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.018+0000 7ff737400640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff738140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff737e00640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff73000efc0 tx=0x7ff73000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730014480 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000f040 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730014820 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff738141e00 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.019+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7381423c0 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.020+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff738067360 con 0x7ff738159480 2024-09-13T18:58:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.021+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff730014980 con 0x7ff738159480 2024-09-13T18:58:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.022+0000 7ff72f400640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 0x7ff71406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.022+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff730089ef0 con 0x7ff738159480 2024-09-13T18:58:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.022+0000 7ff737400640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 0x7ff71406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.023+0000 7ff737400640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 0x7ff71406d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7381f58a0 tx=0x7ff728009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.026+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7300550c0 con 0x7ff738159480 2024-09-13T18:58:34.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.239+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7381425e0 con 0x7ff738159480 2024-09-13T18:58:34.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.240+0000 7ff72f400640 1 -- 172.21.15.33:0/584249804 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7ff730018090 con 0x7ff738159480 2024-09-13T18:58:34.242 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:34.242 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:34.242 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 msgr2=0x7ff71406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 0x7ff71406d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7381f58a0 tx=0x7ff728009040 comp rx=0 tx=0).stop 2024-09-13T18:58:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 msgr2=0x7ff738140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff73000efc0 tx=0x7ff73000c490 comp rx=0 tx=0).stop 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 shutdown_connections 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff71406ac30 0x7ff71406d0f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff738159480 0x7ff738140f40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff738071560 0x7ff7381428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 --2- 172.21.15.33:0/584249804 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff73806f4b0 0x7ff738140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 >> 172.21.15.33:0/584249804 conn(0x7ff7380ae310 msgr2=0x7ff7381557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 shutdown_connections 2024-09-13T18:58:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.242+0000 7ff73d200640 1 -- 172.21.15.33:0/584249804 wait complete. 2024-09-13T18:58:34.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.412+0000 7fcb22600640 1 Processor -- start 2024-09-13T18:58:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.413+0000 7fcb22600640 1 -- start start 2024-09-13T18:58:34.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb22600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb1c0719a0 0x7fcb1c06c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb22600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c06b4a0 con 0x7fcb1c156d10 2024-09-13T18:58:34.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb22600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c15dc70 con 0x7fcb1c071510 2024-09-13T18:58:34.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb22600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1c0b4450 con 0x7fcb1c0719a0 2024-09-13T18:58:34.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb21c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb1c0719a0 0x7fcb1c06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb21200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcb1c156d10 0x7fcb1c15d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38496/0 (socket says 172.21.15.33:38496) 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.414+0000 7fcb21200640 1 -- 172.21.15.33:0/2101622974 learned_addr learned my addr 172.21.15.33:0/2101622974 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.415+0000 7fcb21c00640 1 -- 172.21.15.33:0/2101622974 >> v1:172.21.15.103:6789/0 conn(0x7fcb1c071510 legacy=0x7fcb1c06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.415+0000 7fcb21c00640 1 -- 172.21.15.33:0/2101622974 >> v1:172.21.15.33:6789/0 conn(0x7fcb1c156d10 legacy=0x7fcb1c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.415+0000 7fcb1be00640 1 -- 172.21.15.33:0/2101622974 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192936675 0 0) 0x7fcb1c06b4a0 con 0x7fcb1c156d10 2024-09-13T18:58:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.415+0000 7fcb21c00640 1 -- 172.21.15.33:0/2101622974 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c0b4730 con 0x7fcb1c0719a0 2024-09-13T18:58:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.416+0000 7fcb21c00640 1 --2- 172.21.15.33:0/2101622974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c06c600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009d90 tx=0x7fcb1402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27b9fc53a81b865 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.416+0000 7fcb1be00640 1 -- 172.21.15.33:0/2101622974 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14007740 con 0x7fcb1c0719a0 2024-09-13T18:58:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.416+0000 7fcb1be00640 1 -- 172.21.15.33:0/2101622974 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1402d050 con 0x7fcb1c0719a0 2024-09-13T18:58:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.416+0000 7fcb1be00640 1 -- 172.21.15.33:0/2101622974 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14007ac0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 -- 172.21.15.33:0/2101622974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 msgr2=0x7fcb1c06c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 --2- 172.21.15.33:0/2101622974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c06c600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009d90 tx=0x7fcb1402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 -- 172.21.15.33:0/2101622974 shutdown_connections 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 --2- 172.21.15.33:0/2101622974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c06c600 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 -- 172.21.15.33:0/2101622974 >> 172.21.15.33:0/2101622974 conn(0x7fcb1c06d630 msgr2=0x7fcb1c06da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 -- 172.21.15.33:0/2101622974 shutdown_connections 2024-09-13T18:58:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.417+0000 7fcb22600640 1 -- 172.21.15.33:0/2101622974 wait complete. 2024-09-13T18:58:34.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.418+0000 7fcb22600640 1 Processor -- start 2024-09-13T18:58:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 -- start start 2024-09-13T18:58:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb1c071510 0x7fcb1c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb1c156d10 0x7fcb1c15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c158250 con 0x7fcb1c0719a0 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0cc7b0 con 0x7fcb1c071510 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.419+0000 7fcb22600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0cbc30 con 0x7fcb1c156d10 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46196/0 (socket says 172.21.15.33:46196) 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 -- 172.21.15.33:0/1912427172 learned_addr learned my addr 172.21.15.33:0/1912427172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb21200640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb1c071510 0x7fcb1c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb21c00640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb1c156d10 0x7fcb1c15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 -- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb1c156d10 msgr2=0x7fcb1c15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb1c156d10 0x7fcb1c15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 -- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb1c071510 msgr2=0x7fcb1c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb1c071510 0x7fcb1c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 -- 172.21.15.33:0/1912427172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009a70 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.420+0000 7fcb13e00640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c450 tx=0x7fcb0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.421+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040052d0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.421+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04005430 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.421+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04012870 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.421+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c0cbf10 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.421+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c0cc4d0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.422+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c0b40b0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.423+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb040129d0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.424+0000 7fcb19600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 0x7fcaf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.424+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb04088f60 con 0x7fcb1c0719a0 2024-09-13T18:58:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.425+0000 7fcb21200640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 0x7fcaf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.425+0000 7fcb21200640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 0x7fcaf806d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000f60 tx=0x7fcb0c007d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.428+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcb040540a0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.643+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb1c0d02c0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.643+0000 7fcb19600640 1 -- 172.21.15.33:0/1912427172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fcb040576c0 con 0x7fcb1c0719a0 2024-09-13T18:58:34.646 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:34.646 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:17.395076+0000","modified":"2024-09-13T18:58:20.407536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2809270165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2809270165},{"type":"v1","addr":"172.21.15.33:6835","nonce":2809270165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:58:34.646 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-13T18:58:34.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 msgr2=0x7fcaf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 0x7fcaf806d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000f60 tx=0x7fcb0c007d00 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 msgr2=0x7fcb1c15f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c450 tx=0x7fcb0400c910 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 shutdown_connections 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcaf806ac00 0x7fcaf806d0c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb1c156d10 0x7fcb1c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1c0719a0 0x7fcb1c15f160 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 --2- 172.21.15.33:0/1912427172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb1c071510 0x7fcb1c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 >> 172.21.15.33:0/1912427172 conn(0x7fcb1c06d630 msgr2=0x7fcb1c15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 shutdown_connections 2024-09-13T18:58:34.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.646+0000 7fcb22600640 1 -- 172.21.15.33:0/1912427172 wait complete. 2024-09-13T18:58:34.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.818+0000 7f4abe000640 1 Processor -- start 2024-09-13T18:58:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.818+0000 7f4abe000640 1 -- start start 2024-09-13T18:58:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abe000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ab80d21a0 0x7f4ab80d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abe000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab81601b0 con 0x7f4ab815fdd0 2024-09-13T18:58:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abe000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80cd6a0 con 0x7f4ab80b1c50 2024-09-13T18:58:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abe000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80cfd50 con 0x7f4ab80d21a0 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abd600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ab80d21a0 0x7f4ab80d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abcc00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4ab815fdd0 0x7f4ab80d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38508/0 (socket says 172.21.15.33:38508) 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.819+0000 7f4abcc00640 1 -- 172.21.15.33:0/291201472 learned_addr learned my addr 172.21.15.33:0/291201472 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.820+0000 7f4abd600640 1 -- 172.21.15.33:0/291201472 >> v1:172.21.15.103:6789/0 conn(0x7f4ab80b1c50 legacy=0x7f4ab80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.820+0000 7f4abd600640 1 -- 172.21.15.33:0/291201472 >> v1:172.21.15.33:6789/0 conn(0x7f4ab815fdd0 legacy=0x7f4ab80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.820+0000 7f4abd600640 1 -- 172.21.15.33:0/291201472 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80cd8f0 con 0x7f4ab80d21a0 2024-09-13T18:58:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.820+0000 7f4ab7400640 1 -- 172.21.15.33:0/291201472 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56157957 0 0) 0x7f4ab81601b0 con 0x7f4ab815fdd0 2024-09-13T18:58:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.821+0000 7f4abd600640 1 --2- 172.21.15.33:0/291201472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab80d21a0 0x7f4ab80d0ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009d90 tx=0x7f4ab002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc547e45ed0dc4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.821+0000 7f4ab7400640 1 -- 172.21.15.33:0/291201472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0031600 con 0x7f4ab80d21a0 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.821+0000 7f4ab7400640 1 -- 172.21.15.33:0/291201472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab002d050 con 0x7f4ab80d21a0 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.821+0000 7f4ab7400640 1 -- 172.21.15.33:0/291201472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0031980 con 0x7f4ab80d21a0 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 -- 172.21.15.33:0/291201472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab80d21a0 msgr2=0x7f4ab80d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 --2- 172.21.15.33:0/291201472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab80d21a0 0x7f4ab80d0ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009d90 tx=0x7f4ab002a610 comp rx=0 tx=0).stop 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 -- 172.21.15.33:0/291201472 shutdown_connections 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 --2- 172.21.15.33:0/291201472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab80d21a0 0x7f4ab80d0ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 -- 172.21.15.33:0/291201472 >> 172.21.15.33:0/291201472 conn(0x7f4ab806a7c0 msgr2=0x7f4ab806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 -- 172.21.15.33:0/291201472 shutdown_connections 2024-09-13T18:58:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.822+0000 7f4abe000640 1 -- 172.21.15.33:0/291201472 wait complete. 2024-09-13T18:58:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.823+0000 7f4abe000640 1 Processor -- start 2024-09-13T18:58:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 -- start start 2024-09-13T18:58:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab80b1c50 0x7f4ab80cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ab80d21a0 0x7f4ab8156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab81569c0 con 0x7f4ab815fdd0 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c62c0 con 0x7f4ab80b1c50 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.824+0000 7f4abe000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c6540 con 0x7f4ab80d21a0 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46214/0 (socket says 172.21.15.33:46214) 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 -- 172.21.15.33:0/3260255410 learned_addr learned my addr 172.21.15.33:0/3260255410 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4ab7e00640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ab80d21a0 0x7f4ab8156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abcc00640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab80b1c50 0x7f4ab80cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 -- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ab80d21a0 msgr2=0x7f4ab8156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ab80d21a0 0x7f4ab8156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 -- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab80b1c50 msgr2=0x7f4ab80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab80b1c50 0x7f4ab80cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 -- 172.21.15.33:0/3260255410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0009a70 con 0x7f4ab815fdd0 2024-09-13T18:58:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.825+0000 7f4abd600640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002ac00 tx=0x7f4ab0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.826+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab003c830 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.826+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab003c990 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.826+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab003cd00 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.826+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80c6820 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.826+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80c6de0 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.827+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab815f910 con 0x7f4ab815fdd0 2024-09-13T18:58:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.828+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ab0045460 con 0x7f4ab815fdd0 2024-09-13T18:58:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.828+0000 7f4ab4c00640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 0x7f4a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.829+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab00aafe0 con 0x7f4ab815fdd0 2024-09-13T18:58:34.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.829+0000 7f4abcc00640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 0x7f4a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:34.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.830+0000 7f4abcc00640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 0x7f4a9806d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000f60 tx=0x7f4aac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:34.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:34.833+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4ab0079bb0 con 0x7f4ab815fdd0 2024-09-13T18:58:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.012+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ab80b1700 con 0x7f4ab815fdd0 2024-09-13T18:58:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.013+0000 7f4ab4c00640 1 -- 172.21.15.33:0/3260255410 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f4ab0040090 con 0x7f4ab815fdd0 2024-09-13T18:58:35.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:35.015 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:18.397518+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:15.830061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:16.385610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:35.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 msgr2=0x7f4a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 0x7f4a9806d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000f60 tx=0x7f4aac009040 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 msgr2=0x7f4ab80c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ab002ac00 tx=0x7f4ab0004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 shutdown_connections 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4a9806ac00 0x7f4a9806d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ab815fdd0 0x7f4ab80c5d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4ab80d21a0 0x7f4ab8156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 --2- 172.21.15.33:0/3260255410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab80b1c50 0x7f4ab80cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 >> 172.21.15.33:0/3260255410 conn(0x7f4ab806a7c0 msgr2=0x7f4ab815d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 shutdown_connections 2024-09-13T18:58:35.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.015+0000 7f4abe000640 1 -- 172.21.15.33:0/3260255410 wait complete. 2024-09-13T18:58:35.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:58:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.189+0000 7f5b95600640 1 Processor -- start 2024-09-13T18:58:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.189+0000 7f5b95600640 1 -- start start 2024-09-13T18:58:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b95600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b900cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b95600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b900cba50 0x7f5b900cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b95600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9006ba80 con 0x7f5b90151590 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b95600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b900cc400 con 0x7f5b900cba50 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b95600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900b2270 con 0x7f5b900b1b30 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b8ea00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5b90151590 0x7f5b9006b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38514/0 (socket says 172.21.15.33:38514) 2024-09-13T18:58:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.190+0000 7f5b8ea00640 1 -- 172.21.15.33:0/2913040529 learned_addr learned my addr 172.21.15.33:0/2913040529 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8f400640 1 --2- 172.21.15.33:0/2913040529 >> v2:172.21.15.103:3300/0 conn(0x7f5b900cba50 0x7f5b900cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b87e00640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b900cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8e000640 1 -- 172.21.15.33:0/2913040529 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401031903 0 0) 0x7f5b9006ba80 con 0x7f5b90151590 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8e000640 1 -- 172.21.15.33:0/2913040529 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b74003520 con 0x7f5b90151590 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8f400640 1 -- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 msgr2=0x7f5b900cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8f400640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b900cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8f400640 1 -- 172.21.15.33:0/2913040529 >> v1:172.21.15.33:6789/0 conn(0x7f5b90151590 legacy=0x7f5b9006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.191+0000 7f5b8f400640 1 -- 172.21.15.33:0/2913040529 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900b2550 con 0x7f5b900cba50 2024-09-13T18:58:35.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.192+0000 7f5b8f400640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b900cba50 0x7f5b900cbec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009d90 tx=0x7f5b8802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524d75b56da141fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.195+0000 7f5b8e000640 1 -- 172.21.15.33:0/2913040529 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88007740 con 0x7f5b900cba50 2024-09-13T18:58:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.195+0000 7f5b8e000640 1 -- 172.21.15.33:0/2913040529 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8802d050 con 0x7f5b900cba50 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.195+0000 7f5b8e000640 1 -- 172.21.15.33:0/2913040529 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88007ac0 con 0x7f5b900cba50 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 -- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b900cba50 msgr2=0x7f5b900cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b900cba50 0x7f5b900cbec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009d90 tx=0x7f5b8802a660 comp rx=0 tx=0).stop 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 -- 172.21.15.33:0/2913040529 shutdown_connections 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b900cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 --2- 172.21.15.33:0/2913040529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b900cba50 0x7f5b900cbec0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 -- 172.21.15.33:0/2913040529 >> 172.21.15.33:0/2913040529 conn(0x7f5b900b0510 msgr2=0x7f5b900b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 -- 172.21.15.33:0/2913040529 shutdown_connections 2024-09-13T18:58:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.196+0000 7f5b95600640 1 -- 172.21.15.33:0/2913040529 wait complete. 2024-09-13T18:58:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.198+0000 7f5b95600640 1 Processor -- start 2024-09-13T18:58:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.198+0000 7f5b95600640 1 -- start start 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b901f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b90151590 0x7f5b9015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9015d6a0 con 0x7f5b900cba50 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90155170 con 0x7f5b90151590 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b95600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b901f0660 con 0x7f5b900b1b30 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b8ea00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b901f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46226/0 (socket says 172.21.15.33:46226) 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b87e00640 1 -- 172.21.15.33:0/2548113624 learned_addr learned my addr 172.21.15.33:0/2548113624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:35.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.199+0000 7f5b8f400640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b90151590 0x7f5b9015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 -- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 msgr2=0x7f5b901f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b901f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 -- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b90151590 msgr2=0x7f5b9015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b90151590 0x7f5b9015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 -- 172.21.15.33:0/2548113624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88009a70 con 0x7f5b900cba50 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b8ea00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b901f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b87e00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800e9b0 tx=0x7f5b7800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78009670 con 0x7f5b900cba50 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800c9a0 con 0x7f5b900cba50 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b901f0940 con 0x7f5b900cba50 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800cd50 con 0x7f5b900cba50 2024-09-13T18:58:35.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.200+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b901f0f00 con 0x7f5b900cba50 2024-09-13T18:58:35.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.202+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b901552e0 con 0x7f5b900cba50 2024-09-13T18:58:35.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.202+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b78013470 con 0x7f5b900cba50 2024-09-13T18:58:35.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.203+0000 7f5b86a00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.203+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b78089540 con 0x7f5b900cba50 2024-09-13T18:58:35.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.204+0000 7f5b8ea00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.205+0000 7f5b8ea00640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b800011e0 tx=0x7f5b80007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.208+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5b780547c0 con 0x7f5b900cba50 2024-09-13T18:58:35.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.424+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5b900cbec0 con 0x7f5b900cba50 2024-09-13T18:58:35.427 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T18:58:35.425+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:58:35.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.433+0000 7f5b86a00640 1 -- 172.21.15.33:0/2548113624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5b78057de0 con 0x7f5b900cba50 2024-09-13T18:58:35.436 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:58:35.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 msgr2=0x7f5b6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b800011e0 tx=0x7f5b80007d30 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 msgr2=0x7f5b901f1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800e9b0 tx=0x7f5b7800ee70 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 shutdown_connections 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b90151590 0x7f5b9015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b900cba50 0x7f5b901f1220 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 --2- 172.21.15.33:0/2548113624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b900b1b30 0x7f5b901f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 >> 172.21.15.33:0/2548113624 conn(0x7f5b900b0510 msgr2=0x7f5b90159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 shutdown_connections 2024-09-13T18:58:35.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.436+0000 7f5b95600640 1 -- 172.21.15.33:0/2548113624 wait complete. 2024-09-13T18:58:35.443 INFO:tasks.ceph.mds.c.smithi033.stderr: -3009> 2024-09-13T18:58:20.906+0000 7f0602a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:58:35.455 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:58:35.492 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:58:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.613+0000 7fa7e3c00640 1 Processor -- start 2024-09-13T18:58:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.613+0000 7fa7e3c00640 1 -- start start 2024-09-13T18:58:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e3c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 0x7fa7dc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e3c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7dc0ce020 0x7fa7dc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e3c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7dc06bc00 con 0x7fa7dc0b1b00 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e3c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7dc06bea0 con 0x7fa7dc0ce020 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e3c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7dc06c180 con 0x7fa7dc15a520 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7e1c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7dc0ce020 0x7fa7dc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7dbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa7dc0b1b00 0x7fa7dc0cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38542/0 (socket says 172.21.15.33:38542) 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.614+0000 7fa7dbe00640 1 -- 172.21.15.33:0/551215833 learned_addr learned my addr 172.21.15.33:0/551215833 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1200640 1 --2- 172.21.15.33:0/551215833 >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 0x7fa7dc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1c00640 1 -- 172.21.15.33:0/551215833 >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 msgr2=0x7fa7dc06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1c00640 1 --2- 172.21.15.33:0/551215833 >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 0x7fa7dc06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1c00640 1 -- 172.21.15.33:0/551215833 >> v1:172.21.15.33:6789/0 conn(0x7fa7dc0b1b00 legacy=0x7fa7dc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1c00640 1 -- 172.21.15.33:0/551215833 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc06c460 con 0x7fa7dc0ce020 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7db400640 1 -- 172.21.15.33:0/551215833 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068527615 0 0) 0x7fa7dc06bc00 con 0x7fa7dc0b1b00 2024-09-13T18:58:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.615+0000 7fa7e1200640 1 --2- 172.21.15.33:0/551215833 >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 0x7fa7dc06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.616+0000 7fa7e1c00640 1 --2- 172.21.15.33:0/551215833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc15a900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0b14f0 tx=0x7fa7d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87fc23795544b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.616+0000 7fa7db400640 1 -- 172.21.15.33:0/551215833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d402aea0 con 0x7fa7dc0ce020 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.616+0000 7fa7db400640 1 -- 172.21.15.33:0/551215833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d402d050 con 0x7fa7dc0ce020 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.616+0000 7fa7db400640 1 -- 172.21.15.33:0/551215833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4007960 con 0x7fa7dc0ce020 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 -- 172.21.15.33:0/551215833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 msgr2=0x7fa7dc15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/551215833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc15a900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0b14f0 tx=0x7fa7d402a680 comp rx=0 tx=0).stop 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 -- 172.21.15.33:0/551215833 shutdown_connections 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/551215833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc15a900 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/551215833 >> v2:172.21.15.103:3300/0 conn(0x7fa7dc15a520 0x7fa7dc06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 -- 172.21.15.33:0/551215833 >> 172.21.15.33:0/551215833 conn(0x7fa7dc0b0510 msgr2=0x7fa7dc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 -- 172.21.15.33:0/551215833 shutdown_connections 2024-09-13T18:58:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.617+0000 7fa7e3c00640 1 -- 172.21.15.33:0/551215833 wait complete. 2024-09-13T18:58:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.618+0000 7fa7e3c00640 1 Processor -- start 2024-09-13T18:58:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.619+0000 7fa7e3c00640 1 -- start start 2024-09-13T18:58:35.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.619+0000 7fa7e3c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7dc0b1b00 0x7fa7dc156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.619+0000 7fa7e3c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e3c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 0x7fa7dc154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e3c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0b09a0 con 0x7fa7dc0ce020 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e3c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc154870 con 0x7fa7dc15a520 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e3c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc1f1d90 con 0x7fa7dc0b1b00 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46254/0 (socket says 172.21.15.33:46254) 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 -- 172.21.15.33:0/3348650070 learned_addr learned my addr 172.21.15.33:0/3348650070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e1200640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7dc0b1b00 0x7fa7dc156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e1c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 0x7fa7dc154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 -- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7dc0b1b00 msgr2=0x7fa7dc156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7dc0b1b00 0x7fa7dc156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 -- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 msgr2=0x7fa7dc154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 0x7fa7dc154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7dbe00640 1 -- 172.21.15.33:0/3348650070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4009a70 con 0x7fa7dc0ce020 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.620+0000 7fa7e1c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 0x7fa7dc154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7dbe00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c4d0 tx=0x7fa7c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80074e0 con 0x7fa7dc0ce020 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8007660 con 0x7fa7dc0ce020 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8004a20 con 0x7fa7dc0ce020 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc0b0c20 con 0x7fa7dc0ce020 2024-09-13T18:58:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.621+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc1f2330 con 0x7fa7dc0ce020 2024-09-13T18:58:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.622+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7dc15ae20 con 0x7fa7dc0ce020 2024-09-13T18:58:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.623+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa7c8004b80 con 0x7fa7dc0ce020 2024-09-13T18:58:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.624+0000 7fa7d8c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 0x7fa7bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.624+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa7c80885b0 con 0x7fa7dc0ce020 2024-09-13T18:58:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.624+0000 7fa7e1200640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 0x7fa7bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.625+0000 7fa7e1200640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 0x7fa7bc06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0cbd30 tx=0x7fa7d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:35.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.628+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa7dc15ae20 con 0x7fa7dc0ce020 2024-09-13T18:58:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:35.845+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa7dc15ae20 con 0x7fa7dc0ce020 2024-09-13T18:58:36.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.436+0000 7fa7d8c00640 1 -- 172.21.15.33:0/3348650070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa7dc15ae20 con 0x7fa7dc0ce020 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 msgr2=0x7fa7bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 0x7fa7bc06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0cbd30 tx=0x7fa7d0008040 comp rx=0 tx=0).stop 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 msgr2=0x7fa7dc1564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c4d0 tx=0x7fa7c800c990 comp rx=0 tx=0).stop 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 shutdown_connections 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa7bc06ac00 0x7fa7bc06d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7dc15a520 0x7fa7dc154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7dc0ce020 0x7fa7dc1564d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 --2- 172.21.15.33:0/3348650070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7dc0b1b00 0x7fa7dc156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 >> 172.21.15.33:0/3348650070 conn(0x7fa7dc0b0510 msgr2=0x7fa7dc159380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.439+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 shutdown_connections 2024-09-13T18:58:36.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.440+0000 7fa7e3c00640 1 -- 172.21.15.33:0/3348650070 wait complete. 2024-09-13T18:58:36.461 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:58:36.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.663+0000 7f9086c00640 1 Processor -- start 2024-09-13T18:58:36.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.663+0000 7f9086c00640 1 -- start start 2024-09-13T18:58:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9086c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90800b2080 0x7f90800cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9086c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800ad640 con 0x7f908015c980 2024-09-13T18:58:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9086c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800b2660 con 0x7f90800acf80 2024-09-13T18:58:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9086c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800ad9d0 con 0x7f90800b2080 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9085800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f908015c980 0x7f90800ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38544/0 (socket says 172.21.15.33:38544) 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9085800640 1 -- 172.21.15.33:0/1900173117 learned_addr learned my addr 172.21.15.33:0/1900173117 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.664+0000 7f9086200640 1 --2- 172.21.15.33:0/1900173117 >> v2:172.21.15.33:3300/0 conn(0x7f90800b2080 0x7f90800cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.665+0000 7f9086200640 1 -- 172.21.15.33:0/1900173117 >> v1:172.21.15.103:6789/0 conn(0x7f90800acf80 legacy=0x7f908006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.665+0000 7f9086200640 1 -- 172.21.15.33:0/1900173117 >> v1:172.21.15.33:6789/0 conn(0x7f908015c980 legacy=0x7f90800ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.665+0000 7f907fe00640 1 -- 172.21.15.33:0/1900173117 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226199725 0 0) 0x7f90800ad640 con 0x7f908015c980 2024-09-13T18:58:36.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.665+0000 7f9086200640 1 -- 172.21.15.33:0/1900173117 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800adcb0 con 0x7f90800b2080 2024-09-13T18:58:36.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.666+0000 7f9086200640 1 --2- 172.21.15.33:0/1900173117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90800b2080 0x7f90800cde70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9078009d90 tx=0x7f907802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee635876befffc6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:36.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.666+0000 7f907fe00640 1 -- 172.21.15.33:0/1900173117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078007740 con 0x7f90800b2080 2024-09-13T18:58:36.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.666+0000 7f907fe00640 1 -- 172.21.15.33:0/1900173117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780078a0 con 0x7f90800b2080 2024-09-13T18:58:36.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.666+0000 7f907fe00640 1 -- 172.21.15.33:0/1900173117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078007c30 con 0x7f90800b2080 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.666+0000 7f9086c00640 1 -- 172.21.15.33:0/1900173117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90800b2080 msgr2=0x7f90800cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 --2- 172.21.15.33:0/1900173117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90800b2080 0x7f90800cde70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9078009d90 tx=0x7f907802a780 comp rx=0 tx=0).stop 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 -- 172.21.15.33:0/1900173117 shutdown_connections 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 --2- 172.21.15.33:0/1900173117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90800b2080 0x7f90800cde70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 -- 172.21.15.33:0/1900173117 >> 172.21.15.33:0/1900173117 conn(0x7f90800b0300 msgr2=0x7f90800b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 -- 172.21.15.33:0/1900173117 shutdown_connections 2024-09-13T18:58:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.667+0000 7f9086c00640 1 -- 172.21.15.33:0/1900173117 wait complete. 2024-09-13T18:58:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.668+0000 7f9086c00640 1 Processor -- start 2024-09-13T18:58:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.668+0000 7f9086c00640 1 -- start start 2024-09-13T18:58:36.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90800acf80 0x7f908015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:36.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90800b2080 0x7f908015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015f930 con 0x7f9080147e40 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015df60 con 0x7f90800acf80 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.669+0000 7f9086c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908015d350 con 0x7f90800b2080 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46272/0 (socket says 172.21.15.33:46272) 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 -- 172.21.15.33:0/2116274324 learned_addr learned my addr 172.21.15.33:0/2116274324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9085800640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90800acf80 0x7f908015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9084e00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90800b2080 0x7f908015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 -- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90800b2080 msgr2=0x7f908015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90800b2080 0x7f908015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 -- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90800acf80 msgr2=0x7f908015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:36.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90800acf80 0x7f908015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:36.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 -- 172.21.15.33:0/2116274324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009a70 con 0x7f9080147e40 2024-09-13T18:58:36.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.670+0000 7f9086200640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9078009d90 tx=0x7f9078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:36.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.671+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078032c80 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.671+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078032de0 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.671+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078003b90 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.671+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908015d630 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.671+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908015dbf0 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.672+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90800ac870 con 0x7f9080147e40 2024-09-13T18:58:36.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.673+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9078003cf0 con 0x7f9080147e40 2024-09-13T18:58:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.674+0000 7f907d600640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 0x7f906006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.674+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f90780aa660 con 0x7f9080147e40 2024-09-13T18:58:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.674+0000 7f9085800640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 0x7f906006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.675+0000 7f9085800640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 0x7f906006d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9074000f60 tx=0x7f9074007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.678+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9078075940 con 0x7f9080147e40 2024-09-13T18:58:36.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:36.859+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f908015e0d0 con 0x7f9080147e40 2024-09-13T18:58:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.441+0000 7f907d600640 1 -- 172.21.15.33:0/2116274324 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9078078f60 con 0x7f9080147e40 2024-09-13T18:58:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 msgr2=0x7f906006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 0x7f906006d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9074000f60 tx=0x7f9074007e40 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 msgr2=0x7f90801560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9078009d90 tx=0x7f9078004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 shutdown_connections 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f906006ac30 0x7f906006d0f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9080147e40 0x7f90801560a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90800b2080 0x7f908015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 --2- 172.21.15.33:0/2116274324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90800acf80 0x7f908015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 >> 172.21.15.33:0/2116274324 conn(0x7f90800b0300 msgr2=0x7f90800b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 shutdown_connections 2024-09-13T18:58:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.444+0000 7f9086c00640 1 -- 172.21.15.33:0/2116274324 wait complete. 2024-09-13T18:58:37.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:58:37.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.620+0000 7f3ddcc00640 1 Processor -- start 2024-09-13T18:58:37.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.620+0000 7f3ddcc00640 1 -- start start 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.621+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 0x7f3dd80b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.621+0000 7f3ddcc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd8151a20 con 0x7f3dd80cd870 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3ddcc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80cc430 con 0x7f3dd806cd60 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3ddcc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b1bb0 con 0x7f3dd815b770 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd6800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3dd80cd870 0x7f3dd80cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38550/0 (socket says 172.21.15.33:38550) 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd6800640 1 -- 172.21.15.33:0/3408421232 learned_addr learned my addr 172.21.15.33:0/3408421232 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:37.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/3408421232 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 0x7f3dd80b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443871997 0 0) 0x7f3dd8151a20 con 0x7f3dd80cd870 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc003520 con 0x7f3dd80cd870 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387158896 0 0) 0x7f3dd80cc430 con 0x7f3dd806cd60 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd8151a20 con 0x7f3dd806cd60 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.622+0000 7f3dcfe00640 1 -- 172.21.15.33:0/3408421232 >> v1:172.21.15.103:6789/0 conn(0x7f3dd806cd60 legacy=0x7f3dd80cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.623+0000 7f3dcfe00640 1 -- 172.21.15.33:0/3408421232 >> v1:172.21.15.33:6789/0 conn(0x7f3dd80cd870 legacy=0x7f3dd80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.623+0000 7f3dcfe00640 1 -- 172.21.15.33:0/3408421232 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80b1e70 con 0x7f3dd815b770 2024-09-13T18:58:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.624+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/3408421232 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 0x7f3dd80b2950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097d0 tx=0x7f3dc002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f1497f125ef6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.624+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0032440 con 0x7f3dd815b770 2024-09-13T18:58:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.624+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00325a0 con 0x7f3dd815b770 2024-09-13T18:58:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.624+0000 7f3dd5400640 1 -- 172.21.15.33:0/3408421232 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0032930 con 0x7f3dd815b770 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 -- 172.21.15.33:0/3408421232 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 msgr2=0x7f3dd80b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/3408421232 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 0x7f3dd80b2950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00097d0 tx=0x7f3dc002a200 comp rx=0 tx=0).stop 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 -- 172.21.15.33:0/3408421232 shutdown_connections 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/3408421232 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd815b770 0x7f3dd80b2950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 -- 172.21.15.33:0/3408421232 >> 172.21.15.33:0/3408421232 conn(0x7f3dd80b0510 msgr2=0x7f3dd80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 -- 172.21.15.33:0/3408421232 shutdown_connections 2024-09-13T18:58:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.625+0000 7f3ddcc00640 1 -- 172.21.15.33:0/3408421232 wait complete. 2024-09-13T18:58:37.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.626+0000 7f3ddcc00640 1 Processor -- start 2024-09-13T18:58:37.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 -- start start 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 0x7f3dd814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 0x7f3dd814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd814c6b0 con 0x7f3dd806cd60 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8156e90 con 0x7f3dd815b770 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.627+0000 7f3ddcc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8152c30 con 0x7f3dd80cd870 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46286/0 (socket says 172.21.15.33:46286) 2024-09-13T18:58:37.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 -- 172.21.15.33:0/109686454 learned_addr learned my addr 172.21.15.33:0/109686454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd6800640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 0x7f3dd814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 0x7f3dd814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 -- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 msgr2=0x7f3dd814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 0x7f3dd814c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 -- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 msgr2=0x7f3dd814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 0x7f3dd814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 -- 172.21.15.33:0/109686454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0009400 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd6800640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 0x7f3dd814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 0x7f3dd814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.628+0000 7f3dd5e00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c490 tx=0x7f3dc800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.629+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80052d0 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.629+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8005430 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.629+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8012870 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.629+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd8152f10 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.629+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd81534d0 con 0x7f3dd806cd60 2024-09-13T18:58:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.630+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd8157050 con 0x7f3dd806cd60 2024-09-13T18:58:37.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.631+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3dc80129d0 con 0x7f3dd806cd60 2024-09-13T18:58:37.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.632+0000 7f3dce000640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 0x7f3db406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:37.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.632+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3dc8088dd0 con 0x7f3dd806cd60 2024-09-13T18:58:37.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.632+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 0x7f3db406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.633+0000 7f3dcfe00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 0x7f3db406d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:37.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.636+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3dd8157050 con 0x7f3dd806cd60 2024-09-13T18:58:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:37.815+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3dd8157050 con 0x7f3dd806cd60 2024-09-13T18:58:38.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.443+0000 7f3dce000640 1 -- 172.21.15.33:0/109686454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3dd8157050 con 0x7f3dd806cd60 2024-09-13T18:58:38.446 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T18:58:38.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 msgr2=0x7f3db406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 0x7f3db406d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0034000 tx=0x7f3dc002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 msgr2=0x7f3dd814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c490 tx=0x7f3dc800c950 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 shutdown_connections 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3db406ac00 0x7f3db406d0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dd815b770 0x7f3dd814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3dd80cd870 0x7f3dd814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 --2- 172.21.15.33:0/109686454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd806cd60 0x7f3dd814c940 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 >> 172.21.15.33:0/109686454 conn(0x7f3dd80b0510 msgr2=0x7f3dd80cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:38.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 shutdown_connections 2024-09-13T18:58:38.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.446+0000 7f3ddcc00640 1 -- 172.21.15.33:0/109686454 wait complete. 2024-09-13T18:58:38.466 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:58:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.622+0000 7fb393400640 1 Processor -- start 2024-09-13T18:58:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.622+0000 7fb393400640 1 -- start start 2024-09-13T18:58:38.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.623+0000 7fb393400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.623+0000 7fb393400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb38c0b1b00 0x7fb38c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.623+0000 7fb393400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c06bc00 con 0x7fb38c0cde50 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.623+0000 7fb393400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c06bea0 con 0x7fb38c0b1b00 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.623+0000 7fb393400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c06c180 con 0x7fb38c15a520 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb38c0b1b00 0x7fb38c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb391400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb38c0cde50 0x7fb38c0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38562/0 (socket says 172.21.15.33:38562) 2024-09-13T18:58:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb391400640 1 -- 172.21.15.33:0/4205341178 learned_addr learned my addr 172.21.15.33:0/4205341178 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb390a00640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38be00640 1 -- 172.21.15.33:0/4205341178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 msgr2=0x7fb38c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38be00640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38be00640 1 -- 172.21.15.33:0/4205341178 >> v1:172.21.15.33:6789/0 conn(0x7fb38c0cde50 legacy=0x7fb38c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38be00640 1 -- 172.21.15.33:0/4205341178 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c06c460 con 0x7fb38c0b1b00 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb38b400640 1 -- 172.21.15.33:0/4205341178 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387906063 0 0) 0x7fb38c06bc00 con 0x7fb38c0cde50 2024-09-13T18:58:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.624+0000 7fb390a00640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.625+0000 7fb38be00640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c0cd910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb3780097d0 tx=0x7fb37802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c737a1d111271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.625+0000 7fb38b400640 1 -- 172.21.15.33:0/4205341178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378032440 con 0x7fb38c0b1b00 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.625+0000 7fb38b400640 1 -- 172.21.15.33:0/4205341178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3780325a0 con 0x7fb38c0b1b00 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.625+0000 7fb38b400640 1 -- 172.21.15.33:0/4205341178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378032930 con 0x7fb38c0b1b00 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 -- 172.21.15.33:0/4205341178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 msgr2=0x7fb38c0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c0cd910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb3780097d0 tx=0x7fb37802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 -- 172.21.15.33:0/4205341178 shutdown_connections 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c0cd910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 --2- 172.21.15.33:0/4205341178 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 -- 172.21.15.33:0/4205341178 >> 172.21.15.33:0/4205341178 conn(0x7fb38c0b0510 msgr2=0x7fb38c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 -- 172.21.15.33:0/4205341178 shutdown_connections 2024-09-13T18:58:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.626+0000 7fb393400640 1 -- 172.21.15.33:0/4205341178 wait complete. 2024-09-13T18:58:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.628+0000 7fb393400640 1 Processor -- start 2024-09-13T18:58:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.628+0000 7fb393400640 1 -- start start 2024-09-13T18:58:38.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 0x7fb38c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1444b0 con 0x7fb38c0b1b00 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c144eb0 con 0x7fb38c0cde50 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb393400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1476f0 con 0x7fb38c15a520 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46298/0 (socket says 172.21.15.33:46298) 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 -- 172.21.15.33:0/827834630 learned_addr learned my addr 172.21.15.33:0/827834630 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb391400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb38be00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 0x7fb38c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 -- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 msgr2=0x7fb38c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 -- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 msgr2=0x7fb38c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 0x7fb38c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb390a00640 1 -- 172.21.15.33:0/827834630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378009400 con 0x7fb38c0b1b00 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.629+0000 7fb38be00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 0x7fb38c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb390a00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb38000d7d0 tx=0x7fb38000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380004030 con 0x7fb38c0b1b00 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380004190 con 0x7fb38c0b1b00 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380004520 con 0x7fb38c0b1b00 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c147410 con 0x7fb38c0b1b00 2024-09-13T18:58:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.630+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c144b40 con 0x7fb38c0b1b00 2024-09-13T18:58:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.631+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c0ad3d0 con 0x7fb38c0b1b00 2024-09-13T18:58:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.632+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3800096a0 con 0x7fb38c0b1b00 2024-09-13T18:58:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.633+0000 7fb388c00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 0x7fb36c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.633+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb380089260 con 0x7fb38c0b1b00 2024-09-13T18:58:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.633+0000 7fb38be00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 0x7fb36c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.634+0000 7fb38be00640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 0x7fb36c06d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb378034000 tx=0x7fb37802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:38.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.637+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb380054730 con 0x7fb38c0b1b00 2024-09-13T18:58:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.834+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb38c0cd910 con 0x7fb38c0b1b00 2024-09-13T18:58:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.839+0000 7fb388c00640 1 -- 172.21.15.33:0/827834630 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb380057d50 con 0x7fb38c0b1b00 2024-09-13T18:58:38.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 msgr2=0x7fb36c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 0x7fb36c06d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb378034000 tx=0x7fb37802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:38.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 msgr2=0x7fb38c143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb38000d7d0 tx=0x7fb38000dc90 comp rx=0 tx=0).stop 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 shutdown_connections 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb36c06ac00 0x7fb36c06d0c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb38c15a520 0x7fb38c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb38c0cde50 0x7fb38c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 --2- 172.21.15.33:0/827834630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb38c0b1b00 0x7fb38c143f70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 >> 172.21.15.33:0/827834630 conn(0x7fb38c0b0510 msgr2=0x7fb38c1596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 shutdown_connections 2024-09-13T18:58:38.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:38.841+0000 7fb393400640 1 -- 172.21.15.33:0/827834630 wait complete. 2024-09-13T18:58:38.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-13T18:58:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.012+0000 7f99ebe00640 1 Processor -- start 2024-09-13T18:58:39.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.013+0000 7f99ebe00640 1 -- start start 2024-09-13T18:58:39.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99ebe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99e40b1b00 0x7f99e40cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99ebe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e406bc00 con 0x7f99e40cde50 2024-09-13T18:58:39.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99ebe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406bea0 con 0x7f99e40b1b00 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99ebe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e406c180 con 0x7f99e415a520 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99e9400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99e8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99e40b1b00 0x7f99e40cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99e9400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:50290/0 (socket says 172.21.15.33:50290) 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.014+0000 7f99e9400640 1 -- 172.21.15.33:0/2705621896 learned_addr learned my addr 172.21.15.33:0/2705621896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.015+0000 7f99e9400640 1 -- 172.21.15.33:0/2705621896 >> v2:172.21.15.103:3300/0 conn(0x7f99e40b1b00 msgr2=0x7f99e40cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.015+0000 7f99e9400640 1 --2- 172.21.15.33:0/2705621896 >> v2:172.21.15.103:3300/0 conn(0x7f99e40b1b00 0x7f99e40cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.015+0000 7f99e9400640 1 -- 172.21.15.33:0/2705621896 >> v1:172.21.15.103:6789/0 conn(0x7f99e40cde50 legacy=0x7f99e40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.015+0000 7f99e9400640 1 -- 172.21.15.33:0/2705621896 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e406c460 con 0x7f99e415a520 2024-09-13T18:58:39.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.016+0000 7f99e9400640 1 --2- 172.21.15.33:0/2705621896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098a0 tx=0x7f99d802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d95cfbb76da11c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.016+0000 7f99e3e00640 1 -- 172.21.15.33:0/2705621896 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8032440 con 0x7f99e415a520 2024-09-13T18:58:39.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.016+0000 7f99e3e00640 1 -- 172.21.15.33:0/2705621896 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80325a0 con 0x7f99e415a520 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.016+0000 7f99e3e00640 1 -- 172.21.15.33:0/2705621896 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8032930 con 0x7f99e415a520 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 -- 172.21.15.33:0/2705621896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 msgr2=0x7f99e406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 --2- 172.21.15.33:0/2705621896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098a0 tx=0x7f99d802a2a0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 -- 172.21.15.33:0/2705621896 shutdown_connections 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 --2- 172.21.15.33:0/2705621896 >> v2:172.21.15.103:3300/0 conn(0x7f99e40b1b00 0x7f99e40cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 --2- 172.21.15.33:0/2705621896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e415a520 0x7f99e406b6c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 -- 172.21.15.33:0/2705621896 >> 172.21.15.33:0/2705621896 conn(0x7f99e40b0510 msgr2=0x7f99e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:39.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 -- 172.21.15.33:0/2705621896 shutdown_connections 2024-09-13T18:58:39.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.017+0000 7f99ebe00640 1 -- 172.21.15.33:0/2705621896 wait complete. 2024-09-13T18:58:39.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.019+0000 7f99ebe00640 1 Processor -- start 2024-09-13T18:58:39.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.019+0000 7f99ebe00640 1 -- start start 2024-09-13T18:58:39.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 0x7f99e4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e40cde50 0x7f99e41e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 0x7f99e41e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41e2b20 con 0x7f99e415a520 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41539a0 con 0x7f99e40cde50 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99ebe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4153c80 con 0x7f99e40b1b00 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 0x7f99e41e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 0x7f99e4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e40cde50 0x7f99e41e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 0x7f99e41e25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46314/0 (socket says 172.21.15.33:46314) 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9e00640 1 -- 172.21.15.33:0/281184747 learned_addr learned my addr 172.21.15.33:0/281184747 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 -- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e40cde50 msgr2=0x7f99e41e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e40cde50 0x7f99e41e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 -- 172.21.15.33:0/281184747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 msgr2=0x7f99e41e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 0x7f99e41e25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.020+0000 7f99e9400640 1 -- 172.21.15.33:0/281184747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80094d0 con 0x7f99e40b1b00 2024-09-13T18:58:39.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99e9400640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 0x7f99e4070b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99d8031000 tx=0x7f99d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8032440 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8030ba0 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d803d440 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4153f60 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.021+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e4154520 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.022+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40cd910 con 0x7f99e40b1b00 2024-09-13T18:58:39.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.023+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99d8039040 con 0x7f99e40b1b00 2024-09-13T18:58:39.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.024+0000 7f99e1600640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 0x7f99c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.024+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f99d80a9bb0 con 0x7f99e40b1b00 2024-09-13T18:58:39.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.025+0000 7f99e8a00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 0x7f99c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.025+0000 7f99e8a00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 0x7f99c406d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cc010 tx=0x7f99d000f040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.029+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f99d8075120 con 0x7f99e40b1b00 2024-09-13T18:58:39.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.271+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f99e40703f0 con 0x7f99e40b1b00 2024-09-13T18:58:39.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.449+0000 7f99e1600640 1 -- 172.21.15.33:0/281184747 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v101) v1 ==== 160+0+0 (secure 0 0 0) 0x7f99d8078740 con 0x7f99e40b1b00 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 msgr2=0x7f99c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 0x7f99c406d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99e40cc010 tx=0x7f99d000f040 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 msgr2=0x7f99e4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 0x7f99e4070b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99d8031000 tx=0x7f99d80046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 shutdown_connections 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f99c406ac00 0x7f99c406d0c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99e415a520 0x7f99e41e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99e40cde50 0x7f99e41e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 --2- 172.21.15.33:0/281184747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99e40b1b00 0x7f99e4070b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.451+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 >> 172.21.15.33:0/281184747 conn(0x7f99e40b0510 msgr2=0x7f99e4158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:39.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.452+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 shutdown_connections 2024-09-13T18:58:39.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.452+0000 7f99ebe00640 1 -- 172.21.15.33:0/281184747 wait complete. 2024-09-13T18:58:39.469 INFO:tasks.cephfs_test_runner:test: ... ok 2024-09-13T18:58:39.469 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) test invalid values for ceph.quota.max_bytes 2024-09-13T18:58:39.470 INFO:tasks.cephfs_test_runner:test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T18:58:39.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.623+0000 7eff76a00640 1 Processor -- start 2024-09-13T18:58:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.623+0000 7eff76a00640 1 -- start start 2024-09-13T18:58:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.624+0000 7eff76a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff700b1b00 0x7eff700cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff76a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff700cde50 0x7eff7015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff76a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7006bea0 con 0x7eff7015a520 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff76a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7006c180 con 0x7eff700cde50 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff76a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7006c460 con 0x7eff700b1b00 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff6fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7eff7015a520 0x7eff7006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38564/0 (socket says 172.21.15.33:38564) 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff6fe00640 1 -- 172.21.15.33:0/1332872878 learned_addr learned my addr 172.21.15.33:0/1332872878 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff74a00640 1 --2- 172.21.15.33:0/1332872878 >> v2:172.21.15.33:3300/0 conn(0x7eff700cde50 0x7eff7015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff67e00640 1 --2- 172.21.15.33:0/1332872878 >> v2:172.21.15.103:3300/0 conn(0x7eff700b1b00 0x7eff700cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff6f400640 1 -- 172.21.15.33:0/1332872878 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520176327 0 0) 0x7eff7006bea0 con 0x7eff7015a520 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff6f400640 1 -- 172.21.15.33:0/1332872878 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff54003520 con 0x7eff7015a520 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff74a00640 1 -- 172.21.15.33:0/1332872878 >> v2:172.21.15.103:3300/0 conn(0x7eff700b1b00 msgr2=0x7eff700cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff74a00640 1 --2- 172.21.15.33:0/1332872878 >> v2:172.21.15.103:3300/0 conn(0x7eff700b1b00 0x7eff700cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff74a00640 1 -- 172.21.15.33:0/1332872878 >> v1:172.21.15.33:6789/0 conn(0x7eff7015a520 legacy=0x7eff7006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.625+0000 7eff74a00640 1 -- 172.21.15.33:0/1332872878 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7006c740 con 0x7eff700cde50 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.626+0000 7eff74a00640 1 --2- 172.21.15.33:0/1332872878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700cde50 0x7eff7015a900 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff7006bdd0 tx=0x7eff6802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cd323d0e08844e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff6f400640 1 -- 172.21.15.33:0/1332872878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6802aea0 con 0x7eff700cde50 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff6f400640 1 -- 172.21.15.33:0/1332872878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6802d050 con 0x7eff700cde50 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff6f400640 1 -- 172.21.15.33:0/1332872878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68007960 con 0x7eff700cde50 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 -- 172.21.15.33:0/1332872878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700cde50 msgr2=0x7eff7015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 --2- 172.21.15.33:0/1332872878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700cde50 0x7eff7015a900 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7eff7006bdd0 tx=0x7eff6802a680 comp rx=0 tx=0).stop 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 -- 172.21.15.33:0/1332872878 shutdown_connections 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 --2- 172.21.15.33:0/1332872878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700cde50 0x7eff7015a900 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 --2- 172.21.15.33:0/1332872878 >> v2:172.21.15.103:3300/0 conn(0x7eff700b1b00 0x7eff700cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 -- 172.21.15.33:0/1332872878 >> 172.21.15.33:0/1332872878 conn(0x7eff700b0510 msgr2=0x7eff700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 -- 172.21.15.33:0/1332872878 shutdown_connections 2024-09-13T18:58:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.627+0000 7eff76a00640 1 -- 172.21.15.33:0/1332872878 wait complete. 2024-09-13T18:58:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.629+0000 7eff76a00640 1 Processor -- start 2024-09-13T18:58:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.629+0000 7eff76a00640 1 -- start start 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff700cde50 0x7eff70150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff7015a520 0x7eff70156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701f0ee0 con 0x7eff700b1b00 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70156cb0 con 0x7eff700cde50 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff76a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff701f02d0 con 0x7eff7015a520 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff6fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46328/0 (socket says 172.21.15.33:46328) 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.630+0000 7eff6fe00640 1 -- 172.21.15.33:0/342298694 learned_addr learned my addr 172.21.15.33:0/342298694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:39.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff67e00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff700cde50 0x7eff70150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff74a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff7015a520 0x7eff70156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 -- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff7015a520 msgr2=0x7eff70156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff7015a520 0x7eff70156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 -- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff700cde50 msgr2=0x7eff70150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff700cde50 0x7eff70150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 -- 172.21.15.33:0/342298694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68009a70 con 0x7eff700b1b00 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6fe00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7eff6000c410 tx=0x7eff6000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60005ce0 con 0x7eff700b1b00 2024-09-13T18:58:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60005e40 con 0x7eff700b1b00 2024-09-13T18:58:39.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff701f05b0 con 0x7eff700b1b00 2024-09-13T18:58:39.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600072f0 con 0x7eff700b1b00 2024-09-13T18:58:39.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.631+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff701f0b70 con 0x7eff700b1b00 2024-09-13T18:58:39.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.633+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff70067f20 con 0x7eff700b1b00 2024-09-13T18:58:39.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.633+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff60007510 con 0x7eff700b1b00 2024-09-13T18:58:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.634+0000 7eff6cc00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.634+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7eff60088760 con 0x7eff700b1b00 2024-09-13T18:58:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.635+0000 7eff67e00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.635+0000 7eff67e00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 0x7eff4c06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff7014dde0 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.638+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7eff60053c60 con 0x7eff700b1b00 2024-09-13T18:58:39.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.817+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff700cd910 con 0x7eff700b1b00 2024-09-13T18:58:39.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.818+0000 7eff6cc00640 1 -- 172.21.15.33:0/342298694 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12986 (secure 0 0 0) 0x7eff60057280 con 0x7eff700b1b00 2024-09-13T18:58:39.821 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:39.821 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:38.439992+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6835/2809270165":"2024-09-14T18:58:35.425629+0000","172.21.15.33:6833/2809270165":"2024-09-14T18:58:35.425629+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:39.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 msgr2=0x7eff4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 0x7eff4c06d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff7014dde0 tx=0x7eff58008040 comp rx=0 tx=0).stop 2024-09-13T18:58:39.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 msgr2=0x7eff7014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7eff6000c410 tx=0x7eff6000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 shutdown_connections 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff7015a520 0x7eff70156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff700cde50 0x7eff70150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 --2- 172.21.15.33:0/342298694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff700b1b00 0x7eff7014d8a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 >> 172.21.15.33:0/342298694 conn(0x7eff700b0510 msgr2=0x7eff700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 shutdown_connections 2024-09-13T18:58:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.821+0000 7eff76a00640 1 -- 172.21.15.33:0/342298694 wait complete. 2024-09-13T18:58:39.839 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:39.839 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:39.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.994+0000 7ff4dd400640 1 Processor -- start 2024-09-13T18:58:39.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.994+0000 7ff4dd400640 1 -- start start 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.995+0000 7ff4dd400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4d806f830 0x7ff4d806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4dd400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d80ce490 con 0x7ff4d8070420 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4dd400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d806b7c0 con 0x7ff4d8154ad0 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4dd400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d806b5b0 con 0x7ff4d806f830 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4d7200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff4d8070420 0x7ff4d80cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38574/0 (socket says 172.21.15.33:38574) 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4d7200640 1 -- 172.21.15.33:0/2731460840 learned_addr learned my addr 172.21.15.33:0/2731460840 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:39.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4cde00640 1 --2- 172.21.15.33:0/2731460840 >> v2:172.21.15.103:3300/0 conn(0x7ff4d806f830 0x7ff4d806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:39.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4d5e00640 1 -- 172.21.15.33:0/2731460840 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135290753 0 0) 0x7ff4d80ce490 con 0x7ff4d8070420 2024-09-13T18:58:39.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4d5e00640 1 -- 172.21.15.33:0/2731460840 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4bc003520 con 0x7ff4d8070420 2024-09-13T18:58:39.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.996+0000 7ff4cde00640 1 -- 172.21.15.33:0/2731460840 >> v1:172.21.15.103:6789/0 conn(0x7ff4d8154ad0 legacy=0x7ff4d80cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.997+0000 7ff4cde00640 1 -- 172.21.15.33:0/2731460840 >> v1:172.21.15.33:6789/0 conn(0x7ff4d8070420 legacy=0x7ff4d80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:39.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.997+0000 7ff4cde00640 1 -- 172.21.15.33:0/2731460840 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d806baa0 con 0x7ff4d806f830 2024-09-13T18:58:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4cde00640 1 --2- 172.21.15.33:0/2731460840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d806f830 0x7ff4d806fee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00097a0 tx=0x7ff4c002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379a047b62d13a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4d5e00640 1 -- 172.21.15.33:0/2731460840 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032440 con 0x7ff4d806f830 2024-09-13T18:58:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4d5e00640 1 -- 172.21.15.33:0/2731460840 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00325a0 con 0x7ff4d806f830 2024-09-13T18:58:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4d5e00640 1 -- 172.21.15.33:0/2731460840 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032930 con 0x7ff4d806f830 2024-09-13T18:58:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4dd400640 1 -- 172.21.15.33:0/2731460840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d806f830 msgr2=0x7ff4d806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4dd400640 1 --2- 172.21.15.33:0/2731460840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d806f830 0x7ff4d806fee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00097a0 tx=0x7ff4c002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4dd400640 1 -- 172.21.15.33:0/2731460840 shutdown_connections 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4dd400640 1 --2- 172.21.15.33:0/2731460840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d806f830 0x7ff4d806fee0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.998+0000 7ff4dd400640 1 -- 172.21.15.33:0/2731460840 >> 172.21.15.33:0/2731460840 conn(0x7ff4d80b0580 msgr2=0x7ff4d80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.999+0000 7ff4dd400640 1 -- 172.21.15.33:0/2731460840 shutdown_connections 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:39.999+0000 7ff4dd400640 1 -- 172.21.15.33:0/2731460840 wait complete. 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.000+0000 7ff4dd400640 1 Processor -- start 2024-09-13T18:58:40.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.000+0000 7ff4dd400640 1 -- start start 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 0x7ff4d813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff4d8154ad0 0x7ff4d81f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d814b330 con 0x7ff4d8147470 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8150510 con 0x7ff4d8070420 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4dd400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81507f0 con 0x7ff4d8154ad0 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4d7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4d7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46344/0 (socket says 172.21.15.33:46344) 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4d7200640 1 -- 172.21.15.33:0/3825879660 learned_addr learned my addr 172.21.15.33:0/3825879660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4d6800640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 0x7ff4d813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.001+0000 7ff4cde00640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff4d8154ad0 0x7ff4d81f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 -- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff4d8154ad0 msgr2=0x7ff4d81f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff4d8154ad0 0x7ff4d81f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 -- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 msgr2=0x7ff4d813ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 0x7ff4d813ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 -- 172.21.15.33:0/3825879660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009400 con 0x7ff4d8147470 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d6800640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 0x7ff4d813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4d7200640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cb40 tx=0x7ff4d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000aca0 con 0x7ff4d8147470 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000ae00 con 0x7ff4d8147470 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0012620 con 0x7ff4d8147470 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d8150ad0 con 0x7ff4d8147470 2024-09-13T18:58:40.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.002+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d813f440 con 0x7ff4d8147470 2024-09-13T18:58:40.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.003+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8150ff0 con 0x7ff4d8147470 2024-09-13T18:58:40.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.004+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4d0007070 con 0x7ff4d8147470 2024-09-13T18:58:40.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.005+0000 7ff4cf400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 0x7ff4b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.005+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4d0089200 con 0x7ff4d8147470 2024-09-13T18:58:40.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.005+0000 7ff4d6800640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 0x7ff4b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.006+0000 7ff4d6800640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 0x7ff4b406d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8007fd0 tx=0x7ff4c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.009+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4d8150ff0 con 0x7ff4d8147470 2024-09-13T18:58:40.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.186+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4d8150ff0 con 0x7ff4d8147470 2024-09-13T18:58:40.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.187+0000 7ff4cf400640 1 -- 172.21.15.33:0/3825879660 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4d8150ff0 con 0x7ff4d8147470 2024-09-13T18:58:40.189 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:40.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 msgr2=0x7ff4b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 0x7ff4b406d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8007fd0 tx=0x7ff4c8009040 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 msgr2=0x7ff4d815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000cb40 tx=0x7ff4d000a060 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 shutdown_connections 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff4b406ac00 0x7ff4b406d0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d8147470 0x7ff4d815cb80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff4d8154ad0 0x7ff4d81f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 --2- 172.21.15.33:0/3825879660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d8070420 0x7ff4d813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 >> 172.21.15.33:0/3825879660 conn(0x7ff4d80b0580 msgr2=0x7ff4d80b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 shutdown_connections 2024-09-13T18:58:40.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.189+0000 7ff4dd400640 1 -- 172.21.15.33:0/3825879660 wait complete. 2024-09-13T18:58:40.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-13T18:58:40.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.361+0000 7f993a200640 1 Processor -- start 2024-09-13T18:58:40.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.361+0000 7f993a200640 1 -- start start 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f993a200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9934071560 0x7f99340ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f993a200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f993406f4b0 0x7f99340b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f993a200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340cd850 con 0x7f9934159480 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f993a200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340cd570 con 0x7f9934071560 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f993a200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340b1740 con 0x7f993406f4b0 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f9938e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9934159480 0x7f9934070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38580/0 (socket says 172.21.15.33:38580) 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.362+0000 7f9938e00640 1 -- 172.21.15.33:0/4285378466 learned_addr learned my addr 172.21.15.33:0/4285378466 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9939800640 1 --2- 172.21.15.33:0/4285378466 >> v2:172.21.15.103:3300/0 conn(0x7f993406f4b0 0x7f99340b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933e00640 1 --2- 172.21.15.33:0/4285378466 >> v2:172.21.15.33:3300/0 conn(0x7f9934071560 0x7f99340ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933400640 1 -- 172.21.15.33:0/4285378466 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483363027 0 0) 0x7f99340cd850 con 0x7f9934159480 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933400640 1 -- 172.21.15.33:0/4285378466 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991c003520 con 0x7f9934159480 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933e00640 1 -- 172.21.15.33:0/4285378466 >> v2:172.21.15.103:3300/0 conn(0x7f993406f4b0 msgr2=0x7f99340b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933e00640 1 --2- 172.21.15.33:0/4285378466 >> v2:172.21.15.103:3300/0 conn(0x7f993406f4b0 0x7f99340b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933e00640 1 -- 172.21.15.33:0/4285378466 >> v1:172.21.15.33:6789/0 conn(0x7f9934159480 legacy=0x7f9934070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.363+0000 7f9933e00640 1 -- 172.21.15.33:0/4285378466 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340b1a20 con 0x7f9934071560 2024-09-13T18:58:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.364+0000 7f9933e00640 1 --2- 172.21.15.33:0/4285378466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934071560 0x7f99340ccf90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99340cbfe0 tx=0x7f992002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae2afcfe57ef16a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.364+0000 7f9933400640 1 -- 172.21.15.33:0/4285378466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992002ae60 con 0x7f9934071560 2024-09-13T18:58:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.364+0000 7f9933400640 1 -- 172.21.15.33:0/4285378466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9920032440 con 0x7f9934071560 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.364+0000 7f9933400640 1 -- 172.21.15.33:0/4285378466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99200327b0 con 0x7f9934071560 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 -- 172.21.15.33:0/4285378466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934071560 msgr2=0x7f99340ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 --2- 172.21.15.33:0/4285378466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934071560 0x7f99340ccf90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99340cbfe0 tx=0x7f992002a110 comp rx=0 tx=0).stop 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 -- 172.21.15.33:0/4285378466 shutdown_connections 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 --2- 172.21.15.33:0/4285378466 >> v2:172.21.15.103:3300/0 conn(0x7f993406f4b0 0x7f99340b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 --2- 172.21.15.33:0/4285378466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934071560 0x7f99340ccf90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 -- 172.21.15.33:0/4285378466 >> 172.21.15.33:0/4285378466 conn(0x7f99340ae310 msgr2=0x7f99340ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 -- 172.21.15.33:0/4285378466 shutdown_connections 2024-09-13T18:58:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.365+0000 7f993a200640 1 -- 172.21.15.33:0/4285378466 wait complete. 2024-09-13T18:58:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.367+0000 7f993a200640 1 Processor -- start 2024-09-13T18:58:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.367+0000 7f993a200640 1 -- start start 2024-09-13T18:58:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f993406f4b0 0x7f993413dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 0x7f9934153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934154190 con 0x7f9934159480 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993413da30 con 0x7f993406f4b0 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f993a200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993413ef90 con 0x7f9934071560 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46368/0 (socket says 172.21.15.33:46368) 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 -- 172.21.15.33:0/2711780671 learned_addr learned my addr 172.21.15.33:0/2711780671 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9938e00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f993406f4b0 0x7f993413dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9933e00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 0x7f9934153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 -- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 msgr2=0x7f9934153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 0x7f9934153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 -- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f993406f4b0 msgr2=0x7f993413dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f993406f4b0 0x7f993413dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9939800640 1 -- 172.21.15.33:0/2711780671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009400 con 0x7f9934159480 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.368+0000 7f9933e00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 0x7f9934153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f9939800640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f992c009dd0 tx=0x7f992c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c014480 con 0x7f9934159480 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00f040 con 0x7f9934159480 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993413e380 con 0x7f9934159480 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c014840 con 0x7f9934159480 2024-09-13T18:58:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.369+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993413e940 con 0x7f9934159480 2024-09-13T18:58:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.370+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934067360 con 0x7f9934159480 2024-09-13T18:58:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.371+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f992c0149a0 con 0x7f9934159480 2024-09-13T18:58:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.372+0000 7f9930c00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 0x7f991406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.372+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f992c089d00 con 0x7f9934159480 2024-09-13T18:58:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.372+0000 7f9938e00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 0x7f991406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.373+0000 7f9938e00640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 0x7f991406d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f9928009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:40.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.376+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f992c055140 con 0x7f9934159480 2024-09-13T18:58:40.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:40.621+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) v1 -- 0x7f99340b2220 con 0x7f9934159480 2024-09-13T18:58:41.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.456+0000 7f9930c00640 1 -- 172.21.15.33:0/2711780671 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v103) v1 ==== 156+0+0 (secure 0 0 0) 0x7f992c0180e0 con 0x7f9934159480 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 msgr2=0x7f991406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 0x7f991406d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f9928009040 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 msgr2=0x7f993413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f992c009dd0 tx=0x7f992c00c490 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 shutdown_connections 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f991406ac00 0x7f991406d0c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934159480 0x7f993413f420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9934071560 0x7f9934153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 --2- 172.21.15.33:0/2711780671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f993406f4b0 0x7f993413dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 >> 172.21.15.33:0/2711780671 conn(0x7f99340ae310 msgr2=0x7f99340b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 shutdown_connections 2024-09-13T18:58:41.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.459+0000 7f993a200640 1 -- 172.21.15.33:0/2711780671 wait complete. 2024-09-13T18:58:41.482 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:58:41.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:58:41.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:58:41.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.646+0000 7f9b04800640 1 Processor -- start 2024-09-13T18:58:41.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.646+0000 7f9b04800640 1 -- start start 2024-09-13T18:58:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b04800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9afc156f60 0x7f9afc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b04800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc06f5f0 con 0x7f9afc0cafa0 2024-09-13T18:58:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b04800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc070450 con 0x7f9afc071690 2024-09-13T18:58:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b04800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc15aa30 con 0x7f9afc156f60 2024-09-13T18:58:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b01400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9afc0cafa0 0x7f9afc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38596/0 (socket says 172.21.15.33:38596) 2024-09-13T18:58:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.647+0000 7f9b01400640 1 -- 172.21.15.33:0/2427819369 learned_addr learned my addr 172.21.15.33:0/2427819369 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b01e00640 1 --2- 172.21.15.33:0/2427819369 >> v2:172.21.15.103:3300/0 conn(0x7f9afc156f60 0x7f9afc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767031222 0 0) 0x7f9afc06f5f0 con 0x7f9afc0cafa0 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae4003520 con 0x7f9afc0cafa0 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b01e00640 1 -- 172.21.15.33:0/2427819369 >> v1:172.21.15.103:6789/0 conn(0x7f9afc071690 legacy=0x7f9afc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466569661 0 0) 0x7f9ae4003520 con 0x7f9afc0cafa0 2024-09-13T18:58:41.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b01e00640 1 -- 172.21.15.33:0/2427819369 >> v1:172.21.15.33:6789/0 conn(0x7f9afc0cafa0 legacy=0x7f9afc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.648+0000 7f9b01e00640 1 -- 172.21.15.33:0/2427819369 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc06f840 con 0x7f9afc156f60 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.649+0000 7f9b01e00640 1 --2- 172.21.15.33:0/2427819369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc156f60 0x7f9afc15a4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9af00097a0 tx=0x7f9af002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c044587c0d0c5d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.649+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec001670 con 0x7f9afc156f60 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.649+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af002ac50 con 0x7f9afc156f60 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.649+0000 7f9b00a00640 1 -- 172.21.15.33:0/2427819369 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0032440 con 0x7f9afc156f60 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 -- 172.21.15.33:0/2427819369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc156f60 msgr2=0x7f9afc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 --2- 172.21.15.33:0/2427819369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc156f60 0x7f9afc15a4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9af00097a0 tx=0x7f9af002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 -- 172.21.15.33:0/2427819369 shutdown_connections 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 --2- 172.21.15.33:0/2427819369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc156f60 0x7f9afc15a4f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 -- 172.21.15.33:0/2427819369 >> 172.21.15.33:0/2427819369 conn(0x7f9afc0b0580 msgr2=0x7f9afc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 -- 172.21.15.33:0/2427819369 shutdown_connections 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.650+0000 7f9b04800640 1 -- 172.21.15.33:0/2427819369 wait complete. 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.652+0000 7f9b04800640 1 Processor -- start 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.652+0000 7f9b04800640 1 -- start start 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:41.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc0cafa0 0x7f9afc1f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9afc156f60 0x7f9afc0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14ec30 con 0x7f9afc071690 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1f5c10 con 0x7f9afc0cafa0 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b04800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1f5eb0 con 0x7f9afc156f60 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b01e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b01e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46370/0 (socket says 172.21.15.33:46370) 2024-09-13T18:58:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b01e00640 1 -- 172.21.15.33:0/500210620 learned_addr learned my addr 172.21.15.33:0/500210620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b01400640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc0cafa0 0x7f9afc1f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.653+0000 7f9b02800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9afc156f60 0x7f9afc0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 -- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9afc156f60 msgr2=0x7f9afc0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9afc156f60 0x7f9afc0b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 -- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc0cafa0 msgr2=0x7f9afc1f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc0cafa0 0x7f9afc1f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 -- 172.21.15.33:0/500210620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009400 con 0x7f9afc071690 2024-09-13T18:58:41.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b01e00640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098c0 tx=0x7f9af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:41.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0006e10 con 0x7f9afc071690 2024-09-13T18:58:41.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af003d630 con 0x7f9afc071690 2024-09-13T18:58:41.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc1f6190 con 0x7f9afc071690 2024-09-13T18:58:41.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.654+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af003d9a0 con 0x7f9afc071690 2024-09-13T18:58:41.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.655+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc14ee40 con 0x7f9afc071690 2024-09-13T18:58:41.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.656+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0ce430 con 0x7f9afc071690 2024-09-13T18:58:41.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.656+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9af003db00 con 0x7f9afc071690 2024-09-13T18:58:41.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.657+0000 7f9af6000640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 0x7f9ae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:41.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.657+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9af00a9b20 con 0x7f9afc071690 2024-09-13T18:58:41.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.658+0000 7f9b01400640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 0x7f9ae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:41.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.658+0000 7f9b01400640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 0x7f9ae006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ce400 tx=0x7f9aec000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:41.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.662+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9af00750a0 con 0x7f9afc071690 2024-09-13T18:58:41.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.839+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9afc0cde70 con 0x7f9afc071690 2024-09-13T18:58:41.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.843+0000 7f9af6000640 1 -- 172.21.15.33:0/500210620 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9af00410c0 con 0x7f9afc071690 2024-09-13T18:58:41.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.845+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 msgr2=0x7f9ae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.845+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 0x7f9ae006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ce400 tx=0x7f9aec000bc0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 msgr2=0x7f9afc0ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:41.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098c0 tx=0x7f9af00046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 shutdown_connections 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9ae006ac00 0x7f9ae006d0c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9afc156f60 0x7f9afc0b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9afc0cafa0 0x7f9afc1f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 --2- 172.21.15.33:0/500210620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9afc071690 0x7f9afc0ca470 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 >> 172.21.15.33:0/500210620 conn(0x7f9afc0b0580 msgr2=0x7f9afc15af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 shutdown_connections 2024-09-13T18:58:41.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:41.846+0000 7f9b04800640 1 -- 172.21.15.33:0/500210620 wait complete. 2024-09-13T18:58:41.863 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:58:41.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:41.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:42.038 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:58:42.038 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:42.038 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:42.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:58:42.074 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:42.074 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:42.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:58:42.111 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:42.111 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:42.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:58:42.149 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:42.150 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:42.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:58:42.187 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:58:42.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:42.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.341+0000 7fa3abe00640 1 Processor -- start 2024-09-13T18:58:42.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.341+0000 7fa3abe00640 1 -- start start 2024-09-13T18:58:42.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.342+0000 7fa3abe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3ac159480 0x7fa3ac0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.342+0000 7fa3abe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.342+0000 7fa3abe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0cd850 con 0x7fa3ac06f4b0 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.342+0000 7fa3abe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0cd570 con 0x7fa3ac159480 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.342+0000 7fa3abe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0b1740 con 0x7fa3ac071560 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3aaa00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3ac159480 0x7fa3ac0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:50346/0 (socket says 172.21.15.33:50346) 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3a3e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa3ac06f4b0 0x7fa3ac070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:46634/0 (socket says 172.21.15.33:46634) 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 -- 172.21.15.33:0/2986045794 learned_addr learned my addr 172.21.15.33:0/2986045794 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:42.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 -- 172.21.15.33:0/2986045794 >> v2:172.21.15.103:3300/0 conn(0x7fa3ac159480 msgr2=0x7fa3ac0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:42.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 --2- 172.21.15.33:0/2986045794 >> v2:172.21.15.103:3300/0 conn(0x7fa3ac159480 0x7fa3ac0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 -- 172.21.15.33:0/2986045794 >> v1:172.21.15.103:6789/0 conn(0x7fa3ac06f4b0 legacy=0x7fa3ac070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3ab400640 1 -- 172.21.15.33:0/2986045794 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0b1a20 con 0x7fa3ac071560 2024-09-13T18:58:42.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.343+0000 7fa3aa000640 1 -- 172.21.15.33:0/2986045794 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498132175 0 0) 0x7fa3ac0cd850 con 0x7fa3ac06f4b0 2024-09-13T18:58:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.344+0000 7fa3ab400640 1 --2- 172.21.15.33:0/2986045794 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009e50 tx=0x7fa3a402a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f90e3a544616a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3aa000640 1 -- 172.21.15.33:0/2986045794 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4031600 con 0x7fa3ac071560 2024-09-13T18:58:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3aa000640 1 -- 172.21.15.33:0/2986045794 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a402d050 con 0x7fa3ac071560 2024-09-13T18:58:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3aa000640 1 -- 172.21.15.33:0/2986045794 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4031980 con 0x7fa3ac071560 2024-09-13T18:58:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 -- 172.21.15.33:0/2986045794 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 msgr2=0x7fa3ac0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 --2- 172.21.15.33:0/2986045794 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009e50 tx=0x7fa3a402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 -- 172.21.15.33:0/2986045794 shutdown_connections 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 --2- 172.21.15.33:0/2986045794 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac071560 0x7fa3ac0b2220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 --2- 172.21.15.33:0/2986045794 >> v2:172.21.15.103:3300/0 conn(0x7fa3ac159480 0x7fa3ac0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 -- 172.21.15.33:0/2986045794 >> 172.21.15.33:0/2986045794 conn(0x7fa3ac0ae310 msgr2=0x7fa3ac0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 -- 172.21.15.33:0/2986045794 shutdown_connections 2024-09-13T18:58:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.345+0000 7fa3abe00640 1 -- 172.21.15.33:0/2986045794 wait complete. 2024-09-13T18:58:42.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.347+0000 7fa3abe00640 1 Processor -- start 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.347+0000 7fa3abe00640 1 -- start start 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 0x7fa3ac15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 0x7fa3ac157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac159480 0x7fa3ac154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac15bdd0 con 0x7fa3ac06f4b0 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac154dc0 con 0x7fa3ac071560 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3abe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac15b430 con 0x7fa3ac159480 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 0x7fa3ac15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 0x7fa3ac157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 0x7fa3ac15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46378/0 (socket says 172.21.15.33:46378) 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3aaa00640 1 -- 172.21.15.33:0/1559581417 learned_addr learned my addr 172.21.15.33:0/1559581417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.348+0000 7fa3ab400640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac159480 0x7fa3ac154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 -- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac159480 msgr2=0x7fa3ac154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac159480 0x7fa3ac154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 -- 172.21.15.33:0/1559581417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 msgr2=0x7fa3ac15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 0x7fa3ac15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 -- 172.21.15.33:0/1559581417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009b30 con 0x7fa3ac071560 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a3e00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 0x7fa3ac157d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac06f960 tx=0x7fa39400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940074e0 con 0x7fa3ac071560 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394007660 con 0x7fa3ac071560 2024-09-13T18:58:42.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394004a20 con 0x7fa3ac071560 2024-09-13T18:58:42.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac15b710 con 0x7fa3ac071560 2024-09-13T18:58:42.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.349+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac158270 con 0x7fa3ac071560 2024-09-13T18:58:42.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.350+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac067360 con 0x7fa3ac071560 2024-09-13T18:58:42.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.352+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa394004b80 con 0x7fa3ac071560 2024-09-13T18:58:42.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.352+0000 7fa3a2a00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 0x7fa38806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.353+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa394089110 con 0x7fa3ac071560 2024-09-13T18:58:42.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.353+0000 7fa3aaa00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 0x7fa38806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.354+0000 7fa3aaa00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 0x7fa38806d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009b60 tx=0x7fa39c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.357+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa394054680 con 0x7fa3ac071560 2024-09-13T18:58:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.572+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3ac15bf10 con 0x7fa3ac071560 2024-09-13T18:58:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.573+0000 7fa3a2a00640 1 -- 172.21.15.33:0/1559581417 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fa3ac15bf10 con 0x7fa3ac071560 2024-09-13T18:58:42.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:42.575 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2636265602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2636265602},{"type":"v1","addr":"172.21.15.103:6837","nonce":2636265602}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2190326082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2190326082},{"type":"v1","addr":"172.21.15.103:6836","nonce":2190326082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2317530648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2317530648},{"type":"v1","addr":"172.21.15.33:6834","nonce":2317530648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2993080780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2993080780},{"type":"v1","addr":"172.21.15.33:6835","nonce":2993080780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2024-09-13T18:58:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-09-13T18:58:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 msgr2=0x7fa38806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 0x7fa38806d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009b60 tx=0x7fa39c009190 comp rx=0 tx=0).stop 2024-09-13T18:58:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 msgr2=0x7fa3ac157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 0x7fa3ac157d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac06f960 tx=0x7fa39400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 shutdown_connections 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa38806ac00 0x7fa38806d0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3ac159480 0x7fa3ac154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3ac071560 0x7fa3ac157d30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 --2- 172.21.15.33:0/1559581417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3ac06f4b0 0x7fa3ac15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 >> 172.21.15.33:0/1559581417 conn(0x7fa3ac0ae310 msgr2=0x7fa3ac06fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 shutdown_connections 2024-09-13T18:58:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.575+0000 7fa3abe00640 1 -- 172.21.15.33:0/1559581417 wait complete. 2024-09-13T18:58:42.593 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:58:42.593 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:58:42.593 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:58:42.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:42.594 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:58:42.594 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:58:42.594 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:58:42.594 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:42.594 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:58:42.594 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:58:42.595 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:58:42.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:42.595 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:58:42.595 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:58:42.595 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:58:42.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:58:42.608 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:58:42.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:58:42.609 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:58:42.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:58:42.610 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:58:42.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:58:42.612 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:58:42.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:58:42.653 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:58:42.654 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:42.655 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:58:42.656 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:42.656 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:58:42.656 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:42.658 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:58:42.658 DEBUG:teuthology.parallel:result is None 2024-09-13T18:58:42.659 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:58:42.784 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T18:58:42.784 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:58:42.785 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T18:58:42.786 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:58:42.787 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-09-13T18:58:42.785+0000 7fd0d5600640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-13T18:58:42.790 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T18:58:42.788+0000 7f13de800640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:58:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.823+0000 7f7e17600640 1 Processor -- start 2024-09-13T18:58:42.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.823+0000 7f7e17600640 1 -- start start 2024-09-13T18:58:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e17600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e10159610 0x7f7e10070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e17600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e100b3790 0x7f7e100cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e17600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100709e0 con 0x7f7e10070540 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e17600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e101599f0 con 0x7f7e10159610 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e17600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10070cc0 con 0x7f7e100b3790 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.824+0000 7f7e14c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e10159610 0x7f7e10070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e10159610 0x7f7e10070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59888/0 (socket says 172.21.15.33:59888) 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 -- 172.21.15.33:0/2780407254 learned_addr learned my addr 172.21.15.33:0/2780407254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e15600640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e100b3790 0x7f7e100cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 -- 172.21.15.33:0/2780407254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e100b3790 msgr2=0x7f7e100cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e100b3790 0x7f7e100cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 -- 172.21.15.33:0/2780407254 >> v1:172.21.15.33:6789/0 conn(0x7f7e10070540 legacy=0x7f7e100b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.825+0000 7f7e14c00640 1 -- 172.21.15.33:0/2780407254 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10070fa0 con 0x7f7e10159610 2024-09-13T18:58:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.826+0000 7f7e14c00640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e10070000 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b8acc095d2a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.826+0000 7f7e0f400640 1 -- 172.21.15.33:0/2780407254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04032440 con 0x7f7e10159610 2024-09-13T18:58:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.826+0000 7f7e0f400640 1 -- 172.21.15.33:0/2780407254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040325a0 con 0x7f7e10159610 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.826+0000 7f7e0f400640 1 -- 172.21.15.33:0/2780407254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04032930 con 0x7f7e10159610 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 -- 172.21.15.33:0/2780407254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 msgr2=0x7f7e10070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e10070000 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402a270 comp rx=0 tx=0).stop 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 -- 172.21.15.33:0/2780407254 shutdown_connections 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e100b3790 0x7f7e100cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 --2- 172.21.15.33:0/2780407254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e10070000 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 -- 172.21.15.33:0/2780407254 >> 172.21.15.33:0/2780407254 conn(0x7f7e100b0510 msgr2=0x7f7e100b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 -- 172.21.15.33:0/2780407254 shutdown_connections 2024-09-13T18:58:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.827+0000 7f7e17600640 1 -- 172.21.15.33:0/2780407254 wait complete. 2024-09-13T18:58:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.829+0000 7f7e17600640 1 Processor -- start 2024-09-13T18:58:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.829+0000 7f7e17600640 1 -- start start 2024-09-13T18:58:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.829+0000 7f7e17600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e10070540 0x7f7e101f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e17600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e100b3790 0x7f7e1014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e17600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e17600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1013e980 con 0x7f7e10159610 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e17600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1014d250 con 0x7f7e100b3790 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e17600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1014d530 con 0x7f7e10070540 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59894/0 (socket says 172.21.15.33:59894) 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 -- 172.21.15.33:0/3131988209 learned_addr learned my addr 172.21.15.33:0/3131988209 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e14c00640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e10070540 0x7f7e101f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e0fe00640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e100b3790 0x7f7e1014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 -- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e10070540 msgr2=0x7f7e101f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e10070540 0x7f7e101f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 -- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e100b3790 msgr2=0x7f7e1014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e100b3790 0x7f7e1014c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.830+0000 7f7e15600640 1 -- 172.21.15.33:0/3131988209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040094d0 con 0x7f7e10159610 2024-09-13T18:58:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e15600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800efc0 tx=0x7f7e0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08009ca0 con 0x7f7e10159610 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800f040 con 0x7f7e10159610 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080146c0 con 0x7f7e10159610 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1014d810 con 0x7f7e10159610 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.831+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1014ddd0 con 0x7f7e10159610 2024-09-13T18:58:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.832+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1014dff0 con 0x7f7e10159610 2024-09-13T18:58:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.833+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e08014820 con 0x7f7e10159610 2024-09-13T18:58:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.834+0000 7f7e0cc00640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 0x7f7df006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.834+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7e08089f90 con 0x7f7e10159610 2024-09-13T18:58:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.834+0000 7f7e14c00640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 0x7f7df006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.835+0000 7f7e14c00640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 0x7f7df006d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:42.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:42.838+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e08055480 con 0x7f7e10159610 2024-09-13T18:58:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.031+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e100b0a80 con 0x7f7e10159610 2024-09-13T18:58:43.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.817+0000 7f7e0cc00640 1 -- 172.21.15.33:0/3131988209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e08058aa0 con 0x7f7e10159610 2024-09-13T18:58:43.819 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 msgr2=0x7f7df006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 0x7f7df006d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 msgr2=0x7f7e1015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800efc0 tx=0x7f7e0800c490 comp rx=0 tx=0).stop 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 shutdown_connections 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df006ac00 0x7f7df006d0c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e10159610 0x7f7e1015a540 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e100b3790 0x7f7e1014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 --2- 172.21.15.33:0/3131988209 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e10070540 0x7f7e101f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.819+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 >> 172.21.15.33:0/3131988209 conn(0x7f7e100b0510 msgr2=0x7f7e10157860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.820+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 shutdown_connections 2024-09-13T18:58:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.820+0000 7f7e17600640 1 -- 172.21.15.33:0/3131988209 wait complete. 2024-09-13T18:58:43.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:58:43.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.996+0000 7f281b600640 1 Processor -- start 2024-09-13T18:58:43.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.996+0000 7f281b600640 1 -- start start 2024-09-13T18:58:43.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f281b600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 0x7f2814159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:43.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f281b600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281415a430 con 0x7f28140b2220 2024-09-13T18:58:43.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f281b600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28141598b0 con 0x7f28140b32d0 2024-09-13T18:58:44.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f281b600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814159b90 con 0x7f28140b1e40 2024-09-13T18:58:44.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f2813e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f28140b2220 0x7f28140b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52584/0 (socket says 172.21.15.33:52584) 2024-09-13T18:58:44.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f2813e00640 1 -- 172.21.15.33:0/2546311700 learned_addr learned my addr 172.21.15.33:0/2546311700 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:44.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.997+0000 7f2818c00640 1 --2- 172.21.15.33:0/2546311700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 0x7f2814159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039200773 0 0) 0x7f281415a430 con 0x7f28140b2220 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27fc003520 con 0x7f28140b2220 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26478119 0 0) 0x7f28141598b0 con 0x7f28140b32d0 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f281415a430 con 0x7f28140b32d0 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2818c00640 1 -- 172.21.15.33:0/2546311700 >> v1:172.21.15.103:6789/0 conn(0x7f28140b32d0 legacy=0x7f2814070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2818c00640 1 -- 172.21.15.33:0/2546311700 >> v1:172.21.15.33:6789/0 conn(0x7f28140b2220 legacy=0x7f28140b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.998+0000 7f2818c00640 1 -- 172.21.15.33:0/2546311700 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814159e70 con 0x7f28140b1e40 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.999+0000 7f2818c00640 1 --2- 172.21.15.33:0/2546311700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 0x7f2814159210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f280800a970 tx=0x7f280802b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248503d79f6b0b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.999+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808030710 con 0x7f28140b1e40 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.999+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280802e050 con 0x7f28140b1e40 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:43.999+0000 7f2813400640 1 -- 172.21.15.33:0/2546311700 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808030a90 con 0x7f28140b1e40 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 -- 172.21.15.33:0/2546311700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 msgr2=0x7f2814159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 --2- 172.21.15.33:0/2546311700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 0x7f2814159210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f280800a970 tx=0x7f280802b550 comp rx=0 tx=0).stop 2024-09-13T18:58:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 -- 172.21.15.33:0/2546311700 shutdown_connections 2024-09-13T18:58:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 --2- 172.21.15.33:0/2546311700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b1e40 0x7f2814159210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 -- 172.21.15.33:0/2546311700 >> 172.21.15.33:0/2546311700 conn(0x7f28140b0510 msgr2=0x7f28140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 -- 172.21.15.33:0/2546311700 shutdown_connections 2024-09-13T18:58:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.000+0000 7f281b600640 1 -- 172.21.15.33:0/2546311700 wait complete. 2024-09-13T18:58:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.002+0000 7f281b600640 1 Processor -- start 2024-09-13T18:58:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.002+0000 7f281b600640 1 -- start start 2024-09-13T18:58:44.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28140b1e40 0x7f28140a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b2220 0x7f28141ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281415c2a0 con 0x7f28140b32d0 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281415c580 con 0x7f28140b1e40 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f281b600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281415c860 con 0x7f28140b2220 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59904/0 (socket says 172.21.15.33:59904) 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 -- 172.21.15.33:0/950562623 learned_addr learned my addr 172.21.15.33:0/950562623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2818c00640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28140b1e40 0x7f28140a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2813e00640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b2220 0x7f28141ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 -- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b2220 msgr2=0x7f28141ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b2220 0x7f28141ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 -- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28140b1e40 msgr2=0x7f28140a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28140b1e40 0x7f28140a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.003+0000 7f2819600640 1 -- 172.21.15.33:0/950562623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280800a5a0 con 0x7f28140b32d0 2024-09-13T18:58:44.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f2819600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c6e0 tx=0x7f280c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c003b70 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c003cd0 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28140b2960 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0052d0 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.004+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281415ce20 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.005+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814067fb0 con 0x7f28140b32d0 2024-09-13T18:58:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.006+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f280c005430 con 0x7f28140b32d0 2024-09-13T18:58:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.007+0000 7f2810c00640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 0x7f27f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.007+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f280c088cf0 con 0x7f28140b32d0 2024-09-13T18:58:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.008+0000 7f2818c00640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 0x7f27f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.008+0000 7f2818c00640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 0x7f27f406d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2808035000 tx=0x7f2808030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.012+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f280c0542c0 con 0x7f28140b32d0 2024-09-13T18:58:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.262+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2814159210 con 0x7f28140b32d0 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.263+0000 7f2810c00640 1 -- 172.21.15.33:0/950562623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f280c0578e0 con 0x7f28140b32d0 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.265 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.266 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T18:58:44.267 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.268 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T18:58:44.269 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.272 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2024-09-13T18:58:44.273 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.274 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:58:44.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:58:44.277 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T18:58:44.278 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:58:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 msgr2=0x7f27f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 0x7f27f406d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2808035000 tx=0x7f2808030000 comp rx=0 tx=0).stop 2024-09-13T18:58:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 msgr2=0x7f28141f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c6e0 tx=0x7f280c00cba0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 shutdown_connections 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f27f406ac00 0x7f27f406d0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28140b32d0 0x7f28141f37e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f28140b2220 0x7f28141ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 --2- 172.21.15.33:0/950562623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28140b1e40 0x7f28140a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 >> 172.21.15.33:0/950562623 conn(0x7f28140b0510 msgr2=0x7f28140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 shutdown_connections 2024-09-13T18:58:44.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.265+0000 7f281b600640 1 -- 172.21.15.33:0/950562623 wait complete. 2024-09-13T18:58:44.283 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.435+0000 7f8234c00640 1 Processor -- start 2024-09-13T18:58:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.435+0000 7f8234c00640 1 -- start start 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8234c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f82300b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8234c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8230159a80 0x7f82300b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8234c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8230153f00 con 0x7f82300b2410 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8234c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82300ce600 con 0x7f8230159a80 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8234c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8230070f90 con 0x7f8230153b20 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8227e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8230159a80 0x7f82300b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8227e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8230159a80 0x7f82300b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59912/0 (socket says 172.21.15.33:59912) 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f8227e00640 1 -- 172.21.15.33:0/2222057408 learned_addr learned my addr 172.21.15.33:0/2222057408 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.437+0000 7f822de00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f82300b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.438+0000 7f8227e00640 1 -- 172.21.15.33:0/2222057408 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 msgr2=0x7f82300b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.438+0000 7f8227e00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f82300b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.438+0000 7f8227e00640 1 -- 172.21.15.33:0/2222057408 >> v1:172.21.15.33:6789/0 conn(0x7f82300b2410 legacy=0x7f823006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.438+0000 7f8227e00640 1 -- 172.21.15.33:0/2222057408 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82300b1a40 con 0x7f8230159a80 2024-09-13T18:58:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8227e00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f82300b1ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82180098a0 tx=0x7f821802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d02c2594c4add6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f822d400640 1 -- 172.21.15.33:0/2222057408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218032440 con 0x7f8230159a80 2024-09-13T18:58:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f822d400640 1 -- 172.21.15.33:0/2222057408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180325a0 con 0x7f8230159a80 2024-09-13T18:58:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f822d400640 1 -- 172.21.15.33:0/2222057408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218032930 con 0x7f8230159a80 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 -- 172.21.15.33:0/2222057408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 msgr2=0x7f82300b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f82300b1ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82180098a0 tx=0x7f821802a290 comp rx=0 tx=0).stop 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 -- 172.21.15.33:0/2222057408 shutdown_connections 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f82300b1ed0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 --2- 172.21.15.33:0/2222057408 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f82300b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.439+0000 7f8234c00640 1 -- 172.21.15.33:0/2222057408 >> 172.21.15.33:0/2222057408 conn(0x7f82300b0510 msgr2=0x7f82300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.440+0000 7f8234c00640 1 -- 172.21.15.33:0/2222057408 shutdown_connections 2024-09-13T18:58:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.440+0000 7f8234c00640 1 -- 172.21.15.33:0/2222057408 wait complete. 2024-09-13T18:58:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.441+0000 7f8234c00640 1 Processor -- start 2024-09-13T18:58:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.441+0000 7f8234c00640 1 -- start start 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82300b2410 0x7f8230146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f8230167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82301543e0 con 0x7f8230159a80 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8230146790 con 0x7f82300b2410 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.442+0000 7f8234c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8230166370 con 0x7f8230153b20 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59918/0 (socket says 172.21.15.33:59918) 2024-09-13T18:58:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 -- 172.21.15.33:0/946792132 learned_addr learned my addr 172.21.15.33:0/946792132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f8227e00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f8230167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822de00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82300b2410 0x7f8230146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 -- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 msgr2=0x7f8230167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f8230167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 -- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82300b2410 msgr2=0x7f8230146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82300b2410 0x7f8230146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 -- 172.21.15.33:0/946792132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180094d0 con 0x7f8230159a80 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f822e800640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f822800c6b0 tx=0x7f822800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.443+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228003b70 con 0x7f8230159a80 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.444+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228003cf0 con 0x7f8230159a80 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.444+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228003ea0 con 0x7f8230159a80 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.444+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8230166650 con 0x7f8230159a80 2024-09-13T18:58:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.444+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8230166c10 con 0x7f8230159a80 2024-09-13T18:58:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.445+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82300b3990 con 0x7f8230159a80 2024-09-13T18:58:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.446+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8228005310 con 0x7f8230159a80 2024-09-13T18:58:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.447+0000 7f8226000640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 0x7f820c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.447+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8228088cb0 con 0x7f8230159a80 2024-09-13T18:58:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.447+0000 7f822de00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 0x7f820c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.448+0000 7f822de00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 0x7f820c06d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8220009aa0 tx=0x7f8220009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.451+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8228054280 con 0x7f8230159a80 2024-09-13T18:58:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.632+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82300b21f0 con 0x7f8230159a80 2024-09-13T18:58:44.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.633+0000 7f8226000640 1 -- 172.21.15.33:0/946792132 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f82280578a0 con 0x7f8230159a80 2024-09-13T18:58:44.635 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:44.635 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:43.811344+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 msgr2=0x7f820c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 0x7f820c06d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8220009aa0 tx=0x7f8220009190 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 msgr2=0x7f8230167130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f822800c6b0 tx=0x7f822800cb70 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 shutdown_connections 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f820c06ac00 0x7f820c06d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8230159a80 0x7f8230167130 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8230153b20 0x7f8230167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 --2- 172.21.15.33:0/946792132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82300b2410 0x7f8230146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 >> 172.21.15.33:0/946792132 conn(0x7f82300b0510 msgr2=0x7f82300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 shutdown_connections 2024-09-13T18:58:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.635+0000 7f8234c00640 1 -- 172.21.15.33:0/946792132 wait complete. 2024-09-13T18:58:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:44.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.810+0000 7f7a32e00640 1 Processor -- start 2024-09-13T18:58:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.811+0000 7f7a32e00640 1 -- start start 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a32e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a32e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a2c0b0d20 0x7f7a2c06c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a32e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0b23e0 con 0x7f7a2c0cb640 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a32e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c06d260 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a32e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c06cca0 con 0x7f7a2c0b0d20 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a31a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a31a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59928/0 (socket says 172.21.15.33:59928) 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a31a00640 1 -- 172.21.15.33:0/1852309471 learned_addr learned my addr 172.21.15.33:0/1852309471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.812+0000 7f7a31000640 1 --2- 172.21.15.33:0/1852309471 >> v2:172.21.15.103:3300/0 conn(0x7f7a2c0b0d20 0x7f7a2c06c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.813+0000 7f7a31a00640 1 -- 172.21.15.33:0/1852309471 >> v2:172.21.15.103:3300/0 conn(0x7f7a2c0b0d20 msgr2=0x7f7a2c06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.813+0000 7f7a31a00640 1 --2- 172.21.15.33:0/1852309471 >> v2:172.21.15.103:3300/0 conn(0x7f7a2c0b0d20 0x7f7a2c06c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.813+0000 7f7a31a00640 1 -- 172.21.15.33:0/1852309471 >> v1:172.21.15.33:6789/0 conn(0x7f7a2c0cb640 legacy=0x7f7a2c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.813+0000 7f7a31a00640 1 -- 172.21.15.33:0/1852309471 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c06cf80 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a31a00640 1 --2- 172.21.15.33:0/1852309471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c15df80 tx=0x7f7a2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f131f5524b71af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a2be00640 1 -- 172.21.15.33:0/1852309471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20032440 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a2be00640 1 -- 172.21.15.33:0/1852309471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a200325a0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a2be00640 1 -- 172.21.15.33:0/1852309471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20032930 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a32e00640 1 -- 172.21.15.33:0/1852309471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 msgr2=0x7f7a2c0b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.814+0000 7f7a32e00640 1 --2- 172.21.15.33:0/1852309471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c15df80 tx=0x7f7a2002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 -- 172.21.15.33:0/1852309471 shutdown_connections 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 --2- 172.21.15.33:0/1852309471 >> v2:172.21.15.103:3300/0 conn(0x7f7a2c0b0d20 0x7f7a2c06c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 --2- 172.21.15.33:0/1852309471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c0b1ea0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 -- 172.21.15.33:0/1852309471 >> 172.21.15.33:0/1852309471 conn(0x7f7a2c0b0200 msgr2=0x7f7a2c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 -- 172.21.15.33:0/1852309471 shutdown_connections 2024-09-13T18:58:44.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.815+0000 7f7a32e00640 1 -- 172.21.15.33:0/1852309471 wait complete. 2024-09-13T18:58:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.816+0000 7f7a32e00640 1 Processor -- start 2024-09-13T18:58:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.816+0000 7f7a32e00640 1 -- start start 2024-09-13T18:58:44.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2c0b0d20 0x7f7a2c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2c0cb640 0x7f7a2c1f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c152ba0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1f27e0 con 0x7f7a2c0cb640 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.817+0000 7f7a32e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1f2ac0 con 0x7f7a2c0b0d20 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59938/0 (socket says 172.21.15.33:59938) 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 -- 172.21.15.33:0/2327471426 learned_addr learned my addr 172.21.15.33:0/2327471426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a31000640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2c0cb640 0x7f7a2c1f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a31a00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2c0b0d20 0x7f7a2c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 -- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2c0b0d20 msgr2=0x7f7a2c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2c0b0d20 0x7f7a2c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 -- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2c0cb640 msgr2=0x7f7a2c1f1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2c0cb640 0x7f7a2c1f1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 -- 172.21.15.33:0/2327471426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200094d0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.818+0000 7f7a32400640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7a0 tx=0x7f7a2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.819+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003b70 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.819+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24003cf0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.819+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003ea0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.819+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c1f2da0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.819+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c1524b0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.820+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c152ce0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.821+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a2400aa90 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.821+0000 7f7a29600640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 0x7f7a0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:44.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.822+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a24088dd0 con 0x7f7a2c15a6d0 2024-09-13T18:58:44.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.822+0000 7f7a31a00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 0x7f7a0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:44.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.823+0000 7f7a31a00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 0x7f7a0c06d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a20034000 tx=0x7f7a2002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:44.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:44.826+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7a2c152ce0 con 0x7f7a2c15a6d0 2024-09-13T18:58:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.003+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a2c152ce0 con 0x7f7a2c15a6d0 2024-09-13T18:58:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.004+0000 7f7a29600640 1 -- 172.21.15.33:0/2327471426 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a2c152ce0 con 0x7f7a2c15a6d0 2024-09-13T18:58:45.006 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.006+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 msgr2=0x7f7a0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.006+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 0x7f7a0c06d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a20034000 tx=0x7f7a2002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.006+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 msgr2=0x7f7a2c152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.006+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7a0 tx=0x7f7a2400cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.006+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 shutdown_connections 2024-09-13T18:58:45.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0c06ac00 0x7f7a0c06d0c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a2c15a6d0 0x7f7a2c152fc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2c0cb640 0x7f7a2c1f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 --2- 172.21.15.33:0/2327471426 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2c0b0d20 0x7f7a2c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 >> 172.21.15.33:0/2327471426 conn(0x7f7a2c0b0200 msgr2=0x7f7a2c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 shutdown_connections 2024-09-13T18:58:45.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.007+0000 7f7a32e00640 1 -- 172.21.15.33:0/2327471426 wait complete. 2024-09-13T18:58:45.025 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:58:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.178+0000 7f8bd1800640 1 Processor -- start 2024-09-13T18:58:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.178+0000 7f8bd1800640 1 -- start start 2024-09-13T18:58:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.179+0000 7f8bd1800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bcc0b1b30 0x7f8bcc0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.179+0000 7f8bd1800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc06ba80 con 0x7f8bcc0cba50 2024-09-13T18:58:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.179+0000 7f8bd1800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc0b2270 con 0x7f8bcc151590 2024-09-13T18:58:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.179+0000 7f8bd1800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0b2550 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bcb400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8bcc0cba50 0x7f8bcc0cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52630/0 (socket says 172.21.15.33:52630) 2024-09-13T18:58:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bcb400640 1 -- 172.21.15.33:0/2261260284 learned_addr learned my addr 172.21.15.33:0/2261260284 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bca000640 1 --2- 172.21.15.33:0/2261260284 >> v2:172.21.15.103:3300/0 conn(0x7f8bcc0b1b30 0x7f8bcc0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573664884 0 0) 0x7f8bcc06ba80 con 0x7f8bcc0cba50 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb0003520 con 0x7f8bcc0cba50 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508374552 0 0) 0x7f8bcc0b2270 con 0x7f8bcc151590 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bcc06ba80 con 0x7f8bcc151590 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805094401 0 0) 0x7f8bb0003520 con 0x7f8bcc0cba50 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bca000640 1 -- 172.21.15.33:0/2261260284 >> v1:172.21.15.103:6789/0 conn(0x7f8bcc151590 legacy=0x7f8bcc06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bca000640 1 -- 172.21.15.33:0/2261260284 >> v1:172.21.15.33:6789/0 conn(0x7f8bcc0cba50 legacy=0x7f8bcc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.180+0000 7f8bca000640 1 -- 172.21.15.33:0/2261260284 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0b2830 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bca000640 1 --2- 172.21.15.33:0/2261260284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc0b1b30 0x7f8bcc0cdda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80097a0 tx=0x7f8bb802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982d6886b99fb3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40019f0 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb802ac50 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bc9600640 1 -- 172.21.15.33:0/2261260284 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8032440 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bd1800640 1 -- 172.21.15.33:0/2261260284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc0b1b30 msgr2=0x7f8bcc0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2261260284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc0b1b30 0x7f8bcc0cdda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80097a0 tx=0x7f8bb802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bd1800640 1 -- 172.21.15.33:0/2261260284 shutdown_connections 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2261260284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc0b1b30 0x7f8bcc0cdda0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.182+0000 7f8bd1800640 1 -- 172.21.15.33:0/2261260284 >> 172.21.15.33:0/2261260284 conn(0x7f8bcc0b0510 msgr2=0x7f8bcc0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.183+0000 7f8bd1800640 1 -- 172.21.15.33:0/2261260284 shutdown_connections 2024-09-13T18:58:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.183+0000 7f8bd1800640 1 -- 172.21.15.33:0/2261260284 wait complete. 2024-09-13T18:58:45.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.184+0000 7f8bd1800640 1 Processor -- start 2024-09-13T18:58:45.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.184+0000 7f8bd1800640 1 -- start start 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 0x7f8bcc14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc151590 0x7f8bcc150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc06fbc0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc14cae0 con 0x7f8bcc151590 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bd1800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc14cdc0 con 0x7f8bcc0b1b30 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59940/0 (socket says 172.21.15.33:59940) 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.185+0000 7f8bca000640 1 -- 172.21.15.33:0/2034615547 learned_addr learned my addr 172.21.15.33:0/2034615547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bcaa00640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 0x7f8bcc14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bcb400640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc151590 0x7f8bcc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 -- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 msgr2=0x7f8bcc14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 0x7f8bcc14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 -- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc151590 msgr2=0x7f8bcc150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc151590 0x7f8bcc150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 -- 172.21.15.33:0/2034615547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8009400 con 0x7f8bcc0cba50 2024-09-13T18:58:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bcaa00640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 0x7f8bcc14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bca000640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80098c0 tx=0x7f8bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.186+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8004230 con 0x7f8bcc0cba50 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.187+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb80043b0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.187+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc14d0a0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.187+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8004520 con 0x7f8bcc0cba50 2024-09-13T18:58:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.187+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc14ae40 con 0x7f8bcc0cba50 2024-09-13T18:58:45.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.188+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc0cdda0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.188+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8bb803e8a0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.189+0000 7f8bc2a00640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 0x7f8bac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.189+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8bb80aa0f0 con 0x7f8bcc0cba50 2024-09-13T18:58:45.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.190+0000 7f8bcaa00640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 0x7f8bac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.191+0000 7f8bcaa00640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 0x7f8bac06d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0011e0 tx=0x7f8bbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.194+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8bb8075620 con 0x7f8bcc0cba50 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.376+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8bcc15b590 con 0x7f8bcc0cba50 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.377+0000 7f8bc2a00640 1 -- 172.21.15.33:0/2034615547 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8bb8078c40 con 0x7f8bcc0cba50 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T18:58:45.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:58:45.380 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T18:58:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 msgr2=0x7f8bac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 0x7f8bac06d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0011e0 tx=0x7f8bbc009040 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 msgr2=0x7f8bcc150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80098c0 tx=0x7f8bb80046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 shutdown_connections 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8bac06ac00 0x7f8bac06d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bcc151590 0x7f8bcc150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bcc0cba50 0x7f8bcc150030 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 --2- 172.21.15.33:0/2034615547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bcc0b1b30 0x7f8bcc14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 >> 172.21.15.33:0/2034615547 conn(0x7f8bcc0b0510 msgr2=0x7f8bcc06b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 shutdown_connections 2024-09-13T18:58:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.379+0000 7f8bd1800640 1 -- 172.21.15.33:0/2034615547 wait complete. 2024-09-13T18:58:45.397 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:58:45.397 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:58:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.555+0000 7fc156200640 1 Processor -- start 2024-09-13T18:58:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.555+0000 7fc156200640 1 -- start start 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc156200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc15015b770 0x7fc1500b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc156200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc150151a20 con 0x7fc1500cd870 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc156200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500cc430 con 0x7fc15006cd60 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc156200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1500b1bb0 con 0x7fc15015b770 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc15015b770 0x7fc1500b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc15015b770 0x7fc1500b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59942/0 (socket says 172.21.15.33:59942) 2024-09-13T18:58:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 -- 172.21.15.33:0/2700546764 learned_addr learned my addr 172.21.15.33:0/2700546764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 -- 172.21.15.33:0/2700546764 >> v1:172.21.15.103:6789/0 conn(0x7fc15006cd60 legacy=0x7fc1500cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 -- 172.21.15.33:0/2700546764 >> v1:172.21.15.33:6789/0 conn(0x7fc1500cd870 legacy=0x7fc1500cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.557+0000 7fc147e00640 1 -- 172.21.15.33:0/2700546764 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500b1e70 con 0x7fc15015b770 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.558+0000 7fc147e00640 1 --2- 172.21.15.33:0/2700546764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15015b770 0x7fc1500b2950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc138009870 tx=0x7fc13802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d460183490420c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc14ea00640 1 -- 172.21.15.33:0/2700546764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138032640 con 0x7fc15015b770 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc14ea00640 1 -- 172.21.15.33:0/2700546764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1380327a0 con 0x7fc15015b770 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc14ea00640 1 -- 172.21.15.33:0/2700546764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138032b30 con 0x7fc15015b770 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 -- 172.21.15.33:0/2700546764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15015b770 msgr2=0x7fc1500b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 --2- 172.21.15.33:0/2700546764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15015b770 0x7fc1500b2950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc138009870 tx=0x7fc13802a300 comp rx=0 tx=0).stop 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 -- 172.21.15.33:0/2700546764 shutdown_connections 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 --2- 172.21.15.33:0/2700546764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15015b770 0x7fc1500b2950 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 -- 172.21.15.33:0/2700546764 >> 172.21.15.33:0/2700546764 conn(0x7fc1500b0510 msgr2=0x7fc1500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:45.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 -- 172.21.15.33:0/2700546764 shutdown_connections 2024-09-13T18:58:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.559+0000 7fc156200640 1 -- 172.21.15.33:0/2700546764 wait complete. 2024-09-13T18:58:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.561+0000 7fc156200640 1 Processor -- start 2024-09-13T18:58:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.561+0000 7fc156200640 1 -- start start 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1500cd870 0x7fc1500a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc15015b770 0x7fc1500aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500ac500 con 0x7fc15006cd60 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc150154c20 con 0x7fc15015b770 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc156200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500abeb0 con 0x7fc1500cd870 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc14f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc14f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59948/0 (socket says 172.21.15.33:59948) 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc14f400640 1 -- 172.21.15.33:0/2488764196 learned_addr learned my addr 172.21.15.33:0/2488764196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.562+0000 7fc147e00640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1500cd870 0x7fc1500a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14fe00640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc15015b770 0x7fc1500aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 -- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1500cd870 msgr2=0x7fc1500a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1500cd870 0x7fc1500a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 -- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc15015b770 msgr2=0x7fc1500aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc15015b770 0x7fc1500aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 -- 172.21.15.33:0/2488764196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380094d0 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc14f400640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400052d0 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140005450 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1500ac190 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140003830 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.563+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500abb30 con 0x7fc15006cd60 2024-09-13T18:58:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.564+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1500b2950 con 0x7fc15006cd60 2024-09-13T18:58:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.565+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc140003990 con 0x7fc15006cd60 2024-09-13T18:58:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.566+0000 7fc147400640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 0x7fc12c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.566+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc140088650 con 0x7fc15006cd60 2024-09-13T18:58:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.567+0000 7fc147e00640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 0x7fc12c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.567+0000 7fc147e00640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 0x7fc12c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc138034000 tx=0x7fc13802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.571+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc140053b90 con 0x7fc15006cd60 2024-09-13T18:58:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:45.749+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc15015de00 con 0x7fc15006cd60 2024-09-13T18:58:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.482+0000 7fc147400640 1 -- 172.21.15.33:0/2488764196 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc1400571b0 con 0x7fc15006cd60 2024-09-13T18:58:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T18:58:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 msgr2=0x7fc12c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 0x7fc12c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc138034000 tx=0x7fc13802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 msgr2=0x7fc1500ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 shutdown_connections 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc12c06ac00 0x7fc12c06d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc15015b770 0x7fc1500aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc1500cd870 0x7fc1500a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 --2- 172.21.15.33:0/2488764196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc15006cd60 0x7fc1500ac990 secure :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.486+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 >> 172.21.15.33:0/2488764196 conn(0x7fc1500b0510 msgr2=0x7fc1500ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.488+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 shutdown_connections 2024-09-13T18:58:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.488+0000 7fc156200640 1 -- 172.21.15.33:0/2488764196 wait complete. 2024-09-13T18:58:46.511 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:58:46.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.675+0000 7f3656a00640 1 Processor -- start 2024-09-13T18:58:46.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.676+0000 7f3656a00640 1 -- start start 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3650159490 0x7f365006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 0x7f36500cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 0x7f36500cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500cdf80 con 0x7f3650159490 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3650071030 con 0x7f36500adbf0 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3650159870 con 0x7f36500cdaf0 2024-09-13T18:58:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3655600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3650159490 0x7f365006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3655600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3650159490 0x7f365006fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59962/0 (socket says 172.21.15.33:59962) 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3655600640 1 -- 172.21.15.33:0/200459111 learned_addr learned my addr 172.21.15.33:0/200459111 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3656000640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 0x7f36500cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.677+0000 7f3654c00640 1 --2- 172.21.15.33:0/200459111 >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 0x7f36500cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3655600640 1 -- 172.21.15.33:0/200459111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 msgr2=0x7f36500cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3655600640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 0x7f36500cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3655600640 1 -- 172.21.15.33:0/200459111 >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 msgr2=0x7f36500cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3655600640 1 --2- 172.21.15.33:0/200459111 >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 0x7f36500cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3655600640 1 -- 172.21.15.33:0/200459111 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650070420 con 0x7f3650159490 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3656000640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 0x7f36500cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.678+0000 7f3654c00640 1 --2- 172.21.15.33:0/200459111 >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 0x7f36500cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f3655600640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3650159490 0x7f365006fd20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f365015cee0 tx=0x7f364402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab100b8ca8a441a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f364fe00640 1 -- 172.21.15.33:0/200459111 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644032440 con 0x7f3650159490 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f364fe00640 1 -- 172.21.15.33:0/200459111 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36440325a0 con 0x7f3650159490 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f364fe00640 1 -- 172.21.15.33:0/200459111 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644032930 con 0x7f3650159490 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f3656a00640 1 -- 172.21.15.33:0/200459111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3650159490 msgr2=0x7f365006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.679+0000 7f3656a00640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3650159490 0x7f365006fd20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f365015cee0 tx=0x7f364402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 -- 172.21.15.33:0/200459111 shutdown_connections 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36500cdaf0 0x7f36500cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 --2- 172.21.15.33:0/200459111 >> v2:172.21.15.103:3300/0 conn(0x7f36500adbf0 0x7f36500cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 --2- 172.21.15.33:0/200459111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3650159490 0x7f365006fd20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 -- 172.21.15.33:0/200459111 >> 172.21.15.33:0/200459111 conn(0x7f36500ce5a0 msgr2=0x7f36500ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:46.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 -- 172.21.15.33:0/200459111 shutdown_connections 2024-09-13T18:58:46.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.680+0000 7f3656a00640 1 -- 172.21.15.33:0/200459111 wait complete. 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.681+0000 7f3656a00640 1 Processor -- start 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 -- start start 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36500adbf0 0x7f3650144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3650159490 0x7f36500aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a93e0 con 0x7f36500cdaf0 2024-09-13T18:58:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501457f0 con 0x7f36500adbf0 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.682+0000 7f3656a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3650145ad0 con 0x7f3650159490 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59966/0 (socket says 172.21.15.33:59966) 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 -- 172.21.15.33:0/1236113975 learned_addr learned my addr 172.21.15.33:0/1236113975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3655600640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36500adbf0 0x7f3650144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3656000640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3650159490 0x7f36500aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 -- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3650159490 msgr2=0x7f36500aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3650159490 0x7f36500aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 -- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36500adbf0 msgr2=0x7f3650144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36500adbf0 0x7f3650144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:46.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 -- 172.21.15.33:0/1236113975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440094d0 con 0x7f36500cdaf0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.683+0000 7f3654c00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f363c00e810 tx=0x7f363c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.684+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c004030 con 0x7f36500cdaf0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.684+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c004190 con 0x7f36500cdaf0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.684+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650145db0 con 0x7f36500cdaf0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.684+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c004520 con 0x7f36500cdaf0 2024-09-13T18:58:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.684+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36500a9ce0 con 0x7f36500cdaf0 2024-09-13T18:58:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.685+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500a9ed0 con 0x7f36500cdaf0 2024-09-13T18:58:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.686+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f363c00c6d0 con 0x7f36500cdaf0 2024-09-13T18:58:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.687+0000 7f364d600640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.687+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f363c088ff0 con 0x7f36500cdaf0 2024-09-13T18:58:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.687+0000 7f3655600640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:46.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.688+0000 7f3655600640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 0x7f363006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:46.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.690+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f363c054520 con 0x7f36500cdaf0 2024-09-13T18:58:46.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:46.872+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f36500714a0 con 0x7f36500cdaf0 2024-09-13T18:58:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.495+0000 7f364d600640 1 -- 172.21.15.33:0/1236113975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7f363c057b40 con 0x7f36500cdaf0 2024-09-13T18:58:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.501+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 msgr2=0x7f363006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.501+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 0x7f363006d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402e000 comp rx=0 tx=0).stop 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.501+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 msgr2=0x7f36500ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.501+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f363c00e810 tx=0x7f363c00ecd0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 shutdown_connections 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3650159490 0x7f36500aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36500cdaf0 0x7f36500ac4f0 secure :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f363c00e810 tx=0x7f363c00ecd0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 --2- 172.21.15.33:0/1236113975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36500adbf0 0x7f3650144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.502+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 >> 172.21.15.33:0/1236113975 conn(0x7f36500ce5a0 msgr2=0x7f3650156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:47.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.505+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 shutdown_connections 2024-09-13T18:58:47.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.505+0000 7f3656a00640 1 -- 172.21.15.33:0/1236113975 wait complete. 2024-09-13T18:58:47.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:58:47.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.690+0000 7fb179a00640 1 Processor -- start 2024-09-13T18:58:47.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.690+0000 7fb179a00640 1 -- start start 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb179a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1740b1db0 0x7fb17415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb179a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb174157310 con 0x7fb17406b630 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb179a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17406bae0 con 0x7fb174156f30 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb179a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740b29c0 con 0x7fb1740b1db0 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1740b1db0 0x7fb17415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1740b1db0 0x7fb17415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59976/0 (socket says 172.21.15.33:59976) 2024-09-13T18:58:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 -- 172.21.15.33:0/528721517 learned_addr learned my addr 172.21.15.33:0/528721517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 -- 172.21.15.33:0/528721517 >> v1:172.21.15.103:6789/0 conn(0x7fb174156f30 legacy=0x7fb1740b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 -- 172.21.15.33:0/528721517 >> v1:172.21.15.33:6789/0 conn(0x7fb17406b630 legacy=0x7fb1740cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.692+0000 7fb173400640 1 -- 172.21.15.33:0/528721517 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740b2ca0 con 0x7fb1740b1db0 2024-09-13T18:58:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.693+0000 7fb173400640 1 --2- 172.21.15.33:0/528721517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740b1db0 0x7fb17415a460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1600098a0 tx=0x7fb16002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2152986b65df7568 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb172a00640 1 -- 172.21.15.33:0/528721517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160032640 con 0x7fb1740b1db0 2024-09-13T18:58:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb172a00640 1 -- 172.21.15.33:0/528721517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1600327a0 con 0x7fb1740b1db0 2024-09-13T18:58:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb172a00640 1 -- 172.21.15.33:0/528721517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160032b30 con 0x7fb1740b1db0 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 -- 172.21.15.33:0/528721517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740b1db0 msgr2=0x7fb17415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 --2- 172.21.15.33:0/528721517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740b1db0 0x7fb17415a460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb1600098a0 tx=0x7fb16002a320 comp rx=0 tx=0).stop 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 -- 172.21.15.33:0/528721517 shutdown_connections 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 --2- 172.21.15.33:0/528721517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740b1db0 0x7fb17415a460 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 -- 172.21.15.33:0/528721517 >> 172.21.15.33:0/528721517 conn(0x7fb174069ed0 msgr2=0x7fb17406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 -- 172.21.15.33:0/528721517 shutdown_connections 2024-09-13T18:58:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.694+0000 7fb179a00640 1 -- 172.21.15.33:0/528721517 wait complete. 2024-09-13T18:58:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.696+0000 7fb179a00640 1 Processor -- start 2024-09-13T18:58:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.696+0000 7fb179a00640 1 -- start start 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1740b1db0 0x7fb1740ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb174156f30 0x7fb174154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174154dc0 con 0x7fb17406b630 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740ab970 con 0x7fb174156f30 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb179a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740abc50 con 0x7fb1740b1db0 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb173e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb173e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59984/0 (socket says 172.21.15.33:59984) 2024-09-13T18:58:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.697+0000 7fb173e00640 1 -- 172.21.15.33:0/3491287074 learned_addr learned my addr 172.21.15.33:0/3491287074 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173400640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1740b1db0 0x7fb1740ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb179000640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb174156f30 0x7fb174154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 -- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1740b1db0 msgr2=0x7fb1740ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1740b1db0 0x7fb1740ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 -- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb174156f30 msgr2=0x7fb174154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb174156f30 0x7fb174154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 -- 172.21.15.33:0/3491287074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600094d0 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb173e00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb16400c450 tx=0x7fb16400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640052d0 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164005430 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164012870 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740abf30 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.698+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1740ac4f0 con 0x7fb17406b630 2024-09-13T18:58:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.699+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17415a460 con 0x7fb17406b630 2024-09-13T18:58:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.700+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1640129d0 con 0x7fb17406b630 2024-09-13T18:58:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.701+0000 7fb16be00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.701+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb164088e70 con 0x7fb17406b630 2024-09-13T18:58:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.702+0000 7fb173400640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.703+0000 7fb173400640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 0x7fb15406d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb160034000 tx=0x7fb16002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:47.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.706+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb1640540a0 con 0x7fb17406b630 2024-09-13T18:58:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.919+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb174071780 con 0x7fb17406b630 2024-09-13T18:58:47.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.926+0000 7fb16be00640 1 -- 172.21.15.33:0/3491287074 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb1640576c0 con 0x7fb17406b630 2024-09-13T18:58:47.930 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 6 and data pool 7 2024-09-13T18:58:47.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.934+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 msgr2=0x7fb15406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.934+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 0x7fb15406d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb160034000 tx=0x7fb16002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:47.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.934+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 msgr2=0x7fb174154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:47.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.934+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb16400c450 tx=0x7fb16400c910 comp rx=0 tx=0).stop 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 shutdown_connections 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb15406ac00 0x7fb15406d0c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb174156f30 0x7fb174154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1740b1db0 0x7fb1740ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 --2- 172.21.15.33:0/3491287074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb17406b630 0x7fb174154fc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 >> 172.21.15.33:0/3491287074 conn(0x7fb174069ed0 msgr2=0x7fb174159950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:47.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 shutdown_connections 2024-09-13T18:58:47.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:47.935+0000 7fb179a00640 1 -- 172.21.15.33:0/3491287074 wait complete. 2024-09-13T18:58:47.972 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.125+0000 7f0a67200640 1 Processor -- start 2024-09-13T18:58:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.125+0000 7f0a67200640 1 -- start start 2024-09-13T18:58:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a67200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 0x7f0a6006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a67200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6006bc00 con 0x7f0a600ce020 2024-09-13T18:58:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a67200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6006bea0 con 0x7f0a600b1b00 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a67200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6006c180 con 0x7f0a6015a520 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a65200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0a600ce020 0x7f0a6015a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52656/0 (socket says 172.21.15.33:52656) 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a65200640 1 -- 172.21.15.33:0/2239591722 learned_addr learned my addr 172.21.15.33:0/2239591722 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.126+0000 7f0a5fe00640 1 --2- 172.21.15.33:0/2239591722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 0x7f0a6006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.127+0000 7f0a5fe00640 1 -- 172.21.15.33:0/2239591722 >> v1:172.21.15.103:6789/0 conn(0x7f0a600b1b00 legacy=0x7f0a600cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.127+0000 7f0a5fe00640 1 -- 172.21.15.33:0/2239591722 >> v1:172.21.15.33:6789/0 conn(0x7f0a600ce020 legacy=0x7f0a6015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.127+0000 7f0a5ea00640 1 -- 172.21.15.33:0/2239591722 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714911823 0 0) 0x7f0a6006bc00 con 0x7f0a600ce020 2024-09-13T18:58:48.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.127+0000 7f0a5fe00640 1 -- 172.21.15.33:0/2239591722 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6006c460 con 0x7f0a6015a520 2024-09-13T18:58:48.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.128+0000 7f0a5fe00640 1 --2- 172.21.15.33:0/2239591722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 0x7f0a6006b6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a500097d0 tx=0x7f0a5002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=305ad9f9f7cea52a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.128+0000 7f0a5ea00640 1 -- 172.21.15.33:0/2239591722 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50032440 con 0x7f0a6015a520 2024-09-13T18:58:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.128+0000 7f0a5ea00640 1 -- 172.21.15.33:0/2239591722 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a500325a0 con 0x7f0a6015a520 2024-09-13T18:58:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.128+0000 7f0a5ea00640 1 -- 172.21.15.33:0/2239591722 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50032930 con 0x7f0a6015a520 2024-09-13T18:58:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 -- 172.21.15.33:0/2239591722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 msgr2=0x7f0a6006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 --2- 172.21.15.33:0/2239591722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 0x7f0a6006b6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a500097d0 tx=0x7f0a5002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 -- 172.21.15.33:0/2239591722 shutdown_connections 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 --2- 172.21.15.33:0/2239591722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a6015a520 0x7f0a6006b6c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 -- 172.21.15.33:0/2239591722 >> 172.21.15.33:0/2239591722 conn(0x7f0a600b0510 msgr2=0x7f0a600b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 -- 172.21.15.33:0/2239591722 shutdown_connections 2024-09-13T18:58:48.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.129+0000 7f0a67200640 1 -- 172.21.15.33:0/2239591722 wait complete. 2024-09-13T18:58:48.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.131+0000 7f0a67200640 1 Processor -- start 2024-09-13T18:58:48.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.131+0000 7f0a67200640 1 -- start start 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a600b1b00 0x7f0a600c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a600ce020 0x7f0a600acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600c4800 con 0x7f0a6015a520 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600c4240 con 0x7f0a600ce020 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a67200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600c4520 con 0x7f0a600b1b00 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59986/0 (socket says 172.21.15.33:59986) 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 -- 172.21.15.33:0/2905673058 learned_addr learned my addr 172.21.15.33:0/2905673058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a5f400640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a600ce020 0x7f0a600acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a5fe00640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a600b1b00 0x7f0a600c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 -- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a600b1b00 msgr2=0x7f0a600c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a600b1b00 0x7f0a600c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 -- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a600ce020 msgr2=0x7f0a600acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a600ce020 0x7f0a600acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.132+0000 7f0a65200640 1 -- 172.21.15.33:0/2905673058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50009400 con 0x7f0a6015a520 2024-09-13T18:58:48.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a65200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c7a0 tx=0x7f0a5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800a640 con 0x7f0a6015a520 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800a7a0 con 0x7f0a6015a520 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800abd0 con 0x7f0a6015a520 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a600ac7b0 con 0x7f0a6015a520 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.133+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601f36e0 con 0x7f0a6015a520 2024-09-13T18:58:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.134+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a600accd0 con 0x7f0a6015a520 2024-09-13T18:58:48.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.135+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0a5800ad30 con 0x7f0a6015a520 2024-09-13T18:58:48.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.136+0000 7f0a57e00640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 0x7f0a4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.136+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a580887d0 con 0x7f0a6015a520 2024-09-13T18:58:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.137+0000 7f0a5fe00640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 0x7f0a4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.137+0000 7f0a5fe00640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 0x7f0a4006d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a50034000 tx=0x7f0a5002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.140+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0a600accd0 con 0x7f0a6015a520 2024-09-13T18:58:48.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.319+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a600accd0 con 0x7f0a6015a520 2024-09-13T18:58:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.321+0000 7f0a57e00640 1 -- 172.21.15.33:0/2905673058 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16526 (secure 0 0 0) 0x7f0a600accd0 con 0x7f0a6015a520 2024-09-13T18:58:48.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:48.323 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":45,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:47.920876+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 msgr2=0x7f0a4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 0x7f0a4006d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a50034000 tx=0x7f0a5002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 msgr2=0x7f0a600c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c7a0 tx=0x7f0a5800cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 shutdown_connections 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0a4006ac30 0x7f0a4006d0f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a6015a520 0x7f0a600c3780 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a600ce020 0x7f0a600acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 --2- 172.21.15.33:0/2905673058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0a600b1b00 0x7f0a600c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 >> 172.21.15.33:0/2905673058 conn(0x7f0a600b0510 msgr2=0x7f0a600b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 shutdown_connections 2024-09-13T18:58:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.323+0000 7f0a67200640 1 -- 172.21.15.33:0/2905673058 wait complete. 2024-09-13T18:58:48.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.494+0000 7fdc0ba00640 1 Processor -- start 2024-09-13T18:58:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.494+0000 7fdc0ba00640 1 -- start start 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc0ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 0x7fdc040b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc0ba00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040ae1e0 con 0x7fdc0415c770 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc0ba00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040ad140 con 0x7fdc0406a5e0 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc0ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040ad420 con 0x7fdc0415cb50 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc09000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdc0415c770 0x7fdc04069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52660/0 (socket says 172.21.15.33:52660) 2024-09-13T18:58:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc09000640 1 -- 172.21.15.33:0/319288158 learned_addr learned my addr 172.21.15.33:0/319288158 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc03e00640 1 --2- 172.21.15.33:0/319288158 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 0x7fdc040b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619008505 0 0) 0x7fdc040ae1e0 con 0x7fdc0415c770 2024-09-13T18:58:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.496+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbec003520 con 0x7fdc0415c770 2024-09-13T18:58:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.497+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973621159 0 0) 0x7fdc040ad140 con 0x7fdc0406a5e0 2024-09-13T18:58:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.497+0000 7fdc03e00640 1 -- 172.21.15.33:0/319288158 >> v1:172.21.15.103:6789/0 conn(0x7fdc0406a5e0 legacy=0x7fdc0406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.497+0000 7fdc03e00640 1 -- 172.21.15.33:0/319288158 >> v1:172.21.15.33:6789/0 conn(0x7fdc0415c770 legacy=0x7fdc04069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.497+0000 7fdc03e00640 1 -- 172.21.15.33:0/319288158 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040ad700 con 0x7fdc0415cb50 2024-09-13T18:58:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.498+0000 7fdc03e00640 1 --2- 172.21.15.33:0/319288158 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 0x7fdc040b3690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00097d0 tx=0x7fdbf002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=188eaeff1ccb6d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.498+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0032440 con 0x7fdc0415cb50 2024-09-13T18:58:48.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.498+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf00325a0 con 0x7fdc0415cb50 2024-09-13T18:58:48.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.498+0000 7fdc03400640 1 -- 172.21.15.33:0/319288158 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0032930 con 0x7fdc0415cb50 2024-09-13T18:58:48.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 -- 172.21.15.33:0/319288158 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 msgr2=0x7fdc040b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/319288158 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 0x7fdc040b3690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00097d0 tx=0x7fdbf002a210 comp rx=0 tx=0).stop 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 -- 172.21.15.33:0/319288158 shutdown_connections 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/319288158 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415cb50 0x7fdc040b3690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 -- 172.21.15.33:0/319288158 >> 172.21.15.33:0/319288158 conn(0x7fdc0406afe0 msgr2=0x7fdc0406b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 -- 172.21.15.33:0/319288158 shutdown_connections 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.499+0000 7fdc0ba00640 1 -- 172.21.15.33:0/319288158 wait complete. 2024-09-13T18:58:48.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.501+0000 7fdc0ba00640 1 Processor -- start 2024-09-13T18:58:48.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.501+0000 7fdc0ba00640 1 -- start start 2024-09-13T18:58:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415c770 0x7fdc0415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc0415cb50 0x7fdc0415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040aede0 con 0x7fdc0406a5e0 2024-09-13T18:58:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040af030 con 0x7fdc0415cb50 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc0ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040af310 con 0x7fdc0415c770 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60000/0 (socket says 172.21.15.33:60000) 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 -- 172.21.15.33:0/2120507031 learned_addr learned my addr 172.21.15.33:0/2120507031 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc03e00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415c770 0x7fdc0415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09a00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc0415cb50 0x7fdc0415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 -- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415c770 msgr2=0x7fdc0415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415c770 0x7fdc0415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 -- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc0415cb50 msgr2=0x7fdc0415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc0415cb50 0x7fdc0415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.502+0000 7fdc09000640 1 -- 172.21.15.33:0/2120507031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0009400 con 0x7fdc0406a5e0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc09000640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c430 tx=0x7fdbf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8005ce0 con 0x7fdc0406a5e0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8005e40 con 0x7fdc0406a5e0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc040af5f0 con 0x7fdc0406a5e0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80072f0 con 0x7fdc0406a5e0 2024-09-13T18:58:48.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.503+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc04149570 con 0x7fdc0406a5e0 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.504+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc040afb10 con 0x7fdc0406a5e0 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.505+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbf8007450 con 0x7fdc0406a5e0 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.506+0000 7fdc00c00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 0x7fdbe406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.506+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbf8088990 con 0x7fdc0406a5e0 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.507+0000 7fdc03e00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 0x7fdbe406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.507+0000 7fdc03e00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 0x7fdbe406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0034000 tx=0x7fdbf002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.510+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc040afb10 con 0x7fdc0406a5e0 2024-09-13T18:58:48.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.689+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc040afb10 con 0x7fdc0406a5e0 2024-09-13T18:58:48.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.690+0000 7fdc00c00640 1 -- 172.21.15.33:0/2120507031 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16526 (secure 0 0 0) 0x7fdc040afb10 con 0x7fdc0406a5e0 2024-09-13T18:58:48.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:48.693 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":45,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:47.920876+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 msgr2=0x7fdbe406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 0x7fdbe406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0034000 tx=0x7fdbf002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 msgr2=0x7fdc04149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c430 tx=0x7fdbf800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 shutdown_connections 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe406ac00 0x7fdbe406d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc0415cb50 0x7fdc0415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc0415c770 0x7fdc0415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 --2- 172.21.15.33:0/2120507031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc0406a5e0 0x7fdc04149030 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 >> 172.21.15.33:0/2120507031 conn(0x7fdc0406afe0 msgr2=0x7fdc04070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 shutdown_connections 2024-09-13T18:58:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.692+0000 7fdc0ba00640 1 -- 172.21.15.33:0/2120507031 wait complete. 2024-09-13T18:58:48.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:58:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.867+0000 7fbf90a00640 1 Processor -- start 2024-09-13T18:58:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.867+0000 7fbf90a00640 1 -- start start 2024-09-13T18:58:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf90a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf8c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf90a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0ce490 con 0x7fbf8c154ad0 2024-09-13T18:58:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf90a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c06b7c0 con 0x7fbf8c06f830 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf90a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0cc4b0 con 0x7fbf8c0cbac0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf89e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbf8c154ad0 0x7fbf8c0cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52668/0 (socket says 172.21.15.33:52668) 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.868+0000 7fbf89e00640 1 -- 172.21.15.33:0/3182991520 learned_addr learned my addr 172.21.15.33:0/3182991520 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf8a800640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf8c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415420082 0 0) 0x7fbf8c0ce490 con 0x7fbf8c154ad0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003520 con 0x7fbf8c154ad0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621620710 0 0) 0x7fbf8c06b7c0 con 0x7fbf8c06f830 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c0ce490 con 0x7fbf8c06f830 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163903344 0 0) 0x7fbf70003520 con 0x7fbf8c154ad0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 msgr2=0x7fbf8c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf8c0cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 >> v1:172.21.15.103:6789/0 conn(0x7fbf8c06f830 legacy=0x7fbf8c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c06baa0 con 0x7fbf8c154ad0 2024-09-13T18:58:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fbf7c0019f0 con 0x7fbf8c154ad0 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 >> v1:172.21.15.33:6789/0 conn(0x7fbf8c154ad0 legacy=0x7fbf8c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf70003b30 0x7fbf70003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70004d00 0x7fbf70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0cc4b0 con 0x7fbf70004d00 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000ba80 con 0x7fbf70003b30 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.869+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000bc40 con 0x7fbf8c0cbac0 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf70003b30 0x7fbf70003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf8a800640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70004d00 0x7fbf70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf81400640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 -- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 msgr2=0x7fbf700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c0cbac0 0x7fbf700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 -- 172.21.15.33:0/3182991520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70004d00 msgr2=0x7fbf70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70004d00 0x7fbf70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf89e00640 1 -- 172.21.15.33:0/3182991520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70003520 con 0x7fbf70003b30 2024-09-13T18:58:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.870+0000 7fbf8a800640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70004d00 0x7fbf70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:58:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.871+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf70003b30 0x7fbf70003f30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00a7a0 tx=0x7fbf700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45fb547fd71fb34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c02b9c0 con 0x7fbf70003b30 2024-09-13T18:58:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c02bb20 con 0x7fbf70003b30 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf89400640 1 -- 172.21.15.33:0/3182991520 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c034470 con 0x7fbf70003b30 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 -- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf70003b30 msgr2=0x7fbf70003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3182991520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf70003b30 0x7fbf70003f30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00a7a0 tx=0x7fbf700057f0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf8a800640 1 -- 172.21.15.33:0/3182991520 reap_dead start 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 -- 172.21.15.33:0/3182991520 shutdown_connections 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 -- 172.21.15.33:0/3182991520 >> 172.21.15.33:0/3182991520 conn(0x7fbf8c0b0580 msgr2=0x7fbf8c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 -- 172.21.15.33:0/3182991520 shutdown_connections 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.872+0000 7fbf90a00640 1 -- 172.21.15.33:0/3182991520 wait complete. 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.874+0000 7fbf90a00640 1 Processor -- start 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.874+0000 7fbf90a00640 1 -- start start 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c14fb30 0x7fbf8c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf8c0b3720 0x7fbf8c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0b1ec0 con 0x7fbf70003b30 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0b2140 con 0x7fbf8c0b3720 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf90a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0b2420 con 0x7fbf8c14fb30 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf89e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf89e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60016/0 (socket says 172.21.15.33:60016) 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf89e00640 1 -- 172.21.15.33:0/3226482319 learned_addr learned my addr 172.21.15.33:0/3226482319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf8a800640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf8c0b3720 0x7fbf8c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.875+0000 7fbf81400640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c14fb30 0x7fbf8c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 -- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c14fb30 msgr2=0x7fbf8c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c14fb30 0x7fbf8c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 -- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf8c0b3720 msgr2=0x7fbf8c159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf8c0b3720 0x7fbf8c159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 -- 172.21.15.33:0/3226482319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0b2700 con 0x7fbf70003b30 2024-09-13T18:58:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf89e00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00a7a0 tx=0x7fbf7c001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c038070 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c034470 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c03b040 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.876+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0b29e0 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.877+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c14ffb0 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.878+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c150170 con 0x7fbf70003b30 2024-09-13T18:58:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.879+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf7c031070 con 0x7fbf70003b30 2024-09-13T18:58:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.879+0000 7fbf82a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 0x7fbf6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.879+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf7c0a9520 con 0x7fbf70003b30 2024-09-13T18:58:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.880+0000 7fbf81400640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 0x7fbf6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.881+0000 7fbf81400640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 0x7fbf6806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c15d5e0 tx=0x7fbf74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:48.884+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf7c074840 con 0x7fbf70003b30 2024-09-13T18:58:49.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.100+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbf8c15c8e0 con 0x7fbf70003b30 2024-09-13T18:58:49.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.937+0000 7fbf82a00640 1 -- 172.21.15.33:0/3226482319 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbf7c0450b0 con 0x7fbf70003b30 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 msgr2=0x7fbf6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 0x7fbf6806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c15d5e0 tx=0x7fbf74009040 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 msgr2=0x7fbf8c0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00a7a0 tx=0x7fbf7c001d00 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 shutdown_connections 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbf6806ac00 0x7fbf6806d0c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf8c0b3720 0x7fbf8c159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbf8c14fb30 0x7fbf8c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 --2- 172.21.15.33:0/3226482319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf70003b30 0x7fbf8c0b1980 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 >> 172.21.15.33:0/3226482319 conn(0x7fbf8c0b0580 msgr2=0x7fbf8c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 shutdown_connections 2024-09-13T18:58:49.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:49.940+0000 7fbf90a00640 1 -- 172.21.15.33:0/3226482319 wait complete. 2024-09-13T18:58:49.962 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:58:49.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:58:50.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.122+0000 7ff3d7c00640 1 Processor -- start 2024-09-13T18:58:50.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.122+0000 7ff3d7c00640 1 -- start start 2024-09-13T18:58:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d7c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3d01566f0 0x7ff3d0070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d7c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3d00ae060 0x7ff3d015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d7c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d006fce0 con 0x7ff3d006be40 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d7c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d006c820 con 0x7ff3d00ae060 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d7c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d006f690 con 0x7ff3d01566f0 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3d00ae060 0x7ff3d015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3d00ae060 0x7ff3d015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60026/0 (socket says 172.21.15.33:60026) 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 -- 172.21.15.33:0/2770005834 learned_addr learned my addr 172.21.15.33:0/2770005834 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5200640 1 --2- 172.21.15.33:0/2770005834 >> v2:172.21.15.103:3300/0 conn(0x7ff3d01566f0 0x7ff3d0070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 -- 172.21.15.33:0/2770005834 >> v2:172.21.15.103:3300/0 conn(0x7ff3d01566f0 msgr2=0x7ff3d0070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 --2- 172.21.15.33:0/2770005834 >> v2:172.21.15.103:3300/0 conn(0x7ff3d01566f0 0x7ff3d0070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 -- 172.21.15.33:0/2770005834 >> v1:172.21.15.33:6789/0 conn(0x7ff3d006be40 legacy=0x7ff3d00ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.124+0000 7ff3d5c00640 1 -- 172.21.15.33:0/2770005834 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d006f970 con 0x7ff3d00ae060 2024-09-13T18:58:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.125+0000 7ff3d5c00640 1 --2- 172.21.15.33:0/2770005834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00ae060 0x7ff3d015c800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00677f0 tx=0x7ff3c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4384caf67ba8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3cf400640 1 -- 172.21.15.33:0/2770005834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8008500 con 0x7ff3d00ae060 2024-09-13T18:58:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3cf400640 1 -- 172.21.15.33:0/2770005834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8008660 con 0x7ff3d00ae060 2024-09-13T18:58:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3cf400640 1 -- 172.21.15.33:0/2770005834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80089f0 con 0x7ff3d00ae060 2024-09-13T18:58:50.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 -- 172.21.15.33:0/2770005834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00ae060 msgr2=0x7ff3d015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/2770005834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00ae060 0x7ff3d015c800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00677f0 tx=0x7ff3c802b840 comp rx=0 tx=0).stop 2024-09-13T18:58:50.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 -- 172.21.15.33:0/2770005834 shutdown_connections 2024-09-13T18:58:50.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/2770005834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00ae060 0x7ff3d015c800 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/2770005834 >> v2:172.21.15.103:3300/0 conn(0x7ff3d01566f0 0x7ff3d0070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.126+0000 7ff3d7c00640 1 -- 172.21.15.33:0/2770005834 >> 172.21.15.33:0/2770005834 conn(0x7ff3d00b0580 msgr2=0x7ff3d00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:50.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.127+0000 7ff3d7c00640 1 -- 172.21.15.33:0/2770005834 shutdown_connections 2024-09-13T18:58:50.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.127+0000 7ff3d7c00640 1 -- 172.21.15.33:0/2770005834 wait complete. 2024-09-13T18:58:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.128+0000 7ff3d7c00640 1 Processor -- start 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.128+0000 7ff3d7c00640 1 -- start start 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 0x7ff3d01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3d01566f0 0x7ff3d014e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d014eed0 con 0x7ff3d006be40 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01597a0 con 0x7ff3d01566f0 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d7c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0159a80 con 0x7ff3d00ae060 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60038/0 (socket says 172.21.15.33:60038) 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.129+0000 7ff3d5200640 1 -- 172.21.15.33:0/317955995 learned_addr learned my addr 172.21.15.33:0/317955995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3d01566f0 0x7ff3d014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3cfe00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 0x7ff3d01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 -- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 msgr2=0x7ff3d01590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 0x7ff3d01590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 -- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3d01566f0 msgr2=0x7ff3d014e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3d01566f0 0x7ff3d014e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 -- 172.21.15.33:0/317955995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c800ac40 con 0x7ff3d006be40 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3cfe00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 0x7ff3d01590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d5200640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e870 tx=0x7ff3c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40094f0 con 0x7ff3d006be40 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400c940 con 0x7ff3d006be40 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400ccf0 con 0x7ff3d006be40 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.130+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d0159d60 con 0x7ff3d006be40 2024-09-13T18:58:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.131+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d015a320 con 0x7ff3d006be40 2024-09-13T18:58:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.132+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d006c2d0 con 0x7ff3d006be40 2024-09-13T18:58:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.133+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff3c4013470 con 0x7ff3d006be40 2024-09-13T18:58:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.133+0000 7ff3ccc00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 0x7ff3b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.134+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3c4089350 con 0x7ff3d006be40 2024-09-13T18:58:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.134+0000 7ff3cfe00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 0x7ff3b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:50.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.135+0000 7ff3cfe00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 0x7ff3b006d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3d015c4c0 tx=0x7ff3bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:50.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.138+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff3c40545e0 con 0x7ff3d006be40 2024-09-13T18:58:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.350+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff3d0153000 con 0x7ff3d006be40 2024-09-13T18:58:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.939+0000 7ff3ccc00640 1 -- 172.21.15.33:0/317955995 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3c4057c00 con 0x7ff3d006be40 2024-09-13T18:58:50.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.941+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 msgr2=0x7ff3b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.941+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 0x7ff3b006d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3d015c4c0 tx=0x7ff3bc009040 comp rx=0 tx=0).stop 2024-09-13T18:58:50.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.941+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 msgr2=0x7ff3d015b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.941+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e870 tx=0x7ff3c400ed30 comp rx=0 tx=0).stop 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 shutdown_connections 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff3b006ac00 0x7ff3b006d0c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3d01566f0 0x7ff3d014e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3d00ae060 0x7ff3d01590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 --2- 172.21.15.33:0/317955995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d006be40 0x7ff3d015b850 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 >> 172.21.15.33:0/317955995 conn(0x7ff3d00b0580 msgr2=0x7ff3d0070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 shutdown_connections 2024-09-13T18:58:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:50.942+0000 7ff3d7c00640 1 -- 172.21.15.33:0/317955995 wait complete. 2024-09-13T18:58:50.963 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:58:50.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.120+0000 7fe0bbe00640 1 Processor -- start 2024-09-13T18:58:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.121+0000 7fe0bbe00640 1 -- start start 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bbe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 0x7fe0bc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0bc071560 0x7fe0bc0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bbe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0bc0cd850 con 0x7fe0bc06f4b0 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bbe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0cd570 con 0x7fe0bc071560 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bbe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0b1740 con 0x7fe0bc159480 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0bc071560 0x7fe0bc0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0bc071560 0x7fe0bc0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60052/0 (socket says 172.21.15.33:60052) 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bb400640 1 -- 172.21.15.33:0/2430219684 learned_addr learned my addr 172.21.15.33:0/2430219684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0baa00640 1 --2- 172.21.15.33:0/2430219684 >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 0x7fe0bc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.122+0000 7fe0bb400640 1 -- 172.21.15.33:0/2430219684 >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 msgr2=0x7fe0bc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.123+0000 7fe0bb400640 1 --2- 172.21.15.33:0/2430219684 >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 0x7fe0bc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.123+0000 7fe0bb400640 1 -- 172.21.15.33:0/2430219684 >> v1:172.21.15.33:6789/0 conn(0x7fe0bc06f4b0 legacy=0x7fe0bc070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.123+0000 7fe0bb400640 1 -- 172.21.15.33:0/2430219684 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0b1a20 con 0x7fe0bc071560 2024-09-13T18:58:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.123+0000 7fe0baa00640 1 --2- 172.21.15.33:0/2430219684 >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 0x7fe0bc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:51.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bb400640 1 --2- 172.21.15.33:0/2430219684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc071560 0x7fe0bc0b2220 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc067270 tx=0x7fe0b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853bb0340e6e20f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0ba000640 1 -- 172.21.15.33:0/2430219684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4031600 con 0x7fe0bc071560 2024-09-13T18:58:51.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0ba000640 1 -- 172.21.15.33:0/2430219684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b402d050 con 0x7fe0bc071560 2024-09-13T18:58:51.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0ba000640 1 -- 172.21.15.33:0/2430219684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4031980 con 0x7fe0bc071560 2024-09-13T18:58:51.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 -- 172.21.15.33:0/2430219684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc071560 msgr2=0x7fe0bc0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/2430219684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc071560 0x7fe0bc0b2220 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc067270 tx=0x7fe0b402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 -- 172.21.15.33:0/2430219684 shutdown_connections 2024-09-13T18:58:51.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/2430219684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc071560 0x7fe0bc0b2220 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/2430219684 >> v2:172.21.15.103:3300/0 conn(0x7fe0bc159480 0x7fe0bc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.124+0000 7fe0bbe00640 1 -- 172.21.15.33:0/2430219684 >> 172.21.15.33:0/2430219684 conn(0x7fe0bc0ae310 msgr2=0x7fe0bc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.125+0000 7fe0bbe00640 1 -- 172.21.15.33:0/2430219684 shutdown_connections 2024-09-13T18:58:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.125+0000 7fe0bbe00640 1 -- 172.21.15.33:0/2430219684 wait complete. 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.126+0000 7fe0bbe00640 1 Processor -- start 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.126+0000 7fe0bbe00640 1 -- start start 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0bc06f4b0 0x7fe0bc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0bc071560 0x7fe0bc144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14ff60 con 0x7fe0bc159480 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14f9a0 con 0x7fe0bc06f4b0 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bbe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14fc80 con 0x7fe0bc071560 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60068/0 (socket says 172.21.15.33:60068) 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.127+0000 7fe0bb400640 1 -- 172.21.15.33:0/3817106263 learned_addr learned my addr 172.21.15.33:0/3817106263 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0baa00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0bc06f4b0 0x7fe0bc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0b3e00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0bc071560 0x7fe0bc144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 -- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0bc071560 msgr2=0x7fe0bc144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0bc071560 0x7fe0bc144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 -- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0bc06f4b0 msgr2=0x7fe0bc1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0bc06f4b0 0x7fe0bc1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 -- 172.21.15.33:0/3817106263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4009b30 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bb400640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4034040 tx=0x7fe0b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b403d860 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b403d9e0 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b403dd90 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.128+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc157c60 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.129+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc145410 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.130+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc067360 con 0x7fe0bc159480 2024-09-13T18:58:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.131+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe0b403b400 con 0x7fe0bc159480 2024-09-13T18:58:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.132+0000 7fe0b2a00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 0x7fe09806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.132+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b40aa030 con 0x7fe0bc159480 2024-09-13T18:58:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.132+0000 7fe0baa00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 0x7fe09806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.133+0000 7fe0baa00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 0x7fe09806d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00a950 tx=0x7fe0ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.136+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe0b40752a0 con 0x7fe0bc159480 2024-09-13T18:58:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.352+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0bc157ac0 con 0x7fe0bc159480 2024-09-13T18:58:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.352+0000 7fe0b2a00640 1 -- 172.21.15.33:0/3817106263 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fe0bc157ac0 con 0x7fe0bc159480 2024-09-13T18:58:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:51.355 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:58:51.355 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:58:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.354+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 msgr2=0x7fe09806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.354+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 0x7fe09806d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00a950 tx=0x7fe0ac008040 comp rx=0 tx=0).stop 2024-09-13T18:58:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.354+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 msgr2=0x7fe0bc14f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.354+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4034040 tx=0x7fe0b4004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 shutdown_connections 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe09806ac00 0x7fe09806d0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc159480 0x7fe0bc14f120 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe0bc071560 0x7fe0bc144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 --2- 172.21.15.33:0/3817106263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0bc06f4b0 0x7fe0bc1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 >> 172.21.15.33:0/3817106263 conn(0x7fe0bc0ae310 msgr2=0x7fe0bc0af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 shutdown_connections 2024-09-13T18:58:51.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.355+0000 7fe0bbe00640 1 -- 172.21.15.33:0/3817106263 wait complete. 2024-09-13T18:58:51.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:51.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.528+0000 7fee72000640 1 Processor -- start 2024-09-13T18:58:51.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.528+0000 7fee72000640 1 -- start start 2024-09-13T18:58:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee72000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee6c15a5c0 0x7fee6c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee72000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0cbac0 0x7fee6c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee72000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0cbfc0 con 0x7fee6c0afe10 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee72000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0cce20 con 0x7fee6c15a5c0 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee72000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0707a0 con 0x7fee6c0cbac0 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee70c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee6c15a5c0 0x7fee6c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee70c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee6c15a5c0 0x7fee6c0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60074/0 (socket says 172.21.15.33:60074) 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.529+0000 7fee70c00640 1 -- 172.21.15.33:0/108320253 learned_addr learned my addr 172.21.15.33:0/108320253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.530+0000 7fee70c00640 1 -- 172.21.15.33:0/108320253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0cbac0 msgr2=0x7fee6c0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.530+0000 7fee70c00640 1 --2- 172.21.15.33:0/108320253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0cbac0 0x7fee6c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.530+0000 7fee70c00640 1 -- 172.21.15.33:0/108320253 >> v1:172.21.15.103:6789/0 conn(0x7fee6c0afe10 legacy=0x7fee6c06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.530+0000 7fee70c00640 1 -- 172.21.15.33:0/108320253 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c070a80 con 0x7fee6c15a5c0 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee70c00640 1 --2- 172.21.15.33:0/108320253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c0b39b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc64ff66a3e65736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee6b400640 1 -- 172.21.15.33:0/108320253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60032440 con 0x7fee6c15a5c0 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee6b400640 1 -- 172.21.15.33:0/108320253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600325a0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee6b400640 1 -- 172.21.15.33:0/108320253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60032930 con 0x7fee6c15a5c0 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee72000640 1 -- 172.21.15.33:0/108320253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 msgr2=0x7fee6c0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.531+0000 7fee72000640 1 --2- 172.21.15.33:0/108320253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c0b39b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6002a200 comp rx=0 tx=0).stop 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 -- 172.21.15.33:0/108320253 shutdown_connections 2024-09-13T18:58:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 --2- 172.21.15.33:0/108320253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0cbac0 0x7fee6c0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 --2- 172.21.15.33:0/108320253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c0b39b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 -- 172.21.15.33:0/108320253 >> 172.21.15.33:0/108320253 conn(0x7fee6c0ae310 msgr2=0x7fee6c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:51.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 -- 172.21.15.33:0/108320253 shutdown_connections 2024-09-13T18:58:51.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.532+0000 7fee72000640 1 -- 172.21.15.33:0/108320253 wait complete. 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.533+0000 7fee72000640 1 Processor -- start 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.533+0000 7fee72000640 1 -- start start 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0afe10 0x7fee6c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee6c0cbac0 0x7fee6c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c15d7d0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c15dc60 con 0x7fee6c0cbac0 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.534+0000 7fee72000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c15c8f0 con 0x7fee6c0afe10 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60080/0 (socket says 172.21.15.33:60080) 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 -- 172.21.15.33:0/4011208731 learned_addr learned my addr 172.21.15.33:0/4011208731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee6be00640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee6c0cbac0 0x7fee6c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee70c00640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0afe10 0x7fee6c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 -- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0afe10 msgr2=0x7fee6c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0afe10 0x7fee6c156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 -- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee6c0cbac0 msgr2=0x7fee6c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee6c0cbac0 0x7fee6c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 -- 172.21.15.33:0/4011208731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600094d0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.535+0000 7fee71600640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c780 tx=0x7fee6400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.536+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64003b70 con 0x7fee6c15a5c0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.536+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64003cf0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.536+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64003ea0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.536+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c15cbc0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.536+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c15d180 con 0x7fee6c15a5c0 2024-09-13T18:58:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.537+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c067360 con 0x7fee6c15a5c0 2024-09-13T18:58:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.538+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee64006b10 con 0x7fee6c15a5c0 2024-09-13T18:58:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.538+0000 7fee68c00640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 0x7fee4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.539+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee640886c0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.539+0000 7fee70c00640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 0x7fee4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.540+0000 7fee70c00640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 0x7fee4c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee60034000 tx=0x7fee6002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.543+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fee640538b0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.723+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6c0cd5f0 con 0x7fee6c15a5c0 2024-09-13T18:58:51.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.724+0000 7fee68c00640 1 -- 172.21.15.33:0/4011208731 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16513 (secure 0 0 0) 0x7fee64017090 con 0x7fee6c15a5c0 2024-09-13T18:58:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:51.727 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":46,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:48.923857+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 msgr2=0x7fee4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 0x7fee4c06d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee60034000 tx=0x7fee6002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 msgr2=0x7fee6c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c780 tx=0x7fee6400cb80 comp rx=0 tx=0).stop 2024-09-13T18:58:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 shutdown_connections 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee4c06ac00 0x7fee4c06d0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee6c15a5c0 0x7fee6c15c3b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee6c0cbac0 0x7fee6c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 --2- 172.21.15.33:0/4011208731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee6c0afe10 0x7fee6c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 >> 172.21.15.33:0/4011208731 conn(0x7fee6c0ae310 msgr2=0x7fee6c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 shutdown_connections 2024-09-13T18:58:51.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.727+0000 7fee72000640 1 -- 172.21.15.33:0/4011208731 wait complete. 2024-09-13T18:58:51.745 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:58:51.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:58:51.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.899+0000 7fd72b400640 1 Processor -- start 2024-09-13T18:58:51.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.899+0000 7fd72b400640 1 -- start start 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd724153b20 0x7fd7240b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 0x7fd7240b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 0x7fd72406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7240ce600 con 0x7fd724153b20 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd724070f90 con 0x7fd7240b2410 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.900+0000 7fd72b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd724153f00 con 0x7fd724159a80 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd724153b20 0x7fd7240b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd724153b20 0x7fd7240b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60082/0 (socket says 172.21.15.33:60082) 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 -- 172.21.15.33:0/3457133941 learned_addr learned my addr 172.21.15.33:0/3457133941 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd723e00640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 0x7fd7240b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 -- 172.21.15.33:0/3457133941 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 msgr2=0x7fd7240b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd729400640 1 --2- 172.21.15.33:0/3457133941 >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 0x7fd72406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 0x7fd7240b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 -- 172.21.15.33:0/3457133941 >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 msgr2=0x7fd72406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 --2- 172.21.15.33:0/3457133941 >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 0x7fd72406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd728a00640 1 -- 172.21.15.33:0/3457133941 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240b1a40 con 0x7fd724153b20 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd723e00640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 0x7fd7240b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.901+0000 7fd729400640 1 --2- 172.21.15.33:0/3457133941 >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 0x7fd72406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.902+0000 7fd728a00640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd724153b20 0x7fd7240b3990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd72406b800 tx=0x7fd71802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8092723a9acb43d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.902+0000 7fd723400640 1 -- 172.21.15.33:0/3457133941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718032440 con 0x7fd724153b20 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.902+0000 7fd723400640 1 -- 172.21.15.33:0/3457133941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180325a0 con 0x7fd724153b20 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.902+0000 7fd723400640 1 -- 172.21.15.33:0/3457133941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718032930 con 0x7fd724153b20 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 -- 172.21.15.33:0/3457133941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd724153b20 msgr2=0x7fd7240b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd724153b20 0x7fd7240b3990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd72406b800 tx=0x7fd71802a210 comp rx=0 tx=0).stop 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 -- 172.21.15.33:0/3457133941 shutdown_connections 2024-09-13T18:58:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724159a80 0x7fd7240b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 --2- 172.21.15.33:0/3457133941 >> v2:172.21.15.103:3300/0 conn(0x7fd7240b2410 0x7fd72406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 --2- 172.21.15.33:0/3457133941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd724153b20 0x7fd7240b3990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 -- 172.21.15.33:0/3457133941 >> 172.21.15.33:0/3457133941 conn(0x7fd7240b0510 msgr2=0x7fd7240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 -- 172.21.15.33:0/3457133941 shutdown_connections 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.903+0000 7fd72b400640 1 -- 172.21.15.33:0/3457133941 wait complete. 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.905+0000 7fd72b400640 1 Processor -- start 2024-09-13T18:58:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.905+0000 7fd72b400640 1 -- start start 2024-09-13T18:58:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724153b20 0x7fd72414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 0x7fd724156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd724156840 con 0x7fd7240b2410 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72414fd70 con 0x7fd724159a80 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd72b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd724154110 con 0x7fd724153b20 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60088/0 (socket says 172.21.15.33:60088) 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 -- 172.21.15.33:0/2204628533 learned_addr learned my addr 172.21.15.33:0/2204628533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd729400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 0x7fd724156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd723e00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724153b20 0x7fd72414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 -- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724153b20 msgr2=0x7fd72414f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724153b20 0x7fd72414f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 -- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 msgr2=0x7fd724156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.906+0000 7fd728a00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 0x7fd724156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd728a00640 1 -- 172.21.15.33:0/2204628533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180094d0 con 0x7fd7240b2410 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd729400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 0x7fd724156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd728a00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718032440 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718030ba0 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71803b400 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7241543b0 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.907+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7241594c0 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.908+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7240b3990 con 0x7fd7240b2410 2024-09-13T18:58:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.909+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd718039040 con 0x7fd7240b2410 2024-09-13T18:58:51.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.910+0000 7fd720c00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 0x7fd70406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:51.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.911+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7180a9d40 con 0x7fd7240b2410 2024-09-13T18:58:51.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.911+0000 7fd723e00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 0x7fd70406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:51.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.911+0000 7fd723e00640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 0x7fd70406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7240b0350 tx=0x7fd710008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:51.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:51.915+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd718074e80 con 0x7fd7240b2410 2024-09-13T18:58:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.096+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd72415a7b0 con 0x7fd70406ac00 2024-09-13T18:58:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.105+0000 7fd720c00640 1 -- 172.21.15.33:0/2204628533 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288911 (secure 0 0 0) 0x7fd71000c050 con 0x7fd70406ac00 2024-09-13T18:58:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:58:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 msgr2=0x7fd70406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 0x7fd70406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7240b0350 tx=0x7fd710008040 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 msgr2=0x7fd72414ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd7180046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 shutdown_connections 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd70406ac00 0x7fd70406d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd724159a80 0x7fd724156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd724153b20 0x7fd72414f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 --2- 172.21.15.33:0/2204628533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7240b2410 0x7fd72414ff40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 >> 172.21.15.33:0/2204628533 conn(0x7fd7240b0510 msgr2=0x7fd72406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 shutdown_connections 2024-09-13T18:58:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.109+0000 7fd72b400640 1 -- 172.21.15.33:0/2204628533 wait complete. 2024-09-13T18:58:52.129 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-13T18:58:51.117646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221372,"kb_used_data":5184,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753348,"statfs":{"total":773094113280,"available":772867428352,"internally_reserved":0,"allocated":5308416,"data_stored":2833599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.636801"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.945284+0000","last_change":"2024-09-13T18:58:47.936895+0000","last_active":"2024-09-13T18:58:47.945284+0000","last_peered":"2024-09-13T18:58:47.945284+0000","last_clean":"2024-09-13T18:58:47.945284+0000","last_became_active":"2024-09-13T18:58:47.936554+0000","last_became_peered":"2024-09-13T18:58:47.936554+0000","last_unstale":"2024-09-13T18:58:47.945284+0000","last_undegraded":"2024-09-13T18:58:47.945284+0000","last_fullsized":"2024-09-13T18:58:47.945284+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:52.334093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963411+0000","last_change":"2024-09-13T18:58:47.957491+0000","last_active":"2024-09-13T18:58:47.963411+0000","last_peered":"2024-09-13T18:58:47.963411+0000","last_clean":"2024-09-13T18:58:47.963411+0000","last_became_active":"2024-09-13T18:58:47.957167+0000","last_became_peered":"2024-09-13T18:58:47.957167+0000","last_unstale":"2024-09-13T18:58:47.963411+0000","last_undegraded":"2024-09-13T18:58:47.963411+0000","last_fullsized":"2024-09-13T18:58:47.963411+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950168+0000","last_change":"2024-09-13T18:58:47.947535+0000","last_active":"2024-09-13T18:58:47.950168+0000","last_peered":"2024-09-13T18:58:47.950168+0000","last_clean":"2024-09-13T18:58:47.950168+0000","last_became_active":"2024-09-13T18:58:47.947278+0000","last_became_peered":"2024-09-13T18:58:47.947278+0000","last_unstale":"2024-09-13T18:58:47.950168+0000","last_undegraded":"2024-09-13T18:58:47.950168+0000","last_fullsized":"2024-09-13T18:58:47.950168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:49.793180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965518+0000","last_change":"2024-09-13T18:58:47.956446+0000","last_active":"2024-09-13T18:58:47.965518+0000","last_peered":"2024-09-13T18:58:47.965518+0000","last_clean":"2024-09-13T18:58:47.965518+0000","last_became_active":"2024-09-13T18:58:47.953926+0000","last_became_peered":"2024-09-13T18:58:47.953926+0000","last_unstale":"2024-09-13T18:58:47.965518+0000","last_undegraded":"2024-09-13T18:58:47.965518+0000","last_fullsized":"2024-09-13T18:58:47.965518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:39.712523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.947950+0000","last_change":"2024-09-13T18:58:47.945273+0000","last_active":"2024-09-13T18:58:47.947950+0000","last_peered":"2024-09-13T18:58:47.947950+0000","last_clean":"2024-09-13T18:58:47.947950+0000","last_became_active":"2024-09-13T18:58:47.944203+0000","last_became_peered":"2024-09-13T18:58:47.944203+0000","last_unstale":"2024-09-13T18:58:47.947950+0000","last_undegraded":"2024-09-13T18:58:47.947950+0000","last_fullsized":"2024-09-13T18:58:47.947950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958832+0000","last_change":"2024-09-13T18:58:47.946855+0000","last_active":"2024-09-13T18:58:47.958832+0000","last_peered":"2024-09-13T18:58:47.958832+0000","last_clean":"2024-09-13T18:58:47.958832+0000","last_became_active":"2024-09-13T18:58:47.946619+0000","last_became_peered":"2024-09-13T18:58:47.946619+0000","last_unstale":"2024-09-13T18:58:47.958832+0000","last_undegraded":"2024-09-13T18:58:47.958832+0000","last_fullsized":"2024-09-13T18:58:47.958832+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:42.767156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952457+0000","last_change":"2024-09-13T18:58:47.947515+0000","last_active":"2024-09-13T18:58:47.952457+0000","last_peered":"2024-09-13T18:58:47.952457+0000","last_clean":"2024-09-13T18:58:47.952457+0000","last_became_active":"2024-09-13T18:58:47.947139+0000","last_became_peered":"2024-09-13T18:58:47.947139+0000","last_unstale":"2024-09-13T18:58:47.952457+0000","last_undegraded":"2024-09-13T18:58:47.952457+0000","last_fullsized":"2024-09-13T18:58:47.952457+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:23.926096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952455+0000","last_change":"2024-09-13T18:58:47.943308+0000","last_active":"2024-09-13T18:58:47.952455+0000","last_peered":"2024-09-13T18:58:47.952455+0000","last_clean":"2024-09-13T18:58:47.952455+0000","last_became_active":"2024-09-13T18:58:47.940099+0000","last_became_peered":"2024-09-13T18:58:47.940099+0000","last_unstale":"2024-09-13T18:58:47.952455+0000","last_undegraded":"2024-09-13T18:58:47.952455+0000","last_fullsized":"2024-09-13T18:58:47.952455+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960343+0000","last_change":"2024-09-13T18:58:47.950270+0000","last_active":"2024-09-13T18:58:47.960343+0000","last_peered":"2024-09-13T18:58:47.960343+0000","last_clean":"2024-09-13T18:58:47.960343+0000","last_became_active":"2024-09-13T18:58:47.949223+0000","last_became_peered":"2024-09-13T18:58:47.949223+0000","last_unstale":"2024-09-13T18:58:47.960343+0000","last_undegraded":"2024-09-13T18:58:47.960343+0000","last_fullsized":"2024-09-13T18:58:47.960343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965489+0000","last_change":"2024-09-13T18:58:47.955345+0000","last_active":"2024-09-13T18:58:47.965489+0000","last_peered":"2024-09-13T18:58:47.965489+0000","last_clean":"2024-09-13T18:58:47.965489+0000","last_became_active":"2024-09-13T18:58:47.954526+0000","last_became_peered":"2024-09-13T18:58:47.954526+0000","last_unstale":"2024-09-13T18:58:47.965489+0000","last_undegraded":"2024-09-13T18:58:47.965489+0000","last_fullsized":"2024-09-13T18:58:47.965489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:37.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960252+0000","last_change":"2024-09-13T18:58:47.949859+0000","last_active":"2024-09-13T18:58:47.960252+0000","last_peered":"2024-09-13T18:58:47.960252+0000","last_clean":"2024-09-13T18:58:47.960252+0000","last_became_active":"2024-09-13T18:58:47.949540+0000","last_became_peered":"2024-09-13T18:58:47.949540+0000","last_unstale":"2024-09-13T18:58:47.960252+0000","last_undegraded":"2024-09-13T18:58:47.960252+0000","last_fullsized":"2024-09-13T18:58:47.960252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:24.358542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963906+0000","last_change":"2024-09-13T18:58:47.960412+0000","last_active":"2024-09-13T18:58:47.963906+0000","last_peered":"2024-09-13T18:58:47.963906+0000","last_clean":"2024-09-13T18:58:47.963906+0000","last_became_active":"2024-09-13T18:58:47.960117+0000","last_became_peered":"2024-09-13T18:58:47.960117+0000","last_unstale":"2024-09-13T18:58:47.963906+0000","last_undegraded":"2024-09-13T18:58:47.963906+0000","last_fullsized":"2024-09-13T18:58:47.963906+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952649+0000","last_change":"2024-09-13T18:58:47.945451+0000","last_active":"2024-09-13T18:58:47.952649+0000","last_peered":"2024-09-13T18:58:47.952649+0000","last_clean":"2024-09-13T18:58:47.952649+0000","last_became_active":"2024-09-13T18:58:47.944125+0000","last_became_peered":"2024-09-13T18:58:47.944125+0000","last_unstale":"2024-09-13T18:58:47.952649+0000","last_undegraded":"2024-09-13T18:58:47.952649+0000","last_fullsized":"2024-09-13T18:58:47.952649+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:54.797382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965134+0000","last_change":"2024-09-13T18:58:47.948381+0000","last_active":"2024-09-13T18:58:47.965134+0000","last_peered":"2024-09-13T18:58:47.965134+0000","last_clean":"2024-09-13T18:58:47.965134+0000","last_became_active":"2024-09-13T18:58:47.948098+0000","last_became_peered":"2024-09-13T18:58:47.948098+0000","last_unstale":"2024-09-13T18:58:47.965134+0000","last_undegraded":"2024-09-13T18:58:47.965134+0000","last_fullsized":"2024-09-13T18:58:47.965134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.187769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956104+0000","last_change":"2024-09-13T18:58:47.940832+0000","last_active":"2024-09-13T18:58:47.956104+0000","last_peered":"2024-09-13T18:58:47.956104+0000","last_clean":"2024-09-13T18:58:47.956104+0000","last_became_active":"2024-09-13T18:58:47.940534+0000","last_became_peered":"2024-09-13T18:58:47.940534+0000","last_unstale":"2024-09-13T18:58:47.956104+0000","last_undegraded":"2024-09-13T18:58:47.956104+0000","last_fullsized":"2024-09-13T18:58:47.956104+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:39.712523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.940690+0000","last_change":"2024-09-13T18:58:47.937085+0000","last_active":"2024-09-13T18:58:47.940690+0000","last_peered":"2024-09-13T18:58:47.940690+0000","last_clean":"2024-09-13T18:58:47.940690+0000","last_became_active":"2024-09-13T18:58:47.936827+0000","last_became_peered":"2024-09-13T18:58:47.936827+0000","last_unstale":"2024-09-13T18:58:47.940690+0000","last_undegraded":"2024-09-13T18:58:47.940690+0000","last_fullsized":"2024-09-13T18:58:47.940690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:23.523911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.945862+0000","last_change":"2024-09-13T18:58:47.942377+0000","last_active":"2024-09-13T18:58:47.945862+0000","last_peered":"2024-09-13T18:58:47.945862+0000","last_clean":"2024-09-13T18:58:47.945862+0000","last_became_active":"2024-09-13T18:58:47.942112+0000","last_became_peered":"2024-09-13T18:58:47.942112+0000","last_unstale":"2024-09-13T18:58:47.945862+0000","last_undegraded":"2024-09-13T18:58:47.945862+0000","last_fullsized":"2024-09-13T18:58:47.945862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963366+0000","last_change":"2024-09-13T18:58:47.954813+0000","last_active":"2024-09-13T18:58:47.963366+0000","last_peered":"2024-09-13T18:58:47.963366+0000","last_clean":"2024-09-13T18:58:47.963366+0000","last_became_active":"2024-09-13T18:58:47.954511+0000","last_became_peered":"2024-09-13T18:58:47.954511+0000","last_unstale":"2024-09-13T18:58:47.963366+0000","last_undegraded":"2024-09-13T18:58:47.963366+0000","last_fullsized":"2024-09-13T18:58:47.963366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:16.743681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955833+0000","last_change":"2024-09-13T18:58:47.952278+0000","last_active":"2024-09-13T18:58:47.955833+0000","last_peered":"2024-09-13T18:58:47.955833+0000","last_clean":"2024-09-13T18:58:47.955833+0000","last_became_active":"2024-09-13T18:58:47.951979+0000","last_became_peered":"2024-09-13T18:58:47.951979+0000","last_unstale":"2024-09-13T18:58:47.955833+0000","last_undegraded":"2024-09-13T18:58:47.955833+0000","last_fullsized":"2024-09-13T18:58:47.955833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.167679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958514+0000","last_change":"2024-09-13T18:58:47.953759+0000","last_active":"2024-09-13T18:58:47.958514+0000","last_peered":"2024-09-13T18:58:47.958514+0000","last_clean":"2024-09-13T18:58:47.958514+0000","last_became_active":"2024-09-13T18:58:47.953465+0000","last_became_peered":"2024-09-13T18:58:47.953465+0000","last_unstale":"2024-09-13T18:58:47.958514+0000","last_undegraded":"2024-09-13T18:58:47.958514+0000","last_fullsized":"2024-09-13T18:58:47.958514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:02.880307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958783+0000","last_change":"2024-09-13T18:58:47.946746+0000","last_active":"2024-09-13T18:58:47.958783+0000","last_peered":"2024-09-13T18:58:47.958783+0000","last_clean":"2024-09-13T18:58:47.958783+0000","last_became_active":"2024-09-13T18:58:47.944319+0000","last_became_peered":"2024-09-13T18:58:47.944319+0000","last_unstale":"2024-09-13T18:58:47.958783+0000","last_undegraded":"2024-09-13T18:58:47.958783+0000","last_fullsized":"2024-09-13T18:58:47.958783+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:32.899139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953041+0000","last_change":"2024-09-13T18:58:47.940939+0000","last_active":"2024-09-13T18:58:47.953041+0000","last_peered":"2024-09-13T18:58:47.953041+0000","last_clean":"2024-09-13T18:58:47.953041+0000","last_became_active":"2024-09-13T18:58:47.940660+0000","last_became_peered":"2024-09-13T18:58:47.940660+0000","last_unstale":"2024-09-13T18:58:47.953041+0000","last_undegraded":"2024-09-13T18:58:47.953041+0000","last_fullsized":"2024-09-13T18:58:47.953041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:31.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955468+0000","last_change":"2024-09-13T18:58:47.948238+0000","last_active":"2024-09-13T18:58:47.955468+0000","last_peered":"2024-09-13T18:58:47.955468+0000","last_clean":"2024-09-13T18:58:47.955468+0000","last_became_active":"2024-09-13T18:58:47.947773+0000","last_became_peered":"2024-09-13T18:58:47.947773+0000","last_unstale":"2024-09-13T18:58:47.955468+0000","last_undegraded":"2024-09-13T18:58:47.955468+0000","last_fullsized":"2024-09-13T18:58:47.955468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:31.249447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955610+0000","last_change":"2024-09-13T18:58:47.948780+0000","last_active":"2024-09-13T18:58:47.955610+0000","last_peered":"2024-09-13T18:58:47.955610+0000","last_clean":"2024-09-13T18:58:47.955610+0000","last_became_active":"2024-09-13T18:58:47.947065+0000","last_became_peered":"2024-09-13T18:58:47.947065+0000","last_unstale":"2024-09-13T18:58:47.955610+0000","last_undegraded":"2024-09-13T18:58:47.955610+0000","last_fullsized":"2024-09-13T18:58:47.955610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:30.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955900+0000","last_change":"2024-09-13T18:58:47.948978+0000","last_active":"2024-09-13T18:58:47.955900+0000","last_peered":"2024-09-13T18:58:47.955900+0000","last_clean":"2024-09-13T18:58:47.955900+0000","last_became_active":"2024-09-13T18:58:47.948725+0000","last_became_peered":"2024-09-13T18:58:47.948725+0000","last_unstale":"2024-09-13T18:58:47.955900+0000","last_undegraded":"2024-09-13T18:58:47.955900+0000","last_fullsized":"2024-09-13T18:58:47.955900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:52.848738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959082+0000","last_change":"2024-09-13T18:58:47.946174+0000","last_active":"2024-09-13T18:58:47.959082+0000","last_peered":"2024-09-13T18:58:47.959082+0000","last_clean":"2024-09-13T18:58:47.959082+0000","last_became_active":"2024-09-13T18:58:47.945611+0000","last_became_peered":"2024-09-13T18:58:47.945611+0000","last_unstale":"2024-09-13T18:58:47.959082+0000","last_undegraded":"2024-09-13T18:58:47.959082+0000","last_fullsized":"2024-09-13T18:58:47.959082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:57.160886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.946788+0000","last_change":"2024-09-13T18:58:47.942423+0000","last_active":"2024-09-13T18:58:47.946788+0000","last_peered":"2024-09-13T18:58:47.946788+0000","last_clean":"2024-09-13T18:58:47.946788+0000","last_became_active":"2024-09-13T18:58:47.942140+0000","last_became_peered":"2024-09-13T18:58:47.942140+0000","last_unstale":"2024-09-13T18:58:47.946788+0000","last_undegraded":"2024-09-13T18:58:47.946788+0000","last_fullsized":"2024-09-13T18:58:47.946788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963418+0000","last_change":"2024-09-13T18:58:47.956310+0000","last_active":"2024-09-13T18:58:47.963418+0000","last_peered":"2024-09-13T18:58:47.963418+0000","last_clean":"2024-09-13T18:58:47.963418+0000","last_became_active":"2024-09-13T18:58:47.956079+0000","last_became_peered":"2024-09-13T18:58:47.956079+0000","last_unstale":"2024-09-13T18:58:47.963418+0000","last_undegraded":"2024-09-13T18:58:47.963418+0000","last_fullsized":"2024-09-13T18:58:47.963418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955859+0000","last_change":"2024-09-13T18:58:47.949463+0000","last_active":"2024-09-13T18:58:47.955859+0000","last_peered":"2024-09-13T18:58:47.955859+0000","last_clean":"2024-09-13T18:58:47.955859+0000","last_became_active":"2024-09-13T18:58:47.949187+0000","last_became_peered":"2024-09-13T18:58:47.949187+0000","last_unstale":"2024-09-13T18:58:47.955859+0000","last_undegraded":"2024-09-13T18:58:47.955859+0000","last_fullsized":"2024-09-13T18:58:47.955859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:29.670002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.941918+0000","last_change":"2024-09-13T18:58:47.939851+0000","last_active":"2024-09-13T18:58:47.941918+0000","last_peered":"2024-09-13T18:58:47.941918+0000","last_clean":"2024-09-13T18:58:47.941918+0000","last_became_active":"2024-09-13T18:58:47.939536+0000","last_became_peered":"2024-09-13T18:58:47.939536+0000","last_unstale":"2024-09-13T18:58:47.941918+0000","last_undegraded":"2024-09-13T18:58:47.941918+0000","last_fullsized":"2024-09-13T18:58:47.941918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:17.237878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960079+0000","last_change":"2024-09-13T18:58:47.951192+0000","last_active":"2024-09-13T18:58:47.960079+0000","last_peered":"2024-09-13T18:58:47.960079+0000","last_clean":"2024-09-13T18:58:47.960079+0000","last_became_active":"2024-09-13T18:58:47.950608+0000","last_became_peered":"2024-09-13T18:58:47.950608+0000","last_unstale":"2024-09-13T18:58:47.960079+0000","last_undegraded":"2024-09-13T18:58:47.960079+0000","last_fullsized":"2024-09-13T18:58:47.960079+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952985+0000","last_change":"2024-09-13T18:58:47.949311+0000","last_active":"2024-09-13T18:58:47.952985+0000","last_peered":"2024-09-13T18:58:47.952985+0000","last_clean":"2024-09-13T18:58:47.952985+0000","last_became_active":"2024-09-13T18:58:47.949030+0000","last_became_peered":"2024-09-13T18:58:47.949030+0000","last_unstale":"2024-09-13T18:58:47.952985+0000","last_undegraded":"2024-09-13T18:58:47.952985+0000","last_fullsized":"2024-09-13T18:58:47.952985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:24.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.961425+0000","last_change":"2024-09-13T18:58:47.956958+0000","last_active":"2024-09-13T18:58:47.961425+0000","last_peered":"2024-09-13T18:58:47.961425+0000","last_clean":"2024-09-13T18:58:47.961425+0000","last_became_active":"2024-09-13T18:58:47.956714+0000","last_became_peered":"2024-09-13T18:58:47.956714+0000","last_unstale":"2024-09-13T18:58:47.961425+0000","last_undegraded":"2024-09-13T18:58:47.961425+0000","last_fullsized":"2024-09-13T18:58:47.961425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:50.250970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956014+0000","last_change":"2024-09-13T18:58:47.508920+0000","last_active":"2024-09-13T18:58:47.956014+0000","last_peered":"2024-09-13T18:58:47.956014+0000","last_clean":"2024-09-13T18:58:47.956014+0000","last_became_active":"2024-09-13T18:58:47.508687+0000","last_became_peered":"2024-09-13T18:58:47.508687+0000","last_unstale":"2024-09-13T18:58:47.956014+0000","last_undegraded":"2024-09-13T18:58:47.956014+0000","last_fullsized":"2024-09-13T18:58:47.956014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:13.242211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.941370+0000","last_change":"2024-09-13T18:58:47.937519+0000","last_active":"2024-09-13T18:58:47.941370+0000","last_peered":"2024-09-13T18:58:47.941370+0000","last_clean":"2024-09-13T18:58:47.941370+0000","last_became_active":"2024-09-13T18:58:47.937089+0000","last_became_peered":"2024-09-13T18:58:47.937089+0000","last_unstale":"2024-09-13T18:58:47.941370+0000","last_undegraded":"2024-09-13T18:58:47.941370+0000","last_fullsized":"2024-09-13T18:58:47.941370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:02.880307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.957794+0000","last_change":"2024-09-13T18:58:47.511409+0000","last_active":"2024-09-13T18:58:47.957794+0000","last_peered":"2024-09-13T18:58:47.957794+0000","last_clean":"2024-09-13T18:58:47.957794+0000","last_became_active":"2024-09-13T18:58:47.511127+0000","last_became_peered":"2024-09-13T18:58:47.511127+0000","last_unstale":"2024-09-13T18:58:47.957794+0000","last_undegraded":"2024-09-13T18:58:47.957794+0000","last_fullsized":"2024-09-13T18:58:47.957794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.871345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955353+0000","last_change":"2024-09-13T18:58:47.949870+0000","last_active":"2024-09-13T18:58:47.955353+0000","last_peered":"2024-09-13T18:58:47.955353+0000","last_clean":"2024-09-13T18:58:47.955353+0000","last_became_active":"2024-09-13T18:58:47.949516+0000","last_became_peered":"2024-09-13T18:58:47.949516+0000","last_unstale":"2024-09-13T18:58:47.955353+0000","last_undegraded":"2024-09-13T18:58:47.955353+0000","last_fullsized":"2024-09-13T18:58:47.955353+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:17.237878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949421+0000","last_change":"2024-09-13T18:58:47.510310+0000","last_active":"2024-09-13T18:58:47.949421+0000","last_peered":"2024-09-13T18:58:47.949421+0000","last_clean":"2024-09-13T18:58:47.949421+0000","last_became_active":"2024-09-13T18:58:47.510067+0000","last_became_peered":"2024-09-13T18:58:47.510067+0000","last_unstale":"2024-09-13T18:58:47.949421+0000","last_undegraded":"2024-09-13T18:58:47.949421+0000","last_fullsized":"2024-09-13T18:58:47.949421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:36.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951770+0000","last_change":"2024-09-13T18:58:47.945768+0000","last_active":"2024-09-13T18:58:47.951770+0000","last_peered":"2024-09-13T18:58:47.951770+0000","last_clean":"2024-09-13T18:58:47.951770+0000","last_became_active":"2024-09-13T18:58:47.944582+0000","last_became_peered":"2024-09-13T18:58:47.944582+0000","last_unstale":"2024-09-13T18:58:47.951770+0000","last_undegraded":"2024-09-13T18:58:47.951770+0000","last_fullsized":"2024-09-13T18:58:47.951770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950652+0000","last_change":"2024-09-13T18:58:47.509312+0000","last_active":"2024-09-13T18:58:47.950652+0000","last_peered":"2024-09-13T18:58:47.950652+0000","last_clean":"2024-09-13T18:58:47.950652+0000","last_became_active":"2024-09-13T18:58:47.508963+0000","last_became_peered":"2024-09-13T18:58:47.508963+0000","last_unstale":"2024-09-13T18:58:47.950652+0000","last_undegraded":"2024-09-13T18:58:47.950652+0000","last_fullsized":"2024-09-13T18:58:47.950652+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:41.931110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.938398+0000","last_change":"2024-09-13T18:58:47.935179+0000","last_active":"2024-09-13T18:58:47.938398+0000","last_peered":"2024-09-13T18:58:47.938398+0000","last_clean":"2024-09-13T18:58:47.938398+0000","last_became_active":"2024-09-13T18:58:47.934926+0000","last_became_peered":"2024-09-13T18:58:47.934926+0000","last_unstale":"2024-09-13T18:58:47.938398+0000","last_undegraded":"2024-09-13T18:58:47.938398+0000","last_fullsized":"2024-09-13T18:58:47.938398+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956794+0000","last_change":"2024-09-13T18:58:47.503566+0000","last_active":"2024-09-13T18:58:47.956794+0000","last_peered":"2024-09-13T18:58:47.956794+0000","last_clean":"2024-09-13T18:58:47.956794+0000","last_became_active":"2024-09-13T18:58:47.503244+0000","last_became_peered":"2024-09-13T18:58:47.503244+0000","last_unstale":"2024-09-13T18:58:47.956794+0000","last_undegraded":"2024-09-13T18:58:47.956794+0000","last_fullsized":"2024-09-13T18:58:47.956794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:32.512250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965214+0000","last_change":"2024-09-13T18:58:47.954240+0000","last_active":"2024-09-13T18:58:47.965214+0000","last_peered":"2024-09-13T18:58:47.965214+0000","last_clean":"2024-09-13T18:58:47.965214+0000","last_became_active":"2024-09-13T18:58:47.953993+0000","last_became_peered":"2024-09-13T18:58:47.953993+0000","last_unstale":"2024-09-13T18:58:47.965214+0000","last_undegraded":"2024-09-13T18:58:47.965214+0000","last_fullsized":"2024-09-13T18:58:47.965214+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:16.743681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958213+0000","last_change":"2024-09-13T18:58:47.513830+0000","last_active":"2024-09-13T18:58:47.958213+0000","last_peered":"2024-09-13T18:58:47.958213+0000","last_clean":"2024-09-13T18:58:47.958213+0000","last_became_active":"2024-09-13T18:58:47.510287+0000","last_became_peered":"2024-09-13T18:58:47.510287+0000","last_unstale":"2024-09-13T18:58:47.958213+0000","last_undegraded":"2024-09-13T18:58:47.958213+0000","last_fullsized":"2024-09-13T18:58:47.958213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.151924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949290+0000","last_change":"2024-09-13T18:58:47.940280+0000","last_active":"2024-09-13T18:58:47.949290+0000","last_peered":"2024-09-13T18:58:47.949290+0000","last_clean":"2024-09-13T18:58:47.949290+0000","last_became_active":"2024-09-13T18:58:47.940039+0000","last_became_peered":"2024-09-13T18:58:47.940039+0000","last_unstale":"2024-09-13T18:58:47.949290+0000","last_undegraded":"2024-09-13T18:58:47.949290+0000","last_fullsized":"2024-09-13T18:58:47.949290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:07.695144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.933913+0000","last_change":"2024-09-13T18:58:47.508155+0000","last_active":"2024-09-13T18:58:47.933913+0000","last_peered":"2024-09-13T18:58:47.933913+0000","last_clean":"2024-09-13T18:58:47.933913+0000","last_became_active":"2024-09-13T18:58:47.507852+0000","last_became_peered":"2024-09-13T18:58:47.507852+0000","last_unstale":"2024-09-13T18:58:47.933913+0000","last_undegraded":"2024-09-13T18:58:47.933913+0000","last_fullsized":"2024-09-13T18:58:47.933913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:36.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955444+0000","last_change":"2024-09-13T18:58:47.948076+0000","last_active":"2024-09-13T18:58:47.955444+0000","last_peered":"2024-09-13T18:58:47.955444+0000","last_clean":"2024-09-13T18:58:47.955444+0000","last_became_active":"2024-09-13T18:58:47.947379+0000","last_became_peered":"2024-09-13T18:58:47.947379+0000","last_unstale":"2024-09-13T18:58:47.955444+0000","last_undegraded":"2024-09-13T18:58:47.955444+0000","last_fullsized":"2024-09-13T18:58:47.955444+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:57.160886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939188+0000","last_change":"2024-09-13T18:58:47.516796+0000","last_active":"2024-09-13T18:58:47.939188+0000","last_peered":"2024-09-13T18:58:47.939188+0000","last_clean":"2024-09-13T18:58:47.939188+0000","last_became_active":"2024-09-13T18:58:47.515686+0000","last_became_peered":"2024-09-13T18:58:47.515686+0000","last_unstale":"2024-09-13T18:58:47.939188+0000","last_undegraded":"2024-09-13T18:58:47.939188+0000","last_fullsized":"2024-09-13T18:58:47.939188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.871345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963348+0000","last_change":"2024-09-13T18:58:47.954721+0000","last_active":"2024-09-13T18:58:47.963348+0000","last_peered":"2024-09-13T18:58:47.963348+0000","last_clean":"2024-09-13T18:58:47.963348+0000","last_became_active":"2024-09-13T18:58:47.954441+0000","last_became_peered":"2024-09-13T18:58:47.954441+0000","last_unstale":"2024-09-13T18:58:47.963348+0000","last_undegraded":"2024-09-13T18:58:47.963348+0000","last_fullsized":"2024-09-13T18:58:47.963348+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.931134+0000","last_change":"2024-09-13T18:58:47.511685+0000","last_active":"2024-09-13T18:58:47.931134+0000","last_peered":"2024-09-13T18:58:47.931134+0000","last_clean":"2024-09-13T18:58:47.931134+0000","last_became_active":"2024-09-13T18:58:47.511472+0000","last_became_peered":"2024-09-13T18:58:47.511472+0000","last_unstale":"2024-09-13T18:58:47.931134+0000","last_undegraded":"2024-09-13T18:58:47.931134+0000","last_fullsized":"2024-09-13T18:58:47.931134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.661040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949748+0000","last_change":"2024-09-13T18:58:47.945475+0000","last_active":"2024-09-13T18:58:47.949748+0000","last_peered":"2024-09-13T18:58:47.949748+0000","last_clean":"2024-09-13T18:58:47.949748+0000","last_became_active":"2024-09-13T18:58:47.944561+0000","last_became_peered":"2024-09-13T18:58:47.944561+0000","last_unstale":"2024-09-13T18:58:47.949748+0000","last_undegraded":"2024-09-13T18:58:47.949748+0000","last_fullsized":"2024-09-13T18:58:47.949748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:07.695144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.943085+0000","last_change":"2024-09-13T18:58:47.515701+0000","last_active":"2024-09-13T18:58:47.943085+0000","last_peered":"2024-09-13T18:58:47.943085+0000","last_clean":"2024-09-13T18:58:47.943085+0000","last_became_active":"2024-09-13T18:58:47.515089+0000","last_became_peered":"2024-09-13T18:58:47.515089+0000","last_unstale":"2024-09-13T18:58:47.943085+0000","last_undegraded":"2024-09-13T18:58:47.943085+0000","last_fullsized":"2024-09-13T18:58:47.943085+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:53.788419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960945+0000","last_change":"2024-09-13T18:58:47.958599+0000","last_active":"2024-09-13T18:58:47.960945+0000","last_peered":"2024-09-13T18:58:47.960945+0000","last_clean":"2024-09-13T18:58:47.960945+0000","last_became_active":"2024-09-13T18:58:47.958317+0000","last_became_peered":"2024-09-13T18:58:47.958317+0000","last_unstale":"2024-09-13T18:58:47.960945+0000","last_undegraded":"2024-09-13T18:58:47.960945+0000","last_fullsized":"2024-09-13T18:58:47.960945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:41.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956069+0000","last_change":"2024-09-13T18:58:47.513569+0000","last_active":"2024-09-13T18:58:47.956069+0000","last_peered":"2024-09-13T18:58:47.956069+0000","last_clean":"2024-09-13T18:58:47.956069+0000","last_became_active":"2024-09-13T18:58:47.513294+0000","last_became_peered":"2024-09-13T18:58:47.513294+0000","last_unstale":"2024-09-13T18:58:47.956069+0000","last_undegraded":"2024-09-13T18:58:47.956069+0000","last_fullsized":"2024-09-13T18:58:47.956069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:38.051253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955116+0000","last_change":"2024-09-13T18:58:47.951429+0000","last_active":"2024-09-13T18:58:47.955116+0000","last_peered":"2024-09-13T18:58:47.955116+0000","last_clean":"2024-09-13T18:58:47.955116+0000","last_became_active":"2024-09-13T18:58:47.951033+0000","last_became_peered":"2024-09-13T18:58:47.951033+0000","last_unstale":"2024-09-13T18:58:47.955116+0000","last_undegraded":"2024-09-13T18:58:47.955116+0000","last_fullsized":"2024-09-13T18:58:47.955116+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.187769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.968151+0000","last_change":"2024-09-13T18:58:47.511496+0000","last_active":"2024-09-13T18:58:47.968151+0000","last_peered":"2024-09-13T18:58:47.968151+0000","last_clean":"2024-09-13T18:58:47.968151+0000","last_became_active":"2024-09-13T18:58:47.511213+0000","last_became_peered":"2024-09-13T18:58:47.511213+0000","last_unstale":"2024-09-13T18:58:47.968151+0000","last_undegraded":"2024-09-13T18:58:47.968151+0000","last_fullsized":"2024-09-13T18:58:47.968151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:12.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953119+0000","last_change":"2024-09-13T18:58:47.940762+0000","last_active":"2024-09-13T18:58:47.953119+0000","last_peered":"2024-09-13T18:58:47.953119+0000","last_clean":"2024-09-13T18:58:47.953119+0000","last_became_active":"2024-09-13T18:58:47.940432+0000","last_became_peered":"2024-09-13T18:58:47.940432+0000","last_unstale":"2024-09-13T18:58:47.953119+0000","last_undegraded":"2024-09-13T18:58:47.953119+0000","last_fullsized":"2024-09-13T18:58:47.953119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:24.105515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965960+0000","last_change":"2024-09-13T18:58:47.511419+0000","last_active":"2024-09-13T18:58:47.965960+0000","last_peered":"2024-09-13T18:58:47.965960+0000","last_clean":"2024-09-13T18:58:47.965960+0000","last_became_active":"2024-09-13T18:58:47.511147+0000","last_became_peered":"2024-09-13T18:58:47.511147+0000","last_unstale":"2024-09-13T18:58:47.965960+0000","last_undegraded":"2024-09-13T18:58:47.965960+0000","last_fullsized":"2024-09-13T18:58:47.965960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:48.784217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951590+0000","last_change":"2024-09-13T18:58:47.946421+0000","last_active":"2024-09-13T18:58:47.951590+0000","last_peered":"2024-09-13T18:58:47.951590+0000","last_clean":"2024-09-13T18:58:47.951590+0000","last_became_active":"2024-09-13T18:58:47.946181+0000","last_became_peered":"2024-09-13T18:58:47.946181+0000","last_unstale":"2024-09-13T18:58:47.951590+0000","last_undegraded":"2024-09-13T18:58:47.951590+0000","last_fullsized":"2024-09-13T18:58:47.951590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:23.926096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928284+0000","last_change":"2024-09-13T18:58:47.513103+0000","last_active":"2024-09-13T18:58:47.928284+0000","last_peered":"2024-09-13T18:58:47.928284+0000","last_clean":"2024-09-13T18:58:47.928284+0000","last_became_active":"2024-09-13T18:58:47.512647+0000","last_became_peered":"2024-09-13T18:58:47.512647+0000","last_unstale":"2024-09-13T18:58:47.928284+0000","last_undegraded":"2024-09-13T18:58:47.928284+0000","last_fullsized":"2024-09-13T18:58:47.928284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.275093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958606+0000","last_change":"2024-09-13T18:58:47.944811+0000","last_active":"2024-09-13T18:58:47.958606+0000","last_peered":"2024-09-13T18:58:47.958606+0000","last_clean":"2024-09-13T18:58:47.958606+0000","last_became_active":"2024-09-13T18:58:47.944559+0000","last_became_peered":"2024-09-13T18:58:47.944559+0000","last_unstale":"2024-09-13T18:58:47.958606+0000","last_undegraded":"2024-09-13T18:58:47.958606+0000","last_fullsized":"2024-09-13T18:58:47.958606+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:31.155863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934434+0000","last_change":"2024-09-13T18:58:47.512913+0000","last_active":"2024-09-13T18:58:47.934434+0000","last_peered":"2024-09-13T18:58:47.934434+0000","last_clean":"2024-09-13T18:58:47.934434+0000","last_became_active":"2024-09-13T18:58:47.512659+0000","last_became_peered":"2024-09-13T18:58:47.512659+0000","last_unstale":"2024-09-13T18:58:47.934434+0000","last_undegraded":"2024-09-13T18:58:47.934434+0000","last_fullsized":"2024-09-13T18:58:47.934434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:38.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.944809+0000","last_change":"2024-09-13T18:58:47.943151+0000","last_active":"2024-09-13T18:58:47.944809+0000","last_peered":"2024-09-13T18:58:47.944809+0000","last_clean":"2024-09-13T18:58:47.944809+0000","last_became_active":"2024-09-13T18:58:47.942839+0000","last_became_peered":"2024-09-13T18:58:47.942839+0000","last_unstale":"2024-09-13T18:58:47.944809+0000","last_undegraded":"2024-09-13T18:58:47.944809+0000","last_fullsized":"2024-09-13T18:58:47.944809+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965727+0000","last_change":"2024-09-13T18:58:47.516752+0000","last_active":"2024-09-13T18:58:47.965727+0000","last_peered":"2024-09-13T18:58:47.965727+0000","last_clean":"2024-09-13T18:58:47.965727+0000","last_became_active":"2024-09-13T18:58:47.515267+0000","last_became_peered":"2024-09-13T18:58:47.515267+0000","last_unstale":"2024-09-13T18:58:47.965727+0000","last_undegraded":"2024-09-13T18:58:47.965727+0000","last_fullsized":"2024-09-13T18:58:47.965727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.151924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959101+0000","last_change":"2024-09-13T18:58:47.946280+0000","last_active":"2024-09-13T18:58:47.959101+0000","last_peered":"2024-09-13T18:58:47.959101+0000","last_clean":"2024-09-13T18:58:47.959101+0000","last_became_active":"2024-09-13T18:58:47.945927+0000","last_became_peered":"2024-09-13T18:58:47.945927+0000","last_unstale":"2024-09-13T18:58:47.959101+0000","last_undegraded":"2024-09-13T18:58:47.959101+0000","last_fullsized":"2024-09-13T18:58:47.959101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:08.457497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952823+0000","last_change":"2024-09-13T18:58:47.513408+0000","last_active":"2024-09-13T18:58:47.952823+0000","last_peered":"2024-09-13T18:58:47.952823+0000","last_clean":"2024-09-13T18:58:47.952823+0000","last_became_active":"2024-09-13T18:58:47.513101+0000","last_became_peered":"2024-09-13T18:58:47.513101+0000","last_unstale":"2024-09-13T18:58:47.952823+0000","last_undegraded":"2024-09-13T18:58:47.952823+0000","last_fullsized":"2024-09-13T18:58:47.952823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.125819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965724+0000","last_change":"2024-09-13T18:58:47.960259+0000","last_active":"2024-09-13T18:58:47.965724+0000","last_peered":"2024-09-13T18:58:47.965724+0000","last_clean":"2024-09-13T18:58:47.965724+0000","last_became_active":"2024-09-13T18:58:47.959678+0000","last_became_peered":"2024-09-13T18:58:47.959678+0000","last_unstale":"2024-09-13T18:58:47.965724+0000","last_undegraded":"2024-09-13T18:58:47.965724+0000","last_fullsized":"2024-09-13T18:58:47.965724+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.961664+0000","last_change":"2024-09-13T18:58:47.502162+0000","last_active":"2024-09-13T18:58:47.961664+0000","last_peered":"2024-09-13T18:58:47.961664+0000","last_clean":"2024-09-13T18:58:47.961664+0000","last_became_active":"2024-09-13T18:58:47.501911+0000","last_became_peered":"2024-09-13T18:58:47.501911+0000","last_unstale":"2024-09-13T18:58:47.961664+0000","last_undegraded":"2024-09-13T18:58:47.961664+0000","last_fullsized":"2024-09-13T18:58:47.961664+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:51.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953155+0000","last_change":"2024-09-13T18:58:47.941499+0000","last_active":"2024-09-13T18:58:47.953155+0000","last_peered":"2024-09-13T18:58:47.953155+0000","last_clean":"2024-09-13T18:58:47.953155+0000","last_became_active":"2024-09-13T18:58:47.941220+0000","last_became_peered":"2024-09-13T18:58:47.941220+0000","last_unstale":"2024-09-13T18:58:47.953155+0000","last_undegraded":"2024-09-13T18:58:47.953155+0000","last_fullsized":"2024-09-13T18:58:47.953155+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:19.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952189+0000","last_change":"2024-09-13T18:58:47.509900+0000","last_active":"2024-09-13T18:58:47.952189+0000","last_peered":"2024-09-13T18:58:47.952189+0000","last_clean":"2024-09-13T18:58:47.952189+0000","last_became_active":"2024-09-13T18:58:47.508698+0000","last_became_peered":"2024-09-13T18:58:47.508698+0000","last_unstale":"2024-09-13T18:58:47.952189+0000","last_undegraded":"2024-09-13T18:58:47.952189+0000","last_fullsized":"2024-09-13T18:58:47.952189+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955699+0000","last_change":"2024-09-13T18:58:47.948818+0000","last_active":"2024-09-13T18:58:47.955699+0000","last_peered":"2024-09-13T18:58:47.955699+0000","last_clean":"2024-09-13T18:58:47.955699+0000","last_became_active":"2024-09-13T18:58:47.948526+0000","last_became_peered":"2024-09-13T18:58:47.948526+0000","last_unstale":"2024-09-13T18:58:47.955699+0000","last_undegraded":"2024-09-13T18:58:47.955699+0000","last_fullsized":"2024-09-13T18:58:47.955699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:18.452770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934210+0000","last_change":"2024-09-13T18:58:47.508027+0000","last_active":"2024-09-13T18:58:47.934210+0000","last_peered":"2024-09-13T18:58:47.934210+0000","last_clean":"2024-09-13T18:58:47.934210+0000","last_became_active":"2024-09-13T18:58:47.507792+0000","last_became_peered":"2024-09-13T18:58:47.507792+0000","last_unstale":"2024-09-13T18:58:47.934210+0000","last_undegraded":"2024-09-13T18:58:47.934210+0000","last_fullsized":"2024-09-13T18:58:47.934210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.275093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959158+0000","last_change":"2024-09-13T18:58:47.948202+0000","last_active":"2024-09-13T18:58:47.959158+0000","last_peered":"2024-09-13T18:58:47.959158+0000","last_clean":"2024-09-13T18:58:47.959158+0000","last_became_active":"2024-09-13T18:58:47.947545+0000","last_became_peered":"2024-09-13T18:58:47.947545+0000","last_unstale":"2024-09-13T18:58:47.959158+0000","last_undegraded":"2024-09-13T18:58:47.959158+0000","last_fullsized":"2024-09-13T18:58:47.959158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:23.545533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956857+0000","last_change":"2024-09-13T18:58:47.506264+0000","last_active":"2024-09-13T18:58:47.956857+0000","last_peered":"2024-09-13T18:58:47.956857+0000","last_clean":"2024-09-13T18:58:47.956857+0000","last_became_active":"2024-09-13T18:58:47.506000+0000","last_became_peered":"2024-09-13T18:58:47.506000+0000","last_unstale":"2024-09-13T18:58:47.956857+0000","last_undegraded":"2024-09-13T18:58:47.956857+0000","last_fullsized":"2024-09-13T18:58:47.956857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:16.228915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950346+0000","last_change":"2024-09-13T18:58:47.944544+0000","last_active":"2024-09-13T18:58:47.950346+0000","last_peered":"2024-09-13T18:58:47.950346+0000","last_clean":"2024-09-13T18:58:47.950346+0000","last_became_active":"2024-09-13T18:58:47.944223+0000","last_became_peered":"2024-09-13T18:58:47.944223+0000","last_unstale":"2024-09-13T18:58:47.950346+0000","last_undegraded":"2024-09-13T18:58:47.950346+0000","last_fullsized":"2024-09-13T18:58:47.950346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:39.060215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939438+0000","last_change":"2024-09-13T18:58:47.510010+0000","last_active":"2024-09-13T18:58:47.939438+0000","last_peered":"2024-09-13T18:58:47.939438+0000","last_clean":"2024-09-13T18:58:47.939438+0000","last_became_active":"2024-09-13T18:58:47.509715+0000","last_became_peered":"2024-09-13T18:58:47.509715+0000","last_unstale":"2024-09-13T18:58:47.939438+0000","last_undegraded":"2024-09-13T18:58:47.939438+0000","last_fullsized":"2024-09-13T18:58:47.939438+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.661040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.943404+0000","last_change":"2024-09-13T18:58:47.936830+0000","last_active":"2024-09-13T18:58:47.943404+0000","last_peered":"2024-09-13T18:58:47.943404+0000","last_clean":"2024-09-13T18:58:47.943404+0000","last_became_active":"2024-09-13T18:58:47.936594+0000","last_became_peered":"2024-09-13T18:58:47.936594+0000","last_unstale":"2024-09-13T18:58:47.943404+0000","last_undegraded":"2024-09-13T18:58:47.943404+0000","last_fullsized":"2024-09-13T18:58:47.943404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:19.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.938186+0000","last_change":"2024-09-13T18:58:47.517160+0000","last_active":"2024-09-13T18:58:47.938186+0000","last_peered":"2024-09-13T18:58:47.938186+0000","last_clean":"2024-09-13T18:58:47.938186+0000","last_became_active":"2024-09-13T18:58:47.516304+0000","last_became_peered":"2024-09-13T18:58:47.516304+0000","last_unstale":"2024-09-13T18:58:47.938186+0000","last_undegraded":"2024-09-13T18:58:47.938186+0000","last_fullsized":"2024-09-13T18:58:47.938186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:18.488857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951741+0000","last_change":"2024-09-13T18:58:47.946075+0000","last_active":"2024-09-13T18:58:47.951741+0000","last_peered":"2024-09-13T18:58:47.951741+0000","last_clean":"2024-09-13T18:58:47.951741+0000","last_became_active":"2024-09-13T18:58:47.945791+0000","last_became_peered":"2024-09-13T18:58:47.945791+0000","last_unstale":"2024-09-13T18:58:47.951741+0000","last_undegraded":"2024-09-13T18:58:47.951741+0000","last_fullsized":"2024-09-13T18:58:47.951741+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928008+0000","last_change":"2024-09-13T18:58:47.513703+0000","last_active":"2024-09-13T18:58:47.928008+0000","last_peered":"2024-09-13T18:58:47.928008+0000","last_clean":"2024-09-13T18:58:47.928008+0000","last_became_active":"2024-09-13T18:58:47.512616+0000","last_became_peered":"2024-09-13T18:58:47.512616+0000","last_unstale":"2024-09-13T18:58:47.928008+0000","last_undegraded":"2024-09-13T18:58:47.928008+0000","last_fullsized":"2024-09-13T18:58:47.928008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:13.242211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955916+0000","last_change":"2024-09-13T18:58:47.951936+0000","last_active":"2024-09-13T18:58:47.955916+0000","last_peered":"2024-09-13T18:58:47.955916+0000","last_clean":"2024-09-13T18:58:47.955916+0000","last_became_active":"2024-09-13T18:58:47.951577+0000","last_became_peered":"2024-09-13T18:58:47.951577+0000","last_unstale":"2024-09-13T18:58:47.955916+0000","last_undegraded":"2024-09-13T18:58:47.955916+0000","last_fullsized":"2024-09-13T18:58:47.955916+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:37.612422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934711+0000","last_change":"2024-09-13T18:58:47.504611+0000","last_active":"2024-09-13T18:58:47.934711+0000","last_peered":"2024-09-13T18:58:47.934711+0000","last_clean":"2024-09-13T18:58:47.934711+0000","last_became_active":"2024-09-13T18:58:47.504352+0000","last_became_peered":"2024-09-13T18:58:47.504352+0000","last_unstale":"2024-09-13T18:58:47.934711+0000","last_undegraded":"2024-09-13T18:58:47.934711+0000","last_fullsized":"2024-09-13T18:58:47.934711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:49.242007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960361+0000","last_change":"2024-09-13T18:58:47.948440+0000","last_active":"2024-09-13T18:58:47.960361+0000","last_peered":"2024-09-13T18:58:47.960361+0000","last_clean":"2024-09-13T18:58:47.960361+0000","last_became_active":"2024-09-13T18:58:47.948146+0000","last_became_peered":"2024-09-13T18:58:47.948146+0000","last_unstale":"2024-09-13T18:58:47.960361+0000","last_undegraded":"2024-09-13T18:58:47.960361+0000","last_fullsized":"2024-09-13T18:58:47.960361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928968+0000","last_change":"2024-09-13T18:58:47.510539+0000","last_active":"2024-09-13T18:58:47.928968+0000","last_peered":"2024-09-13T18:58:47.928968+0000","last_clean":"2024-09-13T18:58:47.928968+0000","last_became_active":"2024-09-13T18:58:47.508294+0000","last_became_peered":"2024-09-13T18:58:47.508294+0000","last_unstale":"2024-09-13T18:58:47.928968+0000","last_undegraded":"2024-09-13T18:58:47.928968+0000","last_fullsized":"2024-09-13T18:58:47.928968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:38.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952288+0000","last_change":"2024-09-13T18:58:47.947778+0000","last_active":"2024-09-13T18:58:47.952288+0000","last_peered":"2024-09-13T18:58:47.952288+0000","last_clean":"2024-09-13T18:58:47.952288+0000","last_became_active":"2024-09-13T18:58:47.947517+0000","last_became_peered":"2024-09-13T18:58:47.947517+0000","last_unstale":"2024-09-13T18:58:47.952288+0000","last_undegraded":"2024-09-13T18:58:47.952288+0000","last_fullsized":"2024-09-13T18:58:47.952288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:24.358542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934906+0000","last_change":"2024-09-13T18:58:47.512153+0000","last_active":"2024-09-13T18:58:47.934906+0000","last_peered":"2024-09-13T18:58:47.934906+0000","last_clean":"2024-09-13T18:58:47.934906+0000","last_became_active":"2024-09-13T18:58:47.511587+0000","last_became_peered":"2024-09-13T18:58:47.511587+0000","last_unstale":"2024-09-13T18:58:47.934906+0000","last_undegraded":"2024-09-13T18:58:47.934906+0000","last_fullsized":"2024-09-13T18:58:47.934906+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960530+0000","last_change":"2024-09-13T18:58:47.952790+0000","last_active":"2024-09-13T18:58:47.960530+0000","last_peered":"2024-09-13T18:58:47.960530+0000","last_clean":"2024-09-13T18:58:47.960530+0000","last_became_active":"2024-09-13T18:58:47.952515+0000","last_became_peered":"2024-09-13T18:58:47.952515+0000","last_unstale":"2024-09-13T18:58:47.960530+0000","last_undegraded":"2024-09-13T18:58:47.960530+0000","last_fullsized":"2024-09-13T18:58:47.960530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:37.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928001+0000","last_change":"2024-09-13T18:58:47.510803+0000","last_active":"2024-09-13T18:58:47.928001+0000","last_peered":"2024-09-13T18:58:47.928001+0000","last_clean":"2024-09-13T18:58:47.928001+0000","last_became_active":"2024-09-13T18:58:47.510529+0000","last_became_peered":"2024-09-13T18:58:47.510529+0000","last_unstale":"2024-09-13T18:58:47.928001+0000","last_undegraded":"2024-09-13T18:58:47.928001+0000","last_fullsized":"2024-09-13T18:58:47.928001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:49.242007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958904+0000","last_change":"2024-09-13T18:58:47.947014+0000","last_active":"2024-09-13T18:58:47.958904+0000","last_peered":"2024-09-13T18:58:47.958904+0000","last_clean":"2024-09-13T18:58:47.958904+0000","last_became_active":"2024-09-13T18:58:47.946505+0000","last_became_peered":"2024-09-13T18:58:47.946505+0000","last_unstale":"2024-09-13T18:58:47.958904+0000","last_undegraded":"2024-09-13T18:58:47.958904+0000","last_fullsized":"2024-09-13T18:58:47.958904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:55.112391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.929747+0000","last_change":"2024-09-13T18:58:47.498614+0000","last_active":"2024-09-13T18:58:47.929747+0000","last_peered":"2024-09-13T18:58:47.929747+0000","last_clean":"2024-09-13T18:58:47.929747+0000","last_became_active":"2024-09-13T18:58:47.497704+0000","last_became_peered":"2024-09-13T18:58:47.497704+0000","last_unstale":"2024-09-13T18:58:47.929747+0000","last_undegraded":"2024-09-13T18:58:47.929747+0000","last_fullsized":"2024-09-13T18:58:47.929747+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:23.705468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955258+0000","last_change":"2024-09-13T18:58:47.948447+0000","last_active":"2024-09-13T18:58:47.955258+0000","last_peered":"2024-09-13T18:58:47.955258+0000","last_clean":"2024-09-13T18:58:47.955258+0000","last_became_active":"2024-09-13T18:58:47.948171+0000","last_became_peered":"2024-09-13T18:58:47.948171+0000","last_unstale":"2024-09-13T18:58:47.955258+0000","last_undegraded":"2024-09-13T18:58:47.955258+0000","last_fullsized":"2024-09-13T18:58:47.955258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:49.793180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.933082+0000","last_change":"2024-09-13T18:58:47.508207+0000","last_active":"2024-09-13T18:58:47.933082+0000","last_peered":"2024-09-13T18:58:47.933082+0000","last_clean":"2024-09-13T18:58:47.933082+0000","last_became_active":"2024-09-13T18:58:47.507951+0000","last_became_peered":"2024-09-13T18:58:47.507951+0000","last_unstale":"2024-09-13T18:58:47.933082+0000","last_undegraded":"2024-09-13T18:58:47.933082+0000","last_fullsized":"2024-09-13T18:58:47.933082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:22.514949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.944554+0000","last_change":"2024-09-13T18:58:47.941914+0000","last_active":"2024-09-13T18:58:47.944554+0000","last_peered":"2024-09-13T18:58:47.944554+0000","last_clean":"2024-09-13T18:58:47.944554+0000","last_became_active":"2024-09-13T18:58:47.941613+0000","last_became_peered":"2024-09-13T18:58:47.941613+0000","last_unstale":"2024-09-13T18:58:47.944554+0000","last_undegraded":"2024-09-13T18:58:47.944554+0000","last_fullsized":"2024-09-13T18:58:47.944554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939575+0000","last_change":"2024-09-13T18:58:47.514043+0000","last_active":"2024-09-13T18:58:47.939575+0000","last_peered":"2024-09-13T18:58:47.939575+0000","last_clean":"2024-09-13T18:58:47.939575+0000","last_became_active":"2024-09-13T18:58:47.513780+0000","last_became_peered":"2024-09-13T18:58:47.513780+0000","last_unstale":"2024-09-13T18:58:47.939575+0000","last_undegraded":"2024-09-13T18:58:47.939575+0000","last_fullsized":"2024-09-13T18:58:47.939575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:23.705468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965458+0000","last_change":"2024-09-13T18:58:47.955068+0000","last_active":"2024-09-13T18:58:47.965458+0000","last_peered":"2024-09-13T18:58:47.965458+0000","last_clean":"2024-09-13T18:58:47.965458+0000","last_became_active":"2024-09-13T18:58:47.954825+0000","last_became_peered":"2024-09-13T18:58:47.954825+0000","last_unstale":"2024-09-13T18:58:47.965458+0000","last_undegraded":"2024-09-13T18:58:47.965458+0000","last_fullsized":"2024-09-13T18:58:47.965458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:52.334093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960951+0000","last_change":"2024-09-13T18:58:47.514373+0000","last_active":"2024-09-13T18:58:47.960951+0000","last_peered":"2024-09-13T18:58:47.960951+0000","last_clean":"2024-09-13T18:58:47.960951+0000","last_became_active":"2024-09-13T18:58:47.513188+0000","last_became_peered":"2024-09-13T18:58:47.513188+0000","last_unstale":"2024-09-13T18:58:47.960951+0000","last_undegraded":"2024-09-13T18:58:47.960951+0000","last_fullsized":"2024-09-13T18:58:47.960951+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:22.514949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.492410+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:58:47.492410+0000","last_peered":"2024-09-13T18:58:47.492410+0000","last_clean":"2024-09-13T18:58:47.492410+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:58:47.492410+0000","last_undegraded":"2024-09-13T18:58:47.492410+0000","last_fullsized":"2024-09-13T18:58:47.492410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":797687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.86699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.002}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.497},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.81999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.79800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.621}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.745},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.873}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.0069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":791420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.505},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:58:52.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:58:52.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.321+0000 7f1155000640 1 Processor -- start 2024-09-13T18:58:52.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.322+0000 7f1155000640 1 -- start start 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f1155000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f11500ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f1155000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1150071560 0x7f11500b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f1155000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500cd850 con 0x7f115006f4b0 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f1155000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500cd570 con 0x7f1150071560 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f1155000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500b1740 con 0x7f1150159480 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f114fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1150071560 0x7f11500b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f114fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1150071560 0x7f11500b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60096/0 (socket says 172.21.15.33:60096) 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f114fe00640 1 -- 172.21.15.33:0/2764570163 learned_addr learned my addr 172.21.15.33:0/2764570163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.323+0000 7f114f400640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f11500ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.324+0000 7f114fe00640 1 -- 172.21.15.33:0/2764570163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 msgr2=0x7f11500ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:52.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.324+0000 7f114fe00640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f11500ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.324+0000 7f114fe00640 1 -- 172.21.15.33:0/2764570163 >> v1:172.21.15.103:6789/0 conn(0x7f115006f4b0 legacy=0x7f1150070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.324+0000 7f114fe00640 1 -- 172.21.15.33:0/2764570163 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500b1a20 con 0x7f1150071560 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f114fe00640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f11500b2220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1148009e50 tx=0x7f114802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54c93c377c37e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f114ea00640 1 -- 172.21.15.33:0/2764570163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114802aea0 con 0x7f1150071560 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f114ea00640 1 -- 172.21.15.33:0/2764570163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114802d050 con 0x7f1150071560 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f114ea00640 1 -- 172.21.15.33:0/2764570163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148031820 con 0x7f1150071560 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f1155000640 1 -- 172.21.15.33:0/2764570163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 msgr2=0x7f11500b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.325+0000 7f1155000640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f11500b2220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1148009e50 tx=0x7f114802a680 comp rx=0 tx=0).stop 2024-09-13T18:58:52.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 -- 172.21.15.33:0/2764570163 shutdown_connections 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f11500b2220 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 --2- 172.21.15.33:0/2764570163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f11500ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 -- 172.21.15.33:0/2764570163 >> 172.21.15.33:0/2764570163 conn(0x7f11500ae310 msgr2=0x7f11500ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 -- 172.21.15.33:0/2764570163 shutdown_connections 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.326+0000 7f1155000640 1 -- 172.21.15.33:0/2764570163 wait complete. 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.327+0000 7f1155000640 1 Processor -- start 2024-09-13T18:58:52.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.327+0000 7f1155000640 1 -- start start 2024-09-13T18:58:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 0x7f1150158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f115014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115014ff90 con 0x7f1150071560 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150150270 con 0x7f115006f4b0 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1155000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1150150550 con 0x7f1150159480 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.328+0000 7f1147e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60104/0 (socket says 172.21.15.33:60104) 2024-09-13T18:58:52.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 -- 172.21.15.33:0/2600084284 learned_addr learned my addr 172.21.15.33:0/2600084284 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 -- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 msgr2=0x7f115014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f115014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 -- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 msgr2=0x7f1150158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f114f400640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 0x7f1150158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 0x7f1150158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 -- 172.21.15.33:0/2600084284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009b30 con 0x7f1150071560 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f114f400640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 0x7f1150158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.329+0000 7f1147e00640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f113800c450 tx=0x7f113800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.330+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380052d0 con 0x7f1150071560 2024-09-13T18:58:52.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.330+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138005430 con 0x7f1150071560 2024-09-13T18:58:52.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.330+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138012870 con 0x7f1150071560 2024-09-13T18:58:52.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.330+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1150150830 con 0x7f1150071560 2024-09-13T18:58:52.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.330+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115014cf00 con 0x7f1150071560 2024-09-13T18:58:52.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.331+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1150067360 con 0x7f1150071560 2024-09-13T18:58:52.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.332+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f11380129d0 con 0x7f1150071560 2024-09-13T18:58:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.332+0000 7f1147400640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 0x7f112c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.333+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1138088ed0 con 0x7f1150071560 2024-09-13T18:58:52.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.333+0000 7f114f400640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 0x7f112c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.334+0000 7f114f400640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 0x7f112c06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1140006fd0 tx=0x7f1140008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.337+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f11380540a0 con 0x7f1150071560 2024-09-13T18:58:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.513+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11500ce280 con 0x7f112c06ac00 2024-09-13T18:58:52.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.521+0000 7f1147400640 1 -- 172.21.15.33:0/2600084284 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288911 (secure 0 0 0) 0x7f1140009550 con 0x7f112c06ac00 2024-09-13T18:58:52.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:52.529 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:58:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 msgr2=0x7f112c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 0x7f112c06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1140006fd0 tx=0x7f1140008040 comp rx=0 tx=0).stop 2024-09-13T18:58:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 msgr2=0x7f115014f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f113800c450 tx=0x7f113800c910 comp rx=0 tx=0).stop 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 shutdown_connections 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f112c06ac00 0x7f112c06d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1150159480 0x7f115014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1150071560 0x7f115014f6b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 --2- 172.21.15.33:0/2600084284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f115006f4b0 0x7f1150158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 >> 172.21.15.33:0/2600084284 conn(0x7f11500ae310 msgr2=0x7f1150153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 shutdown_connections 2024-09-13T18:58:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.525+0000 7f1155000640 1 -- 172.21.15.33:0/2600084284 wait complete. 2024-09-13T18:58:52.547 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-13T18:58:51.117646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221372,"kb_used_data":5184,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753348,"statfs":{"total":773094113280,"available":772867428352,"internally_reserved":0,"allocated":5308416,"data_stored":2833599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.636801"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.945284+0000","last_change":"2024-09-13T18:58:47.936895+0000","last_active":"2024-09-13T18:58:47.945284+0000","last_peered":"2024-09-13T18:58:47.945284+0000","last_clean":"2024-09-13T18:58:47.945284+0000","last_became_active":"2024-09-13T18:58:47.936554+0000","last_became_peered":"2024-09-13T18:58:47.936554+0000","last_unstale":"2024-09-13T18:58:47.945284+0000","last_undegraded":"2024-09-13T18:58:47.945284+0000","last_fullsized":"2024-09-13T18:58:47.945284+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:52.334093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963411+0000","last_change":"2024-09-13T18:58:47.957491+0000","last_active":"2024-09-13T18:58:47.963411+0000","last_peered":"2024-09-13T18:58:47.963411+0000","last_clean":"2024-09-13T18:58:47.963411+0000","last_became_active":"2024-09-13T18:58:47.957167+0000","last_became_peered":"2024-09-13T18:58:47.957167+0000","last_unstale":"2024-09-13T18:58:47.963411+0000","last_undegraded":"2024-09-13T18:58:47.963411+0000","last_fullsized":"2024-09-13T18:58:47.963411+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950168+0000","last_change":"2024-09-13T18:58:47.947535+0000","last_active":"2024-09-13T18:58:47.950168+0000","last_peered":"2024-09-13T18:58:47.950168+0000","last_clean":"2024-09-13T18:58:47.950168+0000","last_became_active":"2024-09-13T18:58:47.947278+0000","last_became_peered":"2024-09-13T18:58:47.947278+0000","last_unstale":"2024-09-13T18:58:47.950168+0000","last_undegraded":"2024-09-13T18:58:47.950168+0000","last_fullsized":"2024-09-13T18:58:47.950168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:49.793180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965518+0000","last_change":"2024-09-13T18:58:47.956446+0000","last_active":"2024-09-13T18:58:47.965518+0000","last_peered":"2024-09-13T18:58:47.965518+0000","last_clean":"2024-09-13T18:58:47.965518+0000","last_became_active":"2024-09-13T18:58:47.953926+0000","last_became_peered":"2024-09-13T18:58:47.953926+0000","last_unstale":"2024-09-13T18:58:47.965518+0000","last_undegraded":"2024-09-13T18:58:47.965518+0000","last_fullsized":"2024-09-13T18:58:47.965518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:39.712523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.947950+0000","last_change":"2024-09-13T18:58:47.945273+0000","last_active":"2024-09-13T18:58:47.947950+0000","last_peered":"2024-09-13T18:58:47.947950+0000","last_clean":"2024-09-13T18:58:47.947950+0000","last_became_active":"2024-09-13T18:58:47.944203+0000","last_became_peered":"2024-09-13T18:58:47.944203+0000","last_unstale":"2024-09-13T18:58:47.947950+0000","last_undegraded":"2024-09-13T18:58:47.947950+0000","last_fullsized":"2024-09-13T18:58:47.947950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958832+0000","last_change":"2024-09-13T18:58:47.946855+0000","last_active":"2024-09-13T18:58:47.958832+0000","last_peered":"2024-09-13T18:58:47.958832+0000","last_clean":"2024-09-13T18:58:47.958832+0000","last_became_active":"2024-09-13T18:58:47.946619+0000","last_became_peered":"2024-09-13T18:58:47.946619+0000","last_unstale":"2024-09-13T18:58:47.958832+0000","last_undegraded":"2024-09-13T18:58:47.958832+0000","last_fullsized":"2024-09-13T18:58:47.958832+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:42.767156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952457+0000","last_change":"2024-09-13T18:58:47.947515+0000","last_active":"2024-09-13T18:58:47.952457+0000","last_peered":"2024-09-13T18:58:47.952457+0000","last_clean":"2024-09-13T18:58:47.952457+0000","last_became_active":"2024-09-13T18:58:47.947139+0000","last_became_peered":"2024-09-13T18:58:47.947139+0000","last_unstale":"2024-09-13T18:58:47.952457+0000","last_undegraded":"2024-09-13T18:58:47.952457+0000","last_fullsized":"2024-09-13T18:58:47.952457+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:23.926096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952455+0000","last_change":"2024-09-13T18:58:47.943308+0000","last_active":"2024-09-13T18:58:47.952455+0000","last_peered":"2024-09-13T18:58:47.952455+0000","last_clean":"2024-09-13T18:58:47.952455+0000","last_became_active":"2024-09-13T18:58:47.940099+0000","last_became_peered":"2024-09-13T18:58:47.940099+0000","last_unstale":"2024-09-13T18:58:47.952455+0000","last_undegraded":"2024-09-13T18:58:47.952455+0000","last_fullsized":"2024-09-13T18:58:47.952455+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960343+0000","last_change":"2024-09-13T18:58:47.950270+0000","last_active":"2024-09-13T18:58:47.960343+0000","last_peered":"2024-09-13T18:58:47.960343+0000","last_clean":"2024-09-13T18:58:47.960343+0000","last_became_active":"2024-09-13T18:58:47.949223+0000","last_became_peered":"2024-09-13T18:58:47.949223+0000","last_unstale":"2024-09-13T18:58:47.960343+0000","last_undegraded":"2024-09-13T18:58:47.960343+0000","last_fullsized":"2024-09-13T18:58:47.960343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965489+0000","last_change":"2024-09-13T18:58:47.955345+0000","last_active":"2024-09-13T18:58:47.965489+0000","last_peered":"2024-09-13T18:58:47.965489+0000","last_clean":"2024-09-13T18:58:47.965489+0000","last_became_active":"2024-09-13T18:58:47.954526+0000","last_became_peered":"2024-09-13T18:58:47.954526+0000","last_unstale":"2024-09-13T18:58:47.965489+0000","last_undegraded":"2024-09-13T18:58:47.965489+0000","last_fullsized":"2024-09-13T18:58:47.965489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:37.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960252+0000","last_change":"2024-09-13T18:58:47.949859+0000","last_active":"2024-09-13T18:58:47.960252+0000","last_peered":"2024-09-13T18:58:47.960252+0000","last_clean":"2024-09-13T18:58:47.960252+0000","last_became_active":"2024-09-13T18:58:47.949540+0000","last_became_peered":"2024-09-13T18:58:47.949540+0000","last_unstale":"2024-09-13T18:58:47.960252+0000","last_undegraded":"2024-09-13T18:58:47.960252+0000","last_fullsized":"2024-09-13T18:58:47.960252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:24.358542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963906+0000","last_change":"2024-09-13T18:58:47.960412+0000","last_active":"2024-09-13T18:58:47.963906+0000","last_peered":"2024-09-13T18:58:47.963906+0000","last_clean":"2024-09-13T18:58:47.963906+0000","last_became_active":"2024-09-13T18:58:47.960117+0000","last_became_peered":"2024-09-13T18:58:47.960117+0000","last_unstale":"2024-09-13T18:58:47.963906+0000","last_undegraded":"2024-09-13T18:58:47.963906+0000","last_fullsized":"2024-09-13T18:58:47.963906+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952649+0000","last_change":"2024-09-13T18:58:47.945451+0000","last_active":"2024-09-13T18:58:47.952649+0000","last_peered":"2024-09-13T18:58:47.952649+0000","last_clean":"2024-09-13T18:58:47.952649+0000","last_became_active":"2024-09-13T18:58:47.944125+0000","last_became_peered":"2024-09-13T18:58:47.944125+0000","last_unstale":"2024-09-13T18:58:47.952649+0000","last_undegraded":"2024-09-13T18:58:47.952649+0000","last_fullsized":"2024-09-13T18:58:47.952649+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:54.797382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965134+0000","last_change":"2024-09-13T18:58:47.948381+0000","last_active":"2024-09-13T18:58:47.965134+0000","last_peered":"2024-09-13T18:58:47.965134+0000","last_clean":"2024-09-13T18:58:47.965134+0000","last_became_active":"2024-09-13T18:58:47.948098+0000","last_became_peered":"2024-09-13T18:58:47.948098+0000","last_unstale":"2024-09-13T18:58:47.965134+0000","last_undegraded":"2024-09-13T18:58:47.965134+0000","last_fullsized":"2024-09-13T18:58:47.965134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.187769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956104+0000","last_change":"2024-09-13T18:58:47.940832+0000","last_active":"2024-09-13T18:58:47.956104+0000","last_peered":"2024-09-13T18:58:47.956104+0000","last_clean":"2024-09-13T18:58:47.956104+0000","last_became_active":"2024-09-13T18:58:47.940534+0000","last_became_peered":"2024-09-13T18:58:47.940534+0000","last_unstale":"2024-09-13T18:58:47.956104+0000","last_undegraded":"2024-09-13T18:58:47.956104+0000","last_fullsized":"2024-09-13T18:58:47.956104+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:39.712523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.940690+0000","last_change":"2024-09-13T18:58:47.937085+0000","last_active":"2024-09-13T18:58:47.940690+0000","last_peered":"2024-09-13T18:58:47.940690+0000","last_clean":"2024-09-13T18:58:47.940690+0000","last_became_active":"2024-09-13T18:58:47.936827+0000","last_became_peered":"2024-09-13T18:58:47.936827+0000","last_unstale":"2024-09-13T18:58:47.940690+0000","last_undegraded":"2024-09-13T18:58:47.940690+0000","last_fullsized":"2024-09-13T18:58:47.940690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:23.523911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.945862+0000","last_change":"2024-09-13T18:58:47.942377+0000","last_active":"2024-09-13T18:58:47.945862+0000","last_peered":"2024-09-13T18:58:47.945862+0000","last_clean":"2024-09-13T18:58:47.945862+0000","last_became_active":"2024-09-13T18:58:47.942112+0000","last_became_peered":"2024-09-13T18:58:47.942112+0000","last_unstale":"2024-09-13T18:58:47.945862+0000","last_undegraded":"2024-09-13T18:58:47.945862+0000","last_fullsized":"2024-09-13T18:58:47.945862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963366+0000","last_change":"2024-09-13T18:58:47.954813+0000","last_active":"2024-09-13T18:58:47.963366+0000","last_peered":"2024-09-13T18:58:47.963366+0000","last_clean":"2024-09-13T18:58:47.963366+0000","last_became_active":"2024-09-13T18:58:47.954511+0000","last_became_peered":"2024-09-13T18:58:47.954511+0000","last_unstale":"2024-09-13T18:58:47.963366+0000","last_undegraded":"2024-09-13T18:58:47.963366+0000","last_fullsized":"2024-09-13T18:58:47.963366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:16.743681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955833+0000","last_change":"2024-09-13T18:58:47.952278+0000","last_active":"2024-09-13T18:58:47.955833+0000","last_peered":"2024-09-13T18:58:47.955833+0000","last_clean":"2024-09-13T18:58:47.955833+0000","last_became_active":"2024-09-13T18:58:47.951979+0000","last_became_peered":"2024-09-13T18:58:47.951979+0000","last_unstale":"2024-09-13T18:58:47.955833+0000","last_undegraded":"2024-09-13T18:58:47.955833+0000","last_fullsized":"2024-09-13T18:58:47.955833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.167679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958514+0000","last_change":"2024-09-13T18:58:47.953759+0000","last_active":"2024-09-13T18:58:47.958514+0000","last_peered":"2024-09-13T18:58:47.958514+0000","last_clean":"2024-09-13T18:58:47.958514+0000","last_became_active":"2024-09-13T18:58:47.953465+0000","last_became_peered":"2024-09-13T18:58:47.953465+0000","last_unstale":"2024-09-13T18:58:47.958514+0000","last_undegraded":"2024-09-13T18:58:47.958514+0000","last_fullsized":"2024-09-13T18:58:47.958514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:02.880307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958783+0000","last_change":"2024-09-13T18:58:47.946746+0000","last_active":"2024-09-13T18:58:47.958783+0000","last_peered":"2024-09-13T18:58:47.958783+0000","last_clean":"2024-09-13T18:58:47.958783+0000","last_became_active":"2024-09-13T18:58:47.944319+0000","last_became_peered":"2024-09-13T18:58:47.944319+0000","last_unstale":"2024-09-13T18:58:47.958783+0000","last_undegraded":"2024-09-13T18:58:47.958783+0000","last_fullsized":"2024-09-13T18:58:47.958783+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:32.899139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953041+0000","last_change":"2024-09-13T18:58:47.940939+0000","last_active":"2024-09-13T18:58:47.953041+0000","last_peered":"2024-09-13T18:58:47.953041+0000","last_clean":"2024-09-13T18:58:47.953041+0000","last_became_active":"2024-09-13T18:58:47.940660+0000","last_became_peered":"2024-09-13T18:58:47.940660+0000","last_unstale":"2024-09-13T18:58:47.953041+0000","last_undegraded":"2024-09-13T18:58:47.953041+0000","last_fullsized":"2024-09-13T18:58:47.953041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:31.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955468+0000","last_change":"2024-09-13T18:58:47.948238+0000","last_active":"2024-09-13T18:58:47.955468+0000","last_peered":"2024-09-13T18:58:47.955468+0000","last_clean":"2024-09-13T18:58:47.955468+0000","last_became_active":"2024-09-13T18:58:47.947773+0000","last_became_peered":"2024-09-13T18:58:47.947773+0000","last_unstale":"2024-09-13T18:58:47.955468+0000","last_undegraded":"2024-09-13T18:58:47.955468+0000","last_fullsized":"2024-09-13T18:58:47.955468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:31.249447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955610+0000","last_change":"2024-09-13T18:58:47.948780+0000","last_active":"2024-09-13T18:58:47.955610+0000","last_peered":"2024-09-13T18:58:47.955610+0000","last_clean":"2024-09-13T18:58:47.955610+0000","last_became_active":"2024-09-13T18:58:47.947065+0000","last_became_peered":"2024-09-13T18:58:47.947065+0000","last_unstale":"2024-09-13T18:58:47.955610+0000","last_undegraded":"2024-09-13T18:58:47.955610+0000","last_fullsized":"2024-09-13T18:58:47.955610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:30.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955900+0000","last_change":"2024-09-13T18:58:47.948978+0000","last_active":"2024-09-13T18:58:47.955900+0000","last_peered":"2024-09-13T18:58:47.955900+0000","last_clean":"2024-09-13T18:58:47.955900+0000","last_became_active":"2024-09-13T18:58:47.948725+0000","last_became_peered":"2024-09-13T18:58:47.948725+0000","last_unstale":"2024-09-13T18:58:47.955900+0000","last_undegraded":"2024-09-13T18:58:47.955900+0000","last_fullsized":"2024-09-13T18:58:47.955900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:52.848738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959082+0000","last_change":"2024-09-13T18:58:47.946174+0000","last_active":"2024-09-13T18:58:47.959082+0000","last_peered":"2024-09-13T18:58:47.959082+0000","last_clean":"2024-09-13T18:58:47.959082+0000","last_became_active":"2024-09-13T18:58:47.945611+0000","last_became_peered":"2024-09-13T18:58:47.945611+0000","last_unstale":"2024-09-13T18:58:47.959082+0000","last_undegraded":"2024-09-13T18:58:47.959082+0000","last_fullsized":"2024-09-13T18:58:47.959082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:57.160886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.946788+0000","last_change":"2024-09-13T18:58:47.942423+0000","last_active":"2024-09-13T18:58:47.946788+0000","last_peered":"2024-09-13T18:58:47.946788+0000","last_clean":"2024-09-13T18:58:47.946788+0000","last_became_active":"2024-09-13T18:58:47.942140+0000","last_became_peered":"2024-09-13T18:58:47.942140+0000","last_unstale":"2024-09-13T18:58:47.946788+0000","last_undegraded":"2024-09-13T18:58:47.946788+0000","last_fullsized":"2024-09-13T18:58:47.946788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963418+0000","last_change":"2024-09-13T18:58:47.956310+0000","last_active":"2024-09-13T18:58:47.963418+0000","last_peered":"2024-09-13T18:58:47.963418+0000","last_clean":"2024-09-13T18:58:47.963418+0000","last_became_active":"2024-09-13T18:58:47.956079+0000","last_became_peered":"2024-09-13T18:58:47.956079+0000","last_unstale":"2024-09-13T18:58:47.963418+0000","last_undegraded":"2024-09-13T18:58:47.963418+0000","last_fullsized":"2024-09-13T18:58:47.963418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:43.503086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955859+0000","last_change":"2024-09-13T18:58:47.949463+0000","last_active":"2024-09-13T18:58:47.955859+0000","last_peered":"2024-09-13T18:58:47.955859+0000","last_clean":"2024-09-13T18:58:47.955859+0000","last_became_active":"2024-09-13T18:58:47.949187+0000","last_became_peered":"2024-09-13T18:58:47.949187+0000","last_unstale":"2024-09-13T18:58:47.955859+0000","last_undegraded":"2024-09-13T18:58:47.955859+0000","last_fullsized":"2024-09-13T18:58:47.955859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:29.670002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.941918+0000","last_change":"2024-09-13T18:58:47.939851+0000","last_active":"2024-09-13T18:58:47.941918+0000","last_peered":"2024-09-13T18:58:47.941918+0000","last_clean":"2024-09-13T18:58:47.941918+0000","last_became_active":"2024-09-13T18:58:47.939536+0000","last_became_peered":"2024-09-13T18:58:47.939536+0000","last_unstale":"2024-09-13T18:58:47.941918+0000","last_undegraded":"2024-09-13T18:58:47.941918+0000","last_fullsized":"2024-09-13T18:58:47.941918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:17.237878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960079+0000","last_change":"2024-09-13T18:58:47.951192+0000","last_active":"2024-09-13T18:58:47.960079+0000","last_peered":"2024-09-13T18:58:47.960079+0000","last_clean":"2024-09-13T18:58:47.960079+0000","last_became_active":"2024-09-13T18:58:47.950608+0000","last_became_peered":"2024-09-13T18:58:47.950608+0000","last_unstale":"2024-09-13T18:58:47.960079+0000","last_undegraded":"2024-09-13T18:58:47.960079+0000","last_fullsized":"2024-09-13T18:58:47.960079+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952985+0000","last_change":"2024-09-13T18:58:47.949311+0000","last_active":"2024-09-13T18:58:47.952985+0000","last_peered":"2024-09-13T18:58:47.952985+0000","last_clean":"2024-09-13T18:58:47.952985+0000","last_became_active":"2024-09-13T18:58:47.949030+0000","last_became_peered":"2024-09-13T18:58:47.949030+0000","last_unstale":"2024-09-13T18:58:47.952985+0000","last_undegraded":"2024-09-13T18:58:47.952985+0000","last_fullsized":"2024-09-13T18:58:47.952985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:24.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.961425+0000","last_change":"2024-09-13T18:58:47.956958+0000","last_active":"2024-09-13T18:58:47.961425+0000","last_peered":"2024-09-13T18:58:47.961425+0000","last_clean":"2024-09-13T18:58:47.961425+0000","last_became_active":"2024-09-13T18:58:47.956714+0000","last_became_peered":"2024-09-13T18:58:47.956714+0000","last_unstale":"2024-09-13T18:58:47.961425+0000","last_undegraded":"2024-09-13T18:58:47.961425+0000","last_fullsized":"2024-09-13T18:58:47.961425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:50.250970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956014+0000","last_change":"2024-09-13T18:58:47.508920+0000","last_active":"2024-09-13T18:58:47.956014+0000","last_peered":"2024-09-13T18:58:47.956014+0000","last_clean":"2024-09-13T18:58:47.956014+0000","last_became_active":"2024-09-13T18:58:47.508687+0000","last_became_peered":"2024-09-13T18:58:47.508687+0000","last_unstale":"2024-09-13T18:58:47.956014+0000","last_undegraded":"2024-09-13T18:58:47.956014+0000","last_fullsized":"2024-09-13T18:58:47.956014+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:13.242211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.941370+0000","last_change":"2024-09-13T18:58:47.937519+0000","last_active":"2024-09-13T18:58:47.941370+0000","last_peered":"2024-09-13T18:58:47.941370+0000","last_clean":"2024-09-13T18:58:47.941370+0000","last_became_active":"2024-09-13T18:58:47.937089+0000","last_became_peered":"2024-09-13T18:58:47.937089+0000","last_unstale":"2024-09-13T18:58:47.941370+0000","last_undegraded":"2024-09-13T18:58:47.941370+0000","last_fullsized":"2024-09-13T18:58:47.941370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:02.880307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.957794+0000","last_change":"2024-09-13T18:58:47.511409+0000","last_active":"2024-09-13T18:58:47.957794+0000","last_peered":"2024-09-13T18:58:47.957794+0000","last_clean":"2024-09-13T18:58:47.957794+0000","last_became_active":"2024-09-13T18:58:47.511127+0000","last_became_peered":"2024-09-13T18:58:47.511127+0000","last_unstale":"2024-09-13T18:58:47.957794+0000","last_undegraded":"2024-09-13T18:58:47.957794+0000","last_fullsized":"2024-09-13T18:58:47.957794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.871345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955353+0000","last_change":"2024-09-13T18:58:47.949870+0000","last_active":"2024-09-13T18:58:47.955353+0000","last_peered":"2024-09-13T18:58:47.955353+0000","last_clean":"2024-09-13T18:58:47.955353+0000","last_became_active":"2024-09-13T18:58:47.949516+0000","last_became_peered":"2024-09-13T18:58:47.949516+0000","last_unstale":"2024-09-13T18:58:47.955353+0000","last_undegraded":"2024-09-13T18:58:47.955353+0000","last_fullsized":"2024-09-13T18:58:47.955353+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:17.237878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949421+0000","last_change":"2024-09-13T18:58:47.510310+0000","last_active":"2024-09-13T18:58:47.949421+0000","last_peered":"2024-09-13T18:58:47.949421+0000","last_clean":"2024-09-13T18:58:47.949421+0000","last_became_active":"2024-09-13T18:58:47.510067+0000","last_became_peered":"2024-09-13T18:58:47.510067+0000","last_unstale":"2024-09-13T18:58:47.949421+0000","last_undegraded":"2024-09-13T18:58:47.949421+0000","last_fullsized":"2024-09-13T18:58:47.949421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:36.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951770+0000","last_change":"2024-09-13T18:58:47.945768+0000","last_active":"2024-09-13T18:58:47.951770+0000","last_peered":"2024-09-13T18:58:47.951770+0000","last_clean":"2024-09-13T18:58:47.951770+0000","last_became_active":"2024-09-13T18:58:47.944582+0000","last_became_peered":"2024-09-13T18:58:47.944582+0000","last_unstale":"2024-09-13T18:58:47.951770+0000","last_undegraded":"2024-09-13T18:58:47.951770+0000","last_fullsized":"2024-09-13T18:58:47.951770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950652+0000","last_change":"2024-09-13T18:58:47.509312+0000","last_active":"2024-09-13T18:58:47.950652+0000","last_peered":"2024-09-13T18:58:47.950652+0000","last_clean":"2024-09-13T18:58:47.950652+0000","last_became_active":"2024-09-13T18:58:47.508963+0000","last_became_peered":"2024-09-13T18:58:47.508963+0000","last_unstale":"2024-09-13T18:58:47.950652+0000","last_undegraded":"2024-09-13T18:58:47.950652+0000","last_fullsized":"2024-09-13T18:58:47.950652+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:41.931110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.938398+0000","last_change":"2024-09-13T18:58:47.935179+0000","last_active":"2024-09-13T18:58:47.938398+0000","last_peered":"2024-09-13T18:58:47.938398+0000","last_clean":"2024-09-13T18:58:47.938398+0000","last_became_active":"2024-09-13T18:58:47.934926+0000","last_became_peered":"2024-09-13T18:58:47.934926+0000","last_unstale":"2024-09-13T18:58:47.938398+0000","last_undegraded":"2024-09-13T18:58:47.938398+0000","last_fullsized":"2024-09-13T18:58:47.938398+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956794+0000","last_change":"2024-09-13T18:58:47.503566+0000","last_active":"2024-09-13T18:58:47.956794+0000","last_peered":"2024-09-13T18:58:47.956794+0000","last_clean":"2024-09-13T18:58:47.956794+0000","last_became_active":"2024-09-13T18:58:47.503244+0000","last_became_peered":"2024-09-13T18:58:47.503244+0000","last_unstale":"2024-09-13T18:58:47.956794+0000","last_undegraded":"2024-09-13T18:58:47.956794+0000","last_fullsized":"2024-09-13T18:58:47.956794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:32.512250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965214+0000","last_change":"2024-09-13T18:58:47.954240+0000","last_active":"2024-09-13T18:58:47.965214+0000","last_peered":"2024-09-13T18:58:47.965214+0000","last_clean":"2024-09-13T18:58:47.965214+0000","last_became_active":"2024-09-13T18:58:47.953993+0000","last_became_peered":"2024-09-13T18:58:47.953993+0000","last_unstale":"2024-09-13T18:58:47.965214+0000","last_undegraded":"2024-09-13T18:58:47.965214+0000","last_fullsized":"2024-09-13T18:58:47.965214+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:16.743681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958213+0000","last_change":"2024-09-13T18:58:47.513830+0000","last_active":"2024-09-13T18:58:47.958213+0000","last_peered":"2024-09-13T18:58:47.958213+0000","last_clean":"2024-09-13T18:58:47.958213+0000","last_became_active":"2024-09-13T18:58:47.510287+0000","last_became_peered":"2024-09-13T18:58:47.510287+0000","last_unstale":"2024-09-13T18:58:47.958213+0000","last_undegraded":"2024-09-13T18:58:47.958213+0000","last_fullsized":"2024-09-13T18:58:47.958213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.151924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949290+0000","last_change":"2024-09-13T18:58:47.940280+0000","last_active":"2024-09-13T18:58:47.949290+0000","last_peered":"2024-09-13T18:58:47.949290+0000","last_clean":"2024-09-13T18:58:47.949290+0000","last_became_active":"2024-09-13T18:58:47.940039+0000","last_became_peered":"2024-09-13T18:58:47.940039+0000","last_unstale":"2024-09-13T18:58:47.949290+0000","last_undegraded":"2024-09-13T18:58:47.949290+0000","last_fullsized":"2024-09-13T18:58:47.949290+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:07.695144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.933913+0000","last_change":"2024-09-13T18:58:47.508155+0000","last_active":"2024-09-13T18:58:47.933913+0000","last_peered":"2024-09-13T18:58:47.933913+0000","last_clean":"2024-09-13T18:58:47.933913+0000","last_became_active":"2024-09-13T18:58:47.507852+0000","last_became_peered":"2024-09-13T18:58:47.507852+0000","last_unstale":"2024-09-13T18:58:47.933913+0000","last_undegraded":"2024-09-13T18:58:47.933913+0000","last_fullsized":"2024-09-13T18:58:47.933913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:36.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955444+0000","last_change":"2024-09-13T18:58:47.948076+0000","last_active":"2024-09-13T18:58:47.955444+0000","last_peered":"2024-09-13T18:58:47.955444+0000","last_clean":"2024-09-13T18:58:47.955444+0000","last_became_active":"2024-09-13T18:58:47.947379+0000","last_became_peered":"2024-09-13T18:58:47.947379+0000","last_unstale":"2024-09-13T18:58:47.955444+0000","last_undegraded":"2024-09-13T18:58:47.955444+0000","last_fullsized":"2024-09-13T18:58:47.955444+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:57.160886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939188+0000","last_change":"2024-09-13T18:58:47.516796+0000","last_active":"2024-09-13T18:58:47.939188+0000","last_peered":"2024-09-13T18:58:47.939188+0000","last_clean":"2024-09-13T18:58:47.939188+0000","last_became_active":"2024-09-13T18:58:47.515686+0000","last_became_peered":"2024-09-13T18:58:47.515686+0000","last_unstale":"2024-09-13T18:58:47.939188+0000","last_undegraded":"2024-09-13T18:58:47.939188+0000","last_fullsized":"2024-09-13T18:58:47.939188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.871345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.963348+0000","last_change":"2024-09-13T18:58:47.954721+0000","last_active":"2024-09-13T18:58:47.963348+0000","last_peered":"2024-09-13T18:58:47.963348+0000","last_clean":"2024-09-13T18:58:47.963348+0000","last_became_active":"2024-09-13T18:58:47.954441+0000","last_became_peered":"2024-09-13T18:58:47.954441+0000","last_unstale":"2024-09-13T18:58:47.963348+0000","last_undegraded":"2024-09-13T18:58:47.963348+0000","last_fullsized":"2024-09-13T18:58:47.963348+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.931134+0000","last_change":"2024-09-13T18:58:47.511685+0000","last_active":"2024-09-13T18:58:47.931134+0000","last_peered":"2024-09-13T18:58:47.931134+0000","last_clean":"2024-09-13T18:58:47.931134+0000","last_became_active":"2024-09-13T18:58:47.511472+0000","last_became_peered":"2024-09-13T18:58:47.511472+0000","last_unstale":"2024-09-13T18:58:47.931134+0000","last_undegraded":"2024-09-13T18:58:47.931134+0000","last_fullsized":"2024-09-13T18:58:47.931134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.661040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.949748+0000","last_change":"2024-09-13T18:58:47.945475+0000","last_active":"2024-09-13T18:58:47.949748+0000","last_peered":"2024-09-13T18:58:47.949748+0000","last_clean":"2024-09-13T18:58:47.949748+0000","last_became_active":"2024-09-13T18:58:47.944561+0000","last_became_peered":"2024-09-13T18:58:47.944561+0000","last_unstale":"2024-09-13T18:58:47.949748+0000","last_undegraded":"2024-09-13T18:58:47.949748+0000","last_fullsized":"2024-09-13T18:58:47.949748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:07.695144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.943085+0000","last_change":"2024-09-13T18:58:47.515701+0000","last_active":"2024-09-13T18:58:47.943085+0000","last_peered":"2024-09-13T18:58:47.943085+0000","last_clean":"2024-09-13T18:58:47.943085+0000","last_became_active":"2024-09-13T18:58:47.515089+0000","last_became_peered":"2024-09-13T18:58:47.515089+0000","last_unstale":"2024-09-13T18:58:47.943085+0000","last_undegraded":"2024-09-13T18:58:47.943085+0000","last_fullsized":"2024-09-13T18:58:47.943085+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:53.788419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960945+0000","last_change":"2024-09-13T18:58:47.958599+0000","last_active":"2024-09-13T18:58:47.960945+0000","last_peered":"2024-09-13T18:58:47.960945+0000","last_clean":"2024-09-13T18:58:47.960945+0000","last_became_active":"2024-09-13T18:58:47.958317+0000","last_became_peered":"2024-09-13T18:58:47.958317+0000","last_unstale":"2024-09-13T18:58:47.960945+0000","last_undegraded":"2024-09-13T18:58:47.960945+0000","last_fullsized":"2024-09-13T18:58:47.960945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:41.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956069+0000","last_change":"2024-09-13T18:58:47.513569+0000","last_active":"2024-09-13T18:58:47.956069+0000","last_peered":"2024-09-13T18:58:47.956069+0000","last_clean":"2024-09-13T18:58:47.956069+0000","last_became_active":"2024-09-13T18:58:47.513294+0000","last_became_peered":"2024-09-13T18:58:47.513294+0000","last_unstale":"2024-09-13T18:58:47.956069+0000","last_undegraded":"2024-09-13T18:58:47.956069+0000","last_fullsized":"2024-09-13T18:58:47.956069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:38.051253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955116+0000","last_change":"2024-09-13T18:58:47.951429+0000","last_active":"2024-09-13T18:58:47.955116+0000","last_peered":"2024-09-13T18:58:47.955116+0000","last_clean":"2024-09-13T18:58:47.955116+0000","last_became_active":"2024-09-13T18:58:47.951033+0000","last_became_peered":"2024-09-13T18:58:47.951033+0000","last_unstale":"2024-09-13T18:58:47.955116+0000","last_undegraded":"2024-09-13T18:58:47.955116+0000","last_fullsized":"2024-09-13T18:58:47.955116+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.187769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.968151+0000","last_change":"2024-09-13T18:58:47.511496+0000","last_active":"2024-09-13T18:58:47.968151+0000","last_peered":"2024-09-13T18:58:47.968151+0000","last_clean":"2024-09-13T18:58:47.968151+0000","last_became_active":"2024-09-13T18:58:47.511213+0000","last_became_peered":"2024-09-13T18:58:47.511213+0000","last_unstale":"2024-09-13T18:58:47.968151+0000","last_undegraded":"2024-09-13T18:58:47.968151+0000","last_fullsized":"2024-09-13T18:58:47.968151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:12.736684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953119+0000","last_change":"2024-09-13T18:58:47.940762+0000","last_active":"2024-09-13T18:58:47.953119+0000","last_peered":"2024-09-13T18:58:47.953119+0000","last_clean":"2024-09-13T18:58:47.953119+0000","last_became_active":"2024-09-13T18:58:47.940432+0000","last_became_peered":"2024-09-13T18:58:47.940432+0000","last_unstale":"2024-09-13T18:58:47.953119+0000","last_undegraded":"2024-09-13T18:58:47.953119+0000","last_fullsized":"2024-09-13T18:58:47.953119+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:24.105515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965960+0000","last_change":"2024-09-13T18:58:47.511419+0000","last_active":"2024-09-13T18:58:47.965960+0000","last_peered":"2024-09-13T18:58:47.965960+0000","last_clean":"2024-09-13T18:58:47.965960+0000","last_became_active":"2024-09-13T18:58:47.511147+0000","last_became_peered":"2024-09-13T18:58:47.511147+0000","last_unstale":"2024-09-13T18:58:47.965960+0000","last_undegraded":"2024-09-13T18:58:47.965960+0000","last_fullsized":"2024-09-13T18:58:47.965960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:48.784217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951590+0000","last_change":"2024-09-13T18:58:47.946421+0000","last_active":"2024-09-13T18:58:47.951590+0000","last_peered":"2024-09-13T18:58:47.951590+0000","last_clean":"2024-09-13T18:58:47.951590+0000","last_became_active":"2024-09-13T18:58:47.946181+0000","last_became_peered":"2024-09-13T18:58:47.946181+0000","last_unstale":"2024-09-13T18:58:47.951590+0000","last_undegraded":"2024-09-13T18:58:47.951590+0000","last_fullsized":"2024-09-13T18:58:47.951590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:23.926096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928284+0000","last_change":"2024-09-13T18:58:47.513103+0000","last_active":"2024-09-13T18:58:47.928284+0000","last_peered":"2024-09-13T18:58:47.928284+0000","last_clean":"2024-09-13T18:58:47.928284+0000","last_became_active":"2024-09-13T18:58:47.512647+0000","last_became_peered":"2024-09-13T18:58:47.512647+0000","last_unstale":"2024-09-13T18:58:47.928284+0000","last_undegraded":"2024-09-13T18:58:47.928284+0000","last_fullsized":"2024-09-13T18:58:47.928284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.275093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958606+0000","last_change":"2024-09-13T18:58:47.944811+0000","last_active":"2024-09-13T18:58:47.958606+0000","last_peered":"2024-09-13T18:58:47.958606+0000","last_clean":"2024-09-13T18:58:47.958606+0000","last_became_active":"2024-09-13T18:58:47.944559+0000","last_became_peered":"2024-09-13T18:58:47.944559+0000","last_unstale":"2024-09-13T18:58:47.958606+0000","last_undegraded":"2024-09-13T18:58:47.958606+0000","last_fullsized":"2024-09-13T18:58:47.958606+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:31.155863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934434+0000","last_change":"2024-09-13T18:58:47.512913+0000","last_active":"2024-09-13T18:58:47.934434+0000","last_peered":"2024-09-13T18:58:47.934434+0000","last_clean":"2024-09-13T18:58:47.934434+0000","last_became_active":"2024-09-13T18:58:47.512659+0000","last_became_peered":"2024-09-13T18:58:47.512659+0000","last_unstale":"2024-09-13T18:58:47.934434+0000","last_undegraded":"2024-09-13T18:58:47.934434+0000","last_fullsized":"2024-09-13T18:58:47.934434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:38.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.944809+0000","last_change":"2024-09-13T18:58:47.943151+0000","last_active":"2024-09-13T18:58:47.944809+0000","last_peered":"2024-09-13T18:58:47.944809+0000","last_clean":"2024-09-13T18:58:47.944809+0000","last_became_active":"2024-09-13T18:58:47.942839+0000","last_became_peered":"2024-09-13T18:58:47.942839+0000","last_unstale":"2024-09-13T18:58:47.944809+0000","last_undegraded":"2024-09-13T18:58:47.944809+0000","last_fullsized":"2024-09-13T18:58:47.944809+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:00.164826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965727+0000","last_change":"2024-09-13T18:58:47.516752+0000","last_active":"2024-09-13T18:58:47.965727+0000","last_peered":"2024-09-13T18:58:47.965727+0000","last_clean":"2024-09-13T18:58:47.965727+0000","last_became_active":"2024-09-13T18:58:47.515267+0000","last_became_peered":"2024-09-13T18:58:47.515267+0000","last_unstale":"2024-09-13T18:58:47.965727+0000","last_undegraded":"2024-09-13T18:58:47.965727+0000","last_fullsized":"2024-09-13T18:58:47.965727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.151924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959101+0000","last_change":"2024-09-13T18:58:47.946280+0000","last_active":"2024-09-13T18:58:47.959101+0000","last_peered":"2024-09-13T18:58:47.959101+0000","last_clean":"2024-09-13T18:58:47.959101+0000","last_became_active":"2024-09-13T18:58:47.945927+0000","last_became_peered":"2024-09-13T18:58:47.945927+0000","last_unstale":"2024-09-13T18:58:47.959101+0000","last_undegraded":"2024-09-13T18:58:47.959101+0000","last_fullsized":"2024-09-13T18:58:47.959101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:08.457497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952823+0000","last_change":"2024-09-13T18:58:47.513408+0000","last_active":"2024-09-13T18:58:47.952823+0000","last_peered":"2024-09-13T18:58:47.952823+0000","last_clean":"2024-09-13T18:58:47.952823+0000","last_became_active":"2024-09-13T18:58:47.513101+0000","last_became_peered":"2024-09-13T18:58:47.513101+0000","last_unstale":"2024-09-13T18:58:47.952823+0000","last_undegraded":"2024-09-13T18:58:47.952823+0000","last_fullsized":"2024-09-13T18:58:47.952823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.125819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965724+0000","last_change":"2024-09-13T18:58:47.960259+0000","last_active":"2024-09-13T18:58:47.965724+0000","last_peered":"2024-09-13T18:58:47.965724+0000","last_clean":"2024-09-13T18:58:47.965724+0000","last_became_active":"2024-09-13T18:58:47.959678+0000","last_became_peered":"2024-09-13T18:58:47.959678+0000","last_unstale":"2024-09-13T18:58:47.965724+0000","last_undegraded":"2024-09-13T18:58:47.965724+0000","last_fullsized":"2024-09-13T18:58:47.965724+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:32.447522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.961664+0000","last_change":"2024-09-13T18:58:47.502162+0000","last_active":"2024-09-13T18:58:47.961664+0000","last_peered":"2024-09-13T18:58:47.961664+0000","last_clean":"2024-09-13T18:58:47.961664+0000","last_became_active":"2024-09-13T18:58:47.501911+0000","last_became_peered":"2024-09-13T18:58:47.501911+0000","last_unstale":"2024-09-13T18:58:47.961664+0000","last_undegraded":"2024-09-13T18:58:47.961664+0000","last_fullsized":"2024-09-13T18:58:47.961664+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:51.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.953155+0000","last_change":"2024-09-13T18:58:47.941499+0000","last_active":"2024-09-13T18:58:47.953155+0000","last_peered":"2024-09-13T18:58:47.953155+0000","last_clean":"2024-09-13T18:58:47.953155+0000","last_became_active":"2024-09-13T18:58:47.941220+0000","last_became_peered":"2024-09-13T18:58:47.941220+0000","last_unstale":"2024-09-13T18:58:47.953155+0000","last_undegraded":"2024-09-13T18:58:47.953155+0000","last_fullsized":"2024-09-13T18:58:47.953155+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:19.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952189+0000","last_change":"2024-09-13T18:58:47.509900+0000","last_active":"2024-09-13T18:58:47.952189+0000","last_peered":"2024-09-13T18:58:47.952189+0000","last_clean":"2024-09-13T18:58:47.952189+0000","last_became_active":"2024-09-13T18:58:47.508698+0000","last_became_peered":"2024-09-13T18:58:47.508698+0000","last_unstale":"2024-09-13T18:58:47.952189+0000","last_undegraded":"2024-09-13T18:58:47.952189+0000","last_fullsized":"2024-09-13T18:58:47.952189+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955699+0000","last_change":"2024-09-13T18:58:47.948818+0000","last_active":"2024-09-13T18:58:47.955699+0000","last_peered":"2024-09-13T18:58:47.955699+0000","last_clean":"2024-09-13T18:58:47.955699+0000","last_became_active":"2024-09-13T18:58:47.948526+0000","last_became_peered":"2024-09-13T18:58:47.948526+0000","last_unstale":"2024-09-13T18:58:47.955699+0000","last_undegraded":"2024-09-13T18:58:47.955699+0000","last_fullsized":"2024-09-13T18:58:47.955699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:18.452770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934210+0000","last_change":"2024-09-13T18:58:47.508027+0000","last_active":"2024-09-13T18:58:47.934210+0000","last_peered":"2024-09-13T18:58:47.934210+0000","last_clean":"2024-09-13T18:58:47.934210+0000","last_became_active":"2024-09-13T18:58:47.507792+0000","last_became_peered":"2024-09-13T18:58:47.507792+0000","last_unstale":"2024-09-13T18:58:47.934210+0000","last_undegraded":"2024-09-13T18:58:47.934210+0000","last_fullsized":"2024-09-13T18:58:47.934210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.275093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.959158+0000","last_change":"2024-09-13T18:58:47.948202+0000","last_active":"2024-09-13T18:58:47.959158+0000","last_peered":"2024-09-13T18:58:47.959158+0000","last_clean":"2024-09-13T18:58:47.959158+0000","last_became_active":"2024-09-13T18:58:47.947545+0000","last_became_peered":"2024-09-13T18:58:47.947545+0000","last_unstale":"2024-09-13T18:58:47.959158+0000","last_undegraded":"2024-09-13T18:58:47.959158+0000","last_fullsized":"2024-09-13T18:58:47.959158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:23.545533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.956857+0000","last_change":"2024-09-13T18:58:47.506264+0000","last_active":"2024-09-13T18:58:47.956857+0000","last_peered":"2024-09-13T18:58:47.956857+0000","last_clean":"2024-09-13T18:58:47.956857+0000","last_became_active":"2024-09-13T18:58:47.506000+0000","last_became_peered":"2024-09-13T18:58:47.506000+0000","last_unstale":"2024-09-13T18:58:47.956857+0000","last_undegraded":"2024-09-13T18:58:47.956857+0000","last_fullsized":"2024-09-13T18:58:47.956857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:16.228915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.950346+0000","last_change":"2024-09-13T18:58:47.944544+0000","last_active":"2024-09-13T18:58:47.950346+0000","last_peered":"2024-09-13T18:58:47.950346+0000","last_clean":"2024-09-13T18:58:47.950346+0000","last_became_active":"2024-09-13T18:58:47.944223+0000","last_became_peered":"2024-09-13T18:58:47.944223+0000","last_unstale":"2024-09-13T18:58:47.950346+0000","last_undegraded":"2024-09-13T18:58:47.950346+0000","last_fullsized":"2024-09-13T18:58:47.950346+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:39.060215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939438+0000","last_change":"2024-09-13T18:58:47.510010+0000","last_active":"2024-09-13T18:58:47.939438+0000","last_peered":"2024-09-13T18:58:47.939438+0000","last_clean":"2024-09-13T18:58:47.939438+0000","last_became_active":"2024-09-13T18:58:47.509715+0000","last_became_peered":"2024-09-13T18:58:47.509715+0000","last_unstale":"2024-09-13T18:58:47.939438+0000","last_undegraded":"2024-09-13T18:58:47.939438+0000","last_fullsized":"2024-09-13T18:58:47.939438+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.661040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.943404+0000","last_change":"2024-09-13T18:58:47.936830+0000","last_active":"2024-09-13T18:58:47.943404+0000","last_peered":"2024-09-13T18:58:47.943404+0000","last_clean":"2024-09-13T18:58:47.943404+0000","last_became_active":"2024-09-13T18:58:47.936594+0000","last_became_peered":"2024-09-13T18:58:47.936594+0000","last_unstale":"2024-09-13T18:58:47.943404+0000","last_undegraded":"2024-09-13T18:58:47.943404+0000","last_fullsized":"2024-09-13T18:58:47.943404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:19.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.938186+0000","last_change":"2024-09-13T18:58:47.517160+0000","last_active":"2024-09-13T18:58:47.938186+0000","last_peered":"2024-09-13T18:58:47.938186+0000","last_clean":"2024-09-13T18:58:47.938186+0000","last_became_active":"2024-09-13T18:58:47.516304+0000","last_became_peered":"2024-09-13T18:58:47.516304+0000","last_unstale":"2024-09-13T18:58:47.938186+0000","last_undegraded":"2024-09-13T18:58:47.938186+0000","last_fullsized":"2024-09-13T18:58:47.938186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:18.488857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.951741+0000","last_change":"2024-09-13T18:58:47.946075+0000","last_active":"2024-09-13T18:58:47.951741+0000","last_peered":"2024-09-13T18:58:47.951741+0000","last_clean":"2024-09-13T18:58:47.951741+0000","last_became_active":"2024-09-13T18:58:47.945791+0000","last_became_peered":"2024-09-13T18:58:47.945791+0000","last_unstale":"2024-09-13T18:58:47.951741+0000","last_undegraded":"2024-09-13T18:58:47.951741+0000","last_fullsized":"2024-09-13T18:58:47.951741+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.521213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928008+0000","last_change":"2024-09-13T18:58:47.513703+0000","last_active":"2024-09-13T18:58:47.928008+0000","last_peered":"2024-09-13T18:58:47.928008+0000","last_clean":"2024-09-13T18:58:47.928008+0000","last_became_active":"2024-09-13T18:58:47.512616+0000","last_became_peered":"2024-09-13T18:58:47.512616+0000","last_unstale":"2024-09-13T18:58:47.928008+0000","last_undegraded":"2024-09-13T18:58:47.928008+0000","last_fullsized":"2024-09-13T18:58:47.928008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:13.242211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955916+0000","last_change":"2024-09-13T18:58:47.951936+0000","last_active":"2024-09-13T18:58:47.955916+0000","last_peered":"2024-09-13T18:58:47.955916+0000","last_clean":"2024-09-13T18:58:47.955916+0000","last_became_active":"2024-09-13T18:58:47.951577+0000","last_became_peered":"2024-09-13T18:58:47.951577+0000","last_unstale":"2024-09-13T18:58:47.955916+0000","last_undegraded":"2024-09-13T18:58:47.955916+0000","last_fullsized":"2024-09-13T18:58:47.955916+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:37.612422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934711+0000","last_change":"2024-09-13T18:58:47.504611+0000","last_active":"2024-09-13T18:58:47.934711+0000","last_peered":"2024-09-13T18:58:47.934711+0000","last_clean":"2024-09-13T18:58:47.934711+0000","last_became_active":"2024-09-13T18:58:47.504352+0000","last_became_peered":"2024-09-13T18:58:47.504352+0000","last_unstale":"2024-09-13T18:58:47.934711+0000","last_undegraded":"2024-09-13T18:58:47.934711+0000","last_fullsized":"2024-09-13T18:58:47.934711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:49.242007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960361+0000","last_change":"2024-09-13T18:58:47.948440+0000","last_active":"2024-09-13T18:58:47.960361+0000","last_peered":"2024-09-13T18:58:47.960361+0000","last_clean":"2024-09-13T18:58:47.960361+0000","last_became_active":"2024-09-13T18:58:47.948146+0000","last_became_peered":"2024-09-13T18:58:47.948146+0000","last_unstale":"2024-09-13T18:58:47.960361+0000","last_undegraded":"2024-09-13T18:58:47.960361+0000","last_fullsized":"2024-09-13T18:58:47.960361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928968+0000","last_change":"2024-09-13T18:58:47.510539+0000","last_active":"2024-09-13T18:58:47.928968+0000","last_peered":"2024-09-13T18:58:47.928968+0000","last_clean":"2024-09-13T18:58:47.928968+0000","last_became_active":"2024-09-13T18:58:47.508294+0000","last_became_peered":"2024-09-13T18:58:47.508294+0000","last_unstale":"2024-09-13T18:58:47.928968+0000","last_undegraded":"2024-09-13T18:58:47.928968+0000","last_fullsized":"2024-09-13T18:58:47.928968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:38.299990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.952288+0000","last_change":"2024-09-13T18:58:47.947778+0000","last_active":"2024-09-13T18:58:47.952288+0000","last_peered":"2024-09-13T18:58:47.952288+0000","last_clean":"2024-09-13T18:58:47.952288+0000","last_became_active":"2024-09-13T18:58:47.947517+0000","last_became_peered":"2024-09-13T18:58:47.947517+0000","last_unstale":"2024-09-13T18:58:47.952288+0000","last_undegraded":"2024-09-13T18:58:47.952288+0000","last_fullsized":"2024-09-13T18:58:47.952288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:24.358542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.934906+0000","last_change":"2024-09-13T18:58:47.512153+0000","last_active":"2024-09-13T18:58:47.934906+0000","last_peered":"2024-09-13T18:58:47.934906+0000","last_clean":"2024-09-13T18:58:47.934906+0000","last_became_active":"2024-09-13T18:58:47.511587+0000","last_became_peered":"2024-09-13T18:58:47.511587+0000","last_unstale":"2024-09-13T18:58:47.934906+0000","last_undegraded":"2024-09-13T18:58:47.934906+0000","last_fullsized":"2024-09-13T18:58:47.934906+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960530+0000","last_change":"2024-09-13T18:58:47.952790+0000","last_active":"2024-09-13T18:58:47.960530+0000","last_peered":"2024-09-13T18:58:47.960530+0000","last_clean":"2024-09-13T18:58:47.960530+0000","last_became_active":"2024-09-13T18:58:47.952515+0000","last_became_peered":"2024-09-13T18:58:47.952515+0000","last_unstale":"2024-09-13T18:58:47.960530+0000","last_undegraded":"2024-09-13T18:58:47.960530+0000","last_fullsized":"2024-09-13T18:58:47.960530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:37.398818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.928001+0000","last_change":"2024-09-13T18:58:47.510803+0000","last_active":"2024-09-13T18:58:47.928001+0000","last_peered":"2024-09-13T18:58:47.928001+0000","last_clean":"2024-09-13T18:58:47.928001+0000","last_became_active":"2024-09-13T18:58:47.510529+0000","last_became_peered":"2024-09-13T18:58:47.510529+0000","last_unstale":"2024-09-13T18:58:47.928001+0000","last_undegraded":"2024-09-13T18:58:47.928001+0000","last_fullsized":"2024-09-13T18:58:47.928001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:49.242007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.958904+0000","last_change":"2024-09-13T18:58:47.947014+0000","last_active":"2024-09-13T18:58:47.958904+0000","last_peered":"2024-09-13T18:58:47.958904+0000","last_clean":"2024-09-13T18:58:47.958904+0000","last_became_active":"2024-09-13T18:58:47.946505+0000","last_became_peered":"2024-09-13T18:58:47.946505+0000","last_unstale":"2024-09-13T18:58:47.958904+0000","last_undegraded":"2024-09-13T18:58:47.958904+0000","last_fullsized":"2024-09-13T18:58:47.958904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:55.112391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.929747+0000","last_change":"2024-09-13T18:58:47.498614+0000","last_active":"2024-09-13T18:58:47.929747+0000","last_peered":"2024-09-13T18:58:47.929747+0000","last_clean":"2024-09-13T18:58:47.929747+0000","last_became_active":"2024-09-13T18:58:47.497704+0000","last_became_peered":"2024-09-13T18:58:47.497704+0000","last_unstale":"2024-09-13T18:58:47.929747+0000","last_undegraded":"2024-09-13T18:58:47.929747+0000","last_fullsized":"2024-09-13T18:58:47.929747+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:23.705468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.955258+0000","last_change":"2024-09-13T18:58:47.948447+0000","last_active":"2024-09-13T18:58:47.955258+0000","last_peered":"2024-09-13T18:58:47.955258+0000","last_clean":"2024-09-13T18:58:47.955258+0000","last_became_active":"2024-09-13T18:58:47.948171+0000","last_became_peered":"2024-09-13T18:58:47.948171+0000","last_unstale":"2024-09-13T18:58:47.955258+0000","last_undegraded":"2024-09-13T18:58:47.955258+0000","last_fullsized":"2024-09-13T18:58:47.955258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:49.793180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.933082+0000","last_change":"2024-09-13T18:58:47.508207+0000","last_active":"2024-09-13T18:58:47.933082+0000","last_peered":"2024-09-13T18:58:47.933082+0000","last_clean":"2024-09-13T18:58:47.933082+0000","last_became_active":"2024-09-13T18:58:47.507951+0000","last_became_peered":"2024-09-13T18:58:47.507951+0000","last_unstale":"2024-09-13T18:58:47.933082+0000","last_undegraded":"2024-09-13T18:58:47.933082+0000","last_fullsized":"2024-09-13T18:58:47.933082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:22.514949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.944554+0000","last_change":"2024-09-13T18:58:47.941914+0000","last_active":"2024-09-13T18:58:47.944554+0000","last_peered":"2024-09-13T18:58:47.944554+0000","last_clean":"2024-09-13T18:58:47.944554+0000","last_became_active":"2024-09-13T18:58:47.941613+0000","last_became_peered":"2024-09-13T18:58:47.941613+0000","last_unstale":"2024-09-13T18:58:47.944554+0000","last_undegraded":"2024-09-13T18:58:47.944554+0000","last_fullsized":"2024-09-13T18:58:47.944554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.939575+0000","last_change":"2024-09-13T18:58:47.514043+0000","last_active":"2024-09-13T18:58:47.939575+0000","last_peered":"2024-09-13T18:58:47.939575+0000","last_clean":"2024-09-13T18:58:47.939575+0000","last_became_active":"2024-09-13T18:58:47.513780+0000","last_became_peered":"2024-09-13T18:58:47.513780+0000","last_unstale":"2024-09-13T18:58:47.939575+0000","last_undegraded":"2024-09-13T18:58:47.939575+0000","last_fullsized":"2024-09-13T18:58:47.939575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:23.705468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.965458+0000","last_change":"2024-09-13T18:58:47.955068+0000","last_active":"2024-09-13T18:58:47.965458+0000","last_peered":"2024-09-13T18:58:47.965458+0000","last_clean":"2024-09-13T18:58:47.965458+0000","last_became_active":"2024-09-13T18:58:47.954825+0000","last_became_peered":"2024-09-13T18:58:47.954825+0000","last_unstale":"2024-09-13T18:58:47.965458+0000","last_undegraded":"2024-09-13T18:58:47.965458+0000","last_fullsized":"2024-09-13T18:58:47.965458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:47.480419+0000","last_clean_scrub_stamp":"2024-09-13T18:58:47.480419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:52.334093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.960951+0000","last_change":"2024-09-13T18:58:47.514373+0000","last_active":"2024-09-13T18:58:47.960951+0000","last_peered":"2024-09-13T18:58:47.960951+0000","last_clean":"2024-09-13T18:58:47.960951+0000","last_became_active":"2024-09-13T18:58:47.513188+0000","last_became_peered":"2024-09-13T18:58:47.513188+0000","last_unstale":"2024-09-13T18:58:47.960951+0000","last_undegraded":"2024-09-13T18:58:47.960951+0000","last_fullsized":"2024-09-13T18:58:47.960951+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:58:46.471457+0000","last_clean_scrub_stamp":"2024-09-13T18:58:46.471457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:22.514949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:58:47.492410+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:58:47.492410+0000","last_peered":"2024-09-13T18:58:47.492410+0000","last_clean":"2024-09-13T18:58:47.492410+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:58:47.492410+0000","last_undegraded":"2024-09-13T18:58:47.492410+0000","last_fullsized":"2024-09-13T18:58:47.492410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1110016,"data_stored":797687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.86699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.002}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.497},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.81999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.79800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:58:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.621}]},{"osd":7,"last update":"Fri Sep 13 18:58:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":207319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.745},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":214164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.873}]},{"osd":7,"last update":"Fri Sep 13 18:58:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.0069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1097728,"data_stored":791420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.505},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:58:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:58:52.551 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:58:52.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:58:52.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.745+0000 7efc13200640 1 Processor -- start 2024-09-13T18:58:52.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.746+0000 7efc13200640 1 -- start start 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc13200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 0x7efc0c1650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc13200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c0adfa0 con 0x7efc0c0cd530 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc13200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c15a790 con 0x7efc0c15a3b0 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc13200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0b2230 con 0x7efc0c06c520 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc11400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efc0c0cd530 0x7efc0c0cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52688/0 (socket says 172.21.15.33:52688) 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc11400640 1 -- 172.21.15.33:0/2592852637 learned_addr learned my addr 172.21.15.33:0/2592852637 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:52.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc12800640 1 --2- 172.21.15.33:0/2592852637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 0x7efc0c1650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.747+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610665463 0 0) 0x7efc0c0adfa0 con 0x7efc0c0cd530 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf4003520 con 0x7efc0c0cd530 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555817008 0 0) 0x7efc0c15a790 con 0x7efc0c15a3b0 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0c0adfa0 con 0x7efc0c15a3b0 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828398668 0 0) 0x7efbf4003520 con 0x7efc0c0cd530 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc12800640 1 -- 172.21.15.33:0/2592852637 >> v1:172.21.15.103:6789/0 conn(0x7efc0c15a3b0 legacy=0x7efc0c0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc12800640 1 -- 172.21.15.33:0/2592852637 >> v1:172.21.15.33:6789/0 conn(0x7efc0c0cd530 legacy=0x7efc0c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.748+0000 7efc12800640 1 -- 172.21.15.33:0/2592852637 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0b2510 con 0x7efc0c06c520 2024-09-13T18:58:52.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.749+0000 7efc12800640 1 --2- 172.21.15.33:0/2592852637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 0x7efc0c1650c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc08009dc0 tx=0x7efc0802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de83a936b1a983a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.749+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc001690 con 0x7efc0c06c520 2024-09-13T18:58:52.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.749+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0802d050 con 0x7efc0c06c520 2024-09-13T18:58:52.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.749+0000 7efc10a00640 1 -- 172.21.15.33:0/2592852637 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08007760 con 0x7efc0c06c520 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 -- 172.21.15.33:0/2592852637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 msgr2=0x7efc0c1650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 --2- 172.21.15.33:0/2592852637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 0x7efc0c1650c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc08009dc0 tx=0x7efc0802a660 comp rx=0 tx=0).stop 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 -- 172.21.15.33:0/2592852637 shutdown_connections 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 --2- 172.21.15.33:0/2592852637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c06c520 0x7efc0c1650c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 -- 172.21.15.33:0/2592852637 >> 172.21.15.33:0/2592852637 conn(0x7efc0c069ed0 msgr2=0x7efc0c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 -- 172.21.15.33:0/2592852637 shutdown_connections 2024-09-13T18:58:52.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.750+0000 7efc13200640 1 -- 172.21.15.33:0/2592852637 wait complete. 2024-09-13T18:58:52.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.751+0000 7efc13200640 1 Processor -- start 2024-09-13T18:58:52.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.752+0000 7efc13200640 1 -- start start 2024-09-13T18:58:52.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.752+0000 7efc13200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc0c06c520 0x7efc0c070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.752+0000 7efc13200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c0cd530 0x7efc0c071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.752+0000 7efc13200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc13200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c071540 con 0x7efc0c15a3b0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc13200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1f61e0 con 0x7efc0c06c520 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc13200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06fca0 con 0x7efc0c0cd530 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60106/0 (socket says 172.21.15.33:60106) 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 -- 172.21.15.33:0/4022168140 learned_addr learned my addr 172.21.15.33:0/4022168140 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc11e00640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc0c06c520 0x7efc0c070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc11400640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c0cd530 0x7efc0c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 -- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c0cd530 msgr2=0x7efc0c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c0cd530 0x7efc0c071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 -- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc0c06c520 msgr2=0x7efc0c070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc0c06c520 0x7efc0c070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.753+0000 7efc12800640 1 -- 172.21.15.33:0/4022168140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009a70 con 0x7efc0c15a3b0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc12800640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efc08009ee0 tx=0x7efc08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0803c830 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0803c990 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0803cd00 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c1f5c20 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.754+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c06f650 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.755+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c06f4b0 con 0x7efc0c15a3b0 2024-09-13T18:58:52.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.756+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc08031400 con 0x7efc0c15a3b0 2024-09-13T18:58:52.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.757+0000 7efc06000640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 0x7efbf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:52.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.757+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc080aadf0 con 0x7efc0c15a3b0 2024-09-13T18:58:52.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.757+0000 7efc11e00640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 0x7efbf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:52.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.758+0000 7efc11e00640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 0x7efbf006d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc000011e0 tx=0x7efc00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:52.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:52.761+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc0c06f4b0 con 0x7efc0c15a3b0 2024-09-13T18:58:53.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.007+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efc0c06f4b0 con 0x7efc0c15a3b0 2024-09-13T18:58:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.011+0000 7efc06000640 1 -- 172.21.15.33:0/4022168140 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7efc0c06f4b0 con 0x7efc0c15a3b0 2024-09-13T18:58:53.015 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.013+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 msgr2=0x7efbf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.013+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 0x7efbf006d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc000011e0 tx=0x7efc00009040 comp rx=0 tx=0).stop 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.013+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 msgr2=0x7efc0c0af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.013+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efc08009ee0 tx=0x7efc08004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 shutdown_connections 2024-09-13T18:58:53.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efbf006ac00 0x7efbf006d0c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc0c15a3b0 0x7efc0c0af250 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0c0cd530 0x7efc0c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 --2- 172.21.15.33:0/4022168140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc0c06c520 0x7efc0c070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 >> 172.21.15.33:0/4022168140 conn(0x7efc0c069ed0 msgr2=0x7efc0c0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 shutdown_connections 2024-09-13T18:58:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.014+0000 7efc13200640 1 -- 172.21.15.33:0/4022168140 wait complete. 2024-09-13T18:58:53.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:58:53.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.186+0000 7f9141e00640 1 Processor -- start 2024-09-13T18:58:53.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.187+0000 7f9141e00640 1 -- start start 2024-09-13T18:58:53.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9141e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f913c159480 0x7f913c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:53.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9141e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0cd850 con 0x7f913c06f4b0 2024-09-13T18:58:53.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9141e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0cd570 con 0x7f913c071560 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9141e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0b1740 con 0x7f913c159480 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9140a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f913c159480 0x7f913c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9140a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f913c159480 0x7f913c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37942/0 (socket says 172.21.15.33:37942) 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.188+0000 7f9140a00640 1 -- 172.21.15.33:0/2429114382 learned_addr learned my addr 172.21.15.33:0/2429114382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.189+0000 7f9140a00640 1 -- 172.21.15.33:0/2429114382 >> v1:172.21.15.103:6789/0 conn(0x7f913c071560 legacy=0x7f913c0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.189+0000 7f9140a00640 1 -- 172.21.15.33:0/2429114382 >> v1:172.21.15.33:6789/0 conn(0x7f913c06f4b0 legacy=0x7f913c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.189+0000 7f9140a00640 1 -- 172.21.15.33:0/2429114382 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0b1a20 con 0x7f913c159480 2024-09-13T18:58:53.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.190+0000 7f9140a00640 1 --2- 172.21.15.33:0/2429114382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c0ccf90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f912c009870 tx=0x7f912c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6d2d5c53c7d0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:53.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.190+0000 7f913be00640 1 -- 172.21.15.33:0/2429114382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c032440 con 0x7f913c159480 2024-09-13T18:58:53.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.190+0000 7f913be00640 1 -- 172.21.15.33:0/2429114382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0325a0 con 0x7f913c159480 2024-09-13T18:58:53.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.190+0000 7f913be00640 1 -- 172.21.15.33:0/2429114382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c032930 con 0x7f913c159480 2024-09-13T18:58:53.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 -- 172.21.15.33:0/2429114382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 msgr2=0x7f913c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 --2- 172.21.15.33:0/2429114382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c0ccf90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f912c009870 tx=0x7f912c02a270 comp rx=0 tx=0).stop 2024-09-13T18:58:53.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 -- 172.21.15.33:0/2429114382 shutdown_connections 2024-09-13T18:58:53.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 --2- 172.21.15.33:0/2429114382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c0ccf90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 -- 172.21.15.33:0/2429114382 >> 172.21.15.33:0/2429114382 conn(0x7f913c0ae310 msgr2=0x7f913c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:53.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 -- 172.21.15.33:0/2429114382 shutdown_connections 2024-09-13T18:58:53.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.191+0000 7f9141e00640 1 -- 172.21.15.33:0/2429114382 wait complete. 2024-09-13T18:58:53.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.192+0000 7f9141e00640 1 Processor -- start 2024-09-13T18:58:53.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 -- start start 2024-09-13T18:58:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f913c06f4b0 0x7f913c144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f913c071560 0x7f913c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c150570 con 0x7f913c159480 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c150850 con 0x7f913c071560 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.193+0000 7f9141e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c150b30 con 0x7f913c06f4b0 2024-09-13T18:58:53.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37954/0 (socket says 172.21.15.33:37954) 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 -- 172.21.15.33:0/124569100 learned_addr learned my addr 172.21.15.33:0/124569100 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9133e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f913c071560 0x7f913c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9140a00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f913c06f4b0 0x7f913c144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 -- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f913c06f4b0 msgr2=0x7f913c144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f913c06f4b0 0x7f913c144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 -- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f913c071560 msgr2=0x7f913c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f913c071560 0x7f913c14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.194+0000 7f9141400640 1 -- 172.21.15.33:0/124569100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0094d0 con 0x7f913c159480 2024-09-13T18:58:53.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9141400640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f913400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:53.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134003b70 con 0x7f913c159480 2024-09-13T18:58:53.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134003cf0 con 0x7f913c159480 2024-09-13T18:58:53.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134003ea0 con 0x7f913c159480 2024-09-13T18:58:53.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c150e10 con 0x7f913c159480 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.195+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c145250 con 0x7f913c159480 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.196+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c067360 con 0x7f913c159480 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.197+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f913400aa90 con 0x7f913c159480 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.198+0000 7f9139600640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 0x7f911806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.198+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91340891b0 con 0x7f913c159480 2024-09-13T18:58:53.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.198+0000 7f9140a00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 0x7f911806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:53.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.199+0000 7f9140a00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 0x7f911806d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f912c034000 tx=0x7f912c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:53.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.202+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9134054310 con 0x7f913c159480 2024-09-13T18:58:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.416+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f913c151330 con 0x7f913c159480 2024-09-13T18:58:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.417+0000 7f9139600640 1 -- 172.21.15.33:0/124569100 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f913c151330 con 0x7f913c159480 2024-09-13T18:58:53.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:53.420 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:58:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.418+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 msgr2=0x7f911806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.418+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 0x7f911806d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f912c034000 tx=0x7f912c02e000 comp rx=0 tx=0).stop 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.418+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 msgr2=0x7f913c14f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.418+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f913400cc60 comp rx=0 tx=0).stop 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 shutdown_connections 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f911806ac00 0x7f911806d0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f913c159480 0x7f913c14f210 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f913c071560 0x7f913c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 --2- 172.21.15.33:0/124569100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f913c06f4b0 0x7f913c144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 >> 172.21.15.33:0/124569100 conn(0x7f913c0ae310 msgr2=0x7f913c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 shutdown_connections 2024-09-13T18:58:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.419+0000 7f9141e00640 1 -- 172.21.15.33:0/124569100 wait complete. 2024-09-13T18:58:53.467 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T18:58:53.464+0000 7f13d7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:58:53.841 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:58:47.921315+0000', 'modified': '2024-09-13T18:58:50.936010+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5523}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5523': {'gid': 5523, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6835/2375812342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 2375812342}, {'type': 'v1', 'addr': '172.21.15.33:6835', 'nonce': 2375812342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:58:53.841 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:58:53.842 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:58:54.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.999+0000 7facdb600640 1 Processor -- start 2024-09-13T18:58:54.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:53.999+0000 7facdb600640 1 -- start start 2024-09-13T18:58:54.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facdb600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7facd40b1b30 0x7facd40cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facdb600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facd40cba50 0x7facd40cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facdb600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd406ba80 con 0x7facd4151590 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facdb600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40cc3a0 con 0x7facd40cba50 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facdb600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40b2270 con 0x7facd40b1b30 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facd9600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facd40cba50 0x7facd40cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facd9600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7facd40cba50 0x7facd40cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37958/0 (socket says 172.21.15.33:37958) 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.000+0000 7facd9600640 1 -- 172.21.15.33:0/82425929 learned_addr learned my addr 172.21.15.33:0/82425929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.001+0000 7facd3e00640 1 --2- 172.21.15.33:0/82425929 >> v2:172.21.15.103:3300/0 conn(0x7facd40b1b30 0x7facd40cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.001+0000 7facd9600640 1 -- 172.21.15.33:0/82425929 >> v2:172.21.15.103:3300/0 conn(0x7facd40b1b30 msgr2=0x7facd40cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.001+0000 7facd9600640 1 --2- 172.21.15.33:0/82425929 >> v2:172.21.15.103:3300/0 conn(0x7facd40b1b30 0x7facd40cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.001+0000 7facd9600640 1 -- 172.21.15.33:0/82425929 >> v1:172.21.15.103:6789/0 conn(0x7facd4151590 legacy=0x7facd406b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.001+0000 7facd9600640 1 -- 172.21.15.33:0/82425929 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40b2550 con 0x7facd40cba50 2024-09-13T18:58:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.002+0000 7facd9600640 1 --2- 172.21.15.33:0/82425929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd40cbe60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7facd406da90 tx=0x7faccc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995817e867b54b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.002+0000 7facd3400640 1 -- 172.21.15.33:0/82425929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc031600 con 0x7facd40cba50 2024-09-13T18:58:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.002+0000 7facd3400640 1 -- 172.21.15.33:0/82425929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc02d050 con 0x7facd40cba50 2024-09-13T18:58:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.002+0000 7facd3400640 1 -- 172.21.15.33:0/82425929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc031980 con 0x7facd40cba50 2024-09-13T18:58:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 -- 172.21.15.33:0/82425929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 msgr2=0x7facd40cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 --2- 172.21.15.33:0/82425929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd40cbe60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7facd406da90 tx=0x7faccc02a730 comp rx=0 tx=0).stop 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 -- 172.21.15.33:0/82425929 shutdown_connections 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 --2- 172.21.15.33:0/82425929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd40cbe60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 --2- 172.21.15.33:0/82425929 >> v2:172.21.15.103:3300/0 conn(0x7facd40b1b30 0x7facd40cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 -- 172.21.15.33:0/82425929 >> 172.21.15.33:0/82425929 conn(0x7facd40b0510 msgr2=0x7facd40b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 -- 172.21.15.33:0/82425929 shutdown_connections 2024-09-13T18:58:54.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.003+0000 7facdb600640 1 -- 172.21.15.33:0/82425929 wait complete. 2024-09-13T18:58:54.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.004+0000 7facdb600640 1 Processor -- start 2024-09-13T18:58:54.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.005+0000 7facdb600640 1 -- start start 2024-09-13T18:58:54.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.005+0000 7facdb600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facd40b1b30 0x7facd414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.005+0000 7facdb600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.005+0000 7facdb600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facd4151590 0x7facd414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facdb600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd415e210 con 0x7facd40cba50 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facdb600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd415bd80 con 0x7facd40b1b30 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facdb600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd415c060 con 0x7facd4151590 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37972/0 (socket says 172.21.15.33:37972) 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 -- 172.21.15.33:0/130557189 learned_addr learned my addr 172.21.15.33:0/130557189 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd8c00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facd40b1b30 0x7facd414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd9600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facd4151590 0x7facd414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 -- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facd4151590 msgr2=0x7facd414d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facd4151590 0x7facd414d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 -- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facd40b1b30 msgr2=0x7facd414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facd40b1b30 0x7facd414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.006+0000 7facd3e00640 1 -- 172.21.15.33:0/130557189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc009b30 con 0x7facd40cba50 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facd3e00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7facc000d800 tx=0x7facc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facd0c00640 1 -- 172.21.15.33:0/130557189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000b6c0 con 0x7facd40cba50 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facd0c00640 1 -- 172.21.15.33:0/130557189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc000b820 con 0x7facd40cba50 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facd0c00640 1 -- 172.21.15.33:0/130557189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000bbb0 con 0x7facd40cba50 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd415c340 con 0x7facd40cba50 2024-09-13T18:58:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.007+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd415cb40 con 0x7facd40cba50 2024-09-13T18:58:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.009+0000 7facd0c00640 1 -- 172.21.15.33:0/130557189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7facc000bd10 con 0x7facd40cba50 2024-09-13T18:58:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.010+0000 7facd0c00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 0x7facb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.010+0000 7facd0c00640 1 -- 172.21.15.33:0/130557189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facc00897a0 con 0x7facd40cba50 2024-09-13T18:58:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.010+0000 7facd8c00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 0x7facb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.011+0000 7facde4d6740 1 Processor -- start 2024-09-13T18:58:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.011+0000 7facde4d6740 1 -- start start 2024-09-13T18:58:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.011+0000 7facd8c00640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 0x7facb406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7facc8000f60 tx=0x7facc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12d0b80 0x5557f12f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1212ab0 con 0x5557f12a96d0 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1210240 con 0x5557f12d0b80 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557f120bb30 con 0x5557f12a6e90 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37980/0 (socket says 172.21.15.33:37980) 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:33734/0 (socket says 172.21.15.33:33734) 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd8c00640 1 -- 172.21.15.33:0/774706258 learned_addr learned my addr 172.21.15.33:0/774706258 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.012+0000 7facd9600640 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12d0b80 0x5557f12f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 -- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12d0b80 msgr2=0x5557f12f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12d0b80 0x5557f12f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 -- 172.21.15.33:0/774706258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 msgr2=0x5557f12a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 -- 172.21.15.33:0/774706258 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557f11d6bd0 con 0x5557f12a6e90 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.013+0000 7facd3e00640 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facc0006fd0 tx=0x7facc0058170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812c8e80a3cf42b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facc5600640 1 -- 172.21.15.33:0/774706258 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0056a80 con 0x5557f12a6e90 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facc5600640 1 -- 172.21.15.33:0/774706258 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc005c170 con 0x5557f12a6e90 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facc5600640 1 -- 172.21.15.33:0/774706258 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0060590 con 0x5557f12a6e90 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 -- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 msgr2=0x5557f12f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facc0006fd0 tx=0x7facc0058170 comp rx=0 tx=0).stop 2024-09-13T18:58:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 -- 172.21.15.33:0/774706258 shutdown_connections 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12d0b80 0x5557f12f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12a6e90 0x5557f12f6ba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 --2- 172.21.15.33:0/774706258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.014+0000 7facde4d6740 1 -- 172.21.15.33:0/774706258 >> 172.21.15.33:0/774706258 conn(0x5557f12a5e00 msgr2=0x5557f12ee2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.015+0000 7facde4d6740 1 -- 172.21.15.33:0/774706258 shutdown_connections 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.015+0000 7facde4d6740 1 -- 172.21.15.33:0/774706258 wait complete. 2024-09-13T18:58:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.015+0000 7facde4d6740 1 -- start start 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.015+0000 7facde4d6740 1 Processor -- start 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f12c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f11ad260 con 0x5557f12a96d0 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f11acf00 con 0x5557f12cba40 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557f0f72f20 con 0x5557f12d0b80 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.016+0000 7facde4d6740 10 client.0 _ll_register_callbacks cb 0x5557f12051a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:58:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37996/0 (socket says 172.21.15.33:37996) 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 -- 172.21.15.33:0/2371088295 learned_addr learned my addr 172.21.15.33:0/2371088295 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd3e00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd9600640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f12c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 -- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 msgr2=0x5557f12cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 -- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 msgr2=0x5557f12c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f12c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 -- 172.21.15.33:0/2371088295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd415cb40 con 0x5557f12a96d0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd3e00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd9600640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f12c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facd8c00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7facc8014760 tx=0x7facc8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5346dccb55795158 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.017+0000 7facba000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:58:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8013700 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facc801c040 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557f1235cd0 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc8013860 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 10 client.5655 fetch_fsmap learned FSMap version 24 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5557f120a1b0 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557f1235cd0 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7facc8012070 con 0x5557f12a96d0 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 10 client.5655 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 10 client.5655 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 20 client.5655 populate_metadata read hostname 'smithi033' 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f12cde90 0x5557f12a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 4 client.5655 mds_command: new command op to 5523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.018+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 --> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557f0eff3c0 con 0x5557f12cde90 2024-09-13T18:58:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.019+0000 7facd3e00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f12cde90 0x5557f12a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.019+0000 7facd3e00640 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f12cde90 0x5557f12a2be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07c44e31b2fdb6e server_cookie=e12386fe425f076 in_seq=0 out_seq=0 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.019+0000 7facba000640 10 client.5655 ms_handle_connect on v2:172.21.15.33:6832/2375812342 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facba000640 1 -- 172.21.15.33:0/2371088295 <== mds.0 v2:172.21.15.33:6832/2375812342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5557f0eff3c0 con 0x5557f12cde90 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facba000640 10 client.5655 handle_command_reply: tid=0 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 client.5655 shutdown 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 msgr2=0x5557f12c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7facc8014760 tx=0x7facc8001080 comp rx=0 tx=0).stop 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 shutdown_connections 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f12cde90 0x5557f12a2be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f12c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 --2- 172.21.15.33:0/2371088295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12c76a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 >> 172.21.15.33:0/2371088295 conn(0x5557f12a6e90 msgr2=0x5557f12ec5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facba000640 0 client.5655 ms_handle_reset on v2:172.21.15.33:6832/2375812342 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 shutdown_connections 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.020+0000 7facde4d6740 1 -- 172.21.15.33:0/2371088295 wait complete. 2024-09-13T18:58:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.021+0000 7facde4d6740 20 client.5655 trim_cache size 0 max 16384 2024-09-13T18:58:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.036+0000 7facde4d6740 1 Processor -- start 2024-09-13T18:58:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.036+0000 7facde4d6740 1 -- start start 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f13071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12ea500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f12cb900 con 0x5557f12a96d0 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f12c5730 con 0x5557f12cba40 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557f12c5c80 con 0x5557f12d0b80 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facd8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38000/0 (socket says 172.21.15.33:38000) 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.037+0000 7facd8c00640 1 -- 172.21.15.33:0/1781404322 learned_addr learned my addr 172.21.15.33:0/1781404322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 -- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 msgr2=0x5557f12ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 -- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 msgr2=0x5557f13071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f13071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 -- 172.21.15.33:0/1781404322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557f123f170 con 0x5557f12a96d0 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facd8c00640 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7facc8001670 tx=0x7facc8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc036a7298b0955 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facc6000640 1 -- 172.21.15.33:0/1781404322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8037030 con 0x5557f12a96d0 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facc6000640 1 -- 172.21.15.33:0/1781404322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8013b00 con 0x5557f12a96d0 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.038+0000 7facc6000640 1 -- 172.21.15.33:0/1781404322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8021400 con 0x5557f12a96d0 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 -- 172.21.15.33:0/1781404322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 msgr2=0x5557f12a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7facc8001670 tx=0x7facc8021000 comp rx=0 tx=0).stop 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 -- 172.21.15.33:0/1781404322 shutdown_connections 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f12ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12cba40 0x5557f13071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 --2- 172.21.15.33:0/1781404322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12a96d0 0x5557f12a4fc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 -- 172.21.15.33:0/1781404322 >> 172.21.15.33:0/1781404322 conn(0x5557f12a6e90 msgr2=0x5557f12cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 -- 172.21.15.33:0/1781404322 shutdown_connections 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.039+0000 7facde4d6740 1 -- 172.21.15.33:0/1781404322 wait complete. 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.040+0000 7facde4d6740 1 -- start start 2024-09-13T18:58:54.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.040+0000 7facde4d6740 1 Processor -- start 2024-09-13T18:58:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12a96d0 0x5557f130f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f1351310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f130dc30 con 0x5557f12cba40 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f130cfd0 con 0x5557f12a96d0 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557f130fac0 con 0x5557f12d0b80 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facde4d6740 10 client.0 _ll_register_callbacks cb 0x7facc8007af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38006/0 (socket says 172.21.15.33:38006) 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 -- 172.21.15.33:0/275697164 learned_addr learned my addr 172.21.15.33:0/275697164 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd8c00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12a96d0 0x5557f130f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd9600640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f1351310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 -- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 msgr2=0x5557f1351310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f1351310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 -- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12a96d0 msgr2=0x5557f130f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12a96d0 0x5557f130f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.041+0000 7facd3e00640 1 -- 172.21.15.33:0/275697164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557f120a1b0 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facd3e00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7facc00604f0 tx=0x7facc0087b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dee28e8c6034fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00584b0 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facc0060590 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facc005c170 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc0077080 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 10 client.5661 fetch_fsmap learned FSMap version 24 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5557f11ac470 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc005c170 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7facc0081bc0 con 0x5557f12cba40 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 10 client.5661 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:58:54.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 10 client.5661 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 20 client.5661 populate_metadata read hostname 'smithi033' 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f133ea60 0x5557f133d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 4 client.5661 mds_command: new command op to 5523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.042+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 --> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557f0f106c0 con 0x5557f133ea60 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facd8c00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f133ea60 0x5557f133d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facd8c00640 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f133ea60 0x5557f133d130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9921efc52183c836 server_cookie=7e6ac8ba2f973f54 in_seq=0 out_seq=0 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facba000640 10 client.5661 ms_handle_connect on v2:172.21.15.33:6832/2375812342 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facba000640 1 -- 172.21.15.33:0/275697164 <== mds.0 v2:172.21.15.33:6832/2375812342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5557f0f106c0 con 0x5557f133ea60 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facba000640 10 client.5661 handle_command_reply: tid=0 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facde4d6740 1 client.5661 shutdown 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.043+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 msgr2=0x5557f12ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7facc00604f0 tx=0x7facc0087b90 comp rx=0 tx=0).stop 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 shutdown_connections 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:6832/2375812342,v1:172.21.15.33:6835/2375812342] conn(0x5557f133ea60 0x5557f133d130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x5557f12d0b80 0x5557f1351310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5557f12cba40 0x5557f12ea6f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facba000640 0 client.5661 ms_handle_reset on v2:172.21.15.33:6832/2375812342 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 --2- 172.21.15.33:0/275697164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5557f12a96d0 0x5557f130f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 >> 172.21.15.33:0/275697164 conn(0x5557f12a6e90 msgr2=0x5557f12eb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 shutdown_connections 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 1 -- 172.21.15.33:0/275697164 wait complete. 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facde4d6740 20 client.5661 trim_cache size 0 max 16384 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T18:58:54.051 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5523, 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 6.1209313359999999, 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 24, 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 46, 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 46, 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.255619843 2024-09-13T18:58:54.052 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:58:54.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 msgr2=0x7facb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 0x7facb406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7facc8000f60 tx=0x7facc8009040 comp rx=0 tx=0).stop 2024-09-13T18:58:54.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 msgr2=0x7facd414cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7facc000d800 tx=0x7facc000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 shutdown_connections 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7facb406ac00 0x7facb406d0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7facd4151590 0x7facd414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facd40cba50 0x7facd414cd00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.044+0000 7facdb600640 1 --2- 172.21.15.33:0/130557189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facd40b1b30 0x7facd414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.045+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 >> 172.21.15.33:0/130557189 conn(0x7facd40b0510 msgr2=0x7facd41586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.045+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 shutdown_connections 2024-09-13T18:58:54.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.045+0000 7facdb600640 1 -- 172.21.15.33:0/130557189 wait complete. 2024-09-13T18:58:54.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:58:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.216+0000 7fc8d7200640 1 Processor -- start 2024-09-13T18:58:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.216+0000 7fc8d7200640 1 -- start start 2024-09-13T18:58:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d7200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 0x7fc8d806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d7200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8d815a370 0x7fc8d806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d7200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d815cdd0 con 0x7fc8d8159f90 2024-09-13T18:58:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d7200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815cbc0 con 0x7fc8d815a370 2024-09-13T18:58:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d7200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806e870 con 0x7fc8d806b5f0 2024-09-13T18:58:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d6800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8d815a370 0x7fc8d806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d6800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8d815a370 0x7fc8d806e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38010/0 (socket says 172.21.15.33:38010) 2024-09-13T18:58:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.217+0000 7fc8d6800640 1 -- 172.21.15.33:0/745222765 learned_addr learned my addr 172.21.15.33:0/745222765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8cfe00640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 0x7fc8d806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8d6800640 1 -- 172.21.15.33:0/745222765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 msgr2=0x7fc8d806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8d6800640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 0x7fc8d806db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8d6800640 1 -- 172.21.15.33:0/745222765 >> v1:172.21.15.103:6789/0 conn(0x7fc8d8159f90 legacy=0x7fc8d806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8d6800640 1 -- 172.21.15.33:0/745222765 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d815db50 con 0x7fc8d815a370 2024-09-13T18:58:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.218+0000 7fc8cfe00640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 0x7fc8d806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:54.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d6800640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d806e040 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009e50 tx=0x7fc8d002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9adc0fd7629d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d5400640 1 -- 172.21.15.33:0/745222765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0031600 con 0x7fc8d815a370 2024-09-13T18:58:54.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d5400640 1 -- 172.21.15.33:0/745222765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d002d050 con 0x7fc8d815a370 2024-09-13T18:58:54.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d5400640 1 -- 172.21.15.33:0/745222765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0031980 con 0x7fc8d815a370 2024-09-13T18:58:54.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d7200640 1 -- 172.21.15.33:0/745222765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 msgr2=0x7fc8d806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.219+0000 7fc8d7200640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d806e040 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009e50 tx=0x7fc8d002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 -- 172.21.15.33:0/745222765 shutdown_connections 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d806e040 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 --2- 172.21.15.33:0/745222765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d806b5f0 0x7fc8d806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 -- 172.21.15.33:0/745222765 >> 172.21.15.33:0/745222765 conn(0x7fc8d806cc70 msgr2=0x7fc8d806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 -- 172.21.15.33:0/745222765 shutdown_connections 2024-09-13T18:58:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.220+0000 7fc8d7200640 1 -- 172.21.15.33:0/745222765 wait complete. 2024-09-13T18:58:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.221+0000 7fc8d7200640 1 Processor -- start 2024-09-13T18:58:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.221+0000 7fc8d7200640 1 -- start start 2024-09-13T18:58:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8d806b5f0 0x7fc8d81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d8159f90 0x7fc8d8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81593d0 con 0x7fc8d815a370 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81f5450 con 0x7fc8d806b5f0 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.222+0000 7fc8d7200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8159600 con 0x7fc8d8159f90 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38026/0 (socket says 172.21.15.33:38026) 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 -- 172.21.15.33:0/4029589914 learned_addr learned my addr 172.21.15.33:0/4029589914 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d5e00640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8d806b5f0 0x7fc8d81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8cfe00640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d8159f90 0x7fc8d8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 -- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d8159f90 msgr2=0x7fc8d8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d8159f90 0x7fc8d8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 -- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8d806b5f0 msgr2=0x7fc8d81557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8d806b5f0 0x7fc8d81557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 -- 172.21.15.33:0/4029589914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009b30 con 0x7fc8d815a370 2024-09-13T18:58:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.223+0000 7fc8d6800640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009e50 tx=0x7fc8d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.224+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d003d860 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.224+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d003d9c0 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.224+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d003dd70 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.224+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d81f56a0 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.224+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d81f5c60 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.225+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d806aee0 con 0x7fc8d815a370 2024-09-13T18:58:54.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.226+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc8d003b400 con 0x7fc8d815a370 2024-09-13T18:58:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.227+0000 7fc8ce000640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 0x7fc8b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.227+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d00aa180 con 0x7fc8d815a370 2024-09-13T18:58:54.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.227+0000 7fc8d5e00640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 0x7fc8b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:54.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.228+0000 7fc8d5e00640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 0x7fc8b406d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8152fd0 tx=0x7fc8c8007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.231+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc8d0075400 con 0x7fc8d815a370 2024-09-13T18:58:54.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.447+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8d80711e0 con 0x7fc8d815a370 2024-09-13T18:58:54.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.448+0000 7fc8ce000640 1 -- 172.21.15.33:0/4029589914 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc8d0009510 con 0x7fc8d815a370 2024-09-13T18:58:54.451 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 msgr2=0x7fc8b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 0x7fc8b406d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8152fd0 tx=0x7fc8c8007e30 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 msgr2=0x7fc8d814d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009e50 tx=0x7fc8d0004a40 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 shutdown_connections 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8b406ac00 0x7fc8b406d0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8d815a370 0x7fc8d814d100 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8d8159f90 0x7fc8d8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 --2- 172.21.15.33:0/4029589914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8d806b5f0 0x7fc8d81557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 >> 172.21.15.33:0/4029589914 conn(0x7fc8d806cc70 msgr2=0x7fc8d815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 shutdown_connections 2024-09-13T18:58:54.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:54.450+0000 7fc8d7200640 1 -- 172.21.15.33:0/4029589914 wait complete. 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:54.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:58:54.470 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:58:54.470 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:58:54.470 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:54.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.470 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42597sec preferred_lft 42597sec 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:54.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.509 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:58:54.600 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T18:58:54.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.603 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T18:58:54.639 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T18:58:54.639 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:58:54.639 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:58:54.639 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:58:54.639 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:58:54.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:58:54.640 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:58:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.785 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:58:54.820 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:58:54.820 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:58:54.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:54.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:54.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T18:58:54.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:54.916 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:54.952 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:58:54.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:54.952 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:55.027 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:58:55.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:55.156 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:55.156 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:55.156 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:55.172 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:55.172 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:55.172 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:55.172 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:55.173 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:58:55.197 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:58:55.198 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:58:55.199 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:58:55.199 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:58:55.199 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:58:55.199 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:58:55.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:58:55.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:55.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.264 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:58:55.311 INFO:teuthology.orchestra.run.smithi033.stdout:client5156 2024-09-13T18:58:55.311 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:55.311 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:55.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:58:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.581+0000 7faf5e200640 1 Processor -- start 2024-09-13T18:58:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.581+0000 7faf5e200640 1 -- start start 2024-09-13T18:58:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.582+0000 7faf5e200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 0x7faf5806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf5e200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5806bc00 con 0x7faf580b1b00 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf5e200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5806bea0 con 0x7faf580ce020 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf5e200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5806c180 con 0x7faf5815a520 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf4fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faf580b1b00 0x7faf580cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51324/0 (socket says 172.21.15.33:51324) 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf4fe00640 1 -- 172.21.15.33:0/1728096786 learned_addr learned my addr 172.21.15.33:0/1728096786 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf57400640 1 --2- 172.21.15.33:0/1728096786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 0x7faf5806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945780551 0 0) 0x7faf5806bc00 con 0x7faf580b1b00 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c003520 con 0x7faf580b1b00 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094101135 0 0) 0x7faf5806bea0 con 0x7faf580ce020 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.583+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5806bc00 con 0x7faf580ce020 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.584+0000 7faf57400640 1 -- 172.21.15.33:0/1728096786 >> v1:172.21.15.103:6789/0 conn(0x7faf580ce020 legacy=0x7faf5815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.584+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972302560 0 0) 0x7faf3c003520 con 0x7faf580b1b00 2024-09-13T18:58:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.584+0000 7faf57400640 1 -- 172.21.15.33:0/1728096786 >> v1:172.21.15.33:6789/0 conn(0x7faf580b1b00 legacy=0x7faf580cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.584+0000 7faf57400640 1 -- 172.21.15.33:0/1728096786 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5806c460 con 0x7faf5815a520 2024-09-13T18:58:55.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.585+0000 7faf57400640 1 --2- 172.21.15.33:0/1728096786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 0x7faf5806b6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf480097d0 tx=0x7faf4802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=159be330045193b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:55.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.585+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40001670 con 0x7faf5815a520 2024-09-13T18:58:55.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.585+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4802ac30 con 0x7faf5815a520 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.585+0000 7faf56a00640 1 -- 172.21.15.33:0/1728096786 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48032440 con 0x7faf5815a520 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 -- 172.21.15.33:0/1728096786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 msgr2=0x7faf5806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 --2- 172.21.15.33:0/1728096786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 0x7faf5806b6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf480097d0 tx=0x7faf4802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 -- 172.21.15.33:0/1728096786 shutdown_connections 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 --2- 172.21.15.33:0/1728096786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf5815a520 0x7faf5806b6c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 -- 172.21.15.33:0/1728096786 >> 172.21.15.33:0/1728096786 conn(0x7faf580b0510 msgr2=0x7faf580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 -- 172.21.15.33:0/1728096786 shutdown_connections 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.586+0000 7faf5e200640 1 -- 172.21.15.33:0/1728096786 wait complete. 2024-09-13T18:58:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.588+0000 7faf5e200640 1 Processor -- start 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.588+0000 7faf5e200640 1 -- start start 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.588+0000 7faf5e200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf580b1b00 0x7faf580a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf5e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf5e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf5815a520 0x7faf581f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf5e200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580a9770 con 0x7faf580ce020 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf5e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf581533e0 con 0x7faf5815a520 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf5e200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf581536c0 con 0x7faf580b1b00 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38036/0 (socket says 172.21.15.33:38036) 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 -- 172.21.15.33:0/1080002644 learned_addr learned my addr 172.21.15.33:0/1080002644 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf57400640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf580b1b00 0x7faf580a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf57e00640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf5815a520 0x7faf581f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 -- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf580b1b00 msgr2=0x7faf580a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf580b1b00 0x7faf580a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 -- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf5815a520 msgr2=0x7faf581f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf5815a520 0x7faf581f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 -- 172.21.15.33:0/1080002644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009400 con 0x7faf580ce020 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.589+0000 7faf4fe00640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c780 tx=0x7faf4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.590+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40005ad0 con 0x7faf580ce020 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.590+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf40005c30 con 0x7faf580ce020 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.590+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40007070 con 0x7faf580ce020 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.590+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf581539a0 con 0x7faf580ce020 2024-09-13T18:58:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.590+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf580a93b0 con 0x7faf580ce020 2024-09-13T18:58:55.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.591+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf58153ec0 con 0x7faf580ce020 2024-09-13T18:58:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.592+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf400071d0 con 0x7faf580ce020 2024-09-13T18:58:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.593+0000 7faf4f400640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 0x7faf3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.593+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf40088930 con 0x7faf580ce020 2024-09-13T18:58:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.593+0000 7faf57400640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 0x7faf3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.594+0000 7faf57400640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 0x7faf3406d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf48034000 tx=0x7faf4802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:55.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.597+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf58153ec0 con 0x7faf580ce020 2024-09-13T18:58:55.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.812+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf58153ec0 con 0x7faf580ce020 2024-09-13T18:58:55.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.813+0000 7faf4f400640 1 -- 172.21.15.33:0/1080002644 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf58153ec0 con 0x7faf580ce020 2024-09-13T18:58:55.816 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:58:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 msgr2=0x7faf3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 0x7faf3406d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf48034000 tx=0x7faf4802e000 comp rx=0 tx=0).stop 2024-09-13T18:58:55.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 msgr2=0x7faf580afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c780 tx=0x7faf4000cc40 comp rx=0 tx=0).stop 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 shutdown_connections 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf3406ac00 0x7faf3406d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf5815a520 0x7faf581f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf580ce020 0x7faf580afb90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 --2- 172.21.15.33:0/1080002644 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf580b1b00 0x7faf580a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 >> 172.21.15.33:0/1080002644 conn(0x7faf580b0510 msgr2=0x7faf58158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 shutdown_connections 2024-09-13T18:58:55.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:55.815+0000 7faf5e200640 1 -- 172.21.15.33:0/1080002644 wait complete. 2024-09-13T18:58:55.835 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:58:55.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:58:55.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T18:58:55.835 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:58:55.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:55.836 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:58:55.836 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:58:55.836 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:58:55.836 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:55.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.836 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T18:58:55.876 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:58:55.876 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:58:55.876 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:55.877 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42613sec preferred_lft 42613sec 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T18:58:55.878 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.879 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:58:55.879 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:58:55.879 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T18:58:55.879 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:58:55.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.879 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:58:55.976 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:58:55.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:55.979 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T18:58:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T18:58:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:58:56.017 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:58:56.017 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:58:56.017 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:58:56.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:58:56.017 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:58:56.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.163 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:58:56.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:58:56.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:58:56.200 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:56.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T18:58:56.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:56.295 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:56.330 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:58:56.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:58:56.330 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:56.404 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:58:56.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:56.532 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:56.533 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:56.533 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:56.548 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:56.548 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:56.548 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:56.548 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:56.548 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:56.570 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:58:56.571 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:58:56.572 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:58:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:58:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:58:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:58:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:58:56.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:58:56.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:58:56.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.631 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:58:56.669 INFO:teuthology.orchestra.run.smithi103.stdout:client5165 2024-09-13T18:58:56.669 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:56.669 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:56.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.746 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T18:58:56.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.790 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10A ./subdir) 2024-09-13T18:58:56.868 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:56.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:56.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.870 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1y00Ki ./subdir) 2024-09-13T18:58:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:56.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:56.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:56.948 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v af00 ./subdir) 2024-09-13T18:58:57.024 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:57.025 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v G ./subdir) 2024-09-13T18:58:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:57.103 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v '' ./subdir) 2024-09-13T18:58:57.178 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:57.179 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v ' ' ./subdir) 2024-09-13T18:58:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:57.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1t ./subdir) 2024-09-13T18:58:57.332 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:57.333 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1 ./subdir) 2024-09-13T18:58:57.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:58:57.410 INFO:teuthology.orchestra.run.smithi033.stderr:setfattr: ./subdir: Invalid argument 2024-09-13T18:58:57.411 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:58:57.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:57.549 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:58:57.630 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:58:57.630 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:57.631 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:57.666 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:58:57.667 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:57.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:58:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.935+0000 7f9ea6400640 1 Processor -- start 2024-09-13T18:58:57.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.935+0000 7f9ea6400640 1 -- start start 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9ea6400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9ea6400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9ea0159a80 0x7f9ea00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9ea6400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea0153f00 con 0x7f9ea00b2410 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9ea6400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea00ce600 con 0x7f9ea0159a80 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9ea6400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0070f90 con 0x7f9ea0153b20 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9e96a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9ea0159a80 0x7f9ea00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9e96a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9ea0159a80 0x7f9ea00b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38046/0 (socket says 172.21.15.33:38046) 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9e96a00640 1 -- 172.21.15.33:0/2431863661 learned_addr learned my addr 172.21.15.33:0/2431863661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:57.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.937+0000 7f9e9f400640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.938+0000 7f9e96a00640 1 -- 172.21.15.33:0/2431863661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 msgr2=0x7f9ea00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:57.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.938+0000 7f9e96a00640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea00b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:57.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.938+0000 7f9e96a00640 1 -- 172.21.15.33:0/2431863661 >> v1:172.21.15.33:6789/0 conn(0x7f9ea00b2410 legacy=0x7f9ea006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:57.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.938+0000 7f9e96a00640 1 -- 172.21.15.33:0/2431863661 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00b1a40 con 0x7f9ea0159a80 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9e96a00640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea00b1ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098a0 tx=0x7f9e8802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece73d734f4da307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9e9ea00640 1 -- 172.21.15.33:0/2431863661 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88032440 con 0x7f9ea0159a80 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9e9ea00640 1 -- 172.21.15.33:0/2431863661 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e880325a0 con 0x7f9ea0159a80 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9e9ea00640 1 -- 172.21.15.33:0/2431863661 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88032930 con 0x7f9ea0159a80 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9ea6400640 1 -- 172.21.15.33:0/2431863661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 msgr2=0x7f9ea00b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.939+0000 7f9ea6400640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea00b1ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098a0 tx=0x7f9e8802a290 comp rx=0 tx=0).stop 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 -- 172.21.15.33:0/2431863661 shutdown_connections 2024-09-13T18:58:57.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea00b1ed0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 --2- 172.21.15.33:0/2431863661 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea00b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 -- 172.21.15.33:0/2431863661 >> 172.21.15.33:0/2431863661 conn(0x7f9ea00b0510 msgr2=0x7f9ea00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 -- 172.21.15.33:0/2431863661 shutdown_connections 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.940+0000 7f9ea6400640 1 -- 172.21.15.33:0/2431863661 wait complete. 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.941+0000 7f9ea6400640 1 Processor -- start 2024-09-13T18:58:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.941+0000 7f9ea6400640 1 -- start start 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ea00b2410 0x7f9ea00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00b0e30 con 0x7f9ea0159a80 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0154ac0 con 0x7f9ea00b2410 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9ea6400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0154da0 con 0x7f9ea0153b20 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.942+0000 7f9e9fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38060/0 (socket says 172.21.15.33:38060) 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 -- 172.21.15.33:0/3849664057 learned_addr learned my addr 172.21.15.33:0/3849664057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e96a00640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9f400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ea00b2410 0x7f9ea00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 -- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 msgr2=0x7f9ea015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 -- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ea00b2410 msgr2=0x7f9ea00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ea00b2410 0x7f9ea00b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 -- 172.21.15.33:0/3849664057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880094d0 con 0x7f9ea0159a80 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e9fe00640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800c6b0 tx=0x7f9e9800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98003b70 con 0x7f9ea0159a80 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98003cf0 con 0x7f9ea0159a80 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98003ea0 con 0x7f9ea0159a80 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.943+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea0155080 con 0x7f9ea0159a80 2024-09-13T18:58:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.944+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea0155640 con 0x7f9ea0159a80 2024-09-13T18:58:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.945+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea00b3990 con 0x7f9ea0159a80 2024-09-13T18:58:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.946+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e98005310 con 0x7f9ea0159a80 2024-09-13T18:58:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.946+0000 7f9e97e00640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 0x7f9e7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.947+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e980890d0 con 0x7f9ea0159a80 2024-09-13T18:58:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.947+0000 7f9e9f400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 0x7f9e7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.948+0000 7f9e9f400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 0x7f9e7c06d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0165b40 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:57.951+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e98054280 con 0x7f9ea0159a80 2024-09-13T18:58:58.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.132+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ea0159040 con 0x7f9ea0159a80 2024-09-13T18:58:58.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.133+0000 7f9e97e00640 1 -- 172.21.15.33:0/3849664057 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f9e980578a0 con 0x7f9ea0159a80 2024-09-13T18:58:58.137 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:58:58.137 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":48,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:57.020293+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 msgr2=0x7f9e7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 0x7f9e7c06d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0165b40 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 msgr2=0x7f9ea015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800c6b0 tx=0x7f9e9800cb70 comp rx=0 tx=0).stop 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 shutdown_connections 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9e7c06ac00 0x7f9e7c06d0c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ea0159a80 0x7f9ea015bf80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ea0153b20 0x7f9ea015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 --2- 172.21.15.33:0/3849664057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ea00b2410 0x7f9ea00b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 >> 172.21.15.33:0/3849664057 conn(0x7f9ea00b0510 msgr2=0x7f9ea015d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 shutdown_connections 2024-09-13T18:58:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.135+0000 7f9ea6400640 1 -- 172.21.15.33:0/3849664057 wait complete. 2024-09-13T18:58:58.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:45.791816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:46.914408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:58:58.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:58:58.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.310+0000 7eff95200640 1 Processor -- start 2024-09-13T18:58:58.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.310+0000 7eff95200640 1 -- start start 2024-09-13T18:58:58.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff95200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff90154ad0 0x7eff900cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff95200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff900ce2c0 0x7eff900cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff95200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9006b7c0 con 0x7eff9006f830 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff95200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9006b5b0 con 0x7eff90154ad0 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff95200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9006baa0 con 0x7eff900ce2c0 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff90154ad0 0x7eff900cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff90154ad0 0x7eff900cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38064/0 (socket says 172.21.15.33:38064) 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 -- 172.21.15.33:0/3141131854 learned_addr learned my addr 172.21.15.33:0/3141131854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8e800640 1 --2- 172.21.15.33:0/3141131854 >> v2:172.21.15.103:3300/0 conn(0x7eff900ce2c0 0x7eff900cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 -- 172.21.15.33:0/3141131854 >> v2:172.21.15.103:3300/0 conn(0x7eff900ce2c0 msgr2=0x7eff900cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 --2- 172.21.15.33:0/3141131854 >> v2:172.21.15.103:3300/0 conn(0x7eff900ce2c0 0x7eff900cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 -- 172.21.15.33:0/3141131854 >> v1:172.21.15.33:6789/0 conn(0x7eff9006f830 legacy=0x7eff9006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.312+0000 7eff8de00640 1 -- 172.21.15.33:0/3141131854 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9006bd80 con 0x7eff90154ad0 2024-09-13T18:58:58.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.313+0000 7eff8de00640 1 --2- 172.21.15.33:0/3141131854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff90154ad0 0x7eff900cdd80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff900ce780 tx=0x7eff8002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7003f6b56865ec1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff8d400640 1 -- 172.21.15.33:0/3141131854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80032440 con 0x7eff90154ad0 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff8d400640 1 -- 172.21.15.33:0/3141131854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff800325a0 con 0x7eff90154ad0 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff8d400640 1 -- 172.21.15.33:0/3141131854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80032930 con 0x7eff90154ad0 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 -- 172.21.15.33:0/3141131854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff90154ad0 msgr2=0x7eff900cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 --2- 172.21.15.33:0/3141131854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff90154ad0 0x7eff900cdd80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff900ce780 tx=0x7eff8002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 -- 172.21.15.33:0/3141131854 shutdown_connections 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 --2- 172.21.15.33:0/3141131854 >> v2:172.21.15.103:3300/0 conn(0x7eff900ce2c0 0x7eff900cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 --2- 172.21.15.33:0/3141131854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff90154ad0 0x7eff900cdd80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 -- 172.21.15.33:0/3141131854 >> 172.21.15.33:0/3141131854 conn(0x7eff900b0580 msgr2=0x7eff900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 -- 172.21.15.33:0/3141131854 shutdown_connections 2024-09-13T18:58:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.314+0000 7eff95200640 1 -- 172.21.15.33:0/3141131854 wait complete. 2024-09-13T18:58:58.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.316+0000 7eff95200640 1 Processor -- start 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.316+0000 7eff95200640 1 -- start start 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff90154ad0 0x7eff900b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff900b2c50 0x7eff900b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff901f2710 con 0x7eff901498d0 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff901e62b0 con 0x7eff90154ad0 2024-09-13T18:58:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff95200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff901e6590 con 0x7eff900b2c50 2024-09-13T18:58:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff8e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff8e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38068/0 (socket says 172.21.15.33:38068) 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff8e800640 1 -- 172.21.15.33:0/664678009 learned_addr learned my addr 172.21.15.33:0/664678009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff85400640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff900b2c50 0x7eff900b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.317+0000 7eff8de00640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff90154ad0 0x7eff900b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 -- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff900b2c50 msgr2=0x7eff900b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff900b2c50 0x7eff900b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 -- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff90154ad0 msgr2=0x7eff900b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff90154ad0 0x7eff900b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 -- 172.21.15.33:0/664678009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800094d0 con 0x7eff901498d0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff8e800640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7eff88007e30 tx=0x7eff8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88014620 con 0x7eff901498d0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8800ee90 con 0x7eff901498d0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff880149c0 con 0x7eff901498d0 2024-09-13T18:58:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.318+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff901e6870 con 0x7eff901498d0 2024-09-13T18:58:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.319+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff901e6e30 con 0x7eff901498d0 2024-09-13T18:58:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.320+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff900cdd80 con 0x7eff901498d0 2024-09-13T18:58:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.320+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff88014b20 con 0x7eff901498d0 2024-09-13T18:58:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.321+0000 7eff86a00640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 0x7eff6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.321+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7eff88089cd0 con 0x7eff901498d0 2024-09-13T18:58:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.322+0000 7eff8de00640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 0x7eff6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.323+0000 7eff8de00640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 0x7eff6c06d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7eff80034000 tx=0x7eff8002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.326+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7eff88054e80 con 0x7eff901498d0 2024-09-13T18:58:58.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.505+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff90150d00 con 0x7eff901498d0 2024-09-13T18:58:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.506+0000 7eff86a00640 1 -- 172.21.15.33:0/664678009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff880584a0 con 0x7eff901498d0 2024-09-13T18:58:58.509 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:58:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 msgr2=0x7eff6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 0x7eff6c06d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7eff80034000 tx=0x7eff8002e000 comp rx=0 tx=0).stop 2024-09-13T18:58:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 msgr2=0x7eff90149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7eff88007e30 tx=0x7eff8800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 shutdown_connections 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff6c06ac00 0x7eff6c06d0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff901498d0 0x7eff90149d80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff900b2c50 0x7eff900b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 --2- 172.21.15.33:0/664678009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff90154ad0 0x7eff900b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 >> 172.21.15.33:0/664678009 conn(0x7eff900b0580 msgr2=0x7eff900cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 shutdown_connections 2024-09-13T18:58:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.508+0000 7eff95200640 1 -- 172.21.15.33:0/664678009 wait complete. 2024-09-13T18:58:58.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:58:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.681+0000 7eff69e00640 1 Processor -- start 2024-09-13T18:58:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.681+0000 7eff69e00640 1 -- start start 2024-09-13T18:58:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff69e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff64154ad0 0x7eff640cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff69e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff640ce2c0 0x7eff640cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff69e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6406b7c0 con 0x7eff6406f830 2024-09-13T18:58:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff69e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6406b5b0 con 0x7eff640ce2c0 2024-09-13T18:58:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff69e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6406baa0 con 0x7eff64154ad0 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.682+0000 7eff63400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff640ce2c0 0x7eff640cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff640ce2c0 0x7eff640cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38084/0 (socket says 172.21.15.33:38084) 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 -- 172.21.15.33:0/1614074843 learned_addr learned my addr 172.21.15.33:0/1614074843 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff62000640 1 --1- 172.21.15.33:0/1614074843 >> v1:172.21.15.33:6789/0 conn(0x7eff6406f830 0x7eff6406fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51356/0 (socket says 172.21.15.33:51356) 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff62a00640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff64154ad0 0x7eff640cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 -- 172.21.15.33:0/1614074843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff64154ad0 msgr2=0x7eff640cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff64154ad0 0x7eff640cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 -- 172.21.15.33:0/1614074843 >> v1:172.21.15.33:6789/0 conn(0x7eff6406f830 legacy=0x7eff6406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.683+0000 7eff63400640 1 -- 172.21.15.33:0/1614074843 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6406bd80 con 0x7eff640ce2c0 2024-09-13T18:58:58.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.684+0000 7eff63400640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff640ce2c0 0x7eff640cbac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009e80 tx=0x7eff5c02a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe79e9367198246b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.684+0000 7eff61600640 1 -- 172.21.15.33:0/1614074843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c031600 con 0x7eff640ce2c0 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.684+0000 7eff61600640 1 -- 172.21.15.33:0/1614074843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c02d050 con 0x7eff640ce2c0 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.684+0000 7eff61600640 1 -- 172.21.15.33:0/1614074843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c031980 con 0x7eff640ce2c0 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 -- 172.21.15.33:0/1614074843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff640ce2c0 msgr2=0x7eff640cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff640ce2c0 0x7eff640cbac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009e80 tx=0x7eff5c02a6b0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 -- 172.21.15.33:0/1614074843 shutdown_connections 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff640ce2c0 0x7eff640cbac0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 --2- 172.21.15.33:0/1614074843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff64154ad0 0x7eff640cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 -- 172.21.15.33:0/1614074843 >> 172.21.15.33:0/1614074843 conn(0x7eff640b0580 msgr2=0x7eff640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 -- 172.21.15.33:0/1614074843 shutdown_connections 2024-09-13T18:58:58.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.685+0000 7eff69e00640 1 -- 172.21.15.33:0/1614074843 wait complete. 2024-09-13T18:58:58.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.687+0000 7eff69e00640 1 Processor -- start 2024-09-13T18:58:58.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.687+0000 7eff69e00640 1 -- start start 2024-09-13T18:58:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 0x7eff640b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff641595c0 0x7eff64159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64159fb0 con 0x7eff6415bcc0 2024-09-13T18:58:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b30b0 con 0x7eff64154ad0 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff69e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6415c710 con 0x7eff641595c0 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38100/0 (socket says 172.21.15.33:38100) 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 -- 172.21.15.33:0/334184277 learned_addr learned my addr 172.21.15.33:0/334184277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 -- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff641595c0 msgr2=0x7eff64159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff641595c0 0x7eff64159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62a00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 0x7eff640b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 -- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 msgr2=0x7eff640b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 0x7eff640b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62000640 1 -- 172.21.15.33:0/334184277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009b30 con 0x7eff6415bcc0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.688+0000 7eff62a00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 0x7eff640b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff62000640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c420 tx=0x7eff5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500074e0 con 0x7eff6415bcc0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50007640 con 0x7eff6415bcc0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50004a20 con 0x7eff6415bcc0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6415c9f0 con 0x7eff6415bcc0 2024-09-13T18:58:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.689+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff64152240 con 0x7eff6415bcc0 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.690+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6415cf10 con 0x7eff6415bcc0 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.691+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff50004b80 con 0x7eff6415bcc0 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.692+0000 7eff5b400640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 0x7eff4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.692+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7eff50088d90 con 0x7eff6415bcc0 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.692+0000 7eff62a00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 0x7eff4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:58.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.693+0000 7eff62a00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 0x7eff4406d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7eff54006fd0 tx=0x7eff54008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:58.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.696+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7eff50053f20 con 0x7eff6415bcc0 2024-09-13T18:58:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.872+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff640cdd80 con 0x7eff6415bcc0 2024-09-13T18:58:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.873+0000 7eff5b400640 1 -- 172.21.15.33:0/334184277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff50057540 con 0x7eff6415bcc0 2024-09-13T18:58:58.876 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 msgr2=0x7eff4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 0x7eff4406d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7eff54006fd0 tx=0x7eff54008040 comp rx=0 tx=0).stop 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 msgr2=0x7eff6415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c420 tx=0x7eff5000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 shutdown_connections 2024-09-13T18:58:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7eff4406ac00 0x7eff4406d0c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff641595c0 0x7eff64159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6415bcc0 0x7eff6415c120 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 --2- 172.21.15.33:0/334184277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff64154ad0 0x7eff640b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.875+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 >> 172.21.15.33:0/334184277 conn(0x7eff640b0580 msgr2=0x7eff64070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.876+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 shutdown_connections 2024-09-13T18:58:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:58.876+0000 7eff69e00640 1 -- 172.21.15.33:0/334184277 wait complete. 2024-09-13T18:58:58.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:58:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.049+0000 7fb249800640 1 Processor -- start 2024-09-13T18:58:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.049+0000 7fb249800640 1 -- start start 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.050+0000 7fb249800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb244154ad0 0x7fb2440cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.050+0000 7fb249800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2440ce2c0 0x7fb2440cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.050+0000 7fb249800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24406b7c0 con 0x7fb24406f830 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.050+0000 7fb249800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24406b5b0 con 0x7fb244154ad0 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.050+0000 7fb249800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24406baa0 con 0x7fb2440ce2c0 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb244154ad0 0x7fb2440cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb244154ad0 0x7fb2440cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38112/0 (socket says 172.21.15.33:38112) 2024-09-13T18:58:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 -- 172.21.15.33:0/1681779147 learned_addr learned my addr 172.21.15.33:0/1681779147 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb243400640 1 --2- 172.21.15.33:0/1681779147 >> v2:172.21.15.103:3300/0 conn(0x7fb2440ce2c0 0x7fb2440cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 -- 172.21.15.33:0/1681779147 >> v2:172.21.15.103:3300/0 conn(0x7fb2440ce2c0 msgr2=0x7fb2440cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 --2- 172.21.15.33:0/1681779147 >> v2:172.21.15.103:3300/0 conn(0x7fb2440ce2c0 0x7fb2440cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 -- 172.21.15.33:0/1681779147 >> v1:172.21.15.33:6789/0 conn(0x7fb24406f830 legacy=0x7fb24406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.051+0000 7fb242a00640 1 -- 172.21.15.33:0/1681779147 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24406bd80 con 0x7fb244154ad0 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.052+0000 7fb242a00640 1 --2- 172.21.15.33:0/1681779147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2440cdd80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb2440ce780 tx=0x7fb23402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0faf07e119cc126 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.052+0000 7fb241600640 1 -- 172.21.15.33:0/1681779147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234032440 con 0x7fb244154ad0 2024-09-13T18:58:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.052+0000 7fb241600640 1 -- 172.21.15.33:0/1681779147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2340325a0 con 0x7fb244154ad0 2024-09-13T18:58:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.052+0000 7fb241600640 1 -- 172.21.15.33:0/1681779147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234032930 con 0x7fb244154ad0 2024-09-13T18:58:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 -- 172.21.15.33:0/1681779147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 msgr2=0x7fb2440cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 --2- 172.21.15.33:0/1681779147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2440cdd80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb2440ce780 tx=0x7fb23402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 -- 172.21.15.33:0/1681779147 shutdown_connections 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 --2- 172.21.15.33:0/1681779147 >> v2:172.21.15.103:3300/0 conn(0x7fb2440ce2c0 0x7fb2440cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 --2- 172.21.15.33:0/1681779147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2440cdd80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 -- 172.21.15.33:0/1681779147 >> 172.21.15.33:0/1681779147 conn(0x7fb2440b0580 msgr2=0x7fb2440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 -- 172.21.15.33:0/1681779147 shutdown_connections 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.053+0000 7fb249800640 1 -- 172.21.15.33:0/1681779147 wait complete. 2024-09-13T18:58:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.055+0000 7fb249800640 1 Processor -- start 2024-09-13T18:58:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.055+0000 7fb249800640 1 -- start start 2024-09-13T18:58:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb24413da60 0x7fb2441595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb24413dee0 0x7fb244159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24413ea00 con 0x7fb244154ad0 2024-09-13T18:58:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24413f3b0 con 0x7fb24413dee0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb249800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24413e440 con 0x7fb24413da60 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38126/0 (socket says 172.21.15.33:38126) 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 -- 172.21.15.33:0/40909492 learned_addr learned my addr 172.21.15.33:0/40909492 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb243400640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb24413dee0 0x7fb244159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242000640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb24413da60 0x7fb2441595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 -- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb24413da60 msgr2=0x7fb2441595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb24413da60 0x7fb2441595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 -- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb24413dee0 msgr2=0x7fb244159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb24413dee0 0x7fb244159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.056+0000 7fb242a00640 1 -- 172.21.15.33:0/40909492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340094d0 con 0x7fb244154ad0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb242a00640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb23402a220 tx=0x7fb2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234032440 con 0x7fb244154ad0 2024-09-13T18:58:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234030ba0 con 0x7fb244154ad0 2024-09-13T18:58:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24413e720 con 0x7fb244154ad0 2024-09-13T18:58:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23403d440 con 0x7fb244154ad0 2024-09-13T18:58:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.057+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb244141ba0 con 0x7fb244154ad0 2024-09-13T18:58:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.058+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24413eea0 con 0x7fb244154ad0 2024-09-13T18:58:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.059+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb234039040 con 0x7fb244154ad0 2024-09-13T18:58:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.060+0000 7fb23aa00640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 0x7fb22406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.060+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb2340a9e30 con 0x7fb244154ad0 2024-09-13T18:58:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.060+0000 7fb242000640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 0x7fb22406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.061+0000 7fb242000640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 0x7fb22406d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb24414a8d0 tx=0x7fb230009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.064+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb24413eea0 con 0x7fb244154ad0 2024-09-13T18:58:59.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.246+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb24413eea0 con 0x7fb244154ad0 2024-09-13T18:58:59.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.246+0000 7fb23aa00640 1 -- 172.21.15.33:0/40909492 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb24413eea0 con 0x7fb244154ad0 2024-09-13T18:58:59.250 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 msgr2=0x7fb22406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 0x7fb22406d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb24414a8d0 tx=0x7fb230009040 comp rx=0 tx=0).stop 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 msgr2=0x7fb2441f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb23402a220 tx=0x7fb2340046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 shutdown_connections 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb22406ac00 0x7fb22406d0c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb24413dee0 0x7fb244159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb24413da60 0x7fb2441595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 --2- 172.21.15.33:0/40909492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb244154ad0 0x7fb2441f1900 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.248+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 >> 172.21.15.33:0/40909492 conn(0x7fb2440b0580 msgr2=0x7fb2440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.249+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 shutdown_connections 2024-09-13T18:58:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.249+0000 7fb249800640 1 -- 172.21.15.33:0/40909492 wait complete. 2024-09-13T18:58:59.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:58:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.421+0000 7f010ea00640 1 Processor -- start 2024-09-13T18:58:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.421+0000 7f010ea00640 1 -- start start 2024-09-13T18:58:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.422+0000 7f010ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0108151590 0x7f010806b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.422+0000 7f010ea00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080ce4b0 con 0x7f01080b1b30 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.422+0000 7f010ea00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080b2270 con 0x7f01080cba50 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.422+0000 7f010ea00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080b2550 con 0x7f0108151590 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0108151590 0x7f010806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0108151590 0x7f010806b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38128/0 (socket says 172.21.15.33:38128) 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 -- 172.21.15.33:0/3056397022 learned_addr learned my addr 172.21.15.33:0/3056397022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 -- 172.21.15.33:0/3056397022 >> v1:172.21.15.103:6789/0 conn(0x7f01080cba50 legacy=0x7f01080cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 -- 172.21.15.33:0/3056397022 >> v1:172.21.15.33:6789/0 conn(0x7f01080b1b30 legacy=0x7f01080cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.423+0000 7f0107e00640 1 -- 172.21.15.33:0/3056397022 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080b2830 con 0x7f0108151590 2024-09-13T18:58:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.424+0000 7f0107e00640 1 --2- 172.21.15.33:0/3056397022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0108151590 0x7f010806b370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c075e023f65ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.424+0000 7f0107400640 1 -- 172.21.15.33:0/3056397022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8032640 con 0x7f0108151590 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f0107400640 1 -- 172.21.15.33:0/3056397022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f80327a0 con 0x7f0108151590 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f0107400640 1 -- 172.21.15.33:0/3056397022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8032b30 con 0x7f0108151590 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 -- 172.21.15.33:0/3056397022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0108151590 msgr2=0x7f010806b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 --2- 172.21.15.33:0/3056397022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0108151590 0x7f010806b370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802a300 comp rx=0 tx=0).stop 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 -- 172.21.15.33:0/3056397022 shutdown_connections 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 --2- 172.21.15.33:0/3056397022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0108151590 0x7f010806b370 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 -- 172.21.15.33:0/3056397022 >> 172.21.15.33:0/3056397022 conn(0x7f01080b0510 msgr2=0x7f01080b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 -- 172.21.15.33:0/3056397022 shutdown_connections 2024-09-13T18:58:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.425+0000 7f010ea00640 1 -- 172.21.15.33:0/3056397022 wait complete. 2024-09-13T18:58:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.427+0000 7f010ea00640 1 Processor -- start 2024-09-13T18:58:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.427+0000 7f010ea00640 1 -- start start 2024-09-13T18:58:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01080cba50 0x7f01080ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 0x7f01080afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010814d340 con 0x7f01080b1b30 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108156820 con 0x7f01080cba50 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ea00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108156b00 con 0x7f0108151590 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38130/0 (socket says 172.21.15.33:38130) 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 -- 172.21.15.33:0/2213235581 learned_addr learned my addr 172.21.15.33:0/2213235581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f00ff400640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01080cba50 0x7f01080ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ca00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 0x7f01080afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 -- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 msgr2=0x7f01080afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 0x7f01080afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 -- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01080cba50 msgr2=0x7f01080ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01080cba50 0x7f01080ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f0107e00640 1 -- 172.21.15.33:0/2213235581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80094d0 con 0x7f01080b1b30 2024-09-13T18:58:59.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.428+0000 7f010ca00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 0x7f01080afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f0107e00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000c00 tx=0x7f00f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8030b80 con 0x7f01080b1b30 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8030d00 con 0x7f01080b1b30 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f803d660 con 0x7f01080b1b30 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0108156de0 con 0x7f01080b1b30 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.429+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01080adfe0 con 0x7f01080b1b30 2024-09-13T18:58:59.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.430+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108156c40 con 0x7f01080b1b30 2024-09-13T18:58:59.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.431+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00f8039040 con 0x7f01080b1b30 2024-09-13T18:58:59.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.432+0000 7f0104c00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 0x7f00e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:58:59.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.432+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f00f80aa150 con 0x7f01080b1b30 2024-09-13T18:58:59.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.433+0000 7f00ff400640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 0x7f00e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:58:59.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.433+0000 7f00ff400640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 0x7f00e406d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f01080b3ca0 tx=0x7f00f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:58:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.436+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0108156c40 con 0x7f01080b1b30 2024-09-13T18:58:59.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.630+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0108156c40 con 0x7f01080b1b30 2024-09-13T18:58:59.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.630+0000 7f0104c00640 1 -- 172.21.15.33:0/2213235581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0108156c40 con 0x7f01080b1b30 2024-09-13T18:58:59.634 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:58:59.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 msgr2=0x7f00e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 0x7f00e406d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f01080b3ca0 tx=0x7f00f0009040 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 msgr2=0x7f010814ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000c00 tx=0x7f00f80046c0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 shutdown_connections 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f00e406ac00 0x7f00e406d0c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0108151590 0x7f01080afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01080cba50 0x7f01080ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 --2- 172.21.15.33:0/2213235581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01080b1b30 0x7f010814ce00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 >> 172.21.15.33:0/2213235581 conn(0x7f01080b0510 msgr2=0x7f010815b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 shutdown_connections 2024-09-13T18:58:59.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:58:59.633+0000 7f010ea00640 1 -- 172.21.15.33:0/2213235581 wait complete. 2024-09-13T18:58:59.652 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:58:59.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:59.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:58:59.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:58:59.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:58:59.716 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:58:59.752 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:59.752 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:59.792 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:58:59.792 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:58:59.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:00.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.023+0000 7f29d6200640 1 Processor -- start 2024-09-13T18:59:00.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.023+0000 7f29d6200640 1 -- start start 2024-09-13T18:59:00.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d6200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29d00b40c0 0x7f29d015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d6200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d6200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d00cbfc0 con 0x7f29d015a5c0 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d6200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d00cce20 con 0x7f29d00b40c0 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d6200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00707a0 con 0x7f29d00cbac0 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29cfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29d00b40c0 0x7f29d015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29cfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29d00b40c0 0x7f29d015a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38134/0 (socket says 172.21.15.33:38134) 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29cfe00640 1 -- 172.21.15.33:0/2484256888 learned_addr learned my addr 172.21.15.33:0/2484256888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.024+0000 7f29d5800640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.025+0000 7f29cfe00640 1 -- 172.21.15.33:0/2484256888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 msgr2=0x7f29d015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.025+0000 7f29cfe00640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.025+0000 7f29cfe00640 1 -- 172.21.15.33:0/2484256888 >> v1:172.21.15.33:6789/0 conn(0x7f29d015a5c0 legacy=0x7f29d00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.025+0000 7f29cfe00640 1 -- 172.21.15.33:0/2484256888 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0070a80 con 0x7f29d00b40c0 2024-09-13T18:59:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.026+0000 7f29cfe00640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d015a9a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009870 tx=0x7f29bc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af49b749641c58bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.026+0000 7f29cf400640 1 -- 172.21.15.33:0/2484256888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc032440 con 0x7f29d00b40c0 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.026+0000 7f29cf400640 1 -- 172.21.15.33:0/2484256888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc0325a0 con 0x7f29d00b40c0 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.026+0000 7f29cf400640 1 -- 172.21.15.33:0/2484256888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc032930 con 0x7f29d00b40c0 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 -- 172.21.15.33:0/2484256888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 msgr2=0x7f29d015a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d015a9a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009870 tx=0x7f29bc02a250 comp rx=0 tx=0).stop 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 -- 172.21.15.33:0/2484256888 shutdown_connections 2024-09-13T18:59:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 --2- 172.21.15.33:0/2484256888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d015a9a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 -- 172.21.15.33:0/2484256888 >> 172.21.15.33:0/2484256888 conn(0x7f29d00ae310 msgr2=0x7f29d00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 -- 172.21.15.33:0/2484256888 shutdown_connections 2024-09-13T18:59:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.027+0000 7f29d6200640 1 -- 172.21.15.33:0/2484256888 wait complete. 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.028+0000 7f29d6200640 1 Processor -- start 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.028+0000 7f29d6200640 1 -- start start 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d00b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 0x7f29d00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00b2c20 con 0x7f29d00b40c0 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0153040 con 0x7f29d015a5c0 2024-09-13T18:59:00.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.029+0000 7f29d6200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00b22f0 con 0x7f29d00cbac0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38138/0 (socket says 172.21.15.33:38138) 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 -- 172.21.15.33:0/3688597125 learned_addr learned my addr 172.21.15.33:0/3688597125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29cfe00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d00b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d5800640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 0x7f29d00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 -- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 msgr2=0x7f29d00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d00b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 -- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 msgr2=0x7f29d00ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 0x7f29d00ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 -- 172.21.15.33:0/3688597125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0094d0 con 0x7f29d00b40c0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d5800640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 0x7f29d00ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.030+0000 7f29d4e00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c400 tx=0x7f29c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.031+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40052d0 con 0x7f29d00b40c0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.031+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4005430 con 0x7f29d00b40c0 2024-09-13T18:59:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.031+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4003830 con 0x7f29d00b40c0 2024-09-13T18:59:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.031+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d00b25d0 con 0x7f29d00b40c0 2024-09-13T18:59:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.031+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0146420 con 0x7f29d00b40c0 2024-09-13T18:59:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.032+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d0067360 con 0x7f29d00b40c0 2024-09-13T18:59:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.033+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29c4003990 con 0x7f29d00b40c0 2024-09-13T18:59:00.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.034+0000 7f29ccc00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 0x7f29b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.034+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f29c4088870 con 0x7f29d00b40c0 2024-09-13T18:59:00.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.034+0000 7f29cfe00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 0x7f29b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.035+0000 7f29cfe00640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 0x7f29b006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29bc034000 tx=0x7f29bc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.038+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f29c4053ab0 con 0x7f29d00b40c0 2024-09-13T18:59:00.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.225+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29d00afe10 con 0x7f29d00b40c0 2024-09-13T18:59:00.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.226+0000 7f29ccc00640 1 -- 172.21.15.33:0/3688597125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f29c40570d0 con 0x7f29d00b40c0 2024-09-13T18:59:00.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:00.230 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":48,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:57.020293+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 msgr2=0x7f29b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 0x7f29b006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29bc034000 tx=0x7f29bc02e000 comp rx=0 tx=0).stop 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 msgr2=0x7f29d0145ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c400 tx=0x7f29c400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 shutdown_connections 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f29b006ac00 0x7f29b006d0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d015a5c0 0x7f29d00ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f29d00cbac0 0x7f29d00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 --2- 172.21.15.33:0/3688597125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d00b40c0 0x7f29d0145ee0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.228+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 >> 172.21.15.33:0/3688597125 conn(0x7f29d00ae310 msgr2=0x7f29d0157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.229+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 shutdown_connections 2024-09-13T18:59:00.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.229+0000 7f29d6200640 1 -- 172.21.15.33:0/3688597125 wait complete. 2024-09-13T18:59:00.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:45.791816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:46.914408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:00.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.404+0000 7f3a8f200640 1 Processor -- start 2024-09-13T18:59:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.404+0000 7f3a8f200640 1 -- start start 2024-09-13T18:59:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a8f200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a88154ad0 0x7f3a880cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a8f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8806b7c0 con 0x7f3a8806f830 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a8f200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8806baa0 con 0x7f3a880ce2c0 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a8f200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8806b5b0 con 0x7f3a88154ad0 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a88154ad0 0x7f3a880cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a88154ad0 0x7f3a880cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38140/0 (socket says 172.21.15.33:38140) 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.405+0000 7f3a87e00640 1 -- 172.21.15.33:0/1962771098 learned_addr learned my addr 172.21.15.33:0/1962771098 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:00.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.406+0000 7f3a87e00640 1 -- 172.21.15.33:0/1962771098 >> v1:172.21.15.103:6789/0 conn(0x7f3a880ce2c0 legacy=0x7f3a880cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.406+0000 7f3a87e00640 1 -- 172.21.15.33:0/1962771098 >> v1:172.21.15.33:6789/0 conn(0x7f3a8806f830 legacy=0x7f3a8806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.406+0000 7f3a87e00640 1 -- 172.21.15.33:0/1962771098 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8806bd80 con 0x7f3a88154ad0 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.407+0000 7f3a87e00640 1 --2- 172.21.15.33:0/1962771098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88154ad0 0x7f3a880cdd80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009870 tx=0x7f3a7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95030a77a178860 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.407+0000 7f3a87400640 1 -- 172.21.15.33:0/1962771098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78032440 con 0x7f3a88154ad0 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.407+0000 7f3a87400640 1 -- 172.21.15.33:0/1962771098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a780325a0 con 0x7f3a88154ad0 2024-09-13T18:59:00.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.407+0000 7f3a87400640 1 -- 172.21.15.33:0/1962771098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78032930 con 0x7f3a88154ad0 2024-09-13T18:59:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 -- 172.21.15.33:0/1962771098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88154ad0 msgr2=0x7f3a880cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 --2- 172.21.15.33:0/1962771098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88154ad0 0x7f3a880cdd80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009870 tx=0x7f3a7802a270 comp rx=0 tx=0).stop 2024-09-13T18:59:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 -- 172.21.15.33:0/1962771098 shutdown_connections 2024-09-13T18:59:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 --2- 172.21.15.33:0/1962771098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88154ad0 0x7f3a880cdd80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 -- 172.21.15.33:0/1962771098 >> 172.21.15.33:0/1962771098 conn(0x7f3a880b0580 msgr2=0x7f3a880b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 -- 172.21.15.33:0/1962771098 shutdown_connections 2024-09-13T18:59:00.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.408+0000 7f3a8f200640 1 -- 172.21.15.33:0/1962771098 wait complete. 2024-09-13T18:59:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.410+0000 7f3a8f200640 1 Processor -- start 2024-09-13T18:59:00.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.410+0000 7f3a8f200640 1 -- start start 2024-09-13T18:59:00.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.410+0000 7f3a8f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88154ad0 0x7f3a88141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a880acc60 0x7f3a880ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880b0140 con 0x7f3a880af780 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881f2230 con 0x7f3a88154ad0 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881f24d0 con 0x7f3a880acc60 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38152/0 (socket says 172.21.15.33:38152) 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 -- 172.21.15.33:0/2884791917 learned_addr learned my addr 172.21.15.33:0/2884791917 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a87e00640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88154ad0 0x7f3a88141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a8d200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a880acc60 0x7f3a880ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 -- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a880acc60 msgr2=0x7f3a880ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a880acc60 0x7f3a880ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 -- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88154ad0 msgr2=0x7f3a88141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88154ad0 0x7f3a88141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.411+0000 7f3a7f400640 1 -- 172.21.15.33:0/2884791917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780094d0 con 0x7f3a880af780 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a7f400640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c450 tx=0x7f3a7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700052d0 con 0x7f3a880af780 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70005430 con 0x7f3a880af780 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a881f27b0 con 0x7f3a880af780 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70012870 con 0x7f3a880af780 2024-09-13T18:59:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.412+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a881f2d70 con 0x7f3a880af780 2024-09-13T18:59:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.413+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a880cc260 con 0x7f3a880af780 2024-09-13T18:59:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.414+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a700129d0 con 0x7f3a880af780 2024-09-13T18:59:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.415+0000 7f3a84c00640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 0x7f3a6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.415+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3a70088d60 con 0x7f3a880af780 2024-09-13T18:59:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.415+0000 7f3a87e00640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 0x7f3a6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.416+0000 7f3a87e00640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 0x7f3a6406d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a78034000 tx=0x7f3a7802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.419+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a70053fa0 con 0x7f3a880af780 2024-09-13T18:59:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.599+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a880b0a00 con 0x7f3a880af780 2024-09-13T18:59:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.599+0000 7f3a84c00640 1 -- 172.21.15.33:0/2884791917 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a700575c0 con 0x7f3a880af780 2024-09-13T18:59:00.603 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 msgr2=0x7f3a6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 0x7f3a6406d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a78034000 tx=0x7f3a7802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 msgr2=0x7f3a880afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c450 tx=0x7f3a7000c910 comp rx=0 tx=0).stop 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 shutdown_connections 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a6406ac30 0x7f3a6406d0f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a880acc60 0x7f3a880ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a880af780 0x7f3a880afc00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 --2- 172.21.15.33:0/2884791917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88154ad0 0x7f3a88141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 >> 172.21.15.33:0/2884791917 conn(0x7f3a880b0580 msgr2=0x7f3a880cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 shutdown_connections 2024-09-13T18:59:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.602+0000 7f3a8f200640 1 -- 172.21.15.33:0/2884791917 wait complete. 2024-09-13T18:59:00.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:59:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.776+0000 7fdc0f000640 1 Processor -- start 2024-09-13T18:59:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.776+0000 7fdc0f000640 1 -- start start 2024-09-13T18:59:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc0f000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 0x7fdc080cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc0f000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080ce490 con 0x7fdc08154ad0 2024-09-13T18:59:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc0f000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0806b7c0 con 0x7fdc0806f830 2024-09-13T18:59:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc0f000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080cc4b0 con 0x7fdc080cbac0 2024-09-13T18:59:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc07e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdc08154ad0 0x7fdc080cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51392/0 (socket says 172.21.15.33:51392) 2024-09-13T18:59:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.777+0000 7fdc07e00640 1 -- 172.21.15.33:0/22966619 learned_addr learned my addr 172.21.15.33:0/22966619 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc0d000640 1 --2- 172.21.15.33:0/22966619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 0x7fdc080cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137420958 0 0) 0x7fdc080ce490 con 0x7fdc08154ad0 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbec003520 con 0x7fdc08154ad0 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998644293 0 0) 0x7fdc0806b7c0 con 0x7fdc0806f830 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc080ce490 con 0x7fdc0806f830 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 611849456 0 0) 0x7fdbec003520 con 0x7fdc08154ad0 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc0d000640 1 -- 172.21.15.33:0/22966619 >> v1:172.21.15.103:6789/0 conn(0x7fdc0806f830 legacy=0x7fdc0806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc0d000640 1 -- 172.21.15.33:0/22966619 >> v1:172.21.15.33:6789/0 conn(0x7fdc08154ad0 legacy=0x7fdc080cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.778+0000 7fdc0d000640 1 -- 172.21.15.33:0/22966619 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0806baa0 con 0x7fdc080cbac0 2024-09-13T18:59:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.779+0000 7fdc0d000640 1 --2- 172.21.15.33:0/22966619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 0x7fdc080cbf70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009dc0 tx=0x7fdc0002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c998d3537d534 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8001670 con 0x7fdc080cbac0 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0002d050 con 0x7fdc080cbac0 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc06a00640 1 -- 172.21.15.33:0/22966619 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007760 con 0x7fdc080cbac0 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 -- 172.21.15.33:0/22966619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 msgr2=0x7fdc080cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 --2- 172.21.15.33:0/22966619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 0x7fdc080cbf70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009dc0 tx=0x7fdc0002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 -- 172.21.15.33:0/22966619 shutdown_connections 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 --2- 172.21.15.33:0/22966619 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc080cbac0 0x7fdc080cbf70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 -- 172.21.15.33:0/22966619 >> 172.21.15.33:0/22966619 conn(0x7fdc080b0580 msgr2=0x7fdc080b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 -- 172.21.15.33:0/22966619 shutdown_connections 2024-09-13T18:59:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.780+0000 7fdc0f000640 1 -- 172.21.15.33:0/22966619 wait complete. 2024-09-13T18:59:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.782+0000 7fdc0f000640 1 Processor -- start 2024-09-13T18:59:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.782+0000 7fdc0f000640 1 -- start start 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc08154ad0 0x7fdc08135c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc08136180 0x7fdc0815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08151dc0 con 0x7fdc080cbac0 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815bc40 con 0x7fdc08154ad0 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0f000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815bf20 con 0x7fdc08136180 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc07e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc07e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38164/0 (socket says 172.21.15.33:38164) 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc07e00640 1 -- 172.21.15.33:0/2084672032 learned_addr learned my addr 172.21.15.33:0/2084672032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc0d000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc08136180 0x7fdc0815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.783+0000 7fdc07400640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc08154ad0 0x7fdc08135c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 -- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc08136180 msgr2=0x7fdc0815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc08136180 0x7fdc0815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 -- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc08154ad0 msgr2=0x7fdc08135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc08154ad0 0x7fdc08135c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 -- 172.21.15.33:0/2084672032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009a70 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc07e00640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80010e0 tx=0x7fdbf800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8005ad0 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8005c30 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8007070 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0815c200 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.784+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0815c7c0 con 0x7fdc080cbac0 2024-09-13T18:59:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.786+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0815c9e0 con 0x7fdc080cbac0 2024-09-13T18:59:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.786+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbf80071d0 con 0x7fdc080cbac0 2024-09-13T18:59:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.787+0000 7fdbffe00640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.787+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdbf8088a50 con 0x7fdc080cbac0 2024-09-13T18:59:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.788+0000 7fdc07400640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.788+0000 7fdc07400640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 0x7fdbe806d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc0815ddd0 tx=0x7fdbf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:00.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.792+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdbf8053c10 con 0x7fdc080cbac0 2024-09-13T18:59:00.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.970+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc080cbf70 con 0x7fdc080cbac0 2024-09-13T18:59:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.970+0000 7fdbffe00640 1 -- 172.21.15.33:0/2084672032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbf8017020 con 0x7fdc080cbac0 2024-09-13T18:59:00.974 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 msgr2=0x7fdbe806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 0x7fdbe806d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc0815ddd0 tx=0x7fdbf4009040 comp rx=0 tx=0).stop 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 msgr2=0x7fdc08151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80010e0 tx=0x7fdbf800cbe0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 shutdown_connections 2024-09-13T18:59:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdc08136180 0x7fdc0815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc08154ad0 0x7fdc08135c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 --2- 172.21.15.33:0/2084672032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc080cbac0 0x7fdc08151880 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.972+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 >> 172.21.15.33:0/2084672032 conn(0x7fdc080b0580 msgr2=0x7fdc080cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.973+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 shutdown_connections 2024-09-13T18:59:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:00.973+0000 7fdc0f000640 1 -- 172.21.15.33:0/2084672032 wait complete. 2024-09-13T18:59:00.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:59:01.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.147+0000 7f1c26800640 1 Processor -- start 2024-09-13T18:59:01.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.147+0000 7f1c26800640 1 -- start start 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c20154ad0 0x7f1c200cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c2006f830 0x7f1c2006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 0x7f1c200cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2006b5b0 con 0x7f1c20154ad0 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2006b7c0 con 0x7f1c2006f830 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c26800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2006baa0 con 0x7f1c200ce2c0 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c1f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c20154ad0 0x7f1c200cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c1f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c20154ad0 0x7f1c200cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38180/0 (socket says 172.21.15.33:38180) 2024-09-13T18:59:01.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.148+0000 7f1c1f400640 1 -- 172.21.15.33:0/4016586922 learned_addr learned my addr 172.21.15.33:0/4016586922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1ea00640 1 --2- 172.21.15.33:0/4016586922 >> v2:172.21.15.103:3300/0 conn(0x7f1c2006f830 0x7f1c2006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1fe00640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 0x7f1c200cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1f400640 1 -- 172.21.15.33:0/4016586922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 msgr2=0x7f1c200cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1f400640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 0x7f1c200cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1f400640 1 -- 172.21.15.33:0/4016586922 >> v2:172.21.15.103:3300/0 conn(0x7f1c2006f830 msgr2=0x7f1c2006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1f400640 1 --2- 172.21.15.33:0/4016586922 >> v2:172.21.15.103:3300/0 conn(0x7f1c2006f830 0x7f1c2006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1f400640 1 -- 172.21.15.33:0/4016586922 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2006bd80 con 0x7f1c20154ad0 2024-09-13T18:59:01.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.149+0000 7f1c1fe00640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 0x7f1c200cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:01.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.150+0000 7f1c1f400640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c200cdd80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c200ae4c0 tx=0x7f1c1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35abcbd4ecf7a4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.150+0000 7f1c1e000640 1 -- 172.21.15.33:0/4016586922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1002ae90 con 0x7f1c20154ad0 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.150+0000 7f1c1e000640 1 -- 172.21.15.33:0/4016586922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10032440 con 0x7f1c20154ad0 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.150+0000 7f1c1e000640 1 -- 172.21.15.33:0/4016586922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100327d0 con 0x7f1c20154ad0 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 -- 172.21.15.33:0/4016586922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 msgr2=0x7f1c200cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c200cdd80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c200ae4c0 tx=0x7f1c1002a140 comp rx=0 tx=0).stop 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 -- 172.21.15.33:0/4016586922 shutdown_connections 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c200ce2c0 0x7f1c200cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 --2- 172.21.15.33:0/4016586922 >> v2:172.21.15.103:3300/0 conn(0x7f1c2006f830 0x7f1c2006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 --2- 172.21.15.33:0/4016586922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c200cdd80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 -- 172.21.15.33:0/4016586922 >> 172.21.15.33:0/4016586922 conn(0x7f1c200b0580 msgr2=0x7f1c200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 -- 172.21.15.33:0/4016586922 shutdown_connections 2024-09-13T18:59:01.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.151+0000 7f1c26800640 1 -- 172.21.15.33:0/4016586922 wait complete. 2024-09-13T18:59:01.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.152+0000 7f1c26800640 1 Processor -- start 2024-09-13T18:59:01.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.153+0000 7f1c26800640 1 -- start start 2024-09-13T18:59:01.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 0x7f1c20159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c201f23f0 0x7f1c20141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200b39c0 con 0x7f1c20154ad0 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200b3400 con 0x7f1c200b2c80 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c26800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200b36e0 con 0x7f1c201f23f0 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38192/0 (socket says 172.21.15.33:38192) 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 -- 172.21.15.33:0/2743032877 learned_addr learned my addr 172.21.15.33:0/2743032877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1ea00640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 0x7f1c20159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1fe00640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c201f23f0 0x7f1c20141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 -- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c201f23f0 msgr2=0x7f1c20141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c201f23f0 0x7f1c20141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 -- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 msgr2=0x7f1c20159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 0x7f1c20159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1f400640 1 -- 172.21.15.33:0/2743032877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100094d0 con 0x7f1c20154ad0 2024-09-13T18:59:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.154+0000 7f1c1ea00640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 0x7f1c20159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c1f400640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c1002a180 tx=0x7f1c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10030850 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100309b0 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10030d60 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2014c720 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.155+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c200b3100 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.156+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2014cc40 con 0x7f1c20154ad0 2024-09-13T18:59:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.157+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c10039040 con 0x7f1c20154ad0 2024-09-13T18:59:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.158+0000 7f1c17400640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 0x7f1c0006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.158+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1c100a9fb0 con 0x7f1c20154ad0 2024-09-13T18:59:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.158+0000 7f1c1ea00640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 0x7f1c0006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.159+0000 7f1c1ea00640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 0x7f1c0006d0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.162+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1c2014cc40 con 0x7f1c20154ad0 2024-09-13T18:59:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.339+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c2014cc40 con 0x7f1c20154ad0 2024-09-13T18:59:01.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.340+0000 7f1c17400640 1 -- 172.21.15.33:0/2743032877 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c2014cc40 con 0x7f1c20154ad0 2024-09-13T18:59:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:59:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 msgr2=0x7f1c0006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 0x7f1c0006d0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2024-09-13T18:59:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 msgr2=0x7f1c20150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c1002a180 tx=0x7f1c100046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 shutdown_connections 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1c0006ac30 0x7f1c0006d0f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c201f23f0 0x7f1c20141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c200b2c80 0x7f1c20159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 --2- 172.21.15.33:0/2743032877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c20154ad0 0x7f1c20150260 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 >> 172.21.15.33:0/2743032877 conn(0x7f1c200b0580 msgr2=0x7f1c200cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 shutdown_connections 2024-09-13T18:59:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.342+0000 7f1c26800640 1 -- 172.21.15.33:0/2743032877 wait complete. 2024-09-13T18:59:01.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:59:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.514+0000 7f7909000640 1 Processor -- start 2024-09-13T18:59:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.514+0000 7f7909000640 1 -- start start 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.515+0000 7f7909000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79040b3080 0x7f79040b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.515+0000 7f7909000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79040b3a00 con 0x7f7904159610 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.515+0000 7f7909000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7904070710 con 0x7f79040cd080 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.515+0000 7f7909000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79041599f0 con 0x7f79040b3080 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7904159610 0x7f7904070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51406/0 (socket says 172.21.15.33:51406) 2024-09-13T18:59:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901e00640 1 -- 172.21.15.33:0/1036666573 learned_addr learned my addr 172.21.15.33:0/1036666573 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901400640 1 --2- 172.21.15.33:0/1036666573 >> v2:172.21.15.33:3300/0 conn(0x7f79040b3080 0x7f79040b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901400640 1 -- 172.21.15.33:0/1036666573 >> v1:172.21.15.103:6789/0 conn(0x7f79040cd080 legacy=0x7f79040cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901400640 1 -- 172.21.15.33:0/1036666573 >> v1:172.21.15.33:6789/0 conn(0x7f7904159610 legacy=0x7f7904070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.516+0000 7f7901400640 1 -- 172.21.15.33:0/1036666573 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040709e0 con 0x7f79040b3080 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.517+0000 7f7901400640 1 --2- 172.21.15.33:0/1036666573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040b3080 0x7f79040b34c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f78f00097a0 tx=0x7f78f002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7a5035126857e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.517+0000 7f7900a00640 1 -- 172.21.15.33:0/1036666573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0032440 con 0x7f79040b3080 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.517+0000 7f7900a00640 1 -- 172.21.15.33:0/1036666573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f00325a0 con 0x7f79040b3080 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.517+0000 7f7900a00640 1 -- 172.21.15.33:0/1036666573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0032930 con 0x7f79040b3080 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 -- 172.21.15.33:0/1036666573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040b3080 msgr2=0x7f79040b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 --2- 172.21.15.33:0/1036666573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040b3080 0x7f79040b34c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f78f00097a0 tx=0x7f78f002a230 comp rx=0 tx=0).stop 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 -- 172.21.15.33:0/1036666573 shutdown_connections 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 --2- 172.21.15.33:0/1036666573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040b3080 0x7f79040b34c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 -- 172.21.15.33:0/1036666573 >> 172.21.15.33:0/1036666573 conn(0x7f79040b0510 msgr2=0x7f79040b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 -- 172.21.15.33:0/1036666573 shutdown_connections 2024-09-13T18:59:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.518+0000 7f7909000640 1 -- 172.21.15.33:0/1036666573 wait complete. 2024-09-13T18:59:01.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.520+0000 7f7909000640 1 Processor -- start 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.520+0000 7f7909000640 1 -- start start 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79040b3080 0x7f79041501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7904159610 0x7f7904155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041e25a0 con 0x7f79040cd080 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790415b8d0 con 0x7f7904159610 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7909000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79041e1c70 con 0x7f79040b3080 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38204/0 (socket says 172.21.15.33:38204) 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 -- 172.21.15.33:0/3534264213 learned_addr learned my addr 172.21.15.33:0/3534264213 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7902800640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7904159610 0x7f7904155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901e00640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79040b3080 0x7f79041501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 -- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79040b3080 msgr2=0x7f79041501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79040b3080 0x7f79041501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 -- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7904159610 msgr2=0x7f7904155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7904159610 0x7f7904155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.521+0000 7f7901400640 1 -- 172.21.15.33:0/3534264213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009400 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f7901400640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78f0035040 tx=0x7f78f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0006e10 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0030980 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79041e1ee0 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0030d50 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.522+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904150710 con 0x7f79040cd080 2024-09-13T18:59:01.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.523+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79041e26e0 con 0x7f79040cd080 2024-09-13T18:59:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.524+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78f0039040 con 0x7f79040cd080 2024-09-13T18:59:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.525+0000 7f78fa000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 0x7f78e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.525+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f78f00a9f20 con 0x7f79040cd080 2024-09-13T18:59:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.525+0000 7f7901e00640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 0x7f78e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.526+0000 7f7901e00640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 0x7f78e406d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005880 tx=0x7f78f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:01.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.529+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f79041e26e0 con 0x7f79040cd080 2024-09-13T18:59:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.721+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79041e26e0 con 0x7f79040cd080 2024-09-13T18:59:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.722+0000 7f78fa000640 1 -- 172.21.15.33:0/3534264213 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f79041e26e0 con 0x7f79040cd080 2024-09-13T18:59:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 msgr2=0x7f78e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 0x7f78e406d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005880 tx=0x7f78f4009040 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 msgr2=0x7f7904155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78f0035040 tx=0x7f78f00046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 shutdown_connections 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78e406ac00 0x7f78e406d0c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7904159610 0x7f7904155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79040cd080 0x7f7904155710 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 --2- 172.21.15.33:0/3534264213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79040b3080 0x7f79041501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 >> 172.21.15.33:0/3534264213 conn(0x7f79040b0510 msgr2=0x7f7904158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 shutdown_connections 2024-09-13T18:59:01.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:01.724+0000 7f7909000640 1 -- 172.21.15.33:0/3534264213 wait complete. 2024-09-13T18:59:01.744 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:59:01.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:01.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:01.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:59:01.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:01.814 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:59:01.851 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:01.851 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:01.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:01.888 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:01.888 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:01.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:01.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.081+0000 7f42cc400640 1 Processor -- start 2024-09-13T18:59:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.081+0000 7f42cc400640 1 -- start start 2024-09-13T18:59:02.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42cc400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42c415b910 0x7f42c4165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42cc400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c406bea0 con 0x7f42c415a520 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42cc400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c406c180 con 0x7f42c40b1b00 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42cc400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c406c460 con 0x7f42c415b910 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42c9a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f42c415a520 0x7f42c406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51410/0 (socket says 172.21.15.33:51410) 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.082+0000 7f42c9a00640 1 -- 172.21.15.33:0/3882109009 learned_addr learned my addr 172.21.15.33:0/3882109009 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:02.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42ca400640 1 --2- 172.21.15.33:0/3882109009 >> v2:172.21.15.103:3300/0 conn(0x7f42c415b910 0x7f42c4165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153695274 0 0) 0x7f42c406bea0 con 0x7f42c415a520 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ac003520 con 0x7f42c415a520 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915438861 0 0) 0x7f42c406c180 con 0x7f42c40b1b00 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c406bea0 con 0x7f42c40b1b00 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42ca400640 1 -- 172.21.15.33:0/3882109009 >> v1:172.21.15.103:6789/0 conn(0x7f42c40b1b00 legacy=0x7f42c40cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42ca400640 1 -- 172.21.15.33:0/3882109009 >> v1:172.21.15.33:6789/0 conn(0x7f42c415a520 legacy=0x7f42c406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.083+0000 7f42ca400640 1 -- 172.21.15.33:0/3882109009 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c406c740 con 0x7f42c415b910 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.084+0000 7f42ca400640 1 --2- 172.21.15.33:0/3882109009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415b910 0x7f42c4165190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009d90 tx=0x7f42bc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee3c1a419f0ac95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.084+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc007740 con 0x7f42c415b910 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.084+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc02d050 con 0x7f42c415b910 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.084+0000 7f42c3e00640 1 -- 172.21.15.33:0/3882109009 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc007ac0 con 0x7f42c415b910 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 -- 172.21.15.33:0/3882109009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415b910 msgr2=0x7f42c4165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 --2- 172.21.15.33:0/3882109009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415b910 0x7f42c4165190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009d90 tx=0x7f42bc02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 -- 172.21.15.33:0/3882109009 shutdown_connections 2024-09-13T18:59:02.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 --2- 172.21.15.33:0/3882109009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415b910 0x7f42c4165190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 -- 172.21.15.33:0/3882109009 >> 172.21.15.33:0/3882109009 conn(0x7f42c40b0510 msgr2=0x7f42c40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:02.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 -- 172.21.15.33:0/3882109009 shutdown_connections 2024-09-13T18:59:02.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.085+0000 7f42cc400640 1 -- 172.21.15.33:0/3882109009 wait complete. 2024-09-13T18:59:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.087+0000 7f42cc400640 1 Processor -- start 2024-09-13T18:59:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.087+0000 7f42cc400640 1 -- start start 2024-09-13T18:59:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415a520 0x7f42c406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f42c415b910 0x7f42c40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40700e0 con 0x7f42c40b1b00 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40703c0 con 0x7f42c415a520 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42cc400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40706a0 con 0x7f42c415b910 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38218/0 (socket says 172.21.15.33:38218) 2024-09-13T18:59:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 -- 172.21.15.33:0/493980528 learned_addr learned my addr 172.21.15.33:0/493980528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 -- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f42c415b910 msgr2=0x7f42c40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f42c415b910 0x7f42c40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 -- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415a520 msgr2=0x7f42c406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415a520 0x7f42c406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.088+0000 7f42c9a00640 1 -- 172.21.15.33:0/493980528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc009a70 con 0x7f42c40b1b00 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42c9a00640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c520 tx=0x7f42b800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8005ce0 con 0x7f42c40b1b00 2024-09-13T18:59:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8005e40 con 0x7f42c40b1b00 2024-09-13T18:59:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4070980 con 0x7f42c40b1b00 2024-09-13T18:59:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8007270 con 0x7f42c40b1b00 2024-09-13T18:59:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.089+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c41f2d30 con 0x7f42c40b1b00 2024-09-13T18:59:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.090+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4070ea0 con 0x7f42c40b1b00 2024-09-13T18:59:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.091+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f42b80073d0 con 0x7f42c40b1b00 2024-09-13T18:59:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.092+0000 7f42c1600640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 0x7f42a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.092+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f42b8088920 con 0x7f42c40b1b00 2024-09-13T18:59:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.092+0000 7f42c9000640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 0x7f42a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.093+0000 7f42c9000640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 0x7f42a406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f42b00010e0 tx=0x7f42b0007950 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.096+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f42b8053ad0 con 0x7f42c40b1b00 2024-09-13T18:59:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.309+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c40cd910 con 0x7f42c40b1b00 2024-09-13T18:59:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.310+0000 7f42c1600640 1 -- 172.21.15.33:0/493980528 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f42b8017070 con 0x7f42c40b1b00 2024-09-13T18:59:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:02.314 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:59:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:59:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 msgr2=0x7f42a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 0x7f42a406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f42b00010e0 tx=0x7f42b0007950 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 msgr2=0x7f42c41f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c520 tx=0x7f42b800c9e0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 shutdown_connections 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42a406ac00 0x7f42a406d0c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f42c415b910 0x7f42c40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c415a520 0x7f42c406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 --2- 172.21.15.33:0/493980528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c40b1b00 0x7f42c41f27f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 >> 172.21.15.33:0/493980528 conn(0x7f42c40b0510 msgr2=0x7f42c40cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 shutdown_connections 2024-09-13T18:59:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.312+0000 7f42cc400640 1 -- 172.21.15.33:0/493980528 wait complete. 2024-09-13T18:59:02.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:02.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.483+0000 7f6c7e000640 1 Processor -- start 2024-09-13T18:59:02.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.483+0000 7f6c7e000640 1 -- start start 2024-09-13T18:59:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.484+0000 7f6c7e000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c78153b20 0x7f6c780b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c7e000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c78153f00 con 0x7f6c78159a80 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c7e000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c780ce600 con 0x7f6c78153b20 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c7e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78070f90 con 0x7f6c7806f660 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:33914/0 (socket says 172.21.15.33:33914) 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 -- 172.21.15.33:0/4120367921 learned_addr learned my addr 172.21.15.33:0/4120367921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77400640 1 --2- 172.21.15.33:0/4120367921 >> v2:172.21.15.103:3300/0 conn(0x7f6c78153b20 0x7f6c780b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 -- 172.21.15.33:0/4120367921 >> v2:172.21.15.103:3300/0 conn(0x7f6c78153b20 msgr2=0x7f6c780b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 --2- 172.21.15.33:0/4120367921 >> v2:172.21.15.103:3300/0 conn(0x7f6c78153b20 0x7f6c780b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 -- 172.21.15.33:0/4120367921 >> v1:172.21.15.103:6789/0 conn(0x7f6c78159a80 legacy=0x7f6c780b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c76a00640 1 -- 172.21.15.33:0/4120367921 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660928652 0 0) 0x7f6c78153f00 con 0x7f6c78159a80 2024-09-13T18:59:02.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.485+0000 7f6c77e00640 1 -- 172.21.15.33:0/4120367921 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780b1a40 con 0x7f6c7806f660 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c77e00640 1 --2- 172.21.15.33:0/4120367921 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d150 tx=0x7f6c7002c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a870047204e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c76a00640 1 -- 172.21.15.33:0/4120367921 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70009600 con 0x7f6c7806f660 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c76a00640 1 -- 172.21.15.33:0/4120367921 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7002e040 con 0x7f6c7806f660 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c76a00640 1 -- 172.21.15.33:0/4120367921 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70009980 con 0x7f6c7806f660 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 -- 172.21.15.33:0/4120367921 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 msgr2=0x7f6c7806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 --2- 172.21.15.33:0/4120367921 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d150 tx=0x7f6c7002c920 comp rx=0 tx=0).stop 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 -- 172.21.15.33:0/4120367921 shutdown_connections 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 --2- 172.21.15.33:0/4120367921 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c7806f660 0x7f6c7806fad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 --2- 172.21.15.33:0/4120367921 >> v2:172.21.15.103:3300/0 conn(0x7f6c78153b20 0x7f6c780b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.487+0000 7f6c7e000640 1 -- 172.21.15.33:0/4120367921 >> 172.21.15.33:0/4120367921 conn(0x7f6c780b0510 msgr2=0x7f6c780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.488+0000 7f6c7e000640 1 -- 172.21.15.33:0/4120367921 shutdown_connections 2024-09-13T18:59:02.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.488+0000 7f6c7e000640 1 -- 172.21.15.33:0/4120367921 wait complete. 2024-09-13T18:59:02.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.489+0000 7f6c7e000640 1 Processor -- start 2024-09-13T18:59:02.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.489+0000 7f6c7e000640 1 -- start start 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 0x7f6c7815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c78159a80 0x7f6c780acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781540b0 con 0x7f6c78153b20 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78148b30 con 0x7f6c7806f660 2024-09-13T18:59:02.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c7e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781f5900 con 0x7f6c78159a80 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38220/0 (socket says 172.21.15.33:38220) 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c6ea00640 1 -- 172.21.15.33:0/1718536348 learned_addr learned my addr 172.21.15.33:0/1718536348 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.490+0000 7f6c77400640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 0x7f6c7815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c77e00640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c78159a80 0x7f6c780acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 -- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c78159a80 msgr2=0x7f6c780acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c78159a80 0x7f6c780acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 -- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 msgr2=0x7f6c7815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 0x7f6c7815c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 -- 172.21.15.33:0/1718536348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7000bd40 con 0x7f6c78153b20 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c77400640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 0x7f6c7815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:02.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6ea00640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000c440 tx=0x7f6c6000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60005480 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c600035f0 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.491+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600039a0 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.492+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c781f5b80 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.492+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c781f6140 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.493+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c780b3990 con 0x7f6c78153b20 2024-09-13T18:59:02.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.494+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c60003b00 con 0x7f6c78153b20 2024-09-13T18:59:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.494+0000 7f6c6fe00640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 0x7f6c5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.495+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6c60088810 con 0x7f6c78153b20 2024-09-13T18:59:02.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.495+0000 7f6c77400640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 0x7f6c5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.496+0000 7f6c77400640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 0x7f6c5406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009e90 tx=0x7f6c68009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.499+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6c60053a50 con 0x7f6c78153b20 2024-09-13T18:59:02.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.677+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c78073630 con 0x7f6c78153b20 2024-09-13T18:59:02.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.678+0000 7f6c6fe00640 1 -- 172.21.15.33:0/1718536348 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f6c60017020 con 0x7f6c78153b20 2024-09-13T18:59:02.682 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:02.682 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":48,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:57.020293+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:02.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 msgr2=0x7f6c5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 0x7f6c5406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009e90 tx=0x7f6c68009190 comp rx=0 tx=0).stop 2024-09-13T18:59:02.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 msgr2=0x7f6c781f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000c440 tx=0x7f6c6000c900 comp rx=0 tx=0).stop 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 shutdown_connections 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c5406ac00 0x7f6c5406d0c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c78159a80 0x7f6c780acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c78153b20 0x7f6c781f53c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 --2- 172.21.15.33:0/1718536348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7806f660 0x7f6c7815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 >> 172.21.15.33:0/1718536348 conn(0x7f6c780b0510 msgr2=0x7f6c780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 shutdown_connections 2024-09-13T18:59:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.680+0000 7f6c7e000640 1 -- 172.21.15.33:0/1718536348 wait complete. 2024-09-13T18:59:02.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:58:45.791816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:58:46.914408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:02.700 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:02.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.856+0000 7f4701200640 1 Processor -- start 2024-09-13T18:59:02.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.856+0000 7f4701200640 1 -- start start 2024-09-13T18:59:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc156f60 0x7f46fc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46fc0cafa0 0x7f46fc070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f46fc0714c0 0x7f46fc15d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc15aa30 con 0x7f46fc0714c0 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc071930 con 0x7f46fc0cafa0 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f4701200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc06f5f0 con 0x7f46fc156f60 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.857+0000 7f46fa800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f46fc0714c0 0x7f46fc15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46f1400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46fc0cafa0 0x7f46fc070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46f9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc156f60 0x7f46fc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f46fc0714c0 0x7f46fc15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38674/0 (socket says 172.21.15.33:38674) 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 -- 172.21.15.33:0/1254747419 learned_addr learned my addr 172.21.15.33:0/1254747419 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 -- 172.21.15.33:0/1254747419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc156f60 msgr2=0x7f46fc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 --2- 172.21.15.33:0/1254747419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc156f60 0x7f46fc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 -- 172.21.15.33:0/1254747419 >> v2:172.21.15.103:3300/0 conn(0x7f46fc0cafa0 msgr2=0x7f46fc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 --2- 172.21.15.33:0/1254747419 >> v2:172.21.15.103:3300/0 conn(0x7f46fc0cafa0 0x7f46fc070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.858+0000 7f46fa800640 1 -- 172.21.15.33:0/1254747419 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc070450 con 0x7f46fc0714c0 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.859+0000 7f46fa800640 1 --2- 172.21.15.33:0/1254747419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0714c0 0x7f46fc15d060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0ae4c0 tx=0x7f46f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd15c1da0a800a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.859+0000 7f46f9400640 1 -- 172.21.15.33:0/1254747419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4032440 con 0x7f46fc0714c0 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.859+0000 7f46f9400640 1 -- 172.21.15.33:0/1254747419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f40325a0 con 0x7f46fc0714c0 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.859+0000 7f46f9400640 1 -- 172.21.15.33:0/1254747419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4032930 con 0x7f46fc0714c0 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 -- 172.21.15.33:0/1254747419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0714c0 msgr2=0x7f46fc15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 --2- 172.21.15.33:0/1254747419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0714c0 0x7f46fc15d060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0ae4c0 tx=0x7f46f402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 -- 172.21.15.33:0/1254747419 shutdown_connections 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 --2- 172.21.15.33:0/1254747419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0714c0 0x7f46fc15d060 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 --2- 172.21.15.33:0/1254747419 >> v2:172.21.15.103:3300/0 conn(0x7f46fc0cafa0 0x7f46fc070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 --2- 172.21.15.33:0/1254747419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc156f60 0x7f46fc15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 -- 172.21.15.33:0/1254747419 >> 172.21.15.33:0/1254747419 conn(0x7f46fc0b0580 msgr2=0x7f46fc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 -- 172.21.15.33:0/1254747419 shutdown_connections 2024-09-13T18:59:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.860+0000 7f4701200640 1 -- 172.21.15.33:0/1254747419 wait complete. 2024-09-13T18:59:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.862+0000 7f4701200640 1 Processor -- start 2024-09-13T18:59:02.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.862+0000 7f4701200640 1 -- start start 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc0714c0 0x7f46fc1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46fc156f60 0x7f46fc13b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15c2e0 con 0x7f46fc0cafa0 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15dfa0 con 0x7f46fc156f60 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f4701200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15bfb0 con 0x7f46fc0714c0 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38690/0 (socket says 172.21.15.33:38690) 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 -- 172.21.15.33:0/2782431677 learned_addr learned my addr 172.21.15.33:0/2782431677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f9e00640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc0714c0 0x7f46fc1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46fa800640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46fc156f60 0x7f46fc13b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 -- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc0714c0 msgr2=0x7f46fc1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc0714c0 0x7f46fc1f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 -- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46fc156f60 msgr2=0x7f46fc13b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46fc156f60 0x7f46fc13b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.863+0000 7f46f1400640 1 -- 172.21.15.33:0/2782431677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40094d0 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f46f1400640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e870 tx=0x7f46e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4009590 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400c8e0 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc1525a0 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400cc90 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.864+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc1f5f40 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.865+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc15c420 con 0x7f46fc0cafa0 2024-09-13T18:59:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.866+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46e4013470 con 0x7f46fc0cafa0 2024-09-13T18:59:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.867+0000 7f46f2a00640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 0x7f46d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.867+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f46e40892c0 con 0x7f46fc0cafa0 2024-09-13T18:59:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.867+0000 7f46f9e00640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 0x7f46d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.868+0000 7f46f9e00640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 0x7f46d806d0f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011340 tx=0x7f46ec00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:02.871+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f46fc15c420 con 0x7f46fc0cafa0 2024-09-13T18:59:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.047+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46fc1525a0 con 0x7f46fc0cafa0 2024-09-13T18:59:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.048+0000 7f46f2a00640 1 -- 172.21.15.33:0/2782431677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46fc1525a0 con 0x7f46fc0cafa0 2024-09-13T18:59:03.051 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.049+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 msgr2=0x7f46d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.049+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 0x7f46d806d0f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011340 tx=0x7f46ec00b040 comp rx=0 tx=0).stop 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.049+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 msgr2=0x7f46fc13aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.049+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e870 tx=0x7f46e400ed30 comp rx=0 tx=0).stop 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 shutdown_connections 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46d806ac30 0x7f46d806d0f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46fc156f60 0x7f46fc13b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46fc0cafa0 0x7f46fc13aa00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 --2- 172.21.15.33:0/2782431677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f46fc0714c0 0x7f46fc1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 >> 172.21.15.33:0/2782431677 conn(0x7f46fc0b0580 msgr2=0x7f46fc0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 shutdown_connections 2024-09-13T18:59:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.050+0000 7f4701200640 1 -- 172.21.15.33:0/2782431677 wait complete. 2024-09-13T18:59:03.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:59:03.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.224+0000 7f3c70a00640 1 Processor -- start 2024-09-13T18:59:03.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.224+0000 7f3c70a00640 1 -- start start 2024-09-13T18:59:03.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c70a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c154ad0 0x7f3c6c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c70a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c70a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c06b7c0 con 0x7f3c6c06f830 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c70a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c06b5b0 con 0x7f3c6c0ce2c0 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c70a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c06baa0 con 0x7f3c6c154ad0 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c6a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c6a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38696/0 (socket says 172.21.15.33:38696) 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c6a800640 1 -- 172.21.15.33:0/3172747434 learned_addr learned my addr 172.21.15.33:0/3172747434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.225+0000 7f3c69e00640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c154ad0 0x7f3c6c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.226+0000 7f3c6a800640 1 -- 172.21.15.33:0/3172747434 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c154ad0 msgr2=0x7f3c6c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.226+0000 7f3c6a800640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c154ad0 0x7f3c6c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.226+0000 7f3c6a800640 1 -- 172.21.15.33:0/3172747434 >> v1:172.21.15.103:6789/0 conn(0x7f3c6c06f830 legacy=0x7f3c6c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.226+0000 7f3c6a800640 1 -- 172.21.15.33:0/3172747434 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c06bd80 con 0x7f3c6c0ce2c0 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c6a800640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009e80 tx=0x7f3c6402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c92822efb02f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c69400640 1 -- 172.21.15.33:0/3172747434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6402aea0 con 0x7f3c6c0ce2c0 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c69400640 1 -- 172.21.15.33:0/3172747434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6402d050 con 0x7f3c6c0ce2c0 2024-09-13T18:59:03.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c69400640 1 -- 172.21.15.33:0/3172747434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64031820 con 0x7f3c6c0ce2c0 2024-09-13T18:59:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c70a00640 1 -- 172.21.15.33:0/3172747434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0ce2c0 msgr2=0x7f3c6c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.227+0000 7f3c70a00640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009e80 tx=0x7f3c6402a6c0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 -- 172.21.15.33:0/3172747434 shutdown_connections 2024-09-13T18:59:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c0ce2c0 0x7f3c6c0cbac0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 --2- 172.21.15.33:0/3172747434 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c154ad0 0x7f3c6c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 -- 172.21.15.33:0/3172747434 >> 172.21.15.33:0/3172747434 conn(0x7f3c6c0b0580 msgr2=0x7f3c6c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 -- 172.21.15.33:0/3172747434 shutdown_connections 2024-09-13T18:59:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.228+0000 7f3c70a00640 1 -- 172.21.15.33:0/3172747434 wait complete. 2024-09-13T18:59:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.229+0000 7f3c70a00640 1 Processor -- start 2024-09-13T18:59:03.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.229+0000 7f3c70a00640 1 -- start start 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 0x7f3c6c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c147420 0x7f3c6c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c14ef20 con 0x7f3c6c154ad0 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c14dc10 con 0x7f3c6c147420 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.230+0000 7f3c70a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c14def0 con 0x7f3c6c146fa0 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38708/0 (socket says 172.21.15.33:38708) 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 -- 172.21.15.33:0/1716647703 learned_addr learned my addr 172.21.15.33:0/1716647703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c6a800640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c147420 0x7f3c6c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c63e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 0x7f3c6c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 -- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 msgr2=0x7f3c6c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 0x7f3c6c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 -- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c147420 msgr2=0x7f3c6c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c147420 0x7f3c6c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 -- 172.21.15.33:0/1716647703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009b30 con 0x7f3c6c154ad0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c63e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 0x7f3c6c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.231+0000 7f3c69e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00d5f0 tx=0x7f3c5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.232+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0125f0 con 0x7f3c6c154ad0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.232+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c012750 con 0x7f3c6c154ad0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.232+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012b00 con 0x7f3c6c154ad0 2024-09-13T18:59:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.232+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c14e1d0 con 0x7f3c6c154ad0 2024-09-13T18:59:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.232+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c153590 con 0x7f3c6c154ad0 2024-09-13T18:59:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.233+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c14f190 con 0x7f3c6c154ad0 2024-09-13T18:59:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.234+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c5c012c60 con 0x7f3c6c154ad0 2024-09-13T18:59:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.235+0000 7f3c62000640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 0x7f3c4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.235+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c5c089850 con 0x7f3c6c154ad0 2024-09-13T18:59:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.235+0000 7f3c63e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 0x7f3c4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.236+0000 7f3c63e00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 0x7f3c4806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c152cb0 tx=0x7f3c54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.239+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c5c054950 con 0x7f3c6c154ad0 2024-09-13T18:59:03.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.415+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c6c153720 con 0x7f3c6c154ad0 2024-09-13T18:59:03.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.416+0000 7f3c62000640 1 -- 172.21.15.33:0/1716647703 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c5c057f70 con 0x7f3c6c154ad0 2024-09-13T18:59:03.419 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:59:03.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 msgr2=0x7f3c4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 0x7f3c4806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c152cb0 tx=0x7f3c54009040 comp rx=0 tx=0).stop 2024-09-13T18:59:03.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 msgr2=0x7f3c6c153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00d5f0 tx=0x7f3c5c00dab0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 shutdown_connections 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4806ac00 0x7f3c4806d0c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c147420 0x7f3c6c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c6c146fa0 0x7f3c6c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 --2- 172.21.15.33:0/1716647703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c6c154ad0 0x7f3c6c153050 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 >> 172.21.15.33:0/1716647703 conn(0x7f3c6c0b0580 msgr2=0x7f3c6c06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 shutdown_connections 2024-09-13T18:59:03.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.418+0000 7f3c70a00640 1 -- 172.21.15.33:0/1716647703 wait complete. 2024-09-13T18:59:03.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.595+0000 7f9cbf000640 1 Processor -- start 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.595+0000 7f9cbf000640 1 -- start start 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cbf000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9cb81566f0 0x7f9cb8070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cbf000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cb80ae060 0x7f9cb815c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cbf000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb806fce0 con 0x7f9cb806be40 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cbf000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb806c820 con 0x7f9cb81566f0 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cbf000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb806f690 con 0x7f9cb80ae060 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cb7e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9cb81566f0 0x7f9cb8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cb7e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9cb81566f0 0x7f9cb8070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38710/0 (socket says 172.21.15.33:38710) 2024-09-13T18:59:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.596+0000 7f9cb7e00640 1 -- 172.21.15.33:0/4130646449 learned_addr learned my addr 172.21.15.33:0/4130646449 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:03.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.597+0000 7f9cbd000640 1 --2- 172.21.15.33:0/4130646449 >> v2:172.21.15.103:3300/0 conn(0x7f9cb80ae060 0x7f9cb815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.597+0000 7f9cb7e00640 1 -- 172.21.15.33:0/4130646449 >> v2:172.21.15.103:3300/0 conn(0x7f9cb80ae060 msgr2=0x7f9cb815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:03.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.597+0000 7f9cb7e00640 1 --2- 172.21.15.33:0/4130646449 >> v2:172.21.15.103:3300/0 conn(0x7f9cb80ae060 0x7f9cb815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.597+0000 7f9cb7e00640 1 -- 172.21.15.33:0/4130646449 >> v1:172.21.15.33:6789/0 conn(0x7f9cb806be40 legacy=0x7f9cb80ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.597+0000 7f9cb7e00640 1 -- 172.21.15.33:0/4130646449 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb806f970 con 0x7f9cb81566f0 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.598+0000 7f9cb7e00640 1 --2- 172.21.15.33:0/4130646449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb81566f0 0x7f9cb8070170 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9cb815c760 tx=0x7f9ca802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1329cd75eeffd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.598+0000 7f9cb7400640 1 -- 172.21.15.33:0/4130646449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8032440 con 0x7f9cb81566f0 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.598+0000 7f9cb7400640 1 -- 172.21.15.33:0/4130646449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca80325a0 con 0x7f9cb81566f0 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.598+0000 7f9cb7400640 1 -- 172.21.15.33:0/4130646449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8032930 con 0x7f9cb81566f0 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 -- 172.21.15.33:0/4130646449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb81566f0 msgr2=0x7f9cb8070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 --2- 172.21.15.33:0/4130646449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb81566f0 0x7f9cb8070170 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9cb815c760 tx=0x7f9ca802a270 comp rx=0 tx=0).stop 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 -- 172.21.15.33:0/4130646449 shutdown_connections 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 --2- 172.21.15.33:0/4130646449 >> v2:172.21.15.103:3300/0 conn(0x7f9cb80ae060 0x7f9cb815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 --2- 172.21.15.33:0/4130646449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb81566f0 0x7f9cb8070170 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 -- 172.21.15.33:0/4130646449 >> 172.21.15.33:0/4130646449 conn(0x7f9cb80b0580 msgr2=0x7f9cb80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 -- 172.21.15.33:0/4130646449 shutdown_connections 2024-09-13T18:59:03.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.599+0000 7f9cbf000640 1 -- 172.21.15.33:0/4130646449 wait complete. 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.600+0000 7f9cbf000640 1 Processor -- start 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.600+0000 7f9cbf000640 1 -- start start 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb806be40 0x7f9cb8141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9cb81566f0 0x7f9cb8144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8141960 con 0x7f9cb80ae060 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814dd20 con 0x7f9cb806be40 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.601+0000 7f9cbf000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8143b80 con 0x7f9cb81566f0 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38726/0 (socket says 172.21.15.33:38726) 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 -- 172.21.15.33:0/1939502058 learned_addr learned my addr 172.21.15.33:0/1939502058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cb7e00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb806be40 0x7f9cb8141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cbd000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9cb81566f0 0x7f9cb8144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 -- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9cb81566f0 msgr2=0x7f9cb8144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9cb81566f0 0x7f9cb8144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 -- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb806be40 msgr2=0x7f9cb8141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb806be40 0x7f9cb8141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 -- 172.21.15.33:0/1939502058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80094d0 con 0x7f9cb80ae060 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.602+0000 7f9cafe00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c450 tx=0x7f9ca000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.603+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00052d0 con 0x7f9cb80ae060 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.603+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0005430 con 0x7f9cb80ae060 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.603+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0012870 con 0x7f9cb80ae060 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.603+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb8143e60 con 0x7f9cb80ae060 2024-09-13T18:59:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.603+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8144420 con 0x7f9cb80ae060 2024-09-13T18:59:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.604+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8144640 con 0x7f9cb80ae060 2024-09-13T18:59:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.605+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ca00129d0 con 0x7f9cb80ae060 2024-09-13T18:59:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.605+0000 7f9cb4c00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 0x7f9c9406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.606+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ca0088d50 con 0x7f9cb80ae060 2024-09-13T18:59:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.606+0000 7f9cb7e00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 0x7f9c9406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.607+0000 7f9cb7e00640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 0x7f9c9406d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8034000 tx=0x7f9ca802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.610+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9ca008c030 con 0x7f9cb80ae060 2024-09-13T18:59:03.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.790+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cb806c2d0 con 0x7f9cb80ae060 2024-09-13T18:59:03.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.790+0000 7f9cb4c00640 1 -- 172.21.15.33:0/1939502058 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ca0053fa0 con 0x7f9cb80ae060 2024-09-13T18:59:03.794 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:59:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.792+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 msgr2=0x7f9c9406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.792+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 0x7f9c9406d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8034000 tx=0x7f9ca802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.792+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 msgr2=0x7f9cb814d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.792+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c450 tx=0x7f9ca000c910 comp rx=0 tx=0).stop 2024-09-13T18:59:03.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 shutdown_connections 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9c9406ac30 0x7f9c9406d0f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9cb81566f0 0x7f9cb8144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cb80ae060 0x7f9cb814d640 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 --2- 172.21.15.33:0/1939502058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cb806be40 0x7f9cb8141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 >> 172.21.15.33:0/1939502058 conn(0x7f9cb80b0580 msgr2=0x7f9cb814aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 shutdown_connections 2024-09-13T18:59:03.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.793+0000 7f9cbf000640 1 -- 172.21.15.33:0/1939502058 wait complete. 2024-09-13T18:59:03.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.966+0000 7f9514200640 1 Processor -- start 2024-09-13T18:59:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.966+0000 7f9514200640 1 -- start start 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.967+0000 7f9514200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f950c0b3a40 0x7f950c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.967+0000 7f9514200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 0x7f950c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.967+0000 7f9514200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c13fbc0 con 0x7f950c0b2e90 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.967+0000 7f9514200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c06cca0 con 0x7f950c0b3a40 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.967+0000 7f9514200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15ce80 con 0x7f950c160370 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9512200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f950c0b2e90 0x7f950c0ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45970/0 (socket says 172.21.15.33:45970) 2024-09-13T18:59:03.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9512200640 1 -- 172.21.15.33:0/1857532422 learned_addr learned my addr 172.21.15.33:0/1857532422 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9510e00640 1 --2- 172.21.15.33:0/1857532422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 0x7f950c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9511800640 1 --2- 172.21.15.33:0/1857532422 >> v2:172.21.15.103:3300/0 conn(0x7f950c0b3a40 0x7f950c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f950be00640 1 -- 172.21.15.33:0/1857532422 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616478952 0 0) 0x7f950c13fbc0 con 0x7f950c0b2e90 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f950be00640 1 -- 172.21.15.33:0/1857532422 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f4003520 con 0x7f950c0b2e90 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9510e00640 1 -- 172.21.15.33:0/1857532422 >> v2:172.21.15.103:3300/0 conn(0x7f950c0b3a40 msgr2=0x7f950c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9510e00640 1 --2- 172.21.15.33:0/1857532422 >> v2:172.21.15.103:3300/0 conn(0x7f950c0b3a40 0x7f950c1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9510e00640 1 -- 172.21.15.33:0/1857532422 >> v1:172.21.15.33:6789/0 conn(0x7f950c0b2e90 legacy=0x7f950c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.968+0000 7f9510e00640 1 -- 172.21.15.33:0/1857532422 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c142de0 con 0x7f950c160370 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.969+0000 7f9510e00640 1 --2- 172.21.15.33:0/1857532422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 0x7f950c0b2950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e073c3849e870a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f950be00640 1 -- 172.21.15.33:0/1857532422 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f802ae50 con 0x7f950c160370 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f950be00640 1 -- 172.21.15.33:0/1857532422 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8032440 con 0x7f950c160370 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f950be00640 1 -- 172.21.15.33:0/1857532422 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80327d0 con 0x7f950c160370 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 -- 172.21.15.33:0/1857532422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 msgr2=0x7f950c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 --2- 172.21.15.33:0/1857532422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 0x7f950c0b2950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802a100 comp rx=0 tx=0).stop 2024-09-13T18:59:03.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 -- 172.21.15.33:0/1857532422 shutdown_connections 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 --2- 172.21.15.33:0/1857532422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c160370 0x7f950c0b2950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 --2- 172.21.15.33:0/1857532422 >> v2:172.21.15.103:3300/0 conn(0x7f950c0b3a40 0x7f950c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 -- 172.21.15.33:0/1857532422 >> 172.21.15.33:0/1857532422 conn(0x7f950c0b0510 msgr2=0x7f950c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 -- 172.21.15.33:0/1857532422 shutdown_connections 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.970+0000 7f9514200640 1 -- 172.21.15.33:0/1857532422 wait complete. 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.972+0000 7f9514200640 1 Processor -- start 2024-09-13T18:59:03.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.972+0000 7f9514200640 1 -- start start 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c0b2e90 0x7f950c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c160370 0x7f950c138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c1571d0 con 0x7f950c0b3a40 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c144b80 con 0x7f950c160370 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9514200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c144e60 con 0x7f950c0b2e90 2024-09-13T18:59:03.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9510e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9510e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38728/0 (socket says 172.21.15.33:38728) 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9510e00640 1 -- 172.21.15.33:0/4179463730 learned_addr learned my addr 172.21.15.33:0/4179463730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9511800640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c0b2e90 0x7f950c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.973+0000 7f9512200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c160370 0x7f950c138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 -- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c0b2e90 msgr2=0x7f950c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c0b2e90 0x7f950c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 -- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c160370 msgr2=0x7f950c138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c160370 0x7f950c138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 -- 172.21.15.33:0/4179463730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009400 con 0x7f950c0b3a40 2024-09-13T18:59:03.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9510e00640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f94f8035040 tx=0x7f94f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f803d710 con 0x7f950c0b3a40 2024-09-13T18:59:03.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f803d890 con 0x7f950c0b3a40 2024-09-13T18:59:03.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c145140 con 0x7f950c0b3a40 2024-09-13T18:59:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.974+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f803dc40 con 0x7f950c0b3a40 2024-09-13T18:59:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.975+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c145700 con 0x7f950c0b3a40 2024-09-13T18:59:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.976+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c0ce4d0 con 0x7f950c0b3a40 2024-09-13T18:59:03.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.976+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94f8039040 con 0x7f950c0b3a40 2024-09-13T18:59:03.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.977+0000 7f9509600640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 0x7f94ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:03.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.977+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94f80a9b40 con 0x7f950c0b3a40 2024-09-13T18:59:03.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.978+0000 7f9511800640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 0x7f94ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:03.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.978+0000 7f9511800640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 0x7f94ec06d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9500009b40 tx=0x7f9500009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:03.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:03.982+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94f8074cf0 con 0x7f950c0b3a40 2024-09-13T18:59:04.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.199+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f950c15d930 con 0x7f950c0b3a40 2024-09-13T18:59:04.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.199+0000 7f9509600640 1 -- 172.21.15.33:0/4179463730 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f94f8078310 con 0x7f950c0b3a40 2024-09-13T18:59:04.203 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:04.203 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:59:04.203 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:59:04.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 msgr2=0x7f94ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 0x7f94ec06d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9500009b40 tx=0x7f9500009190 comp rx=0 tx=0).stop 2024-09-13T18:59:04.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 msgr2=0x7f950c144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f94f8035040 tx=0x7f94f80046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 shutdown_connections 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f94ec06ac00 0x7f94ec06d0c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c160370 0x7f950c138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950c0b3a40 0x7f950c144480 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 --2- 172.21.15.33:0/4179463730 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f950c0b2e90 0x7f950c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 >> 172.21.15.33:0/4179463730 conn(0x7f950c0b0510 msgr2=0x7f950c1419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 shutdown_connections 2024-09-13T18:59:04.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.202+0000 7f9514200640 1 -- 172.21.15.33:0/4179463730 wait complete. 2024-09-13T18:59:04.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:04.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.374+0000 7fd44c800640 1 Processor -- start 2024-09-13T18:59:04.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.374+0000 7fd44c800640 1 -- start start 2024-09-13T18:59:04.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd44c800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd44415b910 0x7fd444165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd44c800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44406bea0 con 0x7fd44415a520 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd44c800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44406c180 con 0x7fd4440b1b00 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd44c800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44406c460 con 0x7fd44415b910 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd449e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd44415a520 0x7fd44406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45978/0 (socket says 172.21.15.33:45978) 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.375+0000 7fd449e00640 1 -- 172.21.15.33:0/3652533453 learned_addr learned my addr 172.21.15.33:0/3652533453 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:04.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.376+0000 7fd44a800640 1 --2- 172.21.15.33:0/3652533453 >> v2:172.21.15.33:3300/0 conn(0x7fd44415b910 0x7fd444165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.376+0000 7fd44a800640 1 -- 172.21.15.33:0/3652533453 >> v1:172.21.15.103:6789/0 conn(0x7fd4440b1b00 legacy=0x7fd4440cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.376+0000 7fd44a800640 1 -- 172.21.15.33:0/3652533453 >> v1:172.21.15.33:6789/0 conn(0x7fd44415a520 legacy=0x7fd44406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.376+0000 7fd44a800640 1 -- 172.21.15.33:0/3652533453 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44406c740 con 0x7fd44415b910 2024-09-13T18:59:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.376+0000 7fd448a00640 1 -- 172.21.15.33:0/3652533453 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333618474 0 0) 0x7fd44406c180 con 0x7fd4440b1b00 2024-09-13T18:59:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.377+0000 7fd44a800640 1 --2- 172.21.15.33:0/3652533453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd44415b910 0x7fd444165190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd440009d90 tx=0x7fd44002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133324003834fefe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.377+0000 7fd448a00640 1 -- 172.21.15.33:0/3652533453 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440007740 con 0x7fd44415b910 2024-09-13T18:59:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.377+0000 7fd448a00640 1 -- 172.21.15.33:0/3652533453 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44002d050 con 0x7fd44415b910 2024-09-13T18:59:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.377+0000 7fd448a00640 1 -- 172.21.15.33:0/3652533453 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440007ac0 con 0x7fd44415b910 2024-09-13T18:59:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 -- 172.21.15.33:0/3652533453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd44415b910 msgr2=0x7fd444165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 --2- 172.21.15.33:0/3652533453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd44415b910 0x7fd444165190 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd440009d90 tx=0x7fd44002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 -- 172.21.15.33:0/3652533453 shutdown_connections 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 --2- 172.21.15.33:0/3652533453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd44415b910 0x7fd444165190 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 -- 172.21.15.33:0/3652533453 >> 172.21.15.33:0/3652533453 conn(0x7fd4440b0510 msgr2=0x7fd4440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 -- 172.21.15.33:0/3652533453 shutdown_connections 2024-09-13T18:59:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.378+0000 7fd44c800640 1 -- 172.21.15.33:0/3652533453 wait complete. 2024-09-13T18:59:04.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.380+0000 7fd44c800640 1 Processor -- start 2024-09-13T18:59:04.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.380+0000 7fd44c800640 1 -- start start 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd44415a520 0x7fd444147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd44415b910 0x7fd444153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441517f0 con 0x7fd4440b1b00 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444152bb0 con 0x7fd44415a520 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44c800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd444152e90 con 0x7fd44415b910 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38742/0 (socket says 172.21.15.33:38742) 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 -- 172.21.15.33:0/2023834568 learned_addr learned my addr 172.21.15.33:0/2023834568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449400640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd44415a520 0x7fd444147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd44a800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd44415b910 0x7fd444153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 -- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd44415b910 msgr2=0x7fd444153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd44415b910 0x7fd444153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 -- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd44415a520 msgr2=0x7fd444147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd44415a520 0x7fd444147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.381+0000 7fd449e00640 1 -- 172.21.15.33:0/2023834568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440009a70 con 0x7fd4440b1b00 2024-09-13T18:59:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd449e00640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c400 tx=0x7fd43800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438005ce0 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438005e40 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444153170 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4380072f0 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.382+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd444153730 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.383+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4440cd910 con 0x7fd4440b1b00 2024-09-13T18:59:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.384+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd438007510 con 0x7fd4440b1b00 2024-09-13T18:59:04.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.385+0000 7fd43e000640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.385+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd438088a70 con 0x7fd4440b1b00 2024-09-13T18:59:04.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.385+0000 7fd449400640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.386+0000 7fd449400640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 0x7fd42806d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd444159ed0 tx=0x7fd434009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.389+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd438053b70 con 0x7fd4440b1b00 2024-09-13T18:59:04.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.570+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd444159c20 con 0x7fd4440b1b00 2024-09-13T18:59:04.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.571+0000 7fd43e000640 1 -- 172.21.15.33:0/2023834568 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fd438017020 con 0x7fd4440b1b00 2024-09-13T18:59:04.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:04.575 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":48,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:57.020293+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 msgr2=0x7fd42806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 0x7fd42806d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd444159ed0 tx=0x7fd434009040 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 msgr2=0x7fd4440a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c400 tx=0x7fd43800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 shutdown_connections 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd42806ac00 0x7fd42806d0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd44415b910 0x7fd444153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd44415a520 0x7fd444147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 --2- 172.21.15.33:0/2023834568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4440b1b00 0x7fd4440a8e70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 >> 172.21.15.33:0/2023834568 conn(0x7fd4440b0510 msgr2=0x7fd444069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 shutdown_connections 2024-09-13T18:59:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.574+0000 7fd44c800640 1 -- 172.21.15.33:0/2023834568 wait complete. 2024-09-13T18:59:04.594 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:59:04.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:04.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.746+0000 7f1a7ae00640 1 Processor -- start 2024-09-13T18:59:04.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.746+0000 7f1a7ae00640 1 -- start start 2024-09-13T18:59:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.747+0000 7f1a7ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a74153b20 0x7f1a740b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.747+0000 7f1a7ae00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a74159a80 0x7f1a740b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a7ae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a74153f00 con 0x7f1a740b2410 2024-09-13T18:59:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a7ae00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740ce600 con 0x7f1a74159a80 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a7ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a74070f90 con 0x7f1a74153b20 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a74159a80 0x7f1a740b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a74159a80 0x7f1a740b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38754/0 (socket says 172.21.15.33:38754) 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 -- 172.21.15.33:0/481884275 learned_addr learned my addr 172.21.15.33:0/481884275 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a73e00640 1 --2- 172.21.15.33:0/481884275 >> v2:172.21.15.103:3300/0 conn(0x7f1a74153b20 0x7f1a740b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 -- 172.21.15.33:0/481884275 >> v2:172.21.15.103:3300/0 conn(0x7f1a74153b20 msgr2=0x7f1a740b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 --2- 172.21.15.33:0/481884275 >> v2:172.21.15.103:3300/0 conn(0x7f1a74153b20 0x7f1a740b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 -- 172.21.15.33:0/481884275 >> v1:172.21.15.33:6789/0 conn(0x7f1a740b2410 legacy=0x7f1a7406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.748+0000 7f1a6be00640 1 -- 172.21.15.33:0/481884275 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740b1a40 con 0x7f1a74159a80 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.749+0000 7f1a6be00640 1 --2- 172.21.15.33:0/481884275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74159a80 0x7f1a740b1ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1a740b14f0 tx=0x7f1a5c02c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc77acf8781e9bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.749+0000 7f1a73400640 1 -- 172.21.15.33:0/481884275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c031710 con 0x7f1a74159a80 2024-09-13T18:59:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a73400640 1 -- 172.21.15.33:0/481884275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c02f050 con 0x7f1a74159a80 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a73400640 1 -- 172.21.15.33:0/481884275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c031a90 con 0x7f1a74159a80 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 -- 172.21.15.33:0/481884275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74159a80 msgr2=0x7f1a740b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/481884275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74159a80 0x7f1a740b1ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1a740b14f0 tx=0x7f1a5c02c4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 -- 172.21.15.33:0/481884275 shutdown_connections 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/481884275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74159a80 0x7f1a740b1ed0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/481884275 >> v2:172.21.15.103:3300/0 conn(0x7f1a74153b20 0x7f1a740b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 -- 172.21.15.33:0/481884275 >> 172.21.15.33:0/481884275 conn(0x7f1a740b0510 msgr2=0x7f1a740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:04.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 -- 172.21.15.33:0/481884275 shutdown_connections 2024-09-13T18:59:04.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.750+0000 7f1a7ae00640 1 -- 172.21.15.33:0/481884275 wait complete. 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.752+0000 7f1a7ae00640 1 Processor -- start 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.752+0000 7f1a7ae00640 1 -- start start 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 0x7f1a74148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a74159a80 0x7f1a741540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741535f0 con 0x7f1a74153b20 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74148cb0 con 0x7f1a740b2410 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a7ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74146170 con 0x7f1a74159a80 2024-09-13T18:59:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a6be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a6be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38756/0 (socket says 172.21.15.33:38756) 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a6be00640 1 -- 172.21.15.33:0/3752754779 learned_addr learned my addr 172.21.15.33:0/3752754779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a73e00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 0x7f1a74148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.753+0000 7f1a78e00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a74159a80 0x7f1a741540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 -- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a74159a80 msgr2=0x7f1a741540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a74159a80 0x7f1a741540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 -- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 msgr2=0x7f1a74148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 0x7f1a74148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 -- 172.21.15.33:0/3752754779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0094d0 con 0x7f1a74153b20 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a73e00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 0x7f1a74148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a6be00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c000c00 tx=0x7f1a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c03c830 con 0x7f1a74153b20 2024-09-13T18:59:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c03c990 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c03cd40 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a74146450 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.754+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a74146a10 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.755+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a740b3990 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.756+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a5c03a070 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.757+0000 7f1a70c00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.757+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a5c0aa170 con 0x7f1a74153b20 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.757+0000 7f1a73e00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.758+0000 7f1a73e00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 0x7f1a5006d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009af0 tx=0x7f1a64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.761+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a5c075300 con 0x7f1a74153b20 2024-09-13T18:59:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.975+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a740cd5c0 con 0x7f1a74153b20 2024-09-13T18:59:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.976+0000 7f1a70c00640 1 -- 172.21.15.33:0/3752754779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f1a5c078920 con 0x7f1a74153b20 2024-09-13T18:59:04.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:04.980 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:59:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:59:04.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 msgr2=0x7f1a5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 0x7f1a5006d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009af0 tx=0x7f1a64008040 comp rx=0 tx=0).stop 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 msgr2=0x7f1a740ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c000c00 tx=0x7f1a5c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 shutdown_connections 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a74159a80 0x7f1a741540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a74153b20 0x7f1a740ca630 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 --2- 172.21.15.33:0/3752754779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a740b2410 0x7f1a74148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:04.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 >> 172.21.15.33:0/3752754779 conn(0x7f1a740b0510 msgr2=0x7f1a7406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:04.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.978+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 shutdown_connections 2024-09-13T18:59:04.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:04.979+0000 7f1a7ae00640 1 -- 172.21.15.33:0/3752754779 wait complete. 2024-09-13T18:59:04.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:05.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.152+0000 7f19c0200640 1 Processor -- start 2024-09-13T18:59:05.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.152+0000 7f19c0200640 1 -- start start 2024-09-13T18:59:05.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19c0200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19c0200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b806bea0 con 0x7f19b80cde50 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19c0200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b806c180 con 0x7f19b815a520 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19c0200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b806c460 con 0x7f19b80b1b00 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19be200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f19b80cde50 0x7f19b815a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45998/0 (socket says 172.21.15.33:45998) 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.153+0000 7f19be200640 1 -- 172.21.15.33:0/133586424 learned_addr learned my addr 172.21.15.33:0/133586424 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:05.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19bce00640 1 --2- 172.21.15.33:0/133586424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372441337 0 0) 0x7f19b806bea0 con 0x7f19b80cde50 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003520 con 0x7f19b80cde50 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136816532 0 0) 0x7f19b806c180 con 0x7f19b815a520 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b806bea0 con 0x7f19b815a520 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19bce00640 1 -- 172.21.15.33:0/133586424 >> v1:172.21.15.103:6789/0 conn(0x7f19b815a520 legacy=0x7f19b806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19bce00640 1 -- 172.21.15.33:0/133586424 >> v1:172.21.15.33:6789/0 conn(0x7f19b80cde50 legacy=0x7f19b815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.154+0000 7f19bce00640 1 -- 172.21.15.33:0/133586424 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b806c740 con 0x7f19b80b1b00 2024-09-13T18:59:05.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.155+0000 7f19bce00640 1 --2- 172.21.15.33:0/133586424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b80cd910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009800 tx=0x7f19a402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd580c0169a1860 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032440 con 0x7f19b80b1b00 2024-09-13T18:59:05.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40325a0 con 0x7f19b80b1b00 2024-09-13T18:59:05.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19b7e00640 1 -- 172.21.15.33:0/133586424 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032930 con 0x7f19b80b1b00 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 -- 172.21.15.33:0/133586424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 msgr2=0x7f19b80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 --2- 172.21.15.33:0/133586424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b80cd910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009800 tx=0x7f19a402a250 comp rx=0 tx=0).stop 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 -- 172.21.15.33:0/133586424 shutdown_connections 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 --2- 172.21.15.33:0/133586424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b80cd910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 -- 172.21.15.33:0/133586424 >> 172.21.15.33:0/133586424 conn(0x7f19b80b0510 msgr2=0x7f19b80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 -- 172.21.15.33:0/133586424 shutdown_connections 2024-09-13T18:59:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.156+0000 7f19c0200640 1 -- 172.21.15.33:0/133586424 wait complete. 2024-09-13T18:59:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.158+0000 7f19c0200640 1 Processor -- start 2024-09-13T18:59:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.158+0000 7f19c0200640 1 -- start start 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b8148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b815a520 0x7f19b806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8070e50 con 0x7f19b80cde50 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81f3010 con 0x7f19b815a520 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19c0200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80701d0 con 0x7f19b80b1b00 2024-09-13T18:59:05.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19bce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19bce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38764/0 (socket says 172.21.15.33:38764) 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19bce00640 1 -- 172.21.15.33:0/2457315326 learned_addr learned my addr 172.21.15.33:0/2457315326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19bd800640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b8148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.159+0000 7f19be200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b815a520 0x7f19b806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 -- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 msgr2=0x7f19b8148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b8148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 -- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b815a520 msgr2=0x7f19b806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b815a520 0x7f19b806fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 -- 172.21.15.33:0/2457315326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009400 con 0x7f19b80cde50 2024-09-13T18:59:05.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19bce00640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000c00 tx=0x7f19a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a403e920 con 0x7f19b80cde50 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a403eac0 con 0x7f19b80cde50 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a403ee70 con 0x7f19b80cde50 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.160+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b80704b0 con 0x7f19b80cde50 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.161+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b8070a70 con 0x7f19b80cde50 2024-09-13T18:59:05.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.162+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8070f90 con 0x7f19b80cde50 2024-09-13T18:59:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.162+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19a403c400 con 0x7f19b80cde50 2024-09-13T18:59:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.163+0000 7f19b5600640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.163+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19a40aa1e0 con 0x7f19b80cde50 2024-09-13T18:59:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.164+0000 7f19bd800640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.164+0000 7f19bd800640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19ac007fd0 tx=0x7f19ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.168+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f19b8070f90 con 0x7f19b80cde50 2024-09-13T18:59:05.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.384+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19b8070f90 con 0x7f19b80cde50 2024-09-13T18:59:05.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.384+0000 7f19b5600640 1 -- 172.21.15.33:0/2457315326 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f19b8070f90 con 0x7f19b80cde50 2024-09-13T18:59:05.388 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:05.388 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:58:47.921315+0000","modified":"2024-09-13T18:58:50.936010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2375812342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2375812342},{"type":"v1","addr":"172.21.15.33:6835","nonce":2375812342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:59:05.388 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 msgr2=0x7f199806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19ac007fd0 tx=0x7f19ac009040 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 msgr2=0x7f19b806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19a4000c00 tx=0x7f19a40046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 shutdown_connections 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b815a520 0x7f19b806fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19b80cde50 0x7f19b806f660 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 --2- 172.21.15.33:0/2457315326 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19b80b1b00 0x7f19b8148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 >> 172.21.15.33:0/2457315326 conn(0x7f19b80b0510 msgr2=0x7f19b806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:05.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 shutdown_connections 2024-09-13T18:59:05.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.386+0000 7f19c0200640 1 -- 172.21.15.33:0/2457315326 wait complete. 2024-09-13T18:59:05.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:05.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.557+0000 7f3e3d000640 1 Processor -- start 2024-09-13T18:59:05.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.557+0000 7f3e3d000640 1 -- start start 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e3d000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e380cde90 0x7f3e3806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e3d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e3815ce30 0x7f3e3815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e3d000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3806c4f0 con 0x7f3e381593a0 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e3d000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e380ce2b0 con 0x7f3e380cde90 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e3d000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3815d800 con 0x7f3e3815ce30 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e2fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e380cde90 0x7f3e3806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e2fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e380cde90 0x7f3e3806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38778/0 (socket says 172.21.15.33:38778) 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e2fe00640 1 -- 172.21.15.33:0/884962463 learned_addr learned my addr 172.21.15.33:0/884962463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.558+0000 7f3e37e00640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e3815ce30 0x7f3e3815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.559+0000 7f3e2fe00640 1 -- 172.21.15.33:0/884962463 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e3815ce30 msgr2=0x7f3e3815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.559+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e3815ce30 0x7f3e3815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.559+0000 7f3e2fe00640 1 -- 172.21.15.33:0/884962463 >> v1:172.21.15.103:6789/0 conn(0x7f3e381593a0 legacy=0x7f3e380ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.559+0000 7f3e2fe00640 1 -- 172.21.15.33:0/884962463 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3806c7d0 con 0x7f3e380cde90 2024-09-13T18:59:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.559+0000 7f3e36a00640 1 -- 172.21.15.33:0/884962463 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969754372 0 0) 0x7f3e3806c4f0 con 0x7f3e381593a0 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.560+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e380cde90 0x7f3e3806d2b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a405b61c593230 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.560+0000 7f3e36a00640 1 -- 172.21.15.33:0/884962463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20032440 con 0x7f3e380cde90 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.560+0000 7f3e36a00640 1 -- 172.21.15.33:0/884962463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200325a0 con 0x7f3e380cde90 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.560+0000 7f3e36a00640 1 -- 172.21.15.33:0/884962463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20032930 con 0x7f3e380cde90 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 -- 172.21.15.33:0/884962463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e380cde90 msgr2=0x7f3e3806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e380cde90 0x7f3e3806d2b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2002a270 comp rx=0 tx=0).stop 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 -- 172.21.15.33:0/884962463 shutdown_connections 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e3815ce30 0x7f3e3815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 --2- 172.21.15.33:0/884962463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e380cde90 0x7f3e3806d2b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 -- 172.21.15.33:0/884962463 >> 172.21.15.33:0/884962463 conn(0x7f3e380b0200 msgr2=0x7f3e380b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 -- 172.21.15.33:0/884962463 shutdown_connections 2024-09-13T18:59:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.561+0000 7f3e3d000640 1 -- 172.21.15.33:0/884962463 wait complete. 2024-09-13T18:59:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.562+0000 7f3e3d000640 1 Processor -- start 2024-09-13T18:59:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.563+0000 7f3e3d000640 1 -- start start 2024-09-13T18:59:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.563+0000 7f3e3d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e380cde90 0x7f3e381f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.563+0000 7f3e3d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.563+0000 7f3e3d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 0x7f3e38153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e3d000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c3510 con 0x7f3e381593a0 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e3d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38154440 con 0x7f3e3815ce30 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e3d000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e381f6470 con 0x7f3e380cde90 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38782/0 (socket says 172.21.15.33:38782) 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 -- 172.21.15.33:0/970648097 learned_addr learned my addr 172.21.15.33:0/970648097 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e37400640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e380cde90 0x7f3e381f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e37e00640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 0x7f3e38153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 -- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e380cde90 msgr2=0x7f3e381f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e380cde90 0x7f3e381f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 -- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 msgr2=0x7f3e38153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 0x7f3e38153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e2fe00640 1 -- 172.21.15.33:0/970648097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200094d0 con 0x7f3e381593a0 2024-09-13T18:59:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.564+0000 7f3e37e00640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 0x7f3e38153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c00 tx=0x7f3e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20032440 con 0x7f3e381593a0 2024-09-13T18:59:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20032e20 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20004270 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e381f6750 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.565+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e381f6d10 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.566+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e380c36e0 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.567+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e20039050 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.568+0000 7f3e2f400640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 0x7f3e1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.568+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3e200a9960 con 0x7f3e381593a0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.568+0000 7f3e37400640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 0x7f3e1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.569+0000 7f3e37400640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 0x7f3e1406d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000f60 tx=0x7f3e28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.572+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3e380c36e0 con 0x7f3e381593a0 2024-09-13T18:59:05.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.751+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e380c36e0 con 0x7f3e381593a0 2024-09-13T18:59:05.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.752+0000 7f3e2f400640 1 -- 172.21.15.33:0/970648097 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f3e380c36e0 con 0x7f3e381593a0 2024-09-13T18:59:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:05.756 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":48,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:58:57.020293+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:58:45.791816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:58:46.914408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.18","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 msgr2=0x7f3e1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 0x7f3e1406d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000f60 tx=0x7f3e28009040 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 msgr2=0x7f3e380ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c00 tx=0x7f3e200046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 shutdown_connections 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3e1406ac00 0x7f3e1406d0c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e3815ce30 0x7f3e38153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e381593a0 0x7f3e380ca660 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 --2- 172.21.15.33:0/970648097 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e380cde90 0x7f3e381f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 >> 172.21.15.33:0/970648097 conn(0x7f3e380b0200 msgr2=0x7f3e380aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.754+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 shutdown_connections 2024-09-13T18:59:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.755+0000 7f3e3d000640 1 -- 172.21.15.33:0/970648097 wait complete. 2024-09-13T18:59:05.775 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:59:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.928+0000 7f4f52000640 1 Processor -- start 2024-09-13T18:59:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.928+0000 7f4f52000640 1 -- start start 2024-09-13T18:59:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f52000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f52000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c06ba80 con 0x7f4f4c0b1b30 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f52000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0cc3a0 con 0x7f4f4c151590 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f52000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0ce4b0 con 0x7f4f4c0cba50 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f4be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f4be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38792/0 (socket says 172.21.15.33:38792) 2024-09-13T18:59:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.929+0000 7f4f4be00640 1 -- 172.21.15.33:0/897776789 learned_addr learned my addr 172.21.15.33:0/897776789 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.930+0000 7f4f4be00640 1 -- 172.21.15.33:0/897776789 >> v1:172.21.15.103:6789/0 conn(0x7f4f4c151590 legacy=0x7f4f4c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.930+0000 7f4f4be00640 1 -- 172.21.15.33:0/897776789 >> v1:172.21.15.33:6789/0 conn(0x7f4f4c0b1b30 legacy=0x7f4f4c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.930+0000 7f4f4be00640 1 -- 172.21.15.33:0/897776789 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0b2270 con 0x7f4f4c0cba50 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.931+0000 7f4f4be00640 1 --2- 172.21.15.33:0/897776789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009e50 tx=0x7f4f4402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d9ecca9d64733 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.931+0000 7f4f4a000640 1 -- 172.21.15.33:0/897776789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44031600 con 0x7f4f4c0cba50 2024-09-13T18:59:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.931+0000 7f4f4a000640 1 -- 172.21.15.33:0/897776789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4402d050 con 0x7f4f4c0cba50 2024-09-13T18:59:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.931+0000 7f4f4a000640 1 -- 172.21.15.33:0/897776789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440319a0 con 0x7f4f4c0cba50 2024-09-13T18:59:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 -- 172.21.15.33:0/897776789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c0cba50 msgr2=0x7f4f4c0cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 --2- 172.21.15.33:0/897776789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009e50 tx=0x7f4f4402a7c0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 -- 172.21.15.33:0/897776789 shutdown_connections 2024-09-13T18:59:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 --2- 172.21.15.33:0/897776789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c0cbe60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 -- 172.21.15.33:0/897776789 >> 172.21.15.33:0/897776789 conn(0x7f4f4c0b0510 msgr2=0x7f4f4c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 -- 172.21.15.33:0/897776789 shutdown_connections 2024-09-13T18:59:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.932+0000 7f4f52000640 1 -- 172.21.15.33:0/897776789 wait complete. 2024-09-13T18:59:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.933+0000 7f4f52000640 1 Processor -- start 2024-09-13T18:59:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.934+0000 7f4f52000640 1 -- start start 2024-09-13T18:59:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.934+0000 7f4f52000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4f4c0b1b30 0x7f4f4c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f52000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c1efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f52000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f52000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15df10 con 0x7f4f4c151590 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f52000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15e1f0 con 0x7f4f4c0cba50 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f52000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15e4d0 con 0x7f4f4c0b1b30 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4f4c0b1b30 0x7f4f4c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38804/0 (socket says 172.21.15.33:38804) 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 -- 172.21.15.33:0/859759508 learned_addr learned my addr 172.21.15.33:0/859759508 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4aa00640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c1efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 -- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4f4c0b1b30 msgr2=0x7f4f4c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4f4c0b1b30 0x7f4f4c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 -- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f4c0cba50 msgr2=0x7f4f4c1efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c1efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.935+0000 7f4f4be00640 1 -- 172.21.15.33:0/859759508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44009b30 con 0x7f4f4c151590 2024-09-13T18:59:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f4be00640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f44034040 tx=0x7f4f44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4403b600 con 0x7f4f4c151590 2024-09-13T18:59:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4403b760 con 0x7f4f4c151590 2024-09-13T18:59:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4403bb10 con 0x7f4f4c151590 2024-09-13T18:59:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c1e3f80 con 0x7f4f4c151590 2024-09-13T18:59:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.936+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c1f0140 con 0x7f4f4c151590 2024-09-13T18:59:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.937+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c1e44a0 con 0x7f4f4c151590 2024-09-13T18:59:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.938+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f4403bc70 con 0x7f4f4c151590 2024-09-13T18:59:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.939+0000 7f4f43400640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 0x7f4f2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.939+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4f440aa100 con 0x7f4f4c151590 2024-09-13T18:59:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.939+0000 7f4f4b400640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 0x7f4f2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.940+0000 7f4f4b400640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 0x7f4f2c06d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c14ab80 tx=0x7f4f3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:05.943+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4f4c1e44a0 con 0x7f4f4c151590 2024-09-13T18:59:06.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.160+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f4c1e44a0 con 0x7f4f4c151590 2024-09-13T18:59:06.164 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T18:59:06.161+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:59:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.173+0000 7f4f43400640 1 -- 172.21.15.33:0/859759508 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f4c1e44a0 con 0x7f4f4c151590 2024-09-13T18:59:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.175+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 msgr2=0x7f4f2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.175+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 0x7f4f2c06d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c14ab80 tx=0x7f4f3c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.175+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 msgr2=0x7f4f4c14ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.175+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f44034040 tx=0x7f4f44004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 shutdown_connections 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4f2c06ac00 0x7f4f2c06d0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f4c151590 0x7f4f4c14ff30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f4c0cba50 0x7f4f4c1efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 --2- 172.21.15.33:0/859759508 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4f4c0b1b30 0x7f4f4c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 >> 172.21.15.33:0/859759508 conn(0x7f4f4c0b0510 msgr2=0x7f4f4c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 shutdown_connections 2024-09-13T18:59:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.176+0000 7f4f52000640 1 -- 172.21.15.33:0/859759508 wait complete. 2024-09-13T18:59:06.180 INFO:tasks.ceph.mds.c.smithi033.stderr: -3839> 2024-09-13T18:58:42.788+0000 7f13de800640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:59:06.184 INFO:tasks.ceph.mds.c.smithi033.stderr: -2600> 2024-09-13T18:58:53.464+0000 7f13d7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:59:06.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:59:06.238 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:59:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.357+0000 7f6e48a00640 1 Processor -- start 2024-09-13T18:59:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.357+0000 7f6e48a00640 1 -- start start 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.358+0000 7f6e48a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e440b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.358+0000 7f6e48a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e44159a80 0x7f6e440b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.358+0000 7f6e48a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6e440b2410 0x7f6e4406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.358+0000 7f6e48a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440ce600 con 0x7f6e44159a80 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e48a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e44070f90 con 0x7f6e440b2410 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e48a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44153f00 con 0x7f6e44153b20 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e44159a80 0x7f6e440b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e44159a80 0x7f6e440b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38830/0 (socket says 172.21.15.33:38830) 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 -- 172.21.15.33:0/1314121154 learned_addr learned my addr 172.21.15.33:0/1314121154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e41e00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e440b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e42800640 1 --2- 172.21.15.33:0/1314121154 >> v2:172.21.15.103:3300/0 conn(0x7f6e440b2410 0x7f6e4406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 -- 172.21.15.33:0/1314121154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 msgr2=0x7f6e440b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e440b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 -- 172.21.15.33:0/1314121154 >> v2:172.21.15.103:3300/0 conn(0x7f6e440b2410 msgr2=0x7f6e4406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 --2- 172.21.15.33:0/1314121154 >> v2:172.21.15.103:3300/0 conn(0x7f6e440b2410 0x7f6e4406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.359+0000 7f6e3be00640 1 -- 172.21.15.33:0/1314121154 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440b1a40 con 0x7f6e44159a80 2024-09-13T18:59:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.360+0000 7f6e3be00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e440b1ed0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6e4406b800 tx=0x7f6e2c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd4bd4dbc61790d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e41400640 1 -- 172.21.15.33:0/1314121154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c032440 con 0x7f6e44159a80 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e41400640 1 -- 172.21.15.33:0/1314121154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c0325a0 con 0x7f6e44159a80 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e41400640 1 -- 172.21.15.33:0/1314121154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c032930 con 0x7f6e44159a80 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 -- 172.21.15.33:0/1314121154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 msgr2=0x7f6e440b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e440b1ed0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6e4406b800 tx=0x7f6e2c02a200 comp rx=0 tx=0).stop 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 -- 172.21.15.33:0/1314121154 shutdown_connections 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 --2- 172.21.15.33:0/1314121154 >> v2:172.21.15.103:3300/0 conn(0x7f6e440b2410 0x7f6e4406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e440b1ed0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 --2- 172.21.15.33:0/1314121154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e440b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.361+0000 7f6e48a00640 1 -- 172.21.15.33:0/1314121154 >> 172.21.15.33:0/1314121154 conn(0x7f6e440b0510 msgr2=0x7f6e440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.362+0000 7f6e48a00640 1 -- 172.21.15.33:0/1314121154 shutdown_connections 2024-09-13T18:59:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.362+0000 7f6e48a00640 1 -- 172.21.15.33:0/1314121154 wait complete. 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.363+0000 7f6e48a00640 1 Processor -- start 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.363+0000 7f6e48a00640 1 -- start start 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e440b2410 0x7f6e44154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e44155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441f5ca0 con 0x7f6e44159a80 2024-09-13T18:59:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441553a0 con 0x7f6e440b2410 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e48a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4414fa30 con 0x7f6e44153b20 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e42800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e42800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38834/0 (socket says 172.21.15.33:38834) 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.364+0000 7f6e42800640 1 -- 172.21.15.33:0/988418514 learned_addr learned my addr 172.21.15.33:0/988418514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e41e00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e440b2410 0x7f6e44154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e3be00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e44155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 -- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 msgr2=0x7f6e44155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e44155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 -- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e440b2410 msgr2=0x7f6e44154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e440b2410 0x7f6e44154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 -- 172.21.15.33:0/988418514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0094d0 con 0x7f6e44159a80 2024-09-13T18:59:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e42800640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007d20 tx=0x7f6e3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014420 con 0x7f6e44159a80 2024-09-13T18:59:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.365+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0145a0 con 0x7f6e44159a80 2024-09-13T18:59:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.366+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e441f6160 con 0x7f6e44159a80 2024-09-13T18:59:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.366+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014950 con 0x7f6e44159a80 2024-09-13T18:59:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.366+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e441f6720 con 0x7f6e44159a80 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.366+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e440b3990 con 0x7f6e44159a80 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.368+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e3c014ab0 con 0x7f6e44159a80 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.368+0000 7f6e3a000640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 0x7f6e2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.368+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6e3c089bc0 con 0x7f6e44159a80 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.369+0000 7f6e41e00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 0x7f6e2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.370+0000 7f6e41e00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 0x7f6e2006d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009aa0 tx=0x7f6e34009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.373+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6e3c054d20 con 0x7f6e44159a80 2024-09-13T18:59:06.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:06.589+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6e440b3420 con 0x7f6e44159a80 2024-09-13T18:59:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.175+0000 7f6e3a000640 1 -- 172.21.15.33:0/988418514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e3c058340 con 0x7f6e44159a80 2024-09-13T18:59:07.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 msgr2=0x7f6e2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 0x7f6e2006d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009aa0 tx=0x7f6e34009190 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 msgr2=0x7f6e44156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007d20 tx=0x7f6e3c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 shutdown_connections 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6e2006ac00 0x7f6e2006d0c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e44159a80 0x7f6e44156a20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6e44153b20 0x7f6e44155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 --2- 172.21.15.33:0/988418514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e440b2410 0x7f6e44154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 >> 172.21.15.33:0/988418514 conn(0x7f6e440b0510 msgr2=0x7f6e4406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 shutdown_connections 2024-09-13T18:59:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.178+0000 7f6e48a00640 1 -- 172.21.15.33:0/988418514 wait complete. 2024-09-13T18:59:07.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:59:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.399+0000 7f1976200640 1 Processor -- start 2024-09-13T18:59:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.400+0000 7f1976200640 1 -- start start 2024-09-13T18:59:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1976200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f197015c980 0x7f19700b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1976200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 0x7f197006b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1976200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19700ce290 con 0x7f19700cde70 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1976200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19700ad640 con 0x7f197015c980 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1976200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19700b2660 con 0x7f19700acf80 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f1974e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f197015c980 0x7f19700b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f196fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f19700cde70 0x7f19700ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46020/0 (socket says 172.21.15.33:46020) 2024-09-13T18:59:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.401+0000 7f196fe00640 1 -- 172.21.15.33:0/3303787123 learned_addr learned my addr 172.21.15.33:0/3303787123 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1974e00640 1 -- 172.21.15.33:0/3303787123 >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 msgr2=0x7f197006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1975800640 1 --2- 172.21.15.33:0/3303787123 >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 0x7f197006b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1974e00640 1 --2- 172.21.15.33:0/3303787123 >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 0x7f197006b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1974e00640 1 -- 172.21.15.33:0/3303787123 >> v1:172.21.15.33:6789/0 conn(0x7f19700cde70 legacy=0x7f19700ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f196f400640 1 -- 172.21.15.33:0/3303787123 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912905810 0 0) 0x7f19700ce290 con 0x7f19700cde70 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1974e00640 1 -- 172.21.15.33:0/3303787123 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700ad9d0 con 0x7f197015c980 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.402+0000 7f1975800640 1 --2- 172.21.15.33:0/3303787123 >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 0x7f197006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f1974e00640 1 --2- 172.21.15.33:0/3303787123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197015c980 0x7f19700b2080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f197006ae40 tx=0x7f196402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2784e6ddee8f0202 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:07.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f196f400640 1 -- 172.21.15.33:0/3303787123 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964032440 con 0x7f197015c980 2024-09-13T18:59:07.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f196f400640 1 -- 172.21.15.33:0/3303787123 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19640325a0 con 0x7f197015c980 2024-09-13T18:59:07.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f196f400640 1 -- 172.21.15.33:0/3303787123 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964032930 con 0x7f197015c980 2024-09-13T18:59:07.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f1976200640 1 -- 172.21.15.33:0/3303787123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197015c980 msgr2=0x7f19700b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.403+0000 7f1976200640 1 --2- 172.21.15.33:0/3303787123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197015c980 0x7f19700b2080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f197006ae40 tx=0x7f196402a230 comp rx=0 tx=0).stop 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 -- 172.21.15.33:0/3303787123 shutdown_connections 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 --2- 172.21.15.33:0/3303787123 >> v2:172.21.15.103:3300/0 conn(0x7f19700acf80 0x7f197006b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 --2- 172.21.15.33:0/3303787123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197015c980 0x7f19700b2080 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 -- 172.21.15.33:0/3303787123 >> 172.21.15.33:0/3303787123 conn(0x7f19700b0300 msgr2=0x7f19700b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 -- 172.21.15.33:0/3303787123 shutdown_connections 2024-09-13T18:59:07.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.404+0000 7f1976200640 1 -- 172.21.15.33:0/3303787123 wait complete. 2024-09-13T18:59:07.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.405+0000 7f1976200640 1 Processor -- start 2024-09-13T18:59:07.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 -- start start 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 0x7f1970146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 0x7f197015e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970147470 con 0x7f19701476e0 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970154ae0 con 0x7f19700acf80 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.406+0000 7f1976200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197015f2a0 con 0x7f19700cde70 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38858/0 (socket says 172.21.15.33:38858) 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 -- 172.21.15.33:0/1413406971 learned_addr learned my addr 172.21.15.33:0/1413406971 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f196fe00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 0x7f197015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1974e00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 0x7f1970146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 -- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 msgr2=0x7f197015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 0x7f197015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 -- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 msgr2=0x7f1970146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 0x7f1970146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1975800640 1 -- 172.21.15.33:0/1413406971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009400 con 0x7f19701476e0 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f196fe00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 0x7f197015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.407+0000 7f1974e00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 0x7f1970146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f1975800640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f196800ceb0 tx=0x7f196800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800d840 con 0x7f19701476e0 2024-09-13T18:59:07.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196800d9a0 con 0x7f19701476e0 2024-09-13T18:59:07.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800dd50 con 0x7f19701476e0 2024-09-13T18:59:07.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1970154d30 con 0x7f19701476e0 2024-09-13T18:59:07.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.408+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19701552f0 con 0x7f19701476e0 2024-09-13T18:59:07.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.409+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197006b800 con 0x7f19701476e0 2024-09-13T18:59:07.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.410+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f196801d360 con 0x7f19701476e0 2024-09-13T18:59:07.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.411+0000 7f196cc00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 0x7f195006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:07.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.411+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1968089e00 con 0x7f19701476e0 2024-09-13T18:59:07.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.411+0000 7f1974e00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 0x7f195006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:07.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.412+0000 7f1974e00640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 0x7f195006d0f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1964034000 tx=0x7f196402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:07.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.415+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1968054f40 con 0x7f19701476e0 2024-09-13T18:59:07.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:07.595+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f197015f3e0 con 0x7f19701476e0 2024-09-13T18:59:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.177+0000 7f196cc00640 1 -- 172.21.15.33:0/1413406971 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 181+0+0 (secure 0 0 0) 0x7f196801a020 con 0x7f19701476e0 2024-09-13T18:59:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:59:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 msgr2=0x7f195006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 0x7f195006d0f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1964034000 tx=0x7f196402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 msgr2=0x7f1970147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f196800ceb0 tx=0x7f196800a710 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 shutdown_connections 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f195006ac30 0x7f195006d0f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19701476e0 0x7f1970147b60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19700cde70 0x7f197015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 --2- 172.21.15.33:0/1413406971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19700acf80 0x7f1970146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 >> 172.21.15.33:0/1413406971 conn(0x7f19700b0300 msgr2=0x7f19700ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 shutdown_connections 2024-09-13T18:59:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.180+0000 7f1976200640 1 -- 172.21.15.33:0/1413406971 wait complete. 2024-09-13T18:59:08.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:59:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.361+0000 7f5f81e00640 1 Processor -- start 2024-09-13T18:59:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.361+0000 7f5f81e00640 1 -- start start 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.362+0000 7f5f81e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 0x7f5f7c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.362+0000 7f5f81e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c151a20 con 0x7f5f7c15b770 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.362+0000 7f5f81e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0cc430 con 0x7f5f7c06cd60 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.362+0000 7f5f81e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0b1bb0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.363+0000 7f5f7a000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5f7c15b770 0x7f5f7c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46022/0 (socket says 172.21.15.33:46022) 2024-09-13T18:59:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.363+0000 7f5f7a000640 1 -- 172.21.15.33:0/2185261361 learned_addr learned my addr 172.21.15.33:0/2185261361 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.363+0000 7f5f7b400640 1 --2- 172.21.15.33:0/2185261361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 0x7f5f7c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.363+0000 7f5f79600640 1 -- 172.21.15.33:0/2185261361 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374072828 0 0) 0x7f5f7c151a20 con 0x7f5f7c15b770 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.363+0000 7f5f79600640 1 -- 172.21.15.33:0/2185261361 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f60003520 con 0x7f5f7c15b770 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.364+0000 7f5f7b400640 1 -- 172.21.15.33:0/2185261361 >> v1:172.21.15.103:6789/0 conn(0x7f5f7c06cd60 legacy=0x7f5f7c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.364+0000 7f5f7b400640 1 -- 172.21.15.33:0/2185261361 >> v1:172.21.15.33:6789/0 conn(0x7f5f7c15b770 legacy=0x7f5f7c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.364+0000 7f5f7b400640 1 -- 172.21.15.33:0/2185261361 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0b1e70 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.365+0000 7f5f7b400640 1 --2- 172.21.15.33:0/2185261361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 0x7f5f7c0b2950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009dc0 tx=0x7f5f7402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bad17f103496f917 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.366+0000 7f5f79600640 1 -- 172.21.15.33:0/2185261361 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74007740 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.366+0000 7f5f79600640 1 -- 172.21.15.33:0/2185261361 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7402d050 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.366+0000 7f5f79600640 1 -- 172.21.15.33:0/2185261361 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74007ac0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.367+0000 7f5f81e00640 1 -- 172.21.15.33:0/2185261361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 msgr2=0x7f5f7c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.367+0000 7f5f81e00640 1 --2- 172.21.15.33:0/2185261361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 0x7f5f7c0b2950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009dc0 tx=0x7f5f7402a6d0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.367+0000 7f5f81e00640 1 -- 172.21.15.33:0/2185261361 shutdown_connections 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.367+0000 7f5f81e00640 1 --2- 172.21.15.33:0/2185261361 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c0cdf80 0x7f5f7c0b2950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.367+0000 7f5f81e00640 1 -- 172.21.15.33:0/2185261361 >> 172.21.15.33:0/2185261361 conn(0x7f5f7c0b0510 msgr2=0x7f5f7c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.368+0000 7f5f81e00640 1 -- 172.21.15.33:0/2185261361 shutdown_connections 2024-09-13T18:59:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.368+0000 7f5f81e00640 1 -- 172.21.15.33:0/2185261361 wait complete. 2024-09-13T18:59:08.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.370+0000 7f5f81e00640 1 Processor -- start 2024-09-13T18:59:08.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.370+0000 7f5f81e00640 1 -- start start 2024-09-13T18:59:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c06cd60 0x7f5f7c1e39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f7c15b770 0x7f5f7c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1e3580 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c156240 con 0x7f5f7c15b770 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f81e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1516b0 con 0x7f5f7c06cd60 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f7a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f7a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38864/0 (socket says 172.21.15.33:38864) 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f7a000640 1 -- 172.21.15.33:0/531612101 learned_addr learned my addr 172.21.15.33:0/531612101 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f7aa00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c06cd60 0x7f5f7c1e39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.371+0000 7f5f7b400640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f7c15b770 0x7f5f7c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 -- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c06cd60 msgr2=0x7f5f7c1e39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c06cd60 0x7f5f7c1e39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 -- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f7c15b770 msgr2=0x7f5f7c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f7c15b770 0x7f5f7c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 -- 172.21.15.33:0/531612101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009a70 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f7a000640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c410 tx=0x7f5f6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68005ce0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68005e40 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c155f60 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680072f0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.372+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c1e31a0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.374+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c1e3ee0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.374+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f68007450 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.375+0000 7f5f73400640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 0x7f5f5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.375+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5f680887c0 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.376+0000 7f5f7aa00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 0x7f5f5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.376+0000 7f5f7aa00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 0x7f5f5c06d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000f60 tx=0x7f5f6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:08.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.379+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f68053c30 con 0x7f5f7c0cdf80 2024-09-13T18:59:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:08.560+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f7c1e2d20 con 0x7f5f7c0cdf80 2024-09-13T18:59:09.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.183+0000 7f5f73400640 1 -- 172.21.15.33:0/531612101 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5f7c1e2d20 con 0x7f5f7c0cdf80 2024-09-13T18:59:09.187 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T18:59:09.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.187+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 msgr2=0x7f5f5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.187+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 0x7f5f5c06d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000f60 tx=0x7f5f6c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:09.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.187+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 msgr2=0x7f5f7c151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.187+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c410 tx=0x7f5f6800c8d0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 shutdown_connections 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5f5c06ac30 0x7f5f5c06d0f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f7c15b770 0x7f5f7c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0cdf80 0x7f5f7c151170 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 --2- 172.21.15.33:0/531612101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f7c06cd60 0x7f5f7c1e39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 >> 172.21.15.33:0/531612101 conn(0x7f5f7c0b0510 msgr2=0x7f5f7c0ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:09.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 shutdown_connections 2024-09-13T18:59:09.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.188+0000 7f5f81e00640 1 -- 172.21.15.33:0/531612101 wait complete. 2024-09-13T18:59:09.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:59:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.370+0000 7f212cc00640 1 Processor -- start 2024-09-13T18:59:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.370+0000 7f212cc00640 1 -- start start 2024-09-13T18:59:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.371+0000 7f212cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 0x7f212806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f212cc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212806bc00 con 0x7f21280b1b00 2024-09-13T18:59:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f212cc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212806bea0 con 0x7f21280ce020 2024-09-13T18:59:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f212cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212806c180 con 0x7f212815a520 2024-09-13T18:59:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f211fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21280b1b00 0x7f21280cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46030/0 (socket says 172.21.15.33:46030) 2024-09-13T18:59:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f211fe00640 1 -- 172.21.15.33:0/2819039117 learned_addr learned my addr 172.21.15.33:0/2819039117 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f2125e00640 1 --2- 172.21.15.33:0/2819039117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 0x7f212806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346778791 0 0) 0x7f212806bc00 con 0x7f21280b1b00 2024-09-13T18:59:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f210c003520 con 0x7f21280b1b00 2024-09-13T18:59:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199265943 0 0) 0x7f212806bea0 con 0x7f21280ce020 2024-09-13T18:59:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.372+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212806bc00 con 0x7f21280ce020 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.373+0000 7f2125e00640 1 -- 172.21.15.33:0/2819039117 >> v1:172.21.15.103:6789/0 conn(0x7f21280ce020 legacy=0x7f212815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.373+0000 7f2125e00640 1 -- 172.21.15.33:0/2819039117 >> v1:172.21.15.33:6789/0 conn(0x7f21280b1b00 legacy=0x7f21280cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.373+0000 7f2125e00640 1 -- 172.21.15.33:0/2819039117 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212806c460 con 0x7f212815a520 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f2125e00640 1 --2- 172.21.15.33:0/2819039117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 0x7f212806b6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21180097d0 tx=0x7f211802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4493044f1046ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118032440 con 0x7f212815a520 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180325a0 con 0x7f212815a520 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f2125400640 1 -- 172.21.15.33:0/2819039117 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118032930 con 0x7f212815a520 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f212cc00640 1 -- 172.21.15.33:0/2819039117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 msgr2=0x7f212806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.374+0000 7f212cc00640 1 --2- 172.21.15.33:0/2819039117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 0x7f212806b6c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21180097d0 tx=0x7f211802a210 comp rx=0 tx=0).stop 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.375+0000 7f212cc00640 1 -- 172.21.15.33:0/2819039117 shutdown_connections 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.375+0000 7f212cc00640 1 --2- 172.21.15.33:0/2819039117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f212815a520 0x7f212806b6c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.375+0000 7f212cc00640 1 -- 172.21.15.33:0/2819039117 >> 172.21.15.33:0/2819039117 conn(0x7f21280b0510 msgr2=0x7f21280b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.375+0000 7f212cc00640 1 -- 172.21.15.33:0/2819039117 shutdown_connections 2024-09-13T18:59:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.375+0000 7f212cc00640 1 -- 172.21.15.33:0/2819039117 wait complete. 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.376+0000 7f212cc00640 1 Processor -- start 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.376+0000 7f212cc00640 1 -- start start 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280b1b00 0x7f21281f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 0x7f21280ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281f0e80 con 0x7f21280ce020 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280aa270 con 0x7f212815a520 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f212cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280aa510 con 0x7f21280b1b00 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f211fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f211fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38874/0 (socket says 172.21.15.33:38874) 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.377+0000 7f211fe00640 1 -- 172.21.15.33:0/4181380745 learned_addr learned my addr 172.21.15.33:0/4181380745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f2125e00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280b1b00 0x7f21281f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f2126800640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 0x7f21280ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 -- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280b1b00 msgr2=0x7f21281f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280b1b00 0x7f21281f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 -- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 msgr2=0x7f21280ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 0x7f21280ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 -- 172.21.15.33:0/4181380745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009400 con 0x7f21280ce020 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f2126800640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 0x7f21280ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:09.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211fe00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f211000c4d0 tx=0x7f211000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110005ce0 con 0x7f21280ce020 2024-09-13T18:59:09.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110005e40 con 0x7f21280ce020 2024-09-13T18:59:09.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110007270 con 0x7f21280ce020 2024-09-13T18:59:09.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.378+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280aa7f0 con 0x7f21280ce020 2024-09-13T18:59:09.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.379+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280aadb0 con 0x7f21280ce020 2024-09-13T18:59:09.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.380+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280b0c70 con 0x7f21280ce020 2024-09-13T18:59:09.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.381+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21100073d0 con 0x7f21280ce020 2024-09-13T18:59:09.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.382+0000 7f211e000640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 0x7f210406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.382+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f21100885e0 con 0x7f21280ce020 2024-09-13T18:59:09.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.382+0000 7f2125e00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 0x7f210406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.383+0000 7f2125e00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 0x7f210406d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2118034000 tx=0x7f211802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.386+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2110053ad0 con 0x7f21280ce020 2024-09-13T18:59:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.567+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f21280b0990 con 0x7f21280ce020 2024-09-13T18:59:09.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.571+0000 7f211e000640 1 -- 172.21.15.33:0/4181380745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21100570f0 con 0x7f21280ce020 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 msgr2=0x7f210406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 0x7f210406d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2118034000 tx=0x7f211802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 msgr2=0x7f2128150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f211000c4d0 tx=0x7f211000c990 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 shutdown_connections 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f210406ac00 0x7f210406d0c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f212815a520 0x7f21280ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21280ce020 0x7f2128150140 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 --2- 172.21.15.33:0/4181380745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280b1b00 0x7f21281f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 >> 172.21.15.33:0/4181380745 conn(0x7f21280b0510 msgr2=0x7f212806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.573+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 shutdown_connections 2024-09-13T18:59:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.574+0000 7f212cc00640 1 -- 172.21.15.33:0/4181380745 wait complete. 2024-09-13T18:59:09.593 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-13T18:59:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.745+0000 7fb91ca00640 1 Processor -- start 2024-09-13T18:59:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.745+0000 7fb91ca00640 1 -- start start 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb91ca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb91815a520 0x7fb91806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb91ca00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9180ce020 0x7fb91815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb91ca00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91806bc00 con 0x7fb9180b1b00 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb91ca00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91806bea0 con 0x7fb9180ce020 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb91ca00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91806c180 con 0x7fb91815a520 2024-09-13T18:59:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb916800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9180ce020 0x7fb91815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb916800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9180ce020 0x7fb91815a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38878/0 (socket says 172.21.15.33:38878) 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb916800640 1 -- 172.21.15.33:0/3138973498 learned_addr learned my addr 172.21.15.33:0/3138973498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.746+0000 7fb915e00640 1 --2- 172.21.15.33:0/3138973498 >> v2:172.21.15.103:3300/0 conn(0x7fb91815a520 0x7fb91806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.747+0000 7fb916800640 1 -- 172.21.15.33:0/3138973498 >> v2:172.21.15.103:3300/0 conn(0x7fb91815a520 msgr2=0x7fb91806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.747+0000 7fb916800640 1 --2- 172.21.15.33:0/3138973498 >> v2:172.21.15.103:3300/0 conn(0x7fb91815a520 0x7fb91806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.747+0000 7fb916800640 1 -- 172.21.15.33:0/3138973498 >> v1:172.21.15.103:6789/0 conn(0x7fb9180b1b00 legacy=0x7fb9180cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.747+0000 7fb916800640 1 -- 172.21.15.33:0/3138973498 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91806c460 con 0x7fb9180ce020 2024-09-13T18:59:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb916800640 1 --2- 172.21.15.33:0/3138973498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9180ce020 0x7fb91815a900 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb9180b14f0 tx=0x7fb91002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a0cec47e4daf8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb915400640 1 -- 172.21.15.33:0/3138973498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910031600 con 0x7fb9180ce020 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb915400640 1 -- 172.21.15.33:0/3138973498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91002d050 con 0x7fb9180ce020 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb915400640 1 -- 172.21.15.33:0/3138973498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910031980 con 0x7fb9180ce020 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb91ca00640 1 -- 172.21.15.33:0/3138973498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9180ce020 msgr2=0x7fb91815a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb91ca00640 1 --2- 172.21.15.33:0/3138973498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9180ce020 0x7fb91815a900 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb9180b14f0 tx=0x7fb91002a730 comp rx=0 tx=0).stop 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb91ca00640 1 -- 172.21.15.33:0/3138973498 shutdown_connections 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.748+0000 7fb91ca00640 1 --2- 172.21.15.33:0/3138973498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9180ce020 0x7fb91815a900 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.749+0000 7fb91ca00640 1 --2- 172.21.15.33:0/3138973498 >> v2:172.21.15.103:3300/0 conn(0x7fb91815a520 0x7fb91806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.749+0000 7fb91ca00640 1 -- 172.21.15.33:0/3138973498 >> 172.21.15.33:0/3138973498 conn(0x7fb9180b0510 msgr2=0x7fb9180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.749+0000 7fb91ca00640 1 -- 172.21.15.33:0/3138973498 shutdown_connections 2024-09-13T18:59:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.749+0000 7fb91ca00640 1 -- 172.21.15.33:0/3138973498 wait complete. 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.750+0000 7fb91ca00640 1 Processor -- start 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.750+0000 7fb91ca00640 1 -- start start 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 0x7fb91815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180ce020 0x7fb91814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91815d3b0 con 0x7fb91815a520 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb918150000 con 0x7fb9180ce020 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.751+0000 7fb91ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb918153d30 con 0x7fb9180b1b00 2024-09-13T18:59:09.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38886/0 (socket says 172.21.15.33:38886) 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 -- 172.21.15.33:0/2209166325 learned_addr learned my addr 172.21.15.33:0/2209166325 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb90d400640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180ce020 0x7fb91814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb915e00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 0x7fb91815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 -- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 msgr2=0x7fb91815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 0x7fb91815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 -- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180ce020 msgr2=0x7fb91814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180ce020 0x7fb91814fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 -- 172.21.15.33:0/2209166325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910009b30 con 0x7fb91815a520 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb915e00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 0x7fb91815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.752+0000 7fb916800640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb910009f40 tx=0x7fb910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.753+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91003b810 con 0x7fb91815a520 2024-09-13T18:59:09.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.753+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91003b970 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.753+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91003bd20 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.753+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918152c90 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.753+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918153250 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.754+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91815a900 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.755+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb91003a3a0 con 0x7fb91815a520 2024-09-13T18:59:09.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.755+0000 7fb90ea00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 0x7fb8f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:09.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.756+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb9100a9b90 con 0x7fb91815a520 2024-09-13T18:59:09.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.756+0000 7fb915e00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 0x7fb8f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:09.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.757+0000 7fb915e00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 0x7fb8f406d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb918150950 tx=0x7fb908008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:09.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:09.760+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb910075060 con 0x7fb91815a520 2024-09-13T18:59:10.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.005+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) v1 -- 0x7fb9180b0280 con 0x7fb91815a520 2024-09-13T18:59:10.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.186+0000 7fb90ea00640 1 -- 172.21.15.33:0/2209166325 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v131) v1 ==== 153+0+0 (secure 0 0 0) 0x7fb9100490e0 con 0x7fb91815a520 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 msgr2=0x7fb8f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 0x7fb8f406d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb918150950 tx=0x7fb908008040 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 msgr2=0x7fb9181509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb910009f40 tx=0x7fb910004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 shutdown_connections 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb8f406ac00 0x7fb8f406d0c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb91815a520 0x7fb9181509a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180ce020 0x7fb91814fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 --2- 172.21.15.33:0/2209166325 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb9180b1b00 0x7fb91815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 >> 172.21.15.33:0/2209166325 conn(0x7fb9180b0510 msgr2=0x7fb9180cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 shutdown_connections 2024-09-13T18:59:10.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.188+0000 7fb91ca00640 1 -- 172.21.15.33:0/2209166325 wait complete. 2024-09-13T18:59:10.209 INFO:tasks.cephfs_test_runner:test invalid values for ceph.quota.max_bytes ... ok 2024-09-13T18:59:10.209 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test human-readable values for setting ceph.quota.max_bytes 2024-09-13T18:59:10.209 INFO:tasks.cephfs_test_runner:test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-13T18:59:10.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.362+0000 7f697e400640 1 Processor -- start 2024-09-13T18:59:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.362+0000 7f697e400640 1 -- start start 2024-09-13T18:59:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697e400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6978071510 0x7f69780719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697e400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697806b4a0 con 0x7f697806bef0 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697e400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697815dc70 con 0x7f6978156d10 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697e400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978071ee0 con 0x7f6978071510 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697da00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f697806bef0 0x7f697806c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46038/0 (socket says 172.21.15.33:46038) 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.363+0000 7f697da00640 1 -- 172.21.15.33:0/2169846012 learned_addr learned my addr 172.21.15.33:0/2169846012 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f696fe00640 1 --2- 172.21.15.33:0/2169846012 >> v2:172.21.15.103:3300/0 conn(0x7f6978071510 0x7f69780719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494821529 0 0) 0x7f697806b4a0 con 0x7f697806bef0 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695c003520 con 0x7f697806bef0 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645581960 0 0) 0x7f697815dc70 con 0x7f6978156d10 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f697806b4a0 con 0x7f6978156d10 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f696fe00640 1 -- 172.21.15.33:0/2169846012 >> v1:172.21.15.103:6789/0 conn(0x7f6978156d10 legacy=0x7f697815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f696fe00640 1 -- 172.21.15.33:0/2169846012 >> v1:172.21.15.33:6789/0 conn(0x7f697806bef0 legacy=0x7f697806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.364+0000 7f696fe00640 1 -- 172.21.15.33:0/2169846012 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780b4450 con 0x7f6978071510 2024-09-13T18:59:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f696fe00640 1 --2- 172.21.15.33:0/2169846012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69780719a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69600097a0 tx=0x7f696002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f428e0d580612a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960032440 con 0x7f6978071510 2024-09-13T18:59:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69600325a0 con 0x7f6978071510 2024-09-13T18:59:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f6977e00640 1 -- 172.21.15.33:0/2169846012 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960032930 con 0x7f6978071510 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 -- 172.21.15.33:0/2169846012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 msgr2=0x7f69780719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 --2- 172.21.15.33:0/2169846012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69780719a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69600097a0 tx=0x7f696002a230 comp rx=0 tx=0).stop 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 -- 172.21.15.33:0/2169846012 shutdown_connections 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 --2- 172.21.15.33:0/2169846012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69780719a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 -- 172.21.15.33:0/2169846012 >> 172.21.15.33:0/2169846012 conn(0x7f697806d630 msgr2=0x7f697806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.366+0000 7f697e400640 1 -- 172.21.15.33:0/2169846012 shutdown_connections 2024-09-13T18:59:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.367+0000 7f697e400640 1 -- 172.21.15.33:0/2169846012 wait complete. 2024-09-13T18:59:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.368+0000 7f697e400640 1 Processor -- start 2024-09-13T18:59:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.368+0000 7f697e400640 1 -- start start 2024-09-13T18:59:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69781448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6978156d10 0x7f69780cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697815a460 con 0x7f697806bef0 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780caba0 con 0x7f6978071510 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.369+0000 7f697e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780cae80 con 0x7f6978156d10 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38902/0 (socket says 172.21.15.33:38902) 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 -- 172.21.15.33:0/3172340163 learned_addr learned my addr 172.21.15.33:0/3172340163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697da00640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6978156d10 0x7f69780cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f696fe00640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69781448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 -- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6978156d10 msgr2=0x7f69780cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6978156d10 0x7f69780cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 -- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 msgr2=0x7f69781448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69781448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.370+0000 7f697d000640 1 -- 172.21.15.33:0/3172340163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960009400 con 0x7f697806bef0 2024-09-13T18:59:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f697d000640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f696800c430 tx=0x7f696800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680052d0 con 0x7f697806bef0 2024-09-13T18:59:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968005450 con 0x7f697806bef0 2024-09-13T18:59:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968003830 con 0x7f697806bef0 2024-09-13T18:59:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69780cb160 con 0x7f697806bef0 2024-09-13T18:59:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.371+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69781522b0 con 0x7f697806bef0 2024-09-13T18:59:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.372+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780b40b0 con 0x7f697806bef0 2024-09-13T18:59:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.373+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6968003990 con 0x7f697806bef0 2024-09-13T18:59:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.374+0000 7f6975600640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.374+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6968088620 con 0x7f697806bef0 2024-09-13T18:59:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.374+0000 7f696fe00640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.375+0000 7f696fe00640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 0x7f695406d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6960034000 tx=0x7f696002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.378+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6968053ba0 con 0x7f697806bef0 2024-09-13T18:59:10.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.557+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697815cb60 con 0x7f697806bef0 2024-09-13T18:59:10.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.558+0000 7f6975600640 1 -- 172.21.15.33:0/3172340163 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f69680571c0 con 0x7f697806bef0 2024-09-13T18:59:10.562 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:10.562 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":51,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:09.177430+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6835/2375812342":"2024-09-14T18:59:06.162157+0000","172.21.15.33:6832/2375812342":"2024-09-14T18:59:06.162157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:10.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 msgr2=0x7f695406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 0x7f695406d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6960034000 tx=0x7f696002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 msgr2=0x7f6978144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f696800c430 tx=0x7f696800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 shutdown_connections 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f695406ac00 0x7f695406d0c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6978156d10 0x7f69780cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6978071510 0x7f69781448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 --2- 172.21.15.33:0/3172340163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697806bef0 0x7f6978144fd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 >> 172.21.15.33:0/3172340163 conn(0x7f697806d630 msgr2=0x7f69780b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 shutdown_connections 2024-09-13T18:59:10.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.561+0000 7f697e400640 1 -- 172.21.15.33:0/3172340163 wait complete. 2024-09-13T18:59:10.580 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:10.580 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.734+0000 7f2c79800640 1 Processor -- start 2024-09-13T18:59:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.734+0000 7f2c79800640 1 -- start start 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.735+0000 7f2c79800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c74071690 0x7f2c7415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.735+0000 7f2c79800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c740cafa0 0x7f2c740cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.735+0000 7f2c79800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7406f5f0 con 0x7f2c74156f60 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.735+0000 7f2c79800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7415aa30 con 0x7f2c74071690 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.735+0000 7f2c79800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c74070450 con 0x7f2c740cafa0 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c72a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2c74156f60 0x7f2c74070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46042/0 (socket says 172.21.15.33:46042) 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c72a00640 1 -- 172.21.15.33:0/1455088843 learned_addr learned my addr 172.21.15.33:0/1455088843 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c6be00640 1 --2- 172.21.15.33:0/1455088843 >> v2:172.21.15.33:3300/0 conn(0x7f2c74071690 0x7f2c7415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c73400640 1 --2- 172.21.15.33:0/1455088843 >> v2:172.21.15.103:3300/0 conn(0x7f2c740cafa0 0x7f2c740cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c72000640 1 -- 172.21.15.33:0/1455088843 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084219561 0 0) 0x7f2c7406f5f0 con 0x7f2c74156f60 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c72000640 1 -- 172.21.15.33:0/1455088843 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c58003520 con 0x7f2c74156f60 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c6be00640 1 -- 172.21.15.33:0/1455088843 >> v2:172.21.15.103:3300/0 conn(0x7f2c740cafa0 msgr2=0x7f2c740cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c6be00640 1 --2- 172.21.15.33:0/1455088843 >> v2:172.21.15.103:3300/0 conn(0x7f2c740cafa0 0x7f2c740cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c6be00640 1 -- 172.21.15.33:0/1455088843 >> v1:172.21.15.33:6789/0 conn(0x7f2c74156f60 legacy=0x7f2c74070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.736+0000 7f2c6be00640 1 -- 172.21.15.33:0/1455088843 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7406f840 con 0x7f2c74071690 2024-09-13T18:59:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.737+0000 7f2c6be00640 1 --2- 172.21.15.33:0/1455088843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c74071690 0x7f2c7415a4f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2c74159a70 tx=0x7f2c5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ab4ab61ebf6699 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.737+0000 7f2c72000640 1 -- 172.21.15.33:0/1455088843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c032440 con 0x7f2c74071690 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c72000640 1 -- 172.21.15.33:0/1455088843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0325a0 con 0x7f2c74071690 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c72000640 1 -- 172.21.15.33:0/1455088843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c032930 con 0x7f2c74071690 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 -- 172.21.15.33:0/1455088843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c74071690 msgr2=0x7f2c7415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 --2- 172.21.15.33:0/1455088843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c74071690 0x7f2c7415a4f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2c74159a70 tx=0x7f2c5c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 -- 172.21.15.33:0/1455088843 shutdown_connections 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 --2- 172.21.15.33:0/1455088843 >> v2:172.21.15.103:3300/0 conn(0x7f2c740cafa0 0x7f2c740cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 --2- 172.21.15.33:0/1455088843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c74071690 0x7f2c7415a4f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 -- 172.21.15.33:0/1455088843 >> 172.21.15.33:0/1455088843 conn(0x7f2c740b0580 msgr2=0x7f2c740b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 -- 172.21.15.33:0/1455088843 shutdown_connections 2024-09-13T18:59:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.738+0000 7f2c79800640 1 -- 172.21.15.33:0/1455088843 wait complete. 2024-09-13T18:59:10.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.740+0000 7f2c79800640 1 Processor -- start 2024-09-13T18:59:10.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.740+0000 7f2c79800640 1 -- start start 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c740cafa0 0x7f2c740add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c74156f60 0x7f2c74153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741efe50 con 0x7f2c741540e0 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741548d0 con 0x7f2c740cafa0 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c79800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741545f0 con 0x7f2c74156f60 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c73400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c73400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38914/0 (socket says 172.21.15.33:38914) 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c73400640 1 -- 172.21.15.33:0/1558546096 learned_addr learned my addr 172.21.15.33:0/1558546096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c72a00640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c740cafa0 0x7f2c740add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.741+0000 7f2c6be00640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c74156f60 0x7f2c74153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 -- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c74156f60 msgr2=0x7f2c74153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c74156f60 0x7f2c74153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 -- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c740cafa0 msgr2=0x7f2c740add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c740cafa0 0x7f2c740add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 -- 172.21.15.33:0/1558546096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c009400 con 0x7f2c741540e0 2024-09-13T18:59:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c73400640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00ef90 tx=0x7f2c6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c009ca0 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c00f040 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0146c0 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c741f00a0 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.742+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c741f0660 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.744+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74157340 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.745+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c6c014820 con 0x7f2c741540e0 2024-09-13T18:59:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.745+0000 7f2c6aa00640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 0x7f2c5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.745+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c6c089da0 con 0x7f2c741540e0 2024-09-13T18:59:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.746+0000 7f2c72a00640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 0x7f2c5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.746+0000 7f2c72a00640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 0x7f2c5006d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c640011e0 tx=0x7f2c64007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:10.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.750+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c6c0553c0 con 0x7f2c741540e0 2024-09-13T18:59:10.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.938+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c740cc9a0 con 0x7f2c741540e0 2024-09-13T18:59:10.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.939+0000 7f2c6aa00640 1 -- 172.21.15.33:0/1558546096 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c6c0180a0 con 0x7f2c741540e0 2024-09-13T18:59:10.942 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 msgr2=0x7f2c5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 0x7f2c5006d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c640011e0 tx=0x7f2c64007d30 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 msgr2=0x7f2c740ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00ef90 tx=0x7f2c6c00c490 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 shutdown_connections 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c5006ac00 0x7f2c5006d0c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c741540e0 0x7f2c740ccec0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c74156f60 0x7f2c74153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 --2- 172.21.15.33:0/1558546096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c740cafa0 0x7f2c740add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:10.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 >> 172.21.15.33:0/1558546096 conn(0x7f2c740b0580 msgr2=0x7f2c7406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:10.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.941+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 shutdown_connections 2024-09-13T18:59:10.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:10.942+0000 7f2c79800640 1 -- 172.21.15.33:0/1558546096 wait complete. 2024-09-13T18:59:10.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-13T18:59:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.113+0000 7f4d26600640 1 Processor -- start 2024-09-13T18:59:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.113+0000 7f4d26600640 1 -- start start 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d26600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 0x7f4d200b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d26600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d26600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d20153f00 con 0x7f4d200b2410 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d26600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d200ce600 con 0x7f4d20153b20 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d26600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20070f90 con 0x7f4d20159a80 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:56094/0 (socket says 172.21.15.33:56094) 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d17e00640 1 -- 172.21.15.33:0/453969287 learned_addr learned my addr 172.21.15.33:0/453969287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.115+0000 7f4d1f400640 1 --2- 172.21.15.33:0/453969287 >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 0x7f4d200b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.116+0000 7f4d17e00640 1 -- 172.21.15.33:0/453969287 >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 msgr2=0x7f4d200b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.116+0000 7f4d17e00640 1 --2- 172.21.15.33:0/453969287 >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 0x7f4d200b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.116+0000 7f4d17e00640 1 -- 172.21.15.33:0/453969287 >> v1:172.21.15.33:6789/0 conn(0x7f4d200b2410 legacy=0x7f4d2006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.116+0000 7f4d17e00640 1 -- 172.21.15.33:0/453969287 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200b1a40 con 0x7f4d20159a80 2024-09-13T18:59:11.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.116+0000 7f4d1f400640 1 --2- 172.21.15.33:0/453969287 >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 0x7f4d200b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.117+0000 7f4d17e00640 1 --2- 172.21.15.33:0/453969287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d0802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=277f1910f4919dba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.117+0000 7f4d1ea00640 1 -- 172.21.15.33:0/453969287 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08032440 con 0x7f4d20159a80 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.117+0000 7f4d1ea00640 1 -- 172.21.15.33:0/453969287 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080325a0 con 0x7f4d20159a80 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.117+0000 7f4d1ea00640 1 -- 172.21.15.33:0/453969287 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08032930 con 0x7f4d20159a80 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 -- 172.21.15.33:0/453969287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 msgr2=0x7f4d200b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 --2- 172.21.15.33:0/453969287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d0802a250 comp rx=0 tx=0).stop 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 -- 172.21.15.33:0/453969287 shutdown_connections 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 --2- 172.21.15.33:0/453969287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d20159a80 0x7f4d200b1ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 --2- 172.21.15.33:0/453969287 >> v2:172.21.15.103:3300/0 conn(0x7f4d20153b20 0x7f4d200b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 -- 172.21.15.33:0/453969287 >> 172.21.15.33:0/453969287 conn(0x7f4d200b0510 msgr2=0x7f4d200b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 -- 172.21.15.33:0/453969287 shutdown_connections 2024-09-13T18:59:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.118+0000 7f4d26600640 1 -- 172.21.15.33:0/453969287 wait complete. 2024-09-13T18:59:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.120+0000 7f4d26600640 1 Processor -- start 2024-09-13T18:59:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.120+0000 7f4d26600640 1 -- start start 2024-09-13T18:59:11.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d200b2410 0x7f4d200afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d20159a80 0x7f4d20157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201579f0 con 0x7f4d20153b20 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20158e80 con 0x7f4d20159a80 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d26600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20159160 con 0x7f4d200b2410 2024-09-13T18:59:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38926/0 (socket says 172.21.15.33:38926) 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 -- 172.21.15.33:0/1175565458 learned_addr learned my addr 172.21.15.33:0/1175565458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d1f400640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d200b2410 0x7f4d200afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d1fe00640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d20159a80 0x7f4d20157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 -- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d200b2410 msgr2=0x7f4d200afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d200b2410 0x7f4d200afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 -- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d20159a80 msgr2=0x7f4d20157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d20159a80 0x7f4d20157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.121+0000 7f4d17e00640 1 -- 172.21.15.33:0/1175565458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080094d0 con 0x7f4d20153b20 2024-09-13T18:59:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d17e00640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d0802a290 tx=0x7f4d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08032440 con 0x7f4d20153b20 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d08030ba0 con 0x7f4d20153b20 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0803d440 con 0x7f4d20153b20 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d20159440 con 0x7f4d20153b20 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.122+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d20155f50 con 0x7f4d20153b20 2024-09-13T18:59:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.123+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d20157b30 con 0x7f4d20153b20 2024-09-13T18:59:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.124+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d08039040 con 0x7f4d20153b20 2024-09-13T18:59:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.125+0000 7f4d17400640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 0x7f4cfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.125+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d080a9ad0 con 0x7f4d20153b20 2024-09-13T18:59:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.125+0000 7f4d1f400640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 0x7f4cfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.126+0000 7f4d1f400640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 0x7f4cfc06d0c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006fd0 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:11.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.129+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d20157b30 con 0x7f4d20153b20 2024-09-13T18:59:11.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:11.375+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) v1 -- 0x7f4d20157b30 con 0x7f4d20153b20 2024-09-13T18:59:11.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:59:11.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:59:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.194+0000 7f4d17400640 1 -- 172.21.15.33:0/1175565458 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v133) v1 ==== 148+0+0 (secure 0 0 0) 0x7f4d20157b30 con 0x7f4d20153b20 2024-09-13T18:59:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 msgr2=0x7f4cfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 0x7f4cfc06d0c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006fd0 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2024-09-13T18:59:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 msgr2=0x7f4d20155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d0802a290 tx=0x7f4d080046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 shutdown_connections 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4cfc06ac00 0x7f4cfc06d0c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d20159a80 0x7f4d20157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d20153b20 0x7f4d20155a10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 --2- 172.21.15.33:0/1175565458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d200b2410 0x7f4d200afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.197+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 >> 172.21.15.33:0/1175565458 conn(0x7f4d200b0510 msgr2=0x7f4d20156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.198+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 shutdown_connections 2024-09-13T18:59:12.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.198+0000 7f4d26600640 1 -- 172.21.15.33:0/1175565458 wait complete. 2024-09-13T18:59:12.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:59:12.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.380+0000 7f8b08c00640 1 Processor -- start 2024-09-13T18:59:12.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.380+0000 7f8b08c00640 1 -- start start 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b08c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b0415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b08c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b04071690 0x7f8b040cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b08c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0406f5f0 con 0x7f8b040cafa0 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b08c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0415aa30 con 0x7f8b04071690 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b08c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04070450 con 0x7f8b04156f60 2024-09-13T18:59:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b01400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8b040cafa0 0x7f8b04070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46060/0 (socket says 172.21.15.33:46060) 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b01400640 1 -- 172.21.15.33:0/3440276591 learned_addr learned my addr 172.21.15.33:0/3440276591 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.381+0000 7f8b02800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b04071690 0x7f8b040cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.382+0000 7f8b01e00640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b0415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.382+0000 7f8b02800640 1 -- 172.21.15.33:0/3440276591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 msgr2=0x7f8b0415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.382+0000 7f8b02800640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b0415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.382+0000 7f8b02800640 1 -- 172.21.15.33:0/3440276591 >> v1:172.21.15.33:6789/0 conn(0x7f8b040cafa0 legacy=0x7f8b04070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.382+0000 7f8b02800640 1 -- 172.21.15.33:0/3440276591 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0406f840 con 0x7f8b04071690 2024-09-13T18:59:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.383+0000 7f8b02800640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b04071690 0x7f8b040cc8b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009d90 tx=0x7f8afc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c3de68077222a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.383+0000 7f8b00a00640 1 -- 172.21.15.33:0/3440276591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc007740 con 0x7f8b04071690 2024-09-13T18:59:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.383+0000 7f8b00a00640 1 -- 172.21.15.33:0/3440276591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc02d050 con 0x7f8b04071690 2024-09-13T18:59:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.383+0000 7f8b00a00640 1 -- 172.21.15.33:0/3440276591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc007ac0 con 0x7f8b04071690 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 -- 172.21.15.33:0/3440276591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b04071690 msgr2=0x7f8b040cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b04071690 0x7f8b040cc8b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009d90 tx=0x7f8afc02a660 comp rx=0 tx=0).stop 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 -- 172.21.15.33:0/3440276591 shutdown_connections 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b04071690 0x7f8b040cc8b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3440276591 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b0415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 -- 172.21.15.33:0/3440276591 >> 172.21.15.33:0/3440276591 conn(0x7f8b040b0580 msgr2=0x7f8b040b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 -- 172.21.15.33:0/3440276591 shutdown_connections 2024-09-13T18:59:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.384+0000 7f8b08c00640 1 -- 172.21.15.33:0/3440276591 wait complete. 2024-09-13T18:59:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.385+0000 7f8b08c00640 1 Processor -- start 2024-09-13T18:59:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.386+0000 7f8b08c00640 1 -- start start 2024-09-13T18:59:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.386+0000 7f8b08c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b04071690 0x7f8b04144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.386+0000 7f8b08c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.386+0000 7f8b08c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b040ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b08c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040ac9f0 con 0x7f8b040cafa0 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b08c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040accd0 con 0x7f8b04071690 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b08c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040acfb0 con 0x7f8b04156f60 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38946/0 (socket says 172.21.15.33:38946) 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 -- 172.21.15.33:0/3588288424 learned_addr learned my addr 172.21.15.33:0/3588288424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01e00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b04071690 0x7f8b04144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b02800640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b040ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 -- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 msgr2=0x7f8b040ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b040ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 -- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b04071690 msgr2=0x7f8b04144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b04071690 0x7f8b04144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b01400640 1 -- 172.21.15.33:0/3588288424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009a70 con 0x7f8b040cafa0 2024-09-13T18:59:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.387+0000 7f8b02800640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b040ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8b01400640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c4d0 tx=0x7f8af000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0005ce0 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0005e40 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b040ad290 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0007270 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.388+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0406ca30 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.389+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b04157340 con 0x7f8b040cafa0 2024-09-13T18:59:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.390+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8af00073d0 con 0x7f8b040cafa0 2024-09-13T18:59:12.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.391+0000 7f8afa000640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 0x7f8ae406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:12.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.391+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8af00884b0 con 0x7f8b040cafa0 2024-09-13T18:59:12.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.392+0000 7f8b01e00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 0x7f8ae406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:12.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.392+0000 7f8b01e00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 0x7f8ae406d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8af40079a0 tx=0x7f8af4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:12.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.395+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8af0053a30 con 0x7f8b040cafa0 2024-09-13T18:59:12.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.573+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8b040af5f0 con 0x7f8b040cafa0 2024-09-13T18:59:12.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.578+0000 7f8afa000640 1 -- 172.21.15.33:0/3588288424 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8af00170c0 con 0x7f8b040cafa0 2024-09-13T18:59:12.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 msgr2=0x7f8ae406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 0x7f8ae406d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8af40079a0 tx=0x7f8af4008040 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 msgr2=0x7f8b0414cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c4d0 tx=0x7f8af000c990 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 shutdown_connections 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8ae406ac00 0x7f8ae406d0c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8b04156f60 0x7f8b040ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b040cafa0 0x7f8b0414cd20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 --2- 172.21.15.33:0/3588288424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b04071690 0x7f8b04144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 >> 172.21.15.33:0/3588288424 conn(0x7f8b040b0580 msgr2=0x7f8b04149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 shutdown_connections 2024-09-13T18:59:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:12.580+0000 7f8b08c00640 1 -- 172.21.15.33:0/3588288424 wait complete. 2024-09-13T18:59:12.599 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:59:12.599 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:12.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:12.785 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:59:12.785 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:12.785 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:12.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:12.820 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:12.821 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:12.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:12.858 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:12.858 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:12.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:12.896 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:12.896 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:12.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:12.934 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:59:12.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:13.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.087+0000 7f485ec00640 1 Processor -- start 2024-09-13T18:59:13.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.087+0000 7f485ec00640 1 -- start start 2024-09-13T18:59:13.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.088+0000 7f485ec00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f48580b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.088+0000 7f485ec00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 0x7f48580b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.088+0000 7f485ec00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4858153f00 con 0x7f48580b2410 2024-09-13T18:59:13.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.088+0000 7f485ec00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580ce600 con 0x7f4858159a80 2024-09-13T18:59:13.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.088+0000 7f485ec00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4858070f90 con 0x7f4858153b20 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f48580b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 0x7f48580b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f485cc00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48580b2410 0x7f485806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:40486/0 (socket says 172.21.15.33:40486) 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f485cc00640 1 -- 172.21.15.33:0/872452227 learned_addr learned my addr 172.21.15.33:0/872452227 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857e00640 1 -- 172.21.15.33:0/872452227 >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 msgr2=0x7f48580b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857e00640 1 --2- 172.21.15.33:0/872452227 >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 0x7f48580b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857e00640 1 -- 172.21.15.33:0/872452227 >> v1:172.21.15.103:6789/0 conn(0x7f48580b2410 legacy=0x7f485806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857e00640 1 -- 172.21.15.33:0/872452227 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580b1a40 con 0x7f4858153b20 2024-09-13T18:59:13.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.089+0000 7f4857400640 1 --2- 172.21.15.33:0/872452227 >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 0x7f48580b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:13.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.090+0000 7f4857e00640 1 --2- 172.21.15.33:0/872452227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f48580b3990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48480097a0 tx=0x7f484802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344cfa3182485fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.091+0000 7f4856a00640 1 -- 172.21.15.33:0/872452227 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848032440 con 0x7f4858153b20 2024-09-13T18:59:13.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.091+0000 7f4856a00640 1 -- 172.21.15.33:0/872452227 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480325a0 con 0x7f4858153b20 2024-09-13T18:59:13.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.091+0000 7f4856a00640 1 -- 172.21.15.33:0/872452227 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848032930 con 0x7f4858153b20 2024-09-13T18:59:13.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.091+0000 7f485ec00640 1 -- 172.21.15.33:0/872452227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 msgr2=0x7f48580b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.091+0000 7f485ec00640 1 --2- 172.21.15.33:0/872452227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f48580b3990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48480097a0 tx=0x7f484802a180 comp rx=0 tx=0).stop 2024-09-13T18:59:13.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 -- 172.21.15.33:0/872452227 shutdown_connections 2024-09-13T18:59:13.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 --2- 172.21.15.33:0/872452227 >> v2:172.21.15.103:3300/0 conn(0x7f4858159a80 0x7f48580b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 --2- 172.21.15.33:0/872452227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f48580b3990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 -- 172.21.15.33:0/872452227 >> 172.21.15.33:0/872452227 conn(0x7f48580b0510 msgr2=0x7f48580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:13.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 -- 172.21.15.33:0/872452227 shutdown_connections 2024-09-13T18:59:13.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.092+0000 7f485ec00640 1 -- 172.21.15.33:0/872452227 wait complete. 2024-09-13T18:59:13.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.093+0000 7f485ec00640 1 Processor -- start 2024-09-13T18:59:13.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.093+0000 7f485ec00640 1 -- start start 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f4858134f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4858159a80 0x7f485815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48581354a0 con 0x7f48580b2410 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48581573c0 con 0x7f4858159a80 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f485ec00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4858156e40 con 0x7f4858153b20 2024-09-13T18:59:13.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.094+0000 7f4857e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41372/0 (socket says 172.21.15.33:41372) 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 -- 172.21.15.33:0/2338714001 learned_addr learned my addr 172.21.15.33:0/2338714001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f485cc00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4858159a80 0x7f485815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857400640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f4858134f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 -- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 msgr2=0x7f4858134f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f4858134f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 -- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4858159a80 msgr2=0x7f485815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4858159a80 0x7f485815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 -- 172.21.15.33:0/2338714001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009400 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.095+0000 7f4857e00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4848000c00 tx=0x7f48480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.096+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848030b80 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.096+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848032e90 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.096+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848006e10 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.096+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4848009400 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.096+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48581570e0 con 0x7f48580b2410 2024-09-13T18:59:13.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.097+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48580b3990 con 0x7f48580b2410 2024-09-13T18:59:13.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.098+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4848039040 con 0x7f48580b2410 2024-09-13T18:59:13.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.099+0000 7f484fe00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.099+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f48480a9980 con 0x7f48580b2410 2024-09-13T18:59:13.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.099+0000 7f4857400640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.100+0000 7f4857400640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 0x7f483806d0f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485814e430 tx=0x7f4844009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.103+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4848074e70 con 0x7f48580b2410 2024-09-13T18:59:13.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.319+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48580cabb0 con 0x7f48580b2410 2024-09-13T18:59:13.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.320+0000 7f484fe00640 1 -- 172.21.15.33:0/2338714001 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f4848037de0 con 0x7f48580b2410 2024-09-13T18:59:13.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:13.324 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2968540675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2968540675},{"type":"v1","addr":"172.21.15.103:6836","nonce":2968540675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5057,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/2800777207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2800777207},{"type":"v1","addr":"172.21.15.33:6834","nonce":2800777207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1541755007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1541755007},{"type":"v1","addr":"172.21.15.103:6837","nonce":1541755007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5820,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/712690377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":712690377},{"type":"v1","addr":"172.21.15.33:6835","nonce":712690377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-09-13T18:59:13.326 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-13T18:59:13.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 msgr2=0x7f483806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 0x7f483806d0f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485814e430 tx=0x7f4844009190 comp rx=0 tx=0).stop 2024-09-13T18:59:13.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 msgr2=0x7f485814e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4848000c00 tx=0x7f48480046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 shutdown_connections 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4858159a80 0x7f485815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4858153b20 0x7f4858134f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 --2- 172.21.15.33:0/2338714001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48580b2410 0x7f485814e960 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 >> 172.21.15.33:0/2338714001 conn(0x7f48580b0510 msgr2=0x7f4858165400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:13.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 shutdown_connections 2024-09-13T18:59:13.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.322+0000 7f485ec00640 1 -- 172.21.15.33:0/2338714001 wait complete. 2024-09-13T18:59:13.342 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:59:13.342 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:59:13.343 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:59:13.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:13.343 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:59:13.343 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:59:13.344 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:59:13.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:13.344 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:59:13.344 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:59:13.345 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:59:13.345 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:13.345 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:59:13.345 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:59:13.346 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:59:13.346 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:13.357 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:59:13.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:59:13.359 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:59:13.359 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:59:13.364 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:59:13.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:59:13.365 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:59:13.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:59:13.402 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:59:13.403 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:13.406 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:59:13.406 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:13.408 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:59:13.408 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:13.410 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:59:13.411 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:13.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:59:13.535 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T18:59:13.535 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:59:13.536 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T18:59:13.536 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:59:13.538 INFO:tasks.ceph.mds.b.smithi103.stderr:2024-09-13T18:59:13.536+0000 7f8be6000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:59:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.575+0000 7f7e13200640 1 Processor -- start 2024-09-13T18:59:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.576+0000 7f7e13200640 1 -- start start 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e13200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e1415c810 0x7f7e140b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e13200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e140b4650 0x7f7e140ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e13200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b4aa0 con 0x7f7e140cd220 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e13200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140ce160 con 0x7f7e140b4650 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e13200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140d0260 con 0x7f7e1415c810 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e11400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e140b4650 0x7f7e140ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e11400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e140b4650 0x7f7e140ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41384/0 (socket says 172.21.15.33:41384) 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e11400640 1 -- 172.21.15.33:0/3227067044 learned_addr learned my addr 172.21.15.33:0/3227067044 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.577+0000 7f7e11e00640 1 --2- 172.21.15.33:0/3227067044 >> v2:172.21.15.103:3300/0 conn(0x7f7e1415c810 0x7f7e140b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.578+0000 7f7e11400640 1 -- 172.21.15.33:0/3227067044 >> v2:172.21.15.103:3300/0 conn(0x7f7e1415c810 msgr2=0x7f7e140b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.578+0000 7f7e11400640 1 --2- 172.21.15.33:0/3227067044 >> v2:172.21.15.103:3300/0 conn(0x7f7e1415c810 0x7f7e140b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.578+0000 7f7e11400640 1 -- 172.21.15.33:0/3227067044 >> v1:172.21.15.103:6789/0 conn(0x7f7e140cd220 legacy=0x7f7e14160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.578+0000 7f7e11400640 1 -- 172.21.15.33:0/3227067044 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140cd670 con 0x7f7e140b4650 2024-09-13T18:59:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.579+0000 7f7e11400640 1 --2- 172.21.15.33:0/3227067044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140ccce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7e1408b500 tx=0x7f7e0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2085afd3cfcc996 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.579+0000 7f7e10a00640 1 -- 172.21.15.33:0/3227067044 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00032440 con 0x7f7e140b4650 2024-09-13T18:59:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.579+0000 7f7e10a00640 1 -- 172.21.15.33:0/3227067044 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000325a0 con 0x7f7e140b4650 2024-09-13T18:59:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.579+0000 7f7e10a00640 1 -- 172.21.15.33:0/3227067044 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00032930 con 0x7f7e140b4650 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 -- 172.21.15.33:0/3227067044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 msgr2=0x7f7e140ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 --2- 172.21.15.33:0/3227067044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140ccce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7e1408b500 tx=0x7f7e0002a270 comp rx=0 tx=0).stop 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 -- 172.21.15.33:0/3227067044 shutdown_connections 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 --2- 172.21.15.33:0/3227067044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140ccce0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 --2- 172.21.15.33:0/3227067044 >> v2:172.21.15.103:3300/0 conn(0x7f7e1415c810 0x7f7e140b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 -- 172.21.15.33:0/3227067044 >> 172.21.15.33:0/3227067044 conn(0x7f7e1406c050 msgr2=0x7f7e1406c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 -- 172.21.15.33:0/3227067044 shutdown_connections 2024-09-13T18:59:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.580+0000 7f7e13200640 1 -- 172.21.15.33:0/3227067044 wait complete. 2024-09-13T18:59:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.582+0000 7f7e13200640 1 Processor -- start 2024-09-13T18:59:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.582+0000 7f7e13200640 1 -- start start 2024-09-13T18:59:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e140cd220 0x7f7e14157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1415c810 0x7f7e140c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140cbfa0 con 0x7f7e140b4650 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140cbd20 con 0x7f7e1415c810 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e13200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14157d90 con 0x7f7e140cd220 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41390/0 (socket says 172.21.15.33:41390) 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 -- 172.21.15.33:0/2705351589 learned_addr learned my addr 172.21.15.33:0/2705351589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11400640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e140cd220 0x7f7e14157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e12800640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1415c810 0x7f7e140c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 -- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e140cd220 msgr2=0x7f7e14157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e140cd220 0x7f7e14157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 -- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1415c810 msgr2=0x7f7e140c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1415c810 0x7f7e140c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.583+0000 7f7e11e00640 1 -- 172.21.15.33:0/2705351589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000094d0 con 0x7f7e140b4650 2024-09-13T18:59:13.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e11e00640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8a0 tx=0x7f7e0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040094f0 con 0x7f7e140b4650 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400c940 con 0x7f7e140b4650 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400ccf0 con 0x7f7e140b4650 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140ca950 con 0x7f7e140b4650 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.584+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140caf10 con 0x7f7e140b4650 2024-09-13T18:59:13.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.585+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1415cbf0 con 0x7f7e140b4650 2024-09-13T18:59:13.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.586+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e04013470 con 0x7f7e140b4650 2024-09-13T18:59:13.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.587+0000 7f7e0a000640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 0x7f7df406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:13.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.587+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7e040890f0 con 0x7f7e140b4650 2024-09-13T18:59:13.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.588+0000 7f7e11400640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 0x7f7df406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:13.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.589+0000 7f7e11400640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 0x7f7df406d110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e00034000 tx=0x7f7e0002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:13.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.592+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e04054660 con 0x7f7e140b4650 2024-09-13T18:59:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:13.781+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e140b5030 con 0x7f7e140b4650 2024-09-13T18:59:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.581+0000 7f7e0a000640 1 -- 172.21.15.33:0/2705351589 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e04057c80 con 0x7f7e140b4650 2024-09-13T18:59:14.585 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T18:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.584+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 msgr2=0x7f7df406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.584+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 0x7f7df406d110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e00034000 tx=0x7f7e0002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.584+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 msgr2=0x7f7e140cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.584+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e8a0 tx=0x7f7e0400ed60 comp rx=0 tx=0).stop 2024-09-13T18:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 shutdown_connections 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7df406ac50 0x7f7df406d110 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1415c810 0x7f7e140c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7e140cd220 0x7f7e14157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 --2- 172.21.15.33:0/2705351589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e140b4650 0x7f7e140cb7e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 >> 172.21.15.33:0/2705351589 conn(0x7f7e1406c050 msgr2=0x7f7e140d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 shutdown_connections 2024-09-13T18:59:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.585+0000 7f7e13200640 1 -- 172.21.15.33:0/2705351589 wait complete. 2024-09-13T18:59:14.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:59:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.764+0000 7f7914c00640 1 Processor -- start 2024-09-13T18:59:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.764+0000 7f7914c00640 1 -- start start 2024-09-13T18:59:14.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f7914c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f7914c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7910153f00 con 0x7f791006f660 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f7914c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100b1a40 con 0x7f7910159a80 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f7914c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100ce600 con 0x7f7910153b20 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f790e800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f791006f660 0x7f791006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57548/0 (socket says 172.21.15.33:57548) 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f790e800640 1 -- 172.21.15.33:0/2216544307 learned_addr learned my addr 172.21.15.33:0/2216544307 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f790de00640 1 --2- 172.21.15.33:0/2216544307 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:14.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.766+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637259817 0 0) 0x7f7910153f00 con 0x7f791006f660 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f4003520 con 0x7f791006f660 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710443121 0 0) 0x7f79100b1a40 con 0x7f7910159a80 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7910153f00 con 0x7f7910159a80 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790de00640 1 -- 172.21.15.33:0/2216544307 >> v1:172.21.15.103:6789/0 conn(0x7f7910159a80 legacy=0x7f79100b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790de00640 1 -- 172.21.15.33:0/2216544307 >> v1:172.21.15.33:6789/0 conn(0x7f791006f660 legacy=0x7f791006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.767+0000 7f790de00640 1 -- 172.21.15.33:0/2216544307 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791015a1f0 con 0x7f7910153b20 2024-09-13T18:59:14.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.768+0000 7f790de00640 1 --2- 172.21.15.33:0/2216544307 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100b3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79000097d0 tx=0x7f790002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb280517942f8e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:14.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.768+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900032440 con 0x7f7910153b20 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.768+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000325a0 con 0x7f7910153b20 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.768+0000 7f790d400640 1 -- 172.21.15.33:0/2216544307 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900032930 con 0x7f7910153b20 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 -- 172.21.15.33:0/2216544307 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 msgr2=0x7f79100b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 --2- 172.21.15.33:0/2216544307 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100b3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79000097d0 tx=0x7f790002a210 comp rx=0 tx=0).stop 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 -- 172.21.15.33:0/2216544307 shutdown_connections 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 --2- 172.21.15.33:0/2216544307 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100b3990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 -- 172.21.15.33:0/2216544307 >> 172.21.15.33:0/2216544307 conn(0x7f79100b0510 msgr2=0x7f79100b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 -- 172.21.15.33:0/2216544307 shutdown_connections 2024-09-13T18:59:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.769+0000 7f7914c00640 1 -- 172.21.15.33:0/2216544307 wait complete. 2024-09-13T18:59:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.771+0000 7f7914c00640 1 Processor -- start 2024-09-13T18:59:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.771+0000 7f7914c00640 1 -- start start 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7910159a80 0x7f79100ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910156b20 con 0x7f791006f660 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910157360 con 0x7f7910159a80 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7914c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7910156da0 con 0x7f7910153b20 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41392/0 (socket says 172.21.15.33:41392) 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 -- 172.21.15.33:0/3638370782 learned_addr learned my addr 172.21.15.33:0/3638370782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790e800640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7910159a80 0x7f79100ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f7905400640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 -- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 msgr2=0x7f79100afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 -- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7910159a80 msgr2=0x7f79100ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7910159a80 0x7f79100ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.772+0000 7f790de00640 1 -- 172.21.15.33:0/3638370782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009400 con 0x7f791006f660 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f790de00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7900035040 tx=0x7f79000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790003d8f0 con 0x7f791006f660 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790003da70 con 0x7f791006f660 2024-09-13T18:59:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790003de20 con 0x7f791006f660 2024-09-13T18:59:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7910157080 con 0x7f791006f660 2024-09-13T18:59:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.773+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791015ae00 con 0x7f791006f660 2024-09-13T18:59:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.774+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79100b3990 con 0x7f791006f660 2024-09-13T18:59:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.775+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7900039040 con 0x7f791006f660 2024-09-13T18:59:14.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.776+0000 7f7906a00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 0x7f78ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.776+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79000a99a0 con 0x7f791006f660 2024-09-13T18:59:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.777+0000 7f7905400640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 0x7f78ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:14.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.777+0000 7f7905400640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 0x7f78ec06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f79100707a0 tx=0x7f78f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:14.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:14.780+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7900075090 con 0x7f791006f660 2024-09-13T18:59:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.023+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7910159430 con 0x7f791006f660 2024-09-13T18:59:15.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.024+0000 7f7906a00640 1 -- 172.21.15.33:0/3638370782 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f79000786b0 con 0x7f791006f660 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.030 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.033 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T18:59:15.034 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.035 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T18:59:15.036 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T18:59:15.037 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T18:59:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T18:59:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.042 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:59:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:15.044 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:59:15.045 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:15.045 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.045 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:15.045 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T18:59:15.048 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 msgr2=0x7f78ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 0x7f78ec06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f79100707a0 tx=0x7f78f8009040 comp rx=0 tx=0).stop 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 msgr2=0x7f79101530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7900035040 tx=0x7f79000046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 shutdown_connections 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f78ec06ac00 0x7f78ec06d0c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7910159a80 0x7f79100ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7910153b20 0x7f79100afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 --2- 172.21.15.33:0/3638370782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f791006f660 0x7f79101530e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.026+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 >> 172.21.15.33:0/3638370782 conn(0x7f79100b0510 msgr2=0x7f7910157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.027+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 shutdown_connections 2024-09-13T18:59:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.027+0000 7f7914c00640 1 -- 172.21.15.33:0/3638370782 wait complete. 2024-09-13T18:59:15.051 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.205+0000 7f9f91a00640 1 Processor -- start 2024-09-13T18:59:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.205+0000 7f9f91a00640 1 -- start start 2024-09-13T18:59:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.206+0000 7f9f91a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9f8c15fdd0 0x7f9f8c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f91a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0d1fd0 0x7f9f8c160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f91a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c1601b0 con 0x7f9f8c0b1c50 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f91a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cd6a0 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f91a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0d2400 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9f8c15fdd0 0x7f9f8c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f83e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9f8c0b1c50 0x7f9f8c1603b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57556/0 (socket says 172.21.15.33:57556) 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f83e00640 1 -- 172.21.15.33:0/4112699471 learned_addr learned my addr 172.21.15.33:0/4112699471 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f91000640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0d1fd0 0x7f9f8c160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8be00640 1 -- 172.21.15.33:0/4112699471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0d1fd0 msgr2=0x7f9f8c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8be00640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0d1fd0 0x7f9f8c160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8be00640 1 -- 172.21.15.33:0/4112699471 >> v1:172.21.15.33:6789/0 conn(0x7f9f8c0b1c50 legacy=0x7f9f8c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8be00640 1 -- 172.21.15.33:0/4112699471 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0d17e0 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.207+0000 7f9f8b400640 1 -- 172.21.15.33:0/4112699471 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623070012 0 0) 0x7f9f8c1601b0 con 0x7f9f8c0b1c50 2024-09-13T18:59:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.208+0000 7f9f8be00640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0d1a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097a0 tx=0x7f9f7c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834874088654362a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f8b400640 1 -- 172.21.15.33:0/4112699471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02ae50 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f8b400640 1 -- 172.21.15.33:0/4112699471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c032440 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f8b400640 1 -- 172.21.15.33:0/4112699471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0327d0 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 -- 172.21.15.33:0/4112699471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c15fdd0 msgr2=0x7f9f8c0d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0d1a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097a0 tx=0x7f9f7c02a100 comp rx=0 tx=0).stop 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 -- 172.21.15.33:0/4112699471 shutdown_connections 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0d1fd0 0x7f9f8c160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 --2- 172.21.15.33:0/4112699471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0d1a90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 -- 172.21.15.33:0/4112699471 >> 172.21.15.33:0/4112699471 conn(0x7f9f8c06a7c0 msgr2=0x7f9f8c06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 -- 172.21.15.33:0/4112699471 shutdown_connections 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.209+0000 7f9f91a00640 1 -- 172.21.15.33:0/4112699471 wait complete. 2024-09-13T18:59:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.211+0000 7f9f91a00640 1 Processor -- start 2024-09-13T18:59:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.211+0000 7f9f91a00640 1 -- start start 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0b1c50 0x7f9f8c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c159960 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1f6620 con 0x7f9f8c15fdd0 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f91a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1f6900 con 0x7f9f8c0b1c50 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f83e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41408/0 (socket says 172.21.15.33:41408) 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.212+0000 7f9f83e00640 1 -- 172.21.15.33:0/2931502166 learned_addr learned my addr 172.21.15.33:0/2931502166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 -- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0b1c50 msgr2=0x7f9f8c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0b1c50 0x7f9f8c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f91000640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 -- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 msgr2=0x7f9f8c0b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 -- 172.21.15.33:0/2931502166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009400 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f91000640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f83e00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c430 tx=0x7f9f7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740074e0 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74007660 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74004a20 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c159c00 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.213+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c155b70 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.215+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c15a120 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.215+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f74004b80 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.216+0000 7f9f88c00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.216+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f74088ea0 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.217+0000 7f9f8be00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.217+0000 7f9f8be00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 0x7f9f6806d0c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c034000 tx=0x7f9f7c02c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.221+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9f8c15a120 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.403+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f8c15a120 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.403+0000 7f9f88c00640 1 -- 172.21.15.33:0/2931502166 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f9f8c15a120 con 0x7f9f8c0d1fd0 2024-09-13T18:59:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:15.517 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":56,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:14.578346+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.405+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 msgr2=0x7f9f6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.405+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 0x7f9f6806d0c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c034000 tx=0x7f9f7c02c000 comp rx=0 tx=0).stop 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.405+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 msgr2=0x7f9f8c1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.405+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c430 tx=0x7f9f7400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 shutdown_connections 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f6806ac00 0x7f9f6806d0c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f8c15fdd0 0x7f9f8c0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f8c0d1fd0 0x7f9f8c1f5b60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 --2- 172.21.15.33:0/2931502166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f8c0b1c50 0x7f9f8c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 >> 172.21.15.33:0/2931502166 conn(0x7f9f8c06a7c0 msgr2=0x7f9f8c15e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 shutdown_connections 2024-09-13T18:59:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.406+0000 7f9f91a00640 1 -- 172.21.15.33:0/2931502166 wait complete. 2024-09-13T18:59:15.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:15.521 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:15.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.675+0000 7fa2d9c00640 1 Processor -- start 2024-09-13T18:59:15.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.675+0000 7fa2d9c00640 1 -- start start 2024-09-13T18:59:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d9c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2d406f830 0x7fa2d406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d9c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2d4070420 0x7fa2d40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d9c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40ce490 con 0x7fa2d4154ad0 2024-09-13T18:59:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d9c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d406b5b0 con 0x7fa2d4070420 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d9c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d406b7c0 con 0x7fa2d406f830 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d2a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa2d4154ad0 0x7fa2d40cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57564/0 (socket says 172.21.15.33:57564) 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.676+0000 7fa2d2a00640 1 -- 172.21.15.33:0/1071670808 learned_addr learned my addr 172.21.15.33:0/1071670808 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d3400640 1 --2- 172.21.15.33:0/1071670808 >> v2:172.21.15.33:3300/0 conn(0x7fa2d4070420 0x7fa2d40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d1600640 1 -- 172.21.15.33:0/1071670808 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610283044 0 0) 0x7fa2d40ce490 con 0x7fa2d4154ad0 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d2000640 1 --2- 172.21.15.33:0/1071670808 >> v2:172.21.15.103:3300/0 conn(0x7fa2d406f830 0x7fa2d406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d1600640 1 -- 172.21.15.33:0/1071670808 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b8003520 con 0x7fa2d4154ad0 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d3400640 1 -- 172.21.15.33:0/1071670808 >> v2:172.21.15.103:3300/0 conn(0x7fa2d406f830 msgr2=0x7fa2d406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d3400640 1 --2- 172.21.15.33:0/1071670808 >> v2:172.21.15.103:3300/0 conn(0x7fa2d406f830 0x7fa2d406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d3400640 1 -- 172.21.15.33:0/1071670808 >> v1:172.21.15.33:6789/0 conn(0x7fa2d4154ad0 legacy=0x7fa2d40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.677+0000 7fa2d3400640 1 -- 172.21.15.33:0/1071670808 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d406baa0 con 0x7fa2d4070420 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.678+0000 7fa2d3400640 1 --2- 172.21.15.33:0/1071670808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4070420 0x7fa2d40cbac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40ae4c0 tx=0x7fa2cc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d23ad8c8e2065d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.678+0000 7fa2d1600640 1 -- 172.21.15.33:0/1071670808 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc007740 con 0x7fa2d4070420 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.678+0000 7fa2d1600640 1 -- 172.21.15.33:0/1071670808 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc02d050 con 0x7fa2d4070420 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.678+0000 7fa2d1600640 1 -- 172.21.15.33:0/1071670808 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc007ac0 con 0x7fa2d4070420 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 -- 172.21.15.33:0/1071670808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4070420 msgr2=0x7fa2d40cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/1071670808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4070420 0x7fa2d40cbac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40ae4c0 tx=0x7fa2cc02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 -- 172.21.15.33:0/1071670808 shutdown_connections 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/1071670808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4070420 0x7fa2d40cbac0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/1071670808 >> v2:172.21.15.103:3300/0 conn(0x7fa2d406f830 0x7fa2d406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 -- 172.21.15.33:0/1071670808 >> 172.21.15.33:0/1071670808 conn(0x7fa2d40b0580 msgr2=0x7fa2d40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 -- 172.21.15.33:0/1071670808 shutdown_connections 2024-09-13T18:59:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.679+0000 7fa2d9c00640 1 -- 172.21.15.33:0/1071670808 wait complete. 2024-09-13T18:59:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.681+0000 7fa2d9c00640 1 Processor -- start 2024-09-13T18:59:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.681+0000 7fa2d9c00640 1 -- start start 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2d4070420 0x7fa2d41519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2d414f6e0 0x7fa2d41f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d414fec0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d414b660 con 0x7fa2d414f6e0 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d9c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d414b940 con 0x7fa2d4070420 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41430/0 (socket says 172.21.15.33:41430) 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 -- 172.21.15.33:0/3505165033 learned_addr learned my addr 172.21.15.33:0/3505165033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 -- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2d4070420 msgr2=0x7fa2d41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2d4070420 0x7fa2d41519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 -- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2d414f6e0 msgr2=0x7fa2d41f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2d414f6e0 0x7fa2d41f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.682+0000 7fa2d2000640 1 -- 172.21.15.33:0/3505165033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009a70 con 0x7fa2d4154ad0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2d2000640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d800 tx=0x7fa2c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000b6c0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000b820 con 0x7fa2d4154ad0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000bbb0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d414bc20 con 0x7fa2d4154ad0 2024-09-13T18:59:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.683+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d414fb70 con 0x7fa2d4154ad0 2024-09-13T18:59:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.684+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d41540d0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.685+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2c000bd10 con 0x7fa2d4154ad0 2024-09-13T18:59:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.686+0000 7fa2caa00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 0x7fa2b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.686+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2c0089650 con 0x7fa2d4154ad0 2024-09-13T18:59:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.686+0000 7fa2d2a00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 0x7fa2b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.687+0000 7fa2d2a00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 0x7fa2b406d0c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001570 tx=0x7fa2c4007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.690+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa2c0054ae0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.870+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2d406fee0 con 0x7fa2d4154ad0 2024-09-13T18:59:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.871+0000 7fa2caa00640 1 -- 172.21.15.33:0/3505165033 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2c0058100 con 0x7fa2d4154ad0 2024-09-13T18:59:15.874 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 msgr2=0x7fa2b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 0x7fa2b406d0c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001570 tx=0x7fa2c4007930 comp rx=0 tx=0).stop 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 msgr2=0x7fa2d414c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d800 tx=0x7fa2c000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 shutdown_connections 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa2b406ac00 0x7fa2b406d0c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2d414f6e0 0x7fa2d41f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4154ad0 0x7fa2d414c140 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 --2- 172.21.15.33:0/3505165033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2d4070420 0x7fa2d41519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 >> 172.21.15.33:0/3505165033 conn(0x7fa2d40b0580 msgr2=0x7fa2d406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 shutdown_connections 2024-09-13T18:59:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:15.873+0000 7fa2d9c00640 1 -- 172.21.15.33:0/3505165033 wait complete. 2024-09-13T18:59:15.892 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:59:16.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.044+0000 7fb367600640 1 Processor -- start 2024-09-13T18:59:16.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.044+0000 7fb367600640 1 -- start start 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb367600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 0x7fb36006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb367600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3600cba50 0x7fb3600cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb367600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600cc3c0 con 0x7fb3600b1b30 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb367600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600ce4b0 con 0x7fb3600cba50 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb367600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600b2270 con 0x7fb360151590 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.045+0000 7fb364c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 0x7fb36006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb365600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3600cba50 0x7fb3600cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb364c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 0x7fb36006b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:51424/0 (socket says 172.21.15.33:51424) 2024-09-13T18:59:16.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb364c00640 1 -- 172.21.15.33:0/2549251065 learned_addr learned my addr 172.21.15.33:0/2549251065 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb365600640 1 -- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 msgr2=0x7fb36006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb365600640 1 --2- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 0x7fb36006b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb365600640 1 -- 172.21.15.33:0/2549251065 >> v1:172.21.15.103:6789/0 conn(0x7fb3600b1b30 legacy=0x7fb3600cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb365600640 1 -- 172.21.15.33:0/2549251065 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600b2550 con 0x7fb3600cba50 2024-09-13T18:59:16.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.046+0000 7fb35f400640 1 -- 172.21.15.33:0/2549251065 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253584561 0 0) 0x7fb3600cc3c0 con 0x7fb3600b1b30 2024-09-13T18:59:16.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.047+0000 7fb365600640 1 --2- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb3600cbe80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb358009d90 tx=0x7fb35802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27bc5b735f3ef44c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.047+0000 7fb35f400640 1 -- 172.21.15.33:0/2549251065 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358007740 con 0x7fb3600cba50 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb35f400640 1 -- 172.21.15.33:0/2549251065 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35802d050 con 0x7fb3600cba50 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb35f400640 1 -- 172.21.15.33:0/2549251065 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358007ac0 con 0x7fb3600cba50 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 -- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 msgr2=0x7fb3600cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 --2- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb3600cbe80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb358009d90 tx=0x7fb35802a660 comp rx=0 tx=0).stop 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 -- 172.21.15.33:0/2549251065 shutdown_connections 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 --2- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb3600cbe80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 --2- 172.21.15.33:0/2549251065 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb360151590 0x7fb36006b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 -- 172.21.15.33:0/2549251065 >> 172.21.15.33:0/2549251065 conn(0x7fb3600b0510 msgr2=0x7fb3600b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 -- 172.21.15.33:0/2549251065 shutdown_connections 2024-09-13T18:59:16.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.048+0000 7fb367600640 1 -- 172.21.15.33:0/2549251065 wait complete. 2024-09-13T18:59:16.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.050+0000 7fb367600640 1 Processor -- start 2024-09-13T18:59:16.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.050+0000 7fb367600640 1 -- start start 2024-09-13T18:59:16.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3600b1b30 0x7fb360155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb36014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600b00d0 con 0x7fb360151590 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36014c570 con 0x7fb3600cba50 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb367600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36014c850 con 0x7fb3600b1b30 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb365600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb365600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41432/0 (socket says 172.21.15.33:41432) 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.051+0000 7fb365600640 1 -- 172.21.15.33:0/77565699 learned_addr learned my addr 172.21.15.33:0/77565699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb364c00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3600b1b30 0x7fb360155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb35fe00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb36014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 -- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3600b1b30 msgr2=0x7fb360155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3600b1b30 0x7fb360155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 -- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 msgr2=0x7fb36014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb36014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 -- 172.21.15.33:0/77565699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009a70 con 0x7fb360151590 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb35fe00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb36014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb365600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb358009d90 tx=0x7fb358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35803c830 con 0x7fb360151590 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35803c990 con 0x7fb360151590 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35803cd00 con 0x7fb360151590 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3601556b0 con 0x7fb360151590 2024-09-13T18:59:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.052+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36014cb30 con 0x7fb360151590 2024-09-13T18:59:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.053+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36014c3d0 con 0x7fb360151590 2024-09-13T18:59:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.054+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb358031400 con 0x7fb360151590 2024-09-13T18:59:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.055+0000 7fb35cc00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 0x7fb34006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.055+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3580aa920 con 0x7fb360151590 2024-09-13T18:59:16.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.055+0000 7fb364c00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 0x7fb34006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.056+0000 7fb364c00640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 0x7fb34006d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb354009ac0 tx=0x7fb354008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.059+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb36014c3d0 con 0x7fb360151590 2024-09-13T18:59:16.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.242+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb36014c3d0 con 0x7fb360151590 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.242+0000 7fb35cc00640 1 -- 172.21.15.33:0/77565699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb36014c3d0 con 0x7fb360151590 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:16.246 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T18:59:16.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 msgr2=0x7fb34006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 0x7fb34006d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb354009ac0 tx=0x7fb354008040 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 msgr2=0x7fb36015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb358009d90 tx=0x7fb358004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 shutdown_connections 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb34006ac00 0x7fb34006d0c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb360151590 0x7fb36015cf10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3600cba50 0x7fb36014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 --2- 172.21.15.33:0/77565699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3600b1b30 0x7fb360155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 >> 172.21.15.33:0/77565699 conn(0x7fb3600b0510 msgr2=0x7fb36006b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 shutdown_connections 2024-09-13T18:59:16.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.245+0000 7fb367600640 1 -- 172.21.15.33:0/77565699 wait complete. 2024-09-13T18:59:16.264 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:59:16.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:59:16.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.420+0000 7f2b17800640 1 Processor -- start 2024-09-13T18:59:16.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.420+0000 7f2b17800640 1 -- start start 2024-09-13T18:59:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 0x7f2b100b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b100adeb0 0x7f2b100704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 0x7f2b10070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b10070030 con 0x7f2b100adeb0 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100b1d50 con 0x7f2b101592f0 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b17800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10071870 con 0x7f2b101596d0 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b07e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b100adeb0 0x7f2b100704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b07e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b100adeb0 0x7f2b100704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41446/0 (socket says 172.21.15.33:41446) 2024-09-13T18:59:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.421+0000 7f2b07e00640 1 -- 172.21.15.33:0/3644053865 learned_addr learned my addr 172.21.15.33:0/3644053865 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b14e00640 1 --2- 172.21.15.33:0/3644053865 >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 0x7f2b100b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b07e00640 1 -- 172.21.15.33:0/3644053865 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 msgr2=0x7f2b10070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b15800640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 0x7f2b10070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b07e00640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 0x7f2b10070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b07e00640 1 -- 172.21.15.33:0/3644053865 >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 msgr2=0x7f2b100b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:16.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b07e00640 1 --2- 172.21.15.33:0/3644053865 >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 0x7f2b100b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b07e00640 1 -- 172.21.15.33:0/3644053865 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1006f700 con 0x7f2b100adeb0 2024-09-13T18:59:16.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b14e00640 1 --2- 172.21.15.33:0/3644053865 >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 0x7f2b100b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:16.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.422+0000 7f2b15800640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 0x7f2b10070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:16.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.423+0000 7f2b07e00640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b100adeb0 0x7f2b100704c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b1006d8e0 tx=0x7f2af802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a1c6514758f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.423+0000 7f2b0fe00640 1 -- 172.21.15.33:0/3644053865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8032790 con 0x7f2b100adeb0 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.423+0000 7f2b0fe00640 1 -- 172.21.15.33:0/3644053865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80328f0 con 0x7f2b100adeb0 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.423+0000 7f2b0fe00640 1 -- 172.21.15.33:0/3644053865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8032c80 con 0x7f2b100adeb0 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 -- 172.21.15.33:0/3644053865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b100adeb0 msgr2=0x7f2b100704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b100adeb0 0x7f2b100704c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b1006d8e0 tx=0x7f2af802c890 comp rx=0 tx=0).stop 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 -- 172.21.15.33:0/3644053865 shutdown_connections 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101596d0 0x7f2b10070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 --2- 172.21.15.33:0/3644053865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b100adeb0 0x7f2b100704c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 --2- 172.21.15.33:0/3644053865 >> v2:172.21.15.103:3300/0 conn(0x7f2b101592f0 0x7f2b100b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 -- 172.21.15.33:0/3644053865 >> 172.21.15.33:0/3644053865 conn(0x7f2b100b0510 msgr2=0x7f2b100b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 -- 172.21.15.33:0/3644053865 shutdown_connections 2024-09-13T18:59:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.424+0000 7f2b17800640 1 -- 172.21.15.33:0/3644053865 wait complete. 2024-09-13T18:59:16.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.426+0000 7f2b17800640 1 Processor -- start 2024-09-13T18:59:16.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.426+0000 7f2b17800640 1 -- start start 2024-09-13T18:59:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b100adeb0 0x7f2b10149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101592f0 0x7f2b1014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c98b0 con 0x7f2b101596d0 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101560a0 con 0x7f2b100adeb0 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b17800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1014c910 con 0x7f2b101592f0 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41454/0 (socket says 172.21.15.33:41454) 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 -- 172.21.15.33:0/2535977637 learned_addr learned my addr 172.21.15.33:0/2535977637 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b14e00640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b100adeb0 0x7f2b10149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 -- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101592f0 msgr2=0x7f2b1014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101592f0 0x7f2b1014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 -- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b100adeb0 msgr2=0x7f2b10149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b100adeb0 0x7f2b10149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.427+0000 7f2b15800640 1 -- 172.21.15.33:0/2535977637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af800b770 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b15800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800cca0 tx=0x7f2b0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800f680 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0800f800 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1014cbf0 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800fbb0 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.428+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b10149950 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.429+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b100c99f0 con 0x7f2b101596d0 2024-09-13T18:59:16.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.430+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b0800b040 con 0x7f2b101596d0 2024-09-13T18:59:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.431+0000 7f2b0d600640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 0x7f2aec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.431+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b08089a00 con 0x7f2b101596d0 2024-09-13T18:59:16.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.431+0000 7f2b14e00640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 0x7f2aec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:16.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.432+0000 7f2b14e00640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 0x7f2aec06d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b00006fd0 tx=0x7f2b00008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:16.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.435+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b100c99f0 con 0x7f2b101596d0 2024-09-13T18:59:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:16.614+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2b100c99f0 con 0x7f2b101596d0 2024-09-13T18:59:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.213+0000 7f2b0d600640 1 -- 172.21.15.33:0/2535977637 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b100c99f0 con 0x7f2b101596d0 2024-09-13T18:59:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T18:59:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 msgr2=0x7f2aec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 0x7f2aec06d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b00006fd0 tx=0x7f2b00008040 comp rx=0 tx=0).stop 2024-09-13T18:59:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 msgr2=0x7f2b1014c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800cca0 tx=0x7f2b0800a650 comp rx=0 tx=0).stop 2024-09-13T18:59:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 shutdown_connections 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2aec06ac00 0x7f2aec06d0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b101596d0 0x7f2b1014c2e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b101592f0 0x7f2b1014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 --2- 172.21.15.33:0/2535977637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b100adeb0 0x7f2b10149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.217+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 >> 172.21.15.33:0/2535977637 conn(0x7f2b100b0510 msgr2=0x7f2b100ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.218+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 shutdown_connections 2024-09-13T18:59:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.218+0000 7f2b17800640 1 -- 172.21.15.33:0/2535977637 wait complete. 2024-09-13T18:59:17.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:59:17.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.400+0000 7f01cf400640 1 Processor -- start 2024-09-13T18:59:17.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.400+0000 7f01cf400640 1 -- start start 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.401+0000 7f01cf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.401+0000 7f01cf400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c806f5f0 con 0x7f01c8071690 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.401+0000 7f01cf400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c8070450 con 0x7f01c8156f60 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.401+0000 7f01cf400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815aa30 con 0x7f01c80cafa0 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f01c8071690 0x7f01c80cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57576/0 (socket says 172.21.15.33:57576) 2024-09-13T18:59:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7e00640 1 -- 172.21.15.33:0/1834789417 learned_addr learned my addr 172.21.15.33:0/1834789417 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01cd400640 1 --2- 172.21.15.33:0/1834789417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913889150 0 0) 0x7f01c806f5f0 con 0x7f01c8071690 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b0003520 con 0x7f01c8071690 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576422165 0 0) 0x7f01c8070450 con 0x7f01c8156f60 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c806f5f0 con 0x7f01c8156f60 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3750182641 0 0) 0x7f01b0003520 con 0x7f01c8071690 2024-09-13T18:59:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01cd400640 1 -- 172.21.15.33:0/1834789417 >> v1:172.21.15.103:6789/0 conn(0x7f01c8156f60 legacy=0x7f01c8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01cd400640 1 -- 172.21.15.33:0/1834789417 >> v1:172.21.15.33:6789/0 conn(0x7f01c8071690 legacy=0x7f01c80cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.402+0000 7f01cd400640 1 -- 172.21.15.33:0/1834789417 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c806f840 con 0x7f01c80cafa0 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01cd400640 1 --2- 172.21.15.33:0/1834789417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c815a4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009dc0 tx=0x7f01c002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03834a61332db85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4001670 con 0x7f01c80cafa0 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c002d050 con 0x7f01c80cafa0 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01c7400640 1 -- 172.21.15.33:0/1834789417 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0007740 con 0x7f01c80cafa0 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01cf400640 1 -- 172.21.15.33:0/1834789417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 msgr2=0x7f01c815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01cf400640 1 --2- 172.21.15.33:0/1834789417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c815a4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009dc0 tx=0x7f01c002a660 comp rx=0 tx=0).stop 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01cf400640 1 -- 172.21.15.33:0/1834789417 shutdown_connections 2024-09-13T18:59:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.404+0000 7f01cf400640 1 --2- 172.21.15.33:0/1834789417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c815a4f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.405+0000 7f01cf400640 1 -- 172.21.15.33:0/1834789417 >> 172.21.15.33:0/1834789417 conn(0x7f01c80b0580 msgr2=0x7f01c80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.405+0000 7f01cf400640 1 -- 172.21.15.33:0/1834789417 shutdown_connections 2024-09-13T18:59:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.405+0000 7f01cf400640 1 -- 172.21.15.33:0/1834789417 wait complete. 2024-09-13T18:59:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.406+0000 7f01cf400640 1 Processor -- start 2024-09-13T18:59:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.406+0000 7f01cf400640 1 -- start start 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01c8071690 0x7f01c80a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c8149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815c310 con 0x7f01c8156f60 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815c5f0 con 0x7f01c8071690 2024-09-13T18:59:17.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cf400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815c8d0 con 0x7f01c80cafa0 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41470/0 (socket says 172.21.15.33:41470) 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.407+0000 7f01cd400640 1 -- 172.21.15.33:0/3799871368 learned_addr learned my addr 172.21.15.33:0/3799871368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cca00640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01c8071690 0x7f01c80a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01c7e00640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c8149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 -- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 msgr2=0x7f01c8149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c8149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 -- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01c8071690 msgr2=0x7f01c80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01c8071690 0x7f01c80a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 -- 172.21.15.33:0/3799871368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009a70 con 0x7f01c8156f60 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.408+0000 7f01cd400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ee0 tx=0x7f01c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.409+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c003c830 con 0x7f01c8156f60 2024-09-13T18:59:17.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.409+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c003c990 con 0x7f01c8156f60 2024-09-13T18:59:17.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.409+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c815cbb0 con 0x7f01c8156f60 2024-09-13T18:59:17.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.409+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c003cd20 con 0x7f01c8156f60 2024-09-13T18:59:17.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.409+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8153dd0 con 0x7f01c8156f60 2024-09-13T18:59:17.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.410+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c815d0d0 con 0x7f01c8156f60 2024-09-13T18:59:17.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.411+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f01c0031400 con 0x7f01c8156f60 2024-09-13T18:59:17.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.412+0000 7f01c4c00640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:17.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.412+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f01c00aa490 con 0x7f01c8156f60 2024-09-13T18:59:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.412+0000 7f01cca00640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.413+0000 7f01cca00640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0011e0 tx=0x7f01bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.417+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01c0075860 con 0x7f01c8156f60 2024-09-13T18:59:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:17.598+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01c8157340 con 0x7f01c8156f60 2024-09-13T18:59:18.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.223+0000 7f01c4c00640 1 -- 172.21.15.33:0/3799871368 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7f01c0078e80 con 0x7f01c8156f60 2024-09-13T18:59:18.227 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T18:59:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.229+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 msgr2=0x7f01a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.229+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0011e0 tx=0x7f01bc009040 comp rx=0 tx=0).stop 2024-09-13T18:59:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.230+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 msgr2=0x7f01c80a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.230+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ee0 tx=0x7f01c0004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 shutdown_connections 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01a806ac00 0x7f01a806d0c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01c8156f60 0x7f01c80a9040 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01c80cafa0 0x7f01c8149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 --2- 172.21.15.33:0/3799871368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01c8071690 0x7f01c80a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.231+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 >> 172.21.15.33:0/3799871368 conn(0x7f01c80b0580 msgr2=0x7f01c80b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.232+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 shutdown_connections 2024-09-13T18:59:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.233+0000 7f01cf400640 1 -- 172.21.15.33:0/3799871368 wait complete. 2024-09-13T18:59:18.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:59:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.420+0000 7fde57600640 1 Processor -- start 2024-09-13T18:59:18.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.420+0000 7fde57600640 1 -- start start 2024-09-13T18:59:18.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.421+0000 7fde57600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fde5006f830 0x7fde5006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.421+0000 7fde57600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500ce490 con 0x7fde50070420 2024-09-13T18:59:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.421+0000 7fde57600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5006b7c0 con 0x7fde50154ad0 2024-09-13T18:59:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.421+0000 7fde57600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5006b5b0 con 0x7fde5006f830 2024-09-13T18:59:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde4fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fde5006f830 0x7fde5006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde55600640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fde50070420 0x7fde500cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57592/0 (socket says 172.21.15.33:57592) 2024-09-13T18:59:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde55600640 1 -- 172.21.15.33:0/1978247780 learned_addr learned my addr 172.21.15.33:0/1978247780 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde4fe00640 1 -- 172.21.15.33:0/1978247780 >> v1:172.21.15.103:6789/0 conn(0x7fde50154ad0 legacy=0x7fde500cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde4fe00640 1 -- 172.21.15.33:0/1978247780 >> v1:172.21.15.33:6789/0 conn(0x7fde50070420 legacy=0x7fde500cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.422+0000 7fde4fe00640 1 -- 172.21.15.33:0/1978247780 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5006baa0 con 0x7fde5006f830 2024-09-13T18:59:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.423+0000 7fde4fe00640 1 --2- 172.21.15.33:0/1978247780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde5006f830 0x7fde5006fee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0097a0 tx=0x7fde3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2fb33a0283e0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde4f400640 1 -- 172.21.15.33:0/1978247780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c032440 con 0x7fde5006f830 2024-09-13T18:59:18.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde4f400640 1 -- 172.21.15.33:0/1978247780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0325a0 con 0x7fde5006f830 2024-09-13T18:59:18.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde4f400640 1 -- 172.21.15.33:0/1978247780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c032930 con 0x7fde5006f830 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 -- 172.21.15.33:0/1978247780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde5006f830 msgr2=0x7fde5006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 --2- 172.21.15.33:0/1978247780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde5006f830 0x7fde5006fee0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0097a0 tx=0x7fde3c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 -- 172.21.15.33:0/1978247780 shutdown_connections 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 --2- 172.21.15.33:0/1978247780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde5006f830 0x7fde5006fee0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 -- 172.21.15.33:0/1978247780 >> 172.21.15.33:0/1978247780 conn(0x7fde500b0580 msgr2=0x7fde500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 -- 172.21.15.33:0/1978247780 shutdown_connections 2024-09-13T18:59:18.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.424+0000 7fde57600640 1 -- 172.21.15.33:0/1978247780 wait complete. 2024-09-13T18:59:18.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.426+0000 7fde57600640 1 Processor -- start 2024-09-13T18:59:18.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.426+0000 7fde57600640 1 -- start start 2024-09-13T18:59:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde50070420 0x7fde5014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde5014fb10 0x7fde5015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5013e4c0 con 0x7fde50154ad0 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50150010 con 0x7fde5014fb10 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde57600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5014d950 con 0x7fde50070420 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde54c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde50070420 0x7fde5014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41492/0 (socket says 172.21.15.33:41492) 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde4fe00640 1 -- 172.21.15.33:0/2295778122 learned_addr learned my addr 172.21.15.33:0/2295778122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:18.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.427+0000 7fde55600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde5014fb10 0x7fde5015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 -- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde50070420 msgr2=0x7fde5014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde50070420 0x7fde5014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 -- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde5014fb10 msgr2=0x7fde5015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde5014fb10 0x7fde5015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 -- 172.21.15.33:0/2295778122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009400 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4fe00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0096f0 tx=0x7fde3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c030b80 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c030ce0 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03c640 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.428+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5014dc30 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.429+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5014d570 con 0x7fde50154ad0 2024-09-13T18:59:18.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.430+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500cc260 con 0x7fde50154ad0 2024-09-13T18:59:18.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.432+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde3c03c7a0 con 0x7fde50154ad0 2024-09-13T18:59:18.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.432+0000 7fde4cc00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 0x7fde3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.432+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fde3c0aa7b0 con 0x7fde50154ad0 2024-09-13T18:59:18.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.433+0000 7fde54c00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 0x7fde3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.434+0000 7fde54c00640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 0x7fde3006d0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde440016e0 tx=0x7fde44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.436+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fde3c075ba0 con 0x7fde50154ad0 2024-09-13T18:59:18.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.655+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fde500cddf0 con 0x7fde50154ad0 2024-09-13T18:59:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.661+0000 7fde4cc00640 1 -- 172.21.15.33:0/2295778122 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fde3c006e10 con 0x7fde50154ad0 2024-09-13T18:59:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 8 and data pool 9 2024-09-13T18:59:18.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.668+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 msgr2=0x7fde3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.668+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 0x7fde3006d0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde440016e0 tx=0x7fde44009040 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.668+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 msgr2=0x7fde5013df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.668+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0096f0 tx=0x7fde3c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 shutdown_connections 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fde3006ac30 0x7fde3006d0f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde5014fb10 0x7fde5015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde50154ad0 0x7fde5013df80 secure :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0096f0 tx=0x7fde3c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 --2- 172.21.15.33:0/2295778122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde50070420 0x7fde5014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.669+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 >> 172.21.15.33:0/2295778122 conn(0x7fde500b0580 msgr2=0x7fde50152150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.671+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 shutdown_connections 2024-09-13T18:59:18.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.672+0000 7fde57600640 1 -- 172.21.15.33:0/2295778122 wait complete. 2024-09-13T18:59:18.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.855+0000 7f4718a00640 1 Processor -- start 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.855+0000 7f4718a00640 1 -- start start 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4718a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f47140b2a30 0x7f471406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4718a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f47140adcb0 0x7f47140cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4718a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714070110 con 0x7f4714160d10 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4718a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47141610f0 con 0x7f47140b2a30 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4718a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140703f0 con 0x7f47140adcb0 2024-09-13T18:59:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f470be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f47140b2a30 0x7f471406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f470be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f47140b2a30 0x7f471406bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41504/0 (socket says 172.21.15.33:41504) 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f470be00640 1 -- 172.21.15.33:0/1519544241 learned_addr learned my addr 172.21.15.33:0/1519544241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.857+0000 7f4712800640 1 --2- 172.21.15.33:0/1519544241 >> v2:172.21.15.103:3300/0 conn(0x7f47140adcb0 0x7f47140cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.858+0000 7f470be00640 1 -- 172.21.15.33:0/1519544241 >> v2:172.21.15.103:3300/0 conn(0x7f47140adcb0 msgr2=0x7f47140cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.858+0000 7f470be00640 1 --2- 172.21.15.33:0/1519544241 >> v2:172.21.15.103:3300/0 conn(0x7f47140adcb0 0x7f47140cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.858+0000 7f470be00640 1 -- 172.21.15.33:0/1519544241 >> v1:172.21.15.103:6789/0 conn(0x7f4714160d10 legacy=0x7f47140b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.858+0000 7f470be00640 1 -- 172.21.15.33:0/1519544241 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140706d0 con 0x7f47140b2a30 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f470be00640 1 --2- 172.21.15.33:0/1519544241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140b2a30 0x7f471406bb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f47140b3170 tx=0x7f46fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d0452c01bd4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f4711400640 1 -- 172.21.15.33:0/1519544241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc032440 con 0x7f47140b2a30 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f4711400640 1 -- 172.21.15.33:0/1519544241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0325a0 con 0x7f47140b2a30 2024-09-13T18:59:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f4711400640 1 -- 172.21.15.33:0/1519544241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc032930 con 0x7f47140b2a30 2024-09-13T18:59:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f4718a00640 1 -- 172.21.15.33:0/1519544241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140b2a30 msgr2=0x7f471406bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.859+0000 7f4718a00640 1 --2- 172.21.15.33:0/1519544241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140b2a30 0x7f471406bb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f47140b3170 tx=0x7f46fc02a270 comp rx=0 tx=0).stop 2024-09-13T18:59:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 -- 172.21.15.33:0/1519544241 shutdown_connections 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 --2- 172.21.15.33:0/1519544241 >> v2:172.21.15.103:3300/0 conn(0x7f47140adcb0 0x7f47140cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 --2- 172.21.15.33:0/1519544241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140b2a30 0x7f471406bb60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 -- 172.21.15.33:0/1519544241 >> 172.21.15.33:0/1519544241 conn(0x7f47140b0510 msgr2=0x7f47140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 -- 172.21.15.33:0/1519544241 shutdown_connections 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.860+0000 7f4718a00640 1 -- 172.21.15.33:0/1519544241 wait complete. 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.861+0000 7f4718a00640 1 Processor -- start 2024-09-13T18:59:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.861+0000 7f4718a00640 1 -- start start 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47140b2a30 0x7f47141575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4714160d10 0x7f4714158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714157f30 con 0x7f47140adcb0 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714158210 con 0x7f47140b2a30 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4718a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47141584f0 con 0x7f4714160d10 2024-09-13T18:59:18.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4711e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4711e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41506/0 (socket says 172.21.15.33:41506) 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.862+0000 7f4711e00640 1 -- 172.21.15.33:0/1119214722 learned_addr learned my addr 172.21.15.33:0/1119214722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4712800640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4714160d10 0x7f4714158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f470be00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47140b2a30 0x7f47141575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 -- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4714160d10 msgr2=0x7f4714158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4714160d10 0x7f4714158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 -- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47140b2a30 msgr2=0x7f47141575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47140b2a30 0x7f47141575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 -- 172.21.15.33:0/1119214722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0094d0 con 0x7f47140adcb0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f4711e00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f470400c400 tx=0x7f470400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.863+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040052d0 con 0x7f47140adcb0 2024-09-13T18:59:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.864+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704005430 con 0x7f47140adcb0 2024-09-13T18:59:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.864+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003830 con 0x7f47140adcb0 2024-09-13T18:59:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.864+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47141587d0 con 0x7f47140adcb0 2024-09-13T18:59:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.864+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4714156e00 con 0x7f47140adcb0 2024-09-13T18:59:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.865+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4714164560 con 0x7f47140adcb0 2024-09-13T18:59:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.866+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4704003990 con 0x7f47140adcb0 2024-09-13T18:59:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.866+0000 7f470a000640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 0x7f46f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.866+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47040888c0 con 0x7f47140adcb0 2024-09-13T18:59:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.867+0000 7f470be00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 0x7f46f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.867+0000 7f470be00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 0x7f46f006d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f46fc034000 tx=0x7f46fc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:18.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:18.871+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4704053ab0 con 0x7f47140adcb0 2024-09-13T18:59:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.049+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47140b2f50 con 0x7f47140adcb0 2024-09-13T18:59:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.050+0000 7f470a000640 1 -- 172.21.15.33:0/1119214722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16578 (secure 0 0 0) 0x7f4704017090 con 0x7f47140adcb0 2024-09-13T18:59:19.054 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:19.054 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:18.657103+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.052+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 msgr2=0x7f46f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.052+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 0x7f46f006d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f46fc034000 tx=0x7f46fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.052+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 msgr2=0x7f47141568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.052+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f470400c400 tx=0x7f470400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 shutdown_connections 2024-09-13T18:59:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f46f006ac00 0x7f46f006d0c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4714160d10 0x7f4714158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47140b2a30 0x7f47141575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 --2- 172.21.15.33:0/1119214722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47140adcb0 0x7f47141568c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 >> 172.21.15.33:0/1119214722 conn(0x7f47140b0510 msgr2=0x7f47140cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 shutdown_connections 2024-09-13T18:59:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.053+0000 7f4718a00640 1 -- 172.21.15.33:0/1119214722 wait complete. 2024-09-13T18:59:19.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:19.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.225+0000 7fd466c00640 1 Processor -- start 2024-09-13T18:59:19.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.225+0000 7fd466c00640 1 -- start start 2024-09-13T18:59:19.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd466c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4600d1c40 0x7fd4600b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd466c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4600b5c20 con 0x7fd4600b47e0 2024-09-13T18:59:19.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd466c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4600b5920 con 0x7fd46015c9d0 2024-09-13T18:59:19.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd466c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600cd690 con 0x7fd4600d1c40 2024-09-13T18:59:19.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd466200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4600d1c40 0x7fd4600b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd464e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd4600b47e0 0x7fd4600b60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57606/0 (socket says 172.21.15.33:57606) 2024-09-13T18:59:19.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.226+0000 7fd464e00640 1 -- 172.21.15.33:0/3707919274 learned_addr learned my addr 172.21.15.33:0/3707919274 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:19.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.227+0000 7fd466200640 1 -- 172.21.15.33:0/3707919274 >> v1:172.21.15.103:6789/0 conn(0x7fd46015c9d0 legacy=0x7fd4600b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.227+0000 7fd466200640 1 -- 172.21.15.33:0/3707919274 >> v1:172.21.15.33:6789/0 conn(0x7fd4600b47e0 legacy=0x7fd4600b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.227+0000 7fd466200640 1 -- 172.21.15.33:0/3707919274 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600cd930 con 0x7fd4600d1c40 2024-09-13T18:59:19.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.227+0000 7fd45fe00640 1 -- 172.21.15.33:0/3707919274 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15736648 0 0) 0x7fd4600b5c20 con 0x7fd4600b47e0 2024-09-13T18:59:19.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd466200640 1 --2- 172.21.15.33:0/3707919274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4600b67c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd458009d90 tx=0x7fd45802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7117e70bee7b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd45fe00640 1 -- 172.21.15.33:0/3707919274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458007740 con 0x7fd4600d1c40 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd45fe00640 1 -- 172.21.15.33:0/3707919274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45802d050 con 0x7fd4600d1c40 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd45fe00640 1 -- 172.21.15.33:0/3707919274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458007ac0 con 0x7fd4600d1c40 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd466c00640 1 -- 172.21.15.33:0/3707919274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 msgr2=0x7fd4600b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.228+0000 7fd466c00640 1 --2- 172.21.15.33:0/3707919274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4600b67c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd458009d90 tx=0x7fd45802a660 comp rx=0 tx=0).stop 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.229+0000 7fd466c00640 1 -- 172.21.15.33:0/3707919274 shutdown_connections 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.229+0000 7fd466c00640 1 --2- 172.21.15.33:0/3707919274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4600b67c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.229+0000 7fd466c00640 1 -- 172.21.15.33:0/3707919274 >> 172.21.15.33:0/3707919274 conn(0x7fd4600cf0d0 msgr2=0x7fd4600cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:19.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.229+0000 7fd466c00640 1 -- 172.21.15.33:0/3707919274 shutdown_connections 2024-09-13T18:59:19.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.229+0000 7fd466c00640 1 -- 172.21.15.33:0/3707919274 wait complete. 2024-09-13T18:59:19.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.230+0000 7fd466c00640 1 Processor -- start 2024-09-13T18:59:19.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.230+0000 7fd466c00640 1 -- start start 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd4600b47e0 0x7fd4600c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 0x7fd4601f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c6af0 con 0x7fd4600d1c40 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c6dd0 con 0x7fd46015c9d0 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd466c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c70b0 con 0x7fd4600b47e0 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd464e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd464e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41514/0 (socket says 172.21.15.33:41514) 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.231+0000 7fd464e00640 1 -- 172.21.15.33:0/938724640 learned_addr learned my addr 172.21.15.33:0/938724640 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd466200640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 0x7fd4601f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd465800640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd4600b47e0 0x7fd4600c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 -- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd4600b47e0 msgr2=0x7fd4600c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd4600b47e0 0x7fd4600c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 -- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 msgr2=0x7fd4601f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 0x7fd4601f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 -- 172.21.15.33:0/938724640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009a70 con 0x7fd4600d1c40 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd466200640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 0x7fd4601f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd464e00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c4a0 tx=0x7fd44c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.232+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0074e0 con 0x7fd4600d1c40 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.233+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c007640 con 0x7fd4600d1c40 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.233+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c004a00 con 0x7fd4600d1c40 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.233+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4600c7390 con 0x7fd4600d1c40 2024-09-13T18:59:19.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.233+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4600c66c0 con 0x7fd4600d1c40 2024-09-13T18:59:19.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.234+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4600cfd30 con 0x7fd4600d1c40 2024-09-13T18:59:19.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.235+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd44c004b60 con 0x7fd4600d1c40 2024-09-13T18:59:19.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.236+0000 7fd45d600640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 0x7fd44006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.236+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44c088420 con 0x7fd4600d1c40 2024-09-13T18:59:19.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.236+0000 7fd465800640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 0x7fd44006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.237+0000 7fd465800640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 0x7fd44006d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f60 tx=0x7fd454009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.241+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd44c0536a0 con 0x7fd4600d1c40 2024-09-13T18:59:19.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.423+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4600b40d0 con 0x7fd4600d1c40 2024-09-13T18:59:19.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.425+0000 7fd45d600640 1 -- 172.21.15.33:0/938724640 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16578 (secure 0 0 0) 0x7fd44c056cc0 con 0x7fd4600d1c40 2024-09-13T18:59:19.428 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:19.428 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:18.657103+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 msgr2=0x7fd44006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 0x7fd44006d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f60 tx=0x7fd454009040 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 msgr2=0x7fd4601f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c4a0 tx=0x7fd44c00c960 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 shutdown_connections 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd44006ac00 0x7fd44006d0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46015c9d0 0x7fd4601f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4600d1c40 0x7fd4601f2190 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 --2- 172.21.15.33:0/938724640 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd4600b47e0 0x7fd4600c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 >> 172.21.15.33:0/938724640 conn(0x7fd4600cf0d0 msgr2=0x7fd4600d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 shutdown_connections 2024-09-13T18:59:19.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.427+0000 7fd466c00640 1 -- 172.21.15.33:0/938724640 wait complete. 2024-09-13T18:59:19.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:59:19.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.601+0000 7f501d800640 1 Processor -- start 2024-09-13T18:59:19.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.601+0000 7f501d800640 1 -- start start 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.602+0000 7f501d800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 0x7f501815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.602+0000 7f501d800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5018071690 0x7f50180cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.602+0000 7f501d800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501806f5f0 con 0x7f50180cafa0 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.602+0000 7f501d800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501815aa30 con 0x7f5018071690 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.602+0000 7f501d800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5018070450 con 0x7f5018156f60 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5016000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f50180cafa0 0x7f5018070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57622/0 (socket says 172.21.15.33:57622) 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5016000640 1 -- 172.21.15.33:0/772272261 learned_addr learned my addr 172.21.15.33:0/772272261 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5016a00640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 0x7f501815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5017400640 1 --2- 172.21.15.33:0/772272261 >> v2:172.21.15.103:3300/0 conn(0x7f5018071690 0x7f50180cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669771539 0 0) 0x7f501806f5f0 con 0x7f50180cafa0 2024-09-13T18:59:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ffc003520 con 0x7f50180cafa0 2024-09-13T18:59:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009741288 0 0) 0x7f4ffc003520 con 0x7f50180cafa0 2024-09-13T18:59:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5017400640 1 -- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 msgr2=0x7f501815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5017400640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 0x7f501815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5017400640 1 -- 172.21.15.33:0/772272261 >> v1:172.21.15.33:6789/0 conn(0x7f50180cafa0 legacy=0x7f5018070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5017400640 1 -- 172.21.15.33:0/772272261 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501806f840 con 0x7f5018071690 2024-09-13T18:59:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.603+0000 7f5016a00640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 0x7f501815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f5017400640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5018071690 0x7f50180cc8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f501002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533d55c7f2a17fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004001670 con 0x7f5018071690 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501002d050 con 0x7f5018071690 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f5015600640 1 -- 172.21.15.33:0/772272261 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010007760 con 0x7f5018071690 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f501d800640 1 -- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5018071690 msgr2=0x7f50180cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f501d800640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5018071690 0x7f50180cc8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f501002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f501d800640 1 -- 172.21.15.33:0/772272261 shutdown_connections 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f501d800640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5018071690 0x7f50180cc8b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.605+0000 7f501d800640 1 --2- 172.21.15.33:0/772272261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018156f60 0x7f501815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.606+0000 7f501d800640 1 -- 172.21.15.33:0/772272261 >> 172.21.15.33:0/772272261 conn(0x7f50180b0580 msgr2=0x7f50180b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:19.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.606+0000 7f501d800640 1 -- 172.21.15.33:0/772272261 shutdown_connections 2024-09-13T18:59:19.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.606+0000 7f501d800640 1 -- 172.21.15.33:0/772272261 wait complete. 2024-09-13T18:59:19.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.607+0000 7f501d800640 1 Processor -- start 2024-09-13T18:59:19.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.607+0000 7f501d800640 1 -- start start 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 0x7f501814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 0x7f501814d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018157fe0 con 0x7f5018156f60 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501814e260 con 0x7f50180cafa0 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f501d800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501814e540 con 0x7f5018071690 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.608+0000 7f5017400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41524/0 (socket says 172.21.15.33:41524) 2024-09-13T18:59:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 -- 172.21.15.33:0/1802998224 learned_addr learned my addr 172.21.15.33:0/1802998224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5016a00640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 0x7f501814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5016000640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 0x7f501814d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 -- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 msgr2=0x7f501814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 0x7f501814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 -- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 msgr2=0x7f501814d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 0x7f501814d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 -- 172.21.15.33:0/1802998224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008009400 con 0x7f5018156f60 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5016a00640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 0x7f501814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5016000640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 0x7f501814d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.609+0000 7f5017400640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f5010004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.610+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501003c830 con 0x7f5018156f60 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.610+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501003c990 con 0x7f5018156f60 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.610+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501003cd00 con 0x7f5018156f60 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.610+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5010009a70 con 0x7f5018156f60 2024-09-13T18:59:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.610+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501815dd00 con 0x7f5018156f60 2024-09-13T18:59:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.611+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501815de90 con 0x7f5018156f60 2024-09-13T18:59:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.612+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f501002ad50 con 0x7f5018156f60 2024-09-13T18:59:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.612+0000 7f500ea00640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 0x7f4ff806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.613+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50100aa860 con 0x7f5018156f60 2024-09-13T18:59:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.613+0000 7f5016a00640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 0x7f4ff806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.614+0000 7f5016a00640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 0x7f4ff806d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5008009bb0 tx=0x7f5008008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.617+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5010075a30 con 0x7f5018156f60 2024-09-13T18:59:19.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:19.833+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5018157ab0 con 0x7f5018156f60 2024-09-13T18:59:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.672+0000 7f500ea00640 1 -- 172.21.15.33:0/1802998224 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f501003ce60 con 0x7f5018156f60 2024-09-13T18:59:20.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 msgr2=0x7f4ff806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 0x7f4ff806d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5008009bb0 tx=0x7f5008008040 comp rx=0 tx=0).stop 2024-09-13T18:59:20.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 msgr2=0x7f501815ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f5010004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 shutdown_connections 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ff806ac00 0x7f4ff806d0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5018156f60 0x7f501815ba20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50180cafa0 0x7f501814d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 --2- 172.21.15.33:0/1802998224 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5018071690 0x7f501814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 >> 172.21.15.33:0/1802998224 conn(0x7f50180b0580 msgr2=0x7f50180af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 shutdown_connections 2024-09-13T18:59:20.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.676+0000 7f501d800640 1 -- 172.21.15.33:0/1802998224 wait complete. 2024-09-13T18:59:20.698 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:59:20.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:59:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.858+0000 7fed3d200640 1 Processor -- start 2024-09-13T18:59:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.858+0000 7fed3d200640 1 -- start start 2024-09-13T18:59:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.859+0000 7fed3d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.859+0000 7fed3d200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed380cafa0 0x7fed380cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.859+0000 7fed3d200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3806f5f0 con 0x7fed38156f60 2024-09-13T18:59:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.859+0000 7fed3d200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3815aa30 con 0x7fed380cafa0 2024-09-13T18:59:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.859+0000 7fed3d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed38070450 con 0x7fed38071690 2024-09-13T18:59:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed36800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed380cafa0 0x7fed380cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:51516/0 (socket says 172.21.15.33:51516) 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 -- 172.21.15.33:0/4074402888 learned_addr learned my addr 172.21.15.33:0/4074402888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 -- 172.21.15.33:0/4074402888 >> v2:172.21.15.103:3300/0 conn(0x7fed380cafa0 msgr2=0x7fed380cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 --2- 172.21.15.33:0/4074402888 >> v2:172.21.15.103:3300/0 conn(0x7fed380cafa0 0x7fed380cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 -- 172.21.15.33:0/4074402888 >> v1:172.21.15.103:6789/0 conn(0x7fed38156f60 legacy=0x7fed38070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.860+0000 7fed2d400640 1 -- 172.21.15.33:0/4074402888 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3806f840 con 0x7fed38071690 2024-09-13T18:59:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.861+0000 7fed2d400640 1 --2- 172.21.15.33:0/4074402888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38c5cd49a1647e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed35400640 1 -- 172.21.15.33:0/4074402888 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20032440 con 0x7fed38071690 2024-09-13T18:59:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed35400640 1 -- 172.21.15.33:0/4074402888 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200325a0 con 0x7fed38071690 2024-09-13T18:59:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed35400640 1 -- 172.21.15.33:0/4074402888 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20032930 con 0x7fed38071690 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 -- 172.21.15.33:0/4074402888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 msgr2=0x7fed3815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 --2- 172.21.15.33:0/4074402888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002a250 comp rx=0 tx=0).stop 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 -- 172.21.15.33:0/4074402888 shutdown_connections 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 --2- 172.21.15.33:0/4074402888 >> v2:172.21.15.103:3300/0 conn(0x7fed380cafa0 0x7fed380cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 --2- 172.21.15.33:0/4074402888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3815a4f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 -- 172.21.15.33:0/4074402888 >> 172.21.15.33:0/4074402888 conn(0x7fed380b0580 msgr2=0x7fed380b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 -- 172.21.15.33:0/4074402888 shutdown_connections 2024-09-13T18:59:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.862+0000 7fed3d200640 1 -- 172.21.15.33:0/4074402888 wait complete. 2024-09-13T18:59:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.864+0000 7fed3d200640 1 Processor -- start 2024-09-13T18:59:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.864+0000 7fed3d200640 1 -- start start 2024-09-13T18:59:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed38156f60 0x7fed38158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3814b250 con 0x7fed380cafa0 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3815b340 con 0x7fed38156f60 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed3d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3815b620 con 0x7fed38071690 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed2d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed2d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41538/0 (socket says 172.21.15.33:41538) 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed2d400640 1 -- 172.21.15.33:0/1316096026 learned_addr learned my addr 172.21.15.33:0/1316096026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed36800640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed38156f60 0x7fed38158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.865+0000 7fed35e00640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 -- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 msgr2=0x7fed3814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3814ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 -- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed38156f60 msgr2=0x7fed38158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed38156f60 0x7fed38158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 -- 172.21.15.33:0/1316096026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200094d0 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2d400640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20032440 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed20030980 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3815b900 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.866+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20030d30 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.867+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3815bec0 con 0x7fed380cafa0 2024-09-13T18:59:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.868+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3815c0b0 con 0x7fed380cafa0 2024-09-13T18:59:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.868+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed20039040 con 0x7fed380cafa0 2024-09-13T18:59:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.869+0000 7fed2ea00640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 0x7fed1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.869+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed200a9b80 con 0x7fed380cafa0 2024-09-13T18:59:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.870+0000 7fed35e00640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 0x7fed1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.870+0000 7fed35e00640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 0x7fed1406d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed3814bb90 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:20.874+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fed20074df0 con 0x7fed380cafa0 2024-09-13T18:59:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.089+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed38157340 con 0x7fed380cafa0 2024-09-13T18:59:21.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.678+0000 7fed2ea00640 1 -- 172.21.15.33:0/1316096026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed20078410 con 0x7fed380cafa0 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 msgr2=0x7fed1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 0x7fed1406d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed3814bb90 tx=0x7fed28009040 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 msgr2=0x7fed3814bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed200046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 shutdown_connections 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fed1406ac00 0x7fed1406d0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed38156f60 0x7fed38158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed380cafa0 0x7fed3814bda0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 --2- 172.21.15.33:0/1316096026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed38071690 0x7fed3814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 >> 172.21.15.33:0/1316096026 conn(0x7fed380b0580 msgr2=0x7fed3806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:21.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 shutdown_connections 2024-09-13T18:59:21.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.680+0000 7fed3d200640 1 -- 172.21.15.33:0/1316096026 wait complete. 2024-09-13T18:59:21.701 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:59:21.701 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:21.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.854+0000 7fcadee00640 1 Processor -- start 2024-09-13T18:59:21.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.854+0000 7fcadee00640 1 -- start start 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.855+0000 7fcadee00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcad80b1b00 0x7fcad80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.855+0000 7fcadee00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad806bea0 con 0x7fcad815a520 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.855+0000 7fcadee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad806c180 con 0x7fcad80cde50 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.855+0000 7fcadee00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad806c460 con 0x7fcad80b1b00 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcad815a520 0x7fcad806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57634/0 (socket says 172.21.15.33:57634) 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7e00640 1 -- 172.21.15.33:0/1442298186 learned_addr learned my addr 172.21.15.33:0/1442298186 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:21.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7400640 1 --2- 172.21.15.33:0/1442298186 >> v2:172.21.15.33:3300/0 conn(0x7fcad80b1b00 0x7fcad80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:21.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad6a00640 1 -- 172.21.15.33:0/1442298186 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255151857 0 0) 0x7fcad806bea0 con 0x7fcad815a520 2024-09-13T18:59:21.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad6a00640 1 -- 172.21.15.33:0/1442298186 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc003520 con 0x7fcad815a520 2024-09-13T18:59:21.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7400640 1 -- 172.21.15.33:0/1442298186 >> v1:172.21.15.103:6789/0 conn(0x7fcad80cde50 legacy=0x7fcad815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7400640 1 -- 172.21.15.33:0/1442298186 >> v1:172.21.15.33:6789/0 conn(0x7fcad815a520 legacy=0x7fcad806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.856+0000 7fcad7400640 1 -- 172.21.15.33:0/1442298186 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad806c740 con 0x7fcad80b1b00 2024-09-13T18:59:21.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.857+0000 7fcad7400640 1 --2- 172.21.15.33:0/1442298186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad80b1b00 0x7fcad80cd910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222f420f10776bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:21.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.857+0000 7fcad6a00640 1 -- 172.21.15.33:0/1442298186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4032440 con 0x7fcad80b1b00 2024-09-13T18:59:21.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.857+0000 7fcad6a00640 1 -- 172.21.15.33:0/1442298186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40325a0 con 0x7fcad80b1b00 2024-09-13T18:59:21.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.857+0000 7fcad6a00640 1 -- 172.21.15.33:0/1442298186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4032930 con 0x7fcad80b1b00 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 -- 172.21.15.33:0/1442298186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad80b1b00 msgr2=0x7fcad80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 --2- 172.21.15.33:0/1442298186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad80b1b00 0x7fcad80cd910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402a230 comp rx=0 tx=0).stop 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 -- 172.21.15.33:0/1442298186 shutdown_connections 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 --2- 172.21.15.33:0/1442298186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad80b1b00 0x7fcad80cd910 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 -- 172.21.15.33:0/1442298186 >> 172.21.15.33:0/1442298186 conn(0x7fcad80b0510 msgr2=0x7fcad80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 -- 172.21.15.33:0/1442298186 shutdown_connections 2024-09-13T18:59:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.858+0000 7fcadee00640 1 -- 172.21.15.33:0/1442298186 wait complete. 2024-09-13T18:59:21.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.860+0000 7fcadee00640 1 Processor -- start 2024-09-13T18:59:21.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.860+0000 7fcadee00640 1 -- start start 2024-09-13T18:59:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcad80b1b00 0x7fcad8149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 0x7fcad814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad81498c0 con 0x7fcad815a520 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad814c4d0 con 0x7fcad80cde50 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad814c7b0 con 0x7fcad80b1b00 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41560/0 (socket says 172.21.15.33:41560) 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcadce00640 1 -- 172.21.15.33:0/3770584769 learned_addr learned my addr 172.21.15.33:0/3770584769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcad7400640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 0x7fcad814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.861+0000 7fcad7e00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcad80b1b00 0x7fcad8149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:21.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 -- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcad80b1b00 msgr2=0x7fcad8149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcad80b1b00 0x7fcad8149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 -- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 msgr2=0x7fcad814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:21.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 0x7fcad814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 -- 172.21.15.33:0/3770584769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009400 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcad7400640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 0x7fcad814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadce00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c7a0 tx=0x7fcad000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0003b70 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0003cf0 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000aa90 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad814ca90 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.862+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad8149ec0 con 0x7fcad815a520 2024-09-13T18:59:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.863+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad80cd910 con 0x7fcad815a520 2024-09-13T18:59:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.864+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcad000abf0 con 0x7fcad815a520 2024-09-13T18:59:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.865+0000 7fcacfe00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 0x7fcab806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.865+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcad0089170 con 0x7fcad815a520 2024-09-13T18:59:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.866+0000 7fcad7e00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 0x7fcab806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.867+0000 7fcad7e00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 0x7fcab806d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcac80011e0 tx=0x7fcac8007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:21.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:21.873+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcad00542d0 con 0x7fcad815a520 2024-09-13T18:59:22.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.088+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcad815de60 con 0x7fcad815a520 2024-09-13T18:59:22.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.089+0000 7fcacfe00640 1 -- 172.21.15.33:0/3770584769 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fcad0003e60 con 0x7fcad815a520 2024-09-13T18:59:22.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:22.092 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:22.093 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:22.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 msgr2=0x7fcab806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 0x7fcab806d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcac80011e0 tx=0x7fcac8007d30 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 msgr2=0x7fcad80c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c7a0 tx=0x7fcad000cc60 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 shutdown_connections 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcab806ac30 0x7fcab806d0f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad815a520 0x7fcad80c6b10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcad80cde50 0x7fcad814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 --2- 172.21.15.33:0/3770584769 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcad80b1b00 0x7fcad8149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 >> 172.21.15.33:0/3770584769 conn(0x7fcad80b0510 msgr2=0x7fcad806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 shutdown_connections 2024-09-13T18:59:22.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.091+0000 7fcadee00640 1 -- 172.21.15.33:0/3770584769 wait complete. 2024-09-13T18:59:22.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:22.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.260+0000 7fc7e9e00640 1 Processor -- start 2024-09-13T18:59:22.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.260+0000 7fc7e9e00640 1 -- start start 2024-09-13T18:59:22.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 0x7fc7e40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e9e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e4153f00 con 0x7fc7e406f660 2024-09-13T18:59:22.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e9e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40b1a40 con 0x7fc7e4159a80 2024-09-13T18:59:22.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e9e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40ce600 con 0x7fc7e4153b20 2024-09-13T18:59:22.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e3400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc7e406f660 0x7fc7e406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57644/0 (socket says 172.21.15.33:57644) 2024-09-13T18:59:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e3400640 1 -- 172.21.15.33:0/464114262 learned_addr learned my addr 172.21.15.33:0/464114262 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.262+0000 7fc7e2a00640 1 --2- 172.21.15.33:0/464114262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 0x7fc7e40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234988777 0 0) 0x7fc7e4153f00 con 0x7fc7e406f660 2024-09-13T18:59:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c8003520 con 0x7fc7e406f660 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397892772 0 0) 0x7fc7e40b1a40 con 0x7fc7e4159a80 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2a00640 1 -- 172.21.15.33:0/464114262 >> v1:172.21.15.103:6789/0 conn(0x7fc7e4159a80 legacy=0x7fc7e40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2a00640 1 -- 172.21.15.33:0/464114262 >> v1:172.21.15.33:6789/0 conn(0x7fc7e406f660 legacy=0x7fc7e406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.263+0000 7fc7e2a00640 1 -- 172.21.15.33:0/464114262 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e415a1f0 con 0x7fc7e4153b20 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.264+0000 7fc7e2a00640 1 --2- 172.21.15.33:0/464114262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 0x7fc7e40b3990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40097d0 tx=0x7fc7d402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b759cd2573f2469a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.264+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4032440 con 0x7fc7e4153b20 2024-09-13T18:59:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.264+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d40325a0 con 0x7fc7e4153b20 2024-09-13T18:59:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.264+0000 7fc7e2000640 1 -- 172.21.15.33:0/464114262 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4032930 con 0x7fc7e4153b20 2024-09-13T18:59:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 -- 172.21.15.33:0/464114262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 msgr2=0x7fc7e40b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/464114262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 0x7fc7e40b3990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40097d0 tx=0x7fc7d402a210 comp rx=0 tx=0).stop 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 -- 172.21.15.33:0/464114262 shutdown_connections 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/464114262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e4153b20 0x7fc7e40b3990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 -- 172.21.15.33:0/464114262 >> 172.21.15.33:0/464114262 conn(0x7fc7e40b0510 msgr2=0x7fc7e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 -- 172.21.15.33:0/464114262 shutdown_connections 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.265+0000 7fc7e9e00640 1 -- 172.21.15.33:0/464114262 wait complete. 2024-09-13T18:59:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.266+0000 7fc7e9e00640 1 Processor -- start 2024-09-13T18:59:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 -- start start 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e406f660 0x7fc7e41489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 0x7fc7e406c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41464f0 con 0x7fc7e4153b20 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4148ef0 con 0x7fc7e4159a80 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.267+0000 7fc7e9e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e4156940 con 0x7fc7e406f660 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41566/0 (socket says 172.21.15.33:41566) 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 -- 172.21.15.33:0/4118372948 learned_addr learned my addr 172.21.15.33:0/4118372948 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7e2a00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e406f660 0x7fc7e41489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7e3400640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 0x7fc7e406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 -- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e406f660 msgr2=0x7fc7e41489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e406f660 0x7fc7e41489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 -- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 msgr2=0x7fc7e406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 0x7fc7e406c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 -- 172.21.15.33:0/4118372948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009400 con 0x7fc7e4153b20 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7e3400640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 0x7fc7e406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.268+0000 7fc7dbe00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c520 tx=0x7fc7cc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.269+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0035f0 con 0x7fc7e4153b20 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.269+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc003770 con 0x7fc7e4153b20 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.269+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc003b20 con 0x7fc7e4153b20 2024-09-13T18:59:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.269+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e4156c10 con 0x7fc7e4153b20 2024-09-13T18:59:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.269+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4146110 con 0x7fc7e4153b20 2024-09-13T18:59:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.270+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4157130 con 0x7fc7e4153b20 2024-09-13T18:59:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.271+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7cc003c80 con 0x7fc7e4153b20 2024-09-13T18:59:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.271+0000 7fc7db400640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 0x7fc7c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.272+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7cc0888b0 con 0x7fc7e4153b20 2024-09-13T18:59:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.272+0000 7fc7e2a00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 0x7fc7c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.273+0000 7fc7e2a00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 0x7fc7c006d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4034000 tx=0x7fc7d402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.276+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc7cc053b30 con 0x7fc7e4153b20 2024-09-13T18:59:22.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.455+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e4145f50 con 0x7fc7e4153b20 2024-09-13T18:59:22.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.456+0000 7fc7db400640 1 -- 172.21.15.33:0/4118372948 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fc7cc017070 con 0x7fc7e4153b20 2024-09-13T18:59:22.459 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:22.460 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:22.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 msgr2=0x7fc7c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 0x7fc7c006d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4034000 tx=0x7fc7d402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:22.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 msgr2=0x7fc7e40ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c520 tx=0x7fc7cc00c9e0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 shutdown_connections 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc7c006ac00 0x7fc7c006d0c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e4159a80 0x7fc7e406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7e4153b20 0x7fc7e40ca4e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 --2- 172.21.15.33:0/4118372948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7e406f660 0x7fc7e41489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 >> 172.21.15.33:0/4118372948 conn(0x7fc7e40b0510 msgr2=0x7fc7e40cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 shutdown_connections 2024-09-13T18:59:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.458+0000 7fc7e9e00640 1 -- 172.21.15.33:0/4118372948 wait complete. 2024-09-13T18:59:22.478 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:59:22.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:22.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.630+0000 7fce8de00640 1 Processor -- start 2024-09-13T18:59:22.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.630+0000 7fce8de00640 1 -- start start 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce8de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce8815a520 0x7fce8806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce8de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880ce020 0x7fce8815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce8de00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8806bc00 con 0x7fce880b1b00 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce8de00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8806bea0 con 0x7fce8815a520 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce8de00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8806c180 con 0x7fce880ce020 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.631+0000 7fce86a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce8815a520 0x7fce8806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce8815a520 0x7fce8806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41580/0 (socket says 172.21.15.33:41580) 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 -- 172.21.15.33:0/4126522126 learned_addr learned my addr 172.21.15.33:0/4126522126 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce87400640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880ce020 0x7fce8815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 -- 172.21.15.33:0/4126522126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880ce020 msgr2=0x7fce8815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880ce020 0x7fce8815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 -- 172.21.15.33:0/4126522126 >> v1:172.21.15.103:6789/0 conn(0x7fce880b1b00 legacy=0x7fce880cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.632+0000 7fce86a00640 1 -- 172.21.15.33:0/4126522126 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8806c460 con 0x7fce8815a520 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.633+0000 7fce86a00640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8815a520 0x7fce8806b6c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fce78009870 tx=0x7fce7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7621b3d965017c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.633+0000 7fce85600640 1 -- 172.21.15.33:0/4126522126 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7802ae90 con 0x7fce8815a520 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.633+0000 7fce85600640 1 -- 172.21.15.33:0/4126522126 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78032440 con 0x7fce8815a520 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.633+0000 7fce85600640 1 -- 172.21.15.33:0/4126522126 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780327d0 con 0x7fce8815a520 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 -- 172.21.15.33:0/4126522126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8815a520 msgr2=0x7fce8806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8815a520 0x7fce8806b6c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fce78009870 tx=0x7fce7802a180 comp rx=0 tx=0).stop 2024-09-13T18:59:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 -- 172.21.15.33:0/4126522126 shutdown_connections 2024-09-13T18:59:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880ce020 0x7fce8815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 --2- 172.21.15.33:0/4126522126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8815a520 0x7fce8806b6c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 -- 172.21.15.33:0/4126522126 >> 172.21.15.33:0/4126522126 conn(0x7fce880b0510 msgr2=0x7fce880b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 -- 172.21.15.33:0/4126522126 shutdown_connections 2024-09-13T18:59:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.634+0000 7fce8de00640 1 -- 172.21.15.33:0/4126522126 wait complete. 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.636+0000 7fce8de00640 1 Processor -- start 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.636+0000 7fce8de00640 1 -- start start 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.636+0000 7fce8de00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880b1b00 0x7fce881541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce8de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce8de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce8815a520 0x7fce880cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce8de00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881f55e0 con 0x7fce880ce020 2024-09-13T18:59:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce8de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881f5880 con 0x7fce8815a520 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce8de00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce881f5b60 con 0x7fce880b1b00 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41584/0 (socket says 172.21.15.33:41584) 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 -- 172.21.15.33:0/583957176 learned_addr learned my addr 172.21.15.33:0/583957176 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86a00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880b1b00 0x7fce881541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce87400640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce8815a520 0x7fce880cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 -- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880b1b00 msgr2=0x7fce881541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880b1b00 0x7fce881541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 -- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce8815a520 msgr2=0x7fce880cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce8815a520 0x7fce880cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.637+0000 7fce86000640 1 -- 172.21.15.33:0/583957176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780094d0 con 0x7fce880ce020 2024-09-13T18:59:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce86000640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c430 tx=0x7fce7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011790 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740118f0 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011ce0 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce881f5e40 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.638+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88154730 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.639+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce881f6360 con 0x7fce880ce020 2024-09-13T18:59:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.640+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce7401c460 con 0x7fce880ce020 2024-09-13T18:59:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.641+0000 7fce7f400640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.641+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce74089190 con 0x7fce880ce020 2024-09-13T18:59:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.641+0000 7fce86a00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.642+0000 7fce86a00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce78034000 tx=0x7fce7802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:22.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.645+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce881f6360 con 0x7fce880ce020 2024-09-13T18:59:22.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.821+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce8806cf40 con 0x7fce6806ac00 2024-09-13T18:59:22.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.829+0000 7fce7f400640 1 -- 172.21.15.33:0/583957176 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278486 (secure 0 0 0) 0x7fce78046450 con 0x7fce6806ac00 2024-09-13T18:59:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:22.837 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 msgr2=0x7fce6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce78034000 tx=0x7fce7802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 msgr2=0x7fce880cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c430 tx=0x7fce7400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 shutdown_connections 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce8815a520 0x7fce880cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce880ce020 0x7fce880cb320 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 --2- 172.21.15.33:0/583957176 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce880b1b00 0x7fce881541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 >> 172.21.15.33:0/583957176 conn(0x7fce880b0510 msgr2=0x7fce88070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 shutdown_connections 2024-09-13T18:59:22.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:22.833+0000 7fce8de00640 1 -- 172.21.15.33:0/583957176 wait complete. 2024-09-13T18:59:22.852 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-13T18:59:21.124582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222660,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752060,"statfs":{"total":773094113280,"available":772866109440,"internally_reserved":0,"allocated":6647808,"data_stored":3428655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000848"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220068+0000","last_change":"2024-09-13T18:59:17.220068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220068+0000","last_undegraded":"2024-09-13T18:59:17.220068+0000","last_fullsized":"2024-09-13T18:59:17.220068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217247+0000","last_change":"2024-09-13T18:59:17.217247+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217247+0000","last_undegraded":"2024-09-13T18:59:17.217247+0000","last_fullsized":"2024-09-13T18:59:17.217247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218362+0000","last_change":"2024-09-13T18:59:17.218362+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218362+0000","last_undegraded":"2024-09-13T18:59:17.218362+0000","last_fullsized":"2024-09-13T18:59:17.218362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219586+0000","last_change":"2024-09-13T18:59:17.219586+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219586+0000","last_undegraded":"2024-09-13T18:59:17.219586+0000","last_fullsized":"2024-09-13T18:59:17.219586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213516+0000","last_change":"2024-09-13T18:59:17.213516+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213516+0000","last_undegraded":"2024-09-13T18:59:17.213516+0000","last_fullsized":"2024-09-13T18:59:17.213516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219457+0000","last_change":"2024-09-13T18:59:17.219457+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219457+0000","last_undegraded":"2024-09-13T18:59:17.219457+0000","last_fullsized":"2024-09-13T18:59:17.219457+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219920+0000","last_change":"2024-09-13T18:59:17.219920+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219920+0000","last_undegraded":"2024-09-13T18:59:17.219920+0000","last_fullsized":"2024-09-13T18:59:17.219920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213600+0000","last_change":"2024-09-13T18:59:17.213600+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213600+0000","last_undegraded":"2024-09-13T18:59:17.213600+0000","last_fullsized":"2024-09-13T18:59:17.213600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214502+0000","last_change":"2024-09-13T18:59:17.214502+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214502+0000","last_undegraded":"2024-09-13T18:59:17.214502+0000","last_fullsized":"2024-09-13T18:59:17.214502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216410+0000","last_change":"2024-09-13T18:59:17.216410+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216410+0000","last_undegraded":"2024-09-13T18:59:17.216410+0000","last_fullsized":"2024-09-13T18:59:17.216410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214454+0000","last_change":"2024-09-13T18:59:17.214454+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214454+0000","last_undegraded":"2024-09-13T18:59:17.214454+0000","last_fullsized":"2024-09-13T18:59:17.214454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213676+0000","last_change":"2024-09-13T18:59:17.213676+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213676+0000","last_undegraded":"2024-09-13T18:59:17.213676+0000","last_fullsized":"2024-09-13T18:59:17.213676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216290+0000","last_change":"2024-09-13T18:59:17.216290+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216290+0000","last_undegraded":"2024-09-13T18:59:17.216290+0000","last_fullsized":"2024-09-13T18:59:17.216290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221923+0000","last_change":"2024-09-13T18:59:17.221923+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221923+0000","last_undegraded":"2024-09-13T18:59:17.221923+0000","last_fullsized":"2024-09-13T18:59:17.221923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219389+0000","last_change":"2024-09-13T18:59:17.219389+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219389+0000","last_undegraded":"2024-09-13T18:59:17.219389+0000","last_fullsized":"2024-09-13T18:59:17.219389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214309+0000","last_change":"2024-09-13T18:59:17.214309+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214309+0000","last_undegraded":"2024-09-13T18:59:17.214309+0000","last_fullsized":"2024-09-13T18:59:17.214309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215501+0000","last_change":"2024-09-13T18:59:17.215501+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215501+0000","last_undegraded":"2024-09-13T18:59:17.215501+0000","last_fullsized":"2024-09-13T18:59:17.215501+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218424+0000","last_change":"2024-09-13T18:59:17.218424+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218424+0000","last_undegraded":"2024-09-13T18:59:17.218424+0000","last_fullsized":"2024-09-13T18:59:17.218424+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219379+0000","last_change":"2024-09-13T18:59:17.219379+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219379+0000","last_undegraded":"2024-09-13T18:59:17.219379+0000","last_fullsized":"2024-09-13T18:59:17.219379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218112+0000","last_change":"2024-09-13T18:59:17.218112+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218112+0000","last_undegraded":"2024-09-13T18:59:17.218112+0000","last_fullsized":"2024-09-13T18:59:17.218112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215482+0000","last_change":"2024-09-13T18:59:17.215482+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215482+0000","last_undegraded":"2024-09-13T18:59:17.215482+0000","last_fullsized":"2024-09-13T18:59:17.215482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220492+0000","last_change":"2024-09-13T18:59:17.220492+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220492+0000","last_undegraded":"2024-09-13T18:59:17.220492+0000","last_fullsized":"2024-09-13T18:59:17.220492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219068+0000","last_change":"2024-09-13T18:59:17.219068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219068+0000","last_undegraded":"2024-09-13T18:59:17.219068+0000","last_fullsized":"2024-09-13T18:59:17.219068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220304+0000","last_change":"2024-09-13T18:59:17.220304+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220304+0000","last_undegraded":"2024-09-13T18:59:17.220304+0000","last_fullsized":"2024-09-13T18:59:17.220304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217935+0000","last_change":"2024-09-13T18:59:17.217935+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217935+0000","last_undegraded":"2024-09-13T18:59:17.217935+0000","last_fullsized":"2024-09-13T18:59:17.217935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221900+0000","last_change":"2024-09-13T18:59:17.221900+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221900+0000","last_undegraded":"2024-09-13T18:59:17.221900+0000","last_fullsized":"2024-09-13T18:59:17.221900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219035+0000","last_change":"2024-09-13T18:59:17.219035+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219035+0000","last_undegraded":"2024-09-13T18:59:17.219035+0000","last_fullsized":"2024-09-13T18:59:17.219035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219452+0000","last_change":"2024-09-13T18:59:17.219452+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219452+0000","last_undegraded":"2024-09-13T18:59:17.219452+0000","last_fullsized":"2024-09-13T18:59:17.219452+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213620+0000","last_change":"2024-09-13T18:59:17.213620+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213620+0000","last_undegraded":"2024-09-13T18:59:17.213620+0000","last_fullsized":"2024-09-13T18:59:17.213620+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220269+0000","last_change":"2024-09-13T18:59:17.220269+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220269+0000","last_undegraded":"2024-09-13T18:59:17.220269+0000","last_fullsized":"2024-09-13T18:59:17.220269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215906+0000","last_change":"2024-09-13T18:59:17.215906+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215906+0000","last_undegraded":"2024-09-13T18:59:17.215906+0000","last_fullsized":"2024-09-13T18:59:17.215906+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221907+0000","last_change":"2024-09-13T18:59:17.221907+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221907+0000","last_undegraded":"2024-09-13T18:59:17.221907+0000","last_fullsized":"2024-09-13T18:59:17.221907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:59:14.583767+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:14.583767+0000","last_peered":"2024-09-13T18:59:14.583767+0000","last_clean":"2024-09-13T18:59:14.583767+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:14.583767+0000","last_undegraded":"2024-09-13T18:59:14.583767+0000","last_fullsized":"2024-09-13T18:59:14.583767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.378},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.78500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.378}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.318}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":1.151}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.093},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":1.0309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:22.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:23.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.044+0000 7f3b55800640 1 Processor -- start 2024-09-13T18:59:23.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.044+0000 7f3b55800640 1 -- start start 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b55800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b500712e0 0x7f3b500b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b55800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b5015d1a0 0x7f3b500b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b55800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b500716c0 con 0x7f3b5015c590 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b55800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b2b80 con 0x7f3b5015d1a0 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b55800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500b2e60 con 0x7f3b500712e0 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b47e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b5015d1a0 0x7f3b500b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b54e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b5015c590 0x7f3b5006fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39614/0 (socket says 172.21.15.33:39614) 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.045+0000 7f3b54e00640 1 -- 172.21.15.33:0/1319277417 learned_addr learned my addr 172.21.15.33:0/1319277417 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b500712e0 0x7f3b500b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b47e00640 1 -- 172.21.15.33:0/1319277417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b500712e0 msgr2=0x7f3b500b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b47e00640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b500712e0 0x7f3b500b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b47e00640 1 -- 172.21.15.33:0/1319277417 >> v1:172.21.15.33:6789/0 conn(0x7f3b5015c590 legacy=0x7f3b5006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b47e00640 1 -- 172.21.15.33:0/1319277417 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500b3140 con 0x7f3b5015d1a0 2024-09-13T18:59:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.046+0000 7f3b4f400640 1 -- 172.21.15.33:0/1319277417 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527431832 0 0) 0x7f3b500716c0 con 0x7f3b5015c590 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b47e00640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015d1a0 0x7f3b500b20b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097a0 tx=0x7f3b3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb0f1c2eadd0c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b4f400640 1 -- 172.21.15.33:0/1319277417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38032440 con 0x7f3b5015d1a0 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b4f400640 1 -- 172.21.15.33:0/1319277417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380325a0 con 0x7f3b5015d1a0 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b4f400640 1 -- 172.21.15.33:0/1319277417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38032930 con 0x7f3b5015d1a0 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b55800640 1 -- 172.21.15.33:0/1319277417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015d1a0 msgr2=0x7f3b500b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.047+0000 7f3b55800640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015d1a0 0x7f3b500b20b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097a0 tx=0x7f3b3802a180 comp rx=0 tx=0).stop 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 -- 172.21.15.33:0/1319277417 shutdown_connections 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015d1a0 0x7f3b500b20b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 --2- 172.21.15.33:0/1319277417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b500712e0 0x7f3b500b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 -- 172.21.15.33:0/1319277417 >> 172.21.15.33:0/1319277417 conn(0x7f3b500ae310 msgr2=0x7f3b500ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 -- 172.21.15.33:0/1319277417 shutdown_connections 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.048+0000 7f3b55800640 1 -- 172.21.15.33:0/1319277417 wait complete. 2024-09-13T18:59:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.049+0000 7f3b55800640 1 Processor -- start 2024-09-13T18:59:23.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.049+0000 7f3b55800640 1 -- start start 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 0x7f3b50157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5015d1a0 0x7f3b50142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50158290 con 0x7f3b5015c590 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501579f0 con 0x7f3b500712e0 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b55800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50157cd0 con 0x7f3b5015d1a0 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b47e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.050+0000 7f3b47e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34038/0 (socket says 172.21.15.33:34038) 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 -- 172.21.15.33:0/2632182662 learned_addr learned my addr 172.21.15.33:0/2632182662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b54e00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5015d1a0 0x7f3b50142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 0x7f3b50157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 -- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5015d1a0 msgr2=0x7f3b50142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5015d1a0 0x7f3b50142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 -- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 msgr2=0x7f3b50157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 0x7f3b50157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 -- 172.21.15.33:0/2632182662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009400 con 0x7f3b5015c590 2024-09-13T18:59:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 0x7f3b50157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.051+0000 7f3b47e00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.052+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38032440 con 0x7f3b5015c590 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.052+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38030ba0 con 0x7f3b5015c590 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.052+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38006e10 con 0x7f3b5015c590 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.052+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50157fb0 con 0x7f3b5015c590 2024-09-13T18:59:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.052+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501434d0 con 0x7f3b5015c590 2024-09-13T18:59:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.053+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50067360 con 0x7f3b5015c590 2024-09-13T18:59:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.054+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b38039040 con 0x7f3b5015c590 2024-09-13T18:59:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.055+0000 7f3b4cc00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 0x7f3b2c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.055+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b380a9d20 con 0x7f3b5015c590 2024-09-13T18:59:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.055+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 0x7f3b2c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.056+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 0x7f3b2c06d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.059+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b38074f90 con 0x7f3b5015c590 2024-09-13T18:59:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.234+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b500b25f0 con 0x7f3b2c06ac30 2024-09-13T18:59:23.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.242+0000 7f3b4cc00640 1 -- 172.21.15.33:0/2632182662 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278486 (secure 0 0 0) 0x7f3b40009e10 con 0x7f3b2c06ac30 2024-09-13T18:59:23.249 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 msgr2=0x7f3b2c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 0x7f3b2c06d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2024-09-13T18:59:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 msgr2=0x7f3b5014be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b380046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 shutdown_connections 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b2c06ac30 0x7f3b2c06d0f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5015d1a0 0x7f3b50142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b5015c590 0x7f3b5014be30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 --2- 172.21.15.33:0/2632182662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b500712e0 0x7f3b50157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 >> 172.21.15.33:0/2632182662 conn(0x7f3b500ae310 msgr2=0x7f3b5006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 shutdown_connections 2024-09-13T18:59:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.246+0000 7f3b55800640 1 -- 172.21.15.33:0/2632182662 wait complete. 2024-09-13T18:59:23.265 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-13T18:59:23.125046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222660,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752060,"statfs":{"total":773094113280,"available":772866109440,"internally_reserved":0,"allocated":6647808,"data_stored":3428655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.914684"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220068+0000","last_change":"2024-09-13T18:59:17.220068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220068+0000","last_undegraded":"2024-09-13T18:59:17.220068+0000","last_fullsized":"2024-09-13T18:59:17.220068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217247+0000","last_change":"2024-09-13T18:59:17.217247+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217247+0000","last_undegraded":"2024-09-13T18:59:17.217247+0000","last_fullsized":"2024-09-13T18:59:17.217247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218362+0000","last_change":"2024-09-13T18:59:17.218362+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218362+0000","last_undegraded":"2024-09-13T18:59:17.218362+0000","last_fullsized":"2024-09-13T18:59:17.218362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219586+0000","last_change":"2024-09-13T18:59:17.219586+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219586+0000","last_undegraded":"2024-09-13T18:59:17.219586+0000","last_fullsized":"2024-09-13T18:59:17.219586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213516+0000","last_change":"2024-09-13T18:59:17.213516+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213516+0000","last_undegraded":"2024-09-13T18:59:17.213516+0000","last_fullsized":"2024-09-13T18:59:17.213516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219457+0000","last_change":"2024-09-13T18:59:17.219457+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219457+0000","last_undegraded":"2024-09-13T18:59:17.219457+0000","last_fullsized":"2024-09-13T18:59:17.219457+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219920+0000","last_change":"2024-09-13T18:59:17.219920+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219920+0000","last_undegraded":"2024-09-13T18:59:17.219920+0000","last_fullsized":"2024-09-13T18:59:17.219920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213600+0000","last_change":"2024-09-13T18:59:17.213600+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213600+0000","last_undegraded":"2024-09-13T18:59:17.213600+0000","last_fullsized":"2024-09-13T18:59:17.213600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214502+0000","last_change":"2024-09-13T18:59:17.214502+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214502+0000","last_undegraded":"2024-09-13T18:59:17.214502+0000","last_fullsized":"2024-09-13T18:59:17.214502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216410+0000","last_change":"2024-09-13T18:59:17.216410+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216410+0000","last_undegraded":"2024-09-13T18:59:17.216410+0000","last_fullsized":"2024-09-13T18:59:17.216410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214454+0000","last_change":"2024-09-13T18:59:17.214454+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214454+0000","last_undegraded":"2024-09-13T18:59:17.214454+0000","last_fullsized":"2024-09-13T18:59:17.214454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213676+0000","last_change":"2024-09-13T18:59:17.213676+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213676+0000","last_undegraded":"2024-09-13T18:59:17.213676+0000","last_fullsized":"2024-09-13T18:59:17.213676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216290+0000","last_change":"2024-09-13T18:59:17.216290+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216290+0000","last_undegraded":"2024-09-13T18:59:17.216290+0000","last_fullsized":"2024-09-13T18:59:17.216290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221923+0000","last_change":"2024-09-13T18:59:17.221923+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221923+0000","last_undegraded":"2024-09-13T18:59:17.221923+0000","last_fullsized":"2024-09-13T18:59:17.221923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219389+0000","last_change":"2024-09-13T18:59:17.219389+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219389+0000","last_undegraded":"2024-09-13T18:59:17.219389+0000","last_fullsized":"2024-09-13T18:59:17.219389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214309+0000","last_change":"2024-09-13T18:59:17.214309+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214309+0000","last_undegraded":"2024-09-13T18:59:17.214309+0000","last_fullsized":"2024-09-13T18:59:17.214309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215501+0000","last_change":"2024-09-13T18:59:17.215501+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215501+0000","last_undegraded":"2024-09-13T18:59:17.215501+0000","last_fullsized":"2024-09-13T18:59:17.215501+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218424+0000","last_change":"2024-09-13T18:59:17.218424+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218424+0000","last_undegraded":"2024-09-13T18:59:17.218424+0000","last_fullsized":"2024-09-13T18:59:17.218424+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219379+0000","last_change":"2024-09-13T18:59:17.219379+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219379+0000","last_undegraded":"2024-09-13T18:59:17.219379+0000","last_fullsized":"2024-09-13T18:59:17.219379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218112+0000","last_change":"2024-09-13T18:59:17.218112+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218112+0000","last_undegraded":"2024-09-13T18:59:17.218112+0000","last_fullsized":"2024-09-13T18:59:17.218112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215482+0000","last_change":"2024-09-13T18:59:17.215482+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215482+0000","last_undegraded":"2024-09-13T18:59:17.215482+0000","last_fullsized":"2024-09-13T18:59:17.215482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220492+0000","last_change":"2024-09-13T18:59:17.220492+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220492+0000","last_undegraded":"2024-09-13T18:59:17.220492+0000","last_fullsized":"2024-09-13T18:59:17.220492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219068+0000","last_change":"2024-09-13T18:59:17.219068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219068+0000","last_undegraded":"2024-09-13T18:59:17.219068+0000","last_fullsized":"2024-09-13T18:59:17.219068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220304+0000","last_change":"2024-09-13T18:59:17.220304+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220304+0000","last_undegraded":"2024-09-13T18:59:17.220304+0000","last_fullsized":"2024-09-13T18:59:17.220304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217935+0000","last_change":"2024-09-13T18:59:17.217935+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217935+0000","last_undegraded":"2024-09-13T18:59:17.217935+0000","last_fullsized":"2024-09-13T18:59:17.217935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221900+0000","last_change":"2024-09-13T18:59:17.221900+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221900+0000","last_undegraded":"2024-09-13T18:59:17.221900+0000","last_fullsized":"2024-09-13T18:59:17.221900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219035+0000","last_change":"2024-09-13T18:59:17.219035+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219035+0000","last_undegraded":"2024-09-13T18:59:17.219035+0000","last_fullsized":"2024-09-13T18:59:17.219035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219452+0000","last_change":"2024-09-13T18:59:17.219452+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219452+0000","last_undegraded":"2024-09-13T18:59:17.219452+0000","last_fullsized":"2024-09-13T18:59:17.219452+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213620+0000","last_change":"2024-09-13T18:59:17.213620+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213620+0000","last_undegraded":"2024-09-13T18:59:17.213620+0000","last_fullsized":"2024-09-13T18:59:17.213620+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220269+0000","last_change":"2024-09-13T18:59:17.220269+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220269+0000","last_undegraded":"2024-09-13T18:59:17.220269+0000","last_fullsized":"2024-09-13T18:59:17.220269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215906+0000","last_change":"2024-09-13T18:59:17.215906+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215906+0000","last_undegraded":"2024-09-13T18:59:17.215906+0000","last_fullsized":"2024-09-13T18:59:17.215906+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221907+0000","last_change":"2024-09-13T18:59:17.221907+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221907+0000","last_undegraded":"2024-09-13T18:59:17.221907+0000","last_fullsized":"2024-09-13T18:59:17.221907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:59:14.583767+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:14.583767+0000","last_peered":"2024-09-13T18:59:14.583767+0000","last_clean":"2024-09-13T18:59:14.583767+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:14.583767+0000","last_undegraded":"2024-09-13T18:59:14.583767+0000","last_fullsized":"2024-09-13T18:59:14.583767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.378},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.78500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.378}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.318}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":1.151}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.093},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":1.0309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:23.272 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.458+0000 7f26a9800640 1 Processor -- start 2024-09-13T18:59:23.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.458+0000 7f26a9800640 1 -- start start 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a9800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a4153b20 0x7f26a40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a9800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26a406f660 0x7f26a406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a9800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a4153f00 con 0x7f26a4159a80 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a9800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a40ce600 con 0x7f26a406f660 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a9800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4070f90 con 0x7f26a4153b20 2024-09-13T18:59:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a3400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26a406f660 0x7f26a406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a3400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f26a406f660 0x7f26a406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34050/0 (socket says 172.21.15.33:34050) 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.459+0000 7f26a3400640 1 -- 172.21.15.33:0/721966330 learned_addr learned my addr 172.21.15.33:0/721966330 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.460+0000 7f26a2a00640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a4153b20 0x7f26a40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.460+0000 7f26a3400640 1 -- 172.21.15.33:0/721966330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a4153b20 msgr2=0x7f26a40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.460+0000 7f26a3400640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a4153b20 0x7f26a40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.460+0000 7f26a3400640 1 -- 172.21.15.33:0/721966330 >> v1:172.21.15.103:6789/0 conn(0x7f26a4159a80 legacy=0x7f26a40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.460+0000 7f26a3400640 1 -- 172.21.15.33:0/721966330 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40b1a40 con 0x7f26a406f660 2024-09-13T18:59:23.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.461+0000 7f26a3400640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a406f660 0x7f26a406faf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f269c009e80 tx=0x7f269c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac306b868d07a631 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.461+0000 7f26a1600640 1 -- 172.21.15.33:0/721966330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c031600 con 0x7f26a406f660 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.461+0000 7f26a1600640 1 -- 172.21.15.33:0/721966330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c02d050 con 0x7f26a406f660 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.461+0000 7f26a1600640 1 -- 172.21.15.33:0/721966330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c031980 con 0x7f26a406f660 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 -- 172.21.15.33:0/721966330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a406f660 msgr2=0x7f26a406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a406f660 0x7f26a406faf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f269c009e80 tx=0x7f269c02a750 comp rx=0 tx=0).stop 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 -- 172.21.15.33:0/721966330 shutdown_connections 2024-09-13T18:59:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a406f660 0x7f26a406faf0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 --2- 172.21.15.33:0/721966330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a4153b20 0x7f26a40b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 -- 172.21.15.33:0/721966330 >> 172.21.15.33:0/721966330 conn(0x7f26a40b0510 msgr2=0x7f26a40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:23.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 -- 172.21.15.33:0/721966330 shutdown_connections 2024-09-13T18:59:23.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.462+0000 7f26a9800640 1 -- 172.21.15.33:0/721966330 wait complete. 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.463+0000 7f26a9800640 1 Processor -- start 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.464+0000 7f26a9800640 1 -- start start 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.464+0000 7f26a9800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a406f660 0x7f26a4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a9800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26a4153b20 0x7f26a4156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a9800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40a8800 con 0x7f26a4159a80 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a9800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4155dd0 con 0x7f26a4153b20 2024-09-13T18:59:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a9800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a41551c0 con 0x7f26a406f660 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a2a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a406f660 0x7f26a4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34064/0 (socket says 172.21.15.33:34064) 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 -- 172.21.15.33:0/4042434050 learned_addr learned my addr 172.21.15.33:0/4042434050 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a2000640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26a4153b20 0x7f26a4156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 -- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a406f660 msgr2=0x7f26a4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a406f660 0x7f26a4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 -- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26a4153b20 msgr2=0x7f26a4156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26a4153b20 0x7f26a4156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.465+0000 7f26a3400640 1 -- 172.21.15.33:0/4042434050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c009b30 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f26a3400640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f269c009fa0 tx=0x7f269c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c03b810 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c03b990 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a41554a0 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c03bd40 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.466+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a4155a60 con 0x7f26a4159a80 2024-09-13T18:59:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.467+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a41514c0 con 0x7f26a4159a80 2024-09-13T18:59:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.468+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f269c03a3a0 con 0x7f26a4159a80 2024-09-13T18:59:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.469+0000 7f269aa00640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 0x7f268406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.469+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f269c0a9e20 con 0x7f26a4159a80 2024-09-13T18:59:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.469+0000 7f26a2a00640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 0x7f268406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.470+0000 7f26a2a00640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 0x7f268406d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26940079a0 tx=0x7f2694008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.473+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26a41514c0 con 0x7f26a4159a80 2024-09-13T18:59:23.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.649+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26a415a7b0 con 0x7f268406ac00 2024-09-13T18:59:23.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.656+0000 7f269aa00640 1 -- 172.21.15.33:0/4042434050 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278486 (secure 0 0 0) 0x7f26940108d0 con 0x7f268406ac00 2024-09-13T18:59:23.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 msgr2=0x7f268406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 0x7f268406d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26940079a0 tx=0x7f2694008040 comp rx=0 tx=0).stop 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 msgr2=0x7f26a4150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f269c009fa0 tx=0x7f269c004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 shutdown_connections 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f268406ac00 0x7f268406d0c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a4159a80 0x7f26a4150bd0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26a4153b20 0x7f26a4156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 --2- 172.21.15.33:0/4042434050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f26a406f660 0x7f26a4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 >> 172.21.15.33:0/4042434050 conn(0x7f26a40b0510 msgr2=0x7f26a40cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 shutdown_connections 2024-09-13T18:59:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.660+0000 7f26a9800640 1 -- 172.21.15.33:0/4042434050 wait complete. 2024-09-13T18:59:23.681 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-13T18:59:23.125046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222660,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752060,"statfs":{"total":773094113280,"available":772866109440,"internally_reserved":0,"allocated":6647808,"data_stored":3428655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.914684"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220068+0000","last_change":"2024-09-13T18:59:17.220068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220068+0000","last_undegraded":"2024-09-13T18:59:17.220068+0000","last_fullsized":"2024-09-13T18:59:17.220068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217247+0000","last_change":"2024-09-13T18:59:17.217247+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217247+0000","last_undegraded":"2024-09-13T18:59:17.217247+0000","last_fullsized":"2024-09-13T18:59:17.217247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218362+0000","last_change":"2024-09-13T18:59:17.218362+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218362+0000","last_undegraded":"2024-09-13T18:59:17.218362+0000","last_fullsized":"2024-09-13T18:59:17.218362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219586+0000","last_change":"2024-09-13T18:59:17.219586+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219586+0000","last_undegraded":"2024-09-13T18:59:17.219586+0000","last_fullsized":"2024-09-13T18:59:17.219586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213516+0000","last_change":"2024-09-13T18:59:17.213516+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213516+0000","last_undegraded":"2024-09-13T18:59:17.213516+0000","last_fullsized":"2024-09-13T18:59:17.213516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219457+0000","last_change":"2024-09-13T18:59:17.219457+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219457+0000","last_undegraded":"2024-09-13T18:59:17.219457+0000","last_fullsized":"2024-09-13T18:59:17.219457+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219920+0000","last_change":"2024-09-13T18:59:17.219920+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219920+0000","last_undegraded":"2024-09-13T18:59:17.219920+0000","last_fullsized":"2024-09-13T18:59:17.219920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213600+0000","last_change":"2024-09-13T18:59:17.213600+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213600+0000","last_undegraded":"2024-09-13T18:59:17.213600+0000","last_fullsized":"2024-09-13T18:59:17.213600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214502+0000","last_change":"2024-09-13T18:59:17.214502+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214502+0000","last_undegraded":"2024-09-13T18:59:17.214502+0000","last_fullsized":"2024-09-13T18:59:17.214502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216410+0000","last_change":"2024-09-13T18:59:17.216410+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216410+0000","last_undegraded":"2024-09-13T18:59:17.216410+0000","last_fullsized":"2024-09-13T18:59:17.216410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214454+0000","last_change":"2024-09-13T18:59:17.214454+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214454+0000","last_undegraded":"2024-09-13T18:59:17.214454+0000","last_fullsized":"2024-09-13T18:59:17.214454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213676+0000","last_change":"2024-09-13T18:59:17.213676+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213676+0000","last_undegraded":"2024-09-13T18:59:17.213676+0000","last_fullsized":"2024-09-13T18:59:17.213676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216290+0000","last_change":"2024-09-13T18:59:17.216290+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216290+0000","last_undegraded":"2024-09-13T18:59:17.216290+0000","last_fullsized":"2024-09-13T18:59:17.216290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221923+0000","last_change":"2024-09-13T18:59:17.221923+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221923+0000","last_undegraded":"2024-09-13T18:59:17.221923+0000","last_fullsized":"2024-09-13T18:59:17.221923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219389+0000","last_change":"2024-09-13T18:59:17.219389+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219389+0000","last_undegraded":"2024-09-13T18:59:17.219389+0000","last_fullsized":"2024-09-13T18:59:17.219389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214309+0000","last_change":"2024-09-13T18:59:17.214309+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214309+0000","last_undegraded":"2024-09-13T18:59:17.214309+0000","last_fullsized":"2024-09-13T18:59:17.214309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215501+0000","last_change":"2024-09-13T18:59:17.215501+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215501+0000","last_undegraded":"2024-09-13T18:59:17.215501+0000","last_fullsized":"2024-09-13T18:59:17.215501+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218424+0000","last_change":"2024-09-13T18:59:17.218424+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218424+0000","last_undegraded":"2024-09-13T18:59:17.218424+0000","last_fullsized":"2024-09-13T18:59:17.218424+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219379+0000","last_change":"2024-09-13T18:59:17.219379+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219379+0000","last_undegraded":"2024-09-13T18:59:17.219379+0000","last_fullsized":"2024-09-13T18:59:17.219379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218112+0000","last_change":"2024-09-13T18:59:17.218112+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218112+0000","last_undegraded":"2024-09-13T18:59:17.218112+0000","last_fullsized":"2024-09-13T18:59:17.218112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215482+0000","last_change":"2024-09-13T18:59:17.215482+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215482+0000","last_undegraded":"2024-09-13T18:59:17.215482+0000","last_fullsized":"2024-09-13T18:59:17.215482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220492+0000","last_change":"2024-09-13T18:59:17.220492+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220492+0000","last_undegraded":"2024-09-13T18:59:17.220492+0000","last_fullsized":"2024-09-13T18:59:17.220492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219068+0000","last_change":"2024-09-13T18:59:17.219068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219068+0000","last_undegraded":"2024-09-13T18:59:17.219068+0000","last_fullsized":"2024-09-13T18:59:17.219068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220304+0000","last_change":"2024-09-13T18:59:17.220304+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220304+0000","last_undegraded":"2024-09-13T18:59:17.220304+0000","last_fullsized":"2024-09-13T18:59:17.220304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217935+0000","last_change":"2024-09-13T18:59:17.217935+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217935+0000","last_undegraded":"2024-09-13T18:59:17.217935+0000","last_fullsized":"2024-09-13T18:59:17.217935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221900+0000","last_change":"2024-09-13T18:59:17.221900+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221900+0000","last_undegraded":"2024-09-13T18:59:17.221900+0000","last_fullsized":"2024-09-13T18:59:17.221900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219035+0000","last_change":"2024-09-13T18:59:17.219035+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219035+0000","last_undegraded":"2024-09-13T18:59:17.219035+0000","last_fullsized":"2024-09-13T18:59:17.219035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219452+0000","last_change":"2024-09-13T18:59:17.219452+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219452+0000","last_undegraded":"2024-09-13T18:59:17.219452+0000","last_fullsized":"2024-09-13T18:59:17.219452+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213620+0000","last_change":"2024-09-13T18:59:17.213620+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213620+0000","last_undegraded":"2024-09-13T18:59:17.213620+0000","last_fullsized":"2024-09-13T18:59:17.213620+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220269+0000","last_change":"2024-09-13T18:59:17.220269+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220269+0000","last_undegraded":"2024-09-13T18:59:17.220269+0000","last_fullsized":"2024-09-13T18:59:17.220269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215906+0000","last_change":"2024-09-13T18:59:17.215906+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215906+0000","last_undegraded":"2024-09-13T18:59:17.215906+0000","last_fullsized":"2024-09-13T18:59:17.215906+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221907+0000","last_change":"2024-09-13T18:59:17.221907+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221907+0000","last_undegraded":"2024-09-13T18:59:17.221907+0000","last_fullsized":"2024-09-13T18:59:17.221907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:59:14.583767+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:14.583767+0000","last_peered":"2024-09-13T18:59:14.583767+0000","last_clean":"2024-09-13T18:59:14.583767+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:14.583767+0000","last_undegraded":"2024-09-13T18:59:14.583767+0000","last_fullsized":"2024-09-13T18:59:14.583767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.378},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.78500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.378}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.318}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":1.151}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.093},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":1.0309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-09-13T18:59:23.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-09-13T18:59:23.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-09-13T18:59:23.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.220068+0000', 'last_change': '2024-09-13T18:59:17.220068+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.220068+0000', 'last_undegraded': '2024-09-13T18:59:17.220068+0000', 'last_fullsized': '2024-09-13T18:59:17.220068+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.217247+0000', 'last_change': '2024-09-13T18:59:17.217247+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.217247+0000', 'last_undegraded': '2024-09-13T18:59:17.217247+0000', 'last_fullsized': '2024-09-13T18:59:17.217247+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.218362+0000', 'last_change': '2024-09-13T18:59:17.218362+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.218362+0000', 'last_undegraded': '2024-09-13T18:59:17.218362+0000', 'last_fullsized': '2024-09-13T18:59:17.218362+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219586+0000', 'last_change': '2024-09-13T18:59:17.219586+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219586+0000', 'last_undegraded': '2024-09-13T18:59:17.219586+0000', 'last_fullsized': '2024-09-13T18:59:17.219586+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.213516+0000', 'last_change': '2024-09-13T18:59:17.213516+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.213516+0000', 'last_undegraded': '2024-09-13T18:59:17.213516+0000', 'last_fullsized': '2024-09-13T18:59:17.213516+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219457+0000', 'last_change': '2024-09-13T18:59:17.219457+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219457+0000', 'last_undegraded': '2024-09-13T18:59:17.219457+0000', 'last_fullsized': '2024-09-13T18:59:17.219457+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219920+0000', 'last_change': '2024-09-13T18:59:17.219920+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219920+0000', 'last_undegraded': '2024-09-13T18:59:17.219920+0000', 'last_fullsized': '2024-09-13T18:59:17.219920+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-09-13T18:59:23.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.213600+0000', 'last_change': '2024-09-13T18:59:17.213600+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.213600+0000', 'last_undegraded': '2024-09-13T18:59:17.213600+0000', 'last_fullsized': '2024-09-13T18:59:17.213600+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.214502+0000', 'last_change': '2024-09-13T18:59:17.214502+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.214502+0000', 'last_undegraded': '2024-09-13T18:59:17.214502+0000', 'last_fullsized': '2024-09-13T18:59:17.214502+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.216410+0000', 'last_change': '2024-09-13T18:59:17.216410+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.216410+0000', 'last_undegraded': '2024-09-13T18:59:17.216410+0000', 'last_fullsized': '2024-09-13T18:59:17.216410+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.214454+0000', 'last_change': '2024-09-13T18:59:17.214454+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.214454+0000', 'last_undegraded': '2024-09-13T18:59:17.214454+0000', 'last_fullsized': '2024-09-13T18:59:17.214454+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.213676+0000', 'last_change': '2024-09-13T18:59:17.213676+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.213676+0000', 'last_undegraded': '2024-09-13T18:59:17.213676+0000', 'last_fullsized': '2024-09-13T18:59:17.213676+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.216290+0000', 'last_change': '2024-09-13T18:59:17.216290+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.216290+0000', 'last_undegraded': '2024-09-13T18:59:17.216290+0000', 'last_fullsized': '2024-09-13T18:59:17.216290+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.221923+0000', 'last_change': '2024-09-13T18:59:17.221923+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.221923+0000', 'last_undegraded': '2024-09-13T18:59:17.221923+0000', 'last_fullsized': '2024-09-13T18:59:17.221923+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219389+0000', 'last_change': '2024-09-13T18:59:17.219389+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219389+0000', 'last_undegraded': '2024-09-13T18:59:17.219389+0000', 'last_fullsized': '2024-09-13T18:59:17.219389+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-09-13T18:59:23.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.214309+0000', 'last_change': '2024-09-13T18:59:17.214309+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.214309+0000', 'last_undegraded': '2024-09-13T18:59:17.214309+0000', 'last_fullsized': '2024-09-13T18:59:17.214309+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.215501+0000', 'last_change': '2024-09-13T18:59:17.215501+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.215501+0000', 'last_undegraded': '2024-09-13T18:59:17.215501+0000', 'last_fullsized': '2024-09-13T18:59:17.215501+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-09-13T18:59:23.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.218424+0000', 'last_change': '2024-09-13T18:59:17.218424+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.218424+0000', 'last_undegraded': '2024-09-13T18:59:17.218424+0000', 'last_fullsized': '2024-09-13T18:59:17.218424+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219379+0000', 'last_change': '2024-09-13T18:59:17.219379+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219379+0000', 'last_undegraded': '2024-09-13T18:59:17.219379+0000', 'last_fullsized': '2024-09-13T18:59:17.219379+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.218112+0000', 'last_change': '2024-09-13T18:59:17.218112+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.218112+0000', 'last_undegraded': '2024-09-13T18:59:17.218112+0000', 'last_fullsized': '2024-09-13T18:59:17.218112+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-09-13T18:59:23.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.215482+0000', 'last_change': '2024-09-13T18:59:17.215482+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.215482+0000', 'last_undegraded': '2024-09-13T18:59:17.215482+0000', 'last_fullsized': '2024-09-13T18:59:17.215482+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.220492+0000', 'last_change': '2024-09-13T18:59:17.220492+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.220492+0000', 'last_undegraded': '2024-09-13T18:59:17.220492+0000', 'last_fullsized': '2024-09-13T18:59:17.220492+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219068+0000', 'last_change': '2024-09-13T18:59:17.219068+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219068+0000', 'last_undegraded': '2024-09-13T18:59:17.219068+0000', 'last_fullsized': '2024-09-13T18:59:17.219068+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-09-13T18:59:23.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.220304+0000', 'last_change': '2024-09-13T18:59:17.220304+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.220304+0000', 'last_undegraded': '2024-09-13T18:59:17.220304+0000', 'last_fullsized': '2024-09-13T18:59:17.220304+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.217935+0000', 'last_change': '2024-09-13T18:59:17.217935+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.217935+0000', 'last_undegraded': '2024-09-13T18:59:17.217935+0000', 'last_fullsized': '2024-09-13T18:59:17.217935+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.221900+0000', 'last_change': '2024-09-13T18:59:17.221900+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.221900+0000', 'last_undegraded': '2024-09-13T18:59:17.221900+0000', 'last_fullsized': '2024-09-13T18:59:17.221900+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:59:23.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219035+0000', 'last_change': '2024-09-13T18:59:17.219035+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219035+0000', 'last_undegraded': '2024-09-13T18:59:17.219035+0000', 'last_fullsized': '2024-09-13T18:59:17.219035+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.219452+0000', 'last_change': '2024-09-13T18:59:17.219452+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.219452+0000', 'last_undegraded': '2024-09-13T18:59:17.219452+0000', 'last_fullsized': '2024-09-13T18:59:17.219452+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-09-13T18:59:23.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.213620+0000', 'last_change': '2024-09-13T18:59:17.213620+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.213620+0000', 'last_undegraded': '2024-09-13T18:59:17.213620+0000', 'last_fullsized': '2024-09-13T18:59:17.213620+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.220269+0000', 'last_change': '2024-09-13T18:59:17.220269+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.220269+0000', 'last_undegraded': '2024-09-13T18:59:17.220269+0000', 'last_fullsized': '2024-09-13T18:59:17.220269+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.215906+0000', 'last_change': '2024-09-13T18:59:17.215906+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.215906+0000', 'last_undegraded': '2024-09-13T18:59:17.215906+0000', 'last_fullsized': '2024-09-13T18:59:17.215906+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:59:18.210386+0000', 'last_change': '2024-09-13T18:59:18.210386+0000', 'last_active': '2024-09-13T18:59:18.210386+0000', 'last_peered': '2024-09-13T18:59:18.210386+0000', 'last_clean': '2024-09-13T18:59:18.210386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:18.210386+0000', 'last_undegraded': '2024-09-13T18:59:18.210386+0000', 'last_fullsized': '2024-09-13T18:59:18.210386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:18.210386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:59:23.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-09-13T18:59:23.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:59:17.221907+0000', 'last_change': '2024-09-13T18:59:17.221907+0000', 'last_active': '2024-09-13T18:59:17.204364+0000', 'last_peered': '2024-09-13T18:59:17.204364+0000', 'last_clean': '2024-09-13T18:59:17.204364+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:59:17.221907+0000', 'last_undegraded': '2024-09-13T18:59:17.221907+0000', 'last_fullsized': '2024-09-13T18:59:17.221907+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'last_clean_scrub_stamp': '2024-09-13T18:59:17.204364+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:59:23.707 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:59:23.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.873+0000 7f00a1400640 1 Processor -- start 2024-09-13T18:59:23.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.873+0000 7f00a1400640 1 -- start start 2024-09-13T18:59:23.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.874+0000 7f00a1400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f009c15a520 0x7f009c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.874+0000 7f00a1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0b1b00 0x7f009c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.874+0000 7f00a1400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c06bc00 con 0x7f009c0cde50 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.874+0000 7f00a1400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c06bea0 con 0x7f009c15a520 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.874+0000 7f00a1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c06c180 con 0x7f009c0b1b00 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009b200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f009c0cde50 0x7f009c0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39618/0 (socket says 172.21.15.33:39618) 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009b200640 1 -- 172.21.15.33:0/83151380 learned_addr learned my addr 172.21.15.33:0/83151380 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009a800640 1 --2- 172.21.15.33:0/83151380 >> v2:172.21.15.103:3300/0 conn(0x7f009c15a520 0x7f009c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f0091e00640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0b1b00 0x7f009c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f0099e00640 1 -- 172.21.15.33:0/83151380 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432396097 0 0) 0x7f009c06bc00 con 0x7f009c0cde50 2024-09-13T18:59:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f0099e00640 1 -- 172.21.15.33:0/83151380 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0080003520 con 0x7f009c0cde50 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009a800640 1 -- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0b1b00 msgr2=0x7f009c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009a800640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0b1b00 0x7f009c0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009a800640 1 -- 172.21.15.33:0/83151380 >> v1:172.21.15.33:6789/0 conn(0x7f009c0cde50 legacy=0x7f009c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.875+0000 7f009a800640 1 -- 172.21.15.33:0/83151380 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c06c460 con 0x7f009c15a520 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.877+0000 7f009a800640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c06b6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f008c0097d0 tx=0x7f008c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e864fdb2db1dfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.877+0000 7f0099e00640 1 -- 172.21.15.33:0/83151380 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c032440 con 0x7f009c15a520 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.877+0000 7f0099e00640 1 -- 172.21.15.33:0/83151380 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c0325a0 con 0x7f009c15a520 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.877+0000 7f0099e00640 1 -- 172.21.15.33:0/83151380 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c032930 con 0x7f009c15a520 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 -- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 msgr2=0x7f009c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c06b6c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f008c0097d0 tx=0x7f008c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 -- 172.21.15.33:0/83151380 shutdown_connections 2024-09-13T18:59:23.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0b1b00 0x7f009c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 --2- 172.21.15.33:0/83151380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c06b6c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 -- 172.21.15.33:0/83151380 >> 172.21.15.33:0/83151380 conn(0x7f009c0b0510 msgr2=0x7f009c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 -- 172.21.15.33:0/83151380 shutdown_connections 2024-09-13T18:59:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.878+0000 7f00a1400640 1 -- 172.21.15.33:0/83151380 wait complete. 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.880+0000 7f00a1400640 1 Processor -- start 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.880+0000 7f00a1400640 1 -- start start 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0cde50 0x7f009c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0af170 con 0x7f009c0b1b00 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c144b20 con 0x7f009c15a520 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f00a1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0aeb50 con 0x7f009c0cde50 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34076/0 (socket says 172.21.15.33:34076) 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 -- 172.21.15.33:0/1182980400 learned_addr learned my addr 172.21.15.33:0/1182980400 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f0091e00640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0cde50 0x7f009c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009b200640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 -- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0cde50 msgr2=0x7f009c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0cde50 0x7f009c0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 -- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 msgr2=0x7f009c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.881+0000 7f009a800640 1 -- 172.21.15.33:0/1182980400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009400 con 0x7f009c0b1b00 2024-09-13T18:59:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f009a800640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f008c035040 tx=0x7f008c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c03d8f0 con 0x7f009c0b1b00 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c03da70 con 0x7f009c0b1b00 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c03de20 con 0x7f009c0b1b00 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c0ae2b0 con 0x7f009c0b1b00 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.882+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c0ae870 con 0x7f009c0b1b00 2024-09-13T18:59:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.883+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c0af2b0 con 0x7f009c0b1b00 2024-09-13T18:59:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.884+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f008c039040 con 0x7f009c0b1b00 2024-09-13T18:59:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.885+0000 7f0093400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 0x7f007806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.885+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f008c0a9b80 con 0x7f009c0b1b00 2024-09-13T18:59:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.886+0000 7f0091e00640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 0x7f007806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.887+0000 7f0091e00640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 0x7f007806d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f009c152f30 tx=0x7f0084008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:23.890+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f009c0af2b0 con 0x7f009c0b1b00 2024-09-13T18:59:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.131+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f009c0af2b0 con 0x7f009c0b1b00 2024-09-13T18:59:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.132+0000 7f0093400640 1 -- 172.21.15.33:0/1182980400 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7f009c0af2b0 con 0x7f009c0b1b00 2024-09-13T18:59:24.135 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:24.135 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":153,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253822,"num_in_osds":8,"osd_in_since":1726253813,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":228003840,"bytes_avail":772866109440,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5907}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-13T18:59:07.121597+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:59:24.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 msgr2=0x7f007806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 0x7f007806d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f009c152f30 tx=0x7f0084008040 comp rx=0 tx=0).stop 2024-09-13T18:59:24.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 msgr2=0x7f009c141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f008c035040 tx=0x7f008c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 shutdown_connections 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f007806ac00 0x7f007806d0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c15a520 0x7f009c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f009c0cde50 0x7f009c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 --2- 172.21.15.33:0/1182980400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f009c0b1b00 0x7f009c141ac0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 >> 172.21.15.33:0/1182980400 conn(0x7f009c0b0510 msgr2=0x7f009c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 shutdown_connections 2024-09-13T18:59:24.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.134+0000 7f00a1400640 1 -- 172.21.15.33:0/1182980400 wait complete. 2024-09-13T18:59:24.153 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:59:24.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:24.206 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T18:59:24.203+0000 7f1e5ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:59:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.306+0000 7f9008200640 1 Processor -- start 2024-09-13T18:59:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.306+0000 7f9008200640 1 -- start start 2024-09-13T18:59:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9008200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f90000b3990 0x7f9000159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9008200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9000159fc0 con 0x7f9000153b20 2024-09-13T18:59:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9008200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9000153f00 con 0x7f900006f660 2024-09-13T18:59:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9008200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000ce600 con 0x7f90000b3990 2024-09-13T18:59:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9005800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9000153b20 0x7f90000b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39620/0 (socket says 172.21.15.33:39620) 2024-09-13T18:59:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.307+0000 7f9005800640 1 -- 172.21.15.33:0/2413025832 learned_addr learned my addr 172.21.15.33:0/2413025832 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f9004e00640 1 --2- 172.21.15.33:0/2413025832 >> v2:172.21.15.103:3300/0 conn(0x7f90000b3990 0x7f9000159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789183083 0 0) 0x7f9000159fc0 con 0x7f9000153b20 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe8003520 con 0x7f9000153b20 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3581031373 0 0) 0x7f8fe8003520 con 0x7f9000153b20 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 >> v2:172.21.15.103:3300/0 conn(0x7f90000b3990 msgr2=0x7f9000159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 --2- 172.21.15.33:0/2413025832 >> v2:172.21.15.103:3300/0 conn(0x7f90000b3990 0x7f9000159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 >> v1:172.21.15.103:6789/0 conn(0x7f900006f660 legacy=0x7f900006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000b1a40 con 0x7f9000153b20 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f8ff4001670 con 0x7f9000153b20 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 >> v1:172.21.15.33:6789/0 conn(0x7f9000153b20 legacy=0x7f90000b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8005180 0x7f8fe800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000ce600 con 0x7f8fe8003970 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800bfd0 con 0x7f8fe8005180 2024-09-13T18:59:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800c190 con 0x7f8fe80047c0 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.308+0000 7f9005800640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9004e00640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9006200640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8005180 0x7f8fe800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9005800640 1 -- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fe80047c0 msgr2=0x7f8fe8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9005800640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9005800640 1 -- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8005180 msgr2=0x7f8fe800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9005800640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8005180 0x7f8fe800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9005800640 1 -- 172.21.15.33:0/2413025832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8003520 con 0x7f8fe8003970 2024-09-13T18:59:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.309+0000 7f9006200640 1 -- 172.21.15.33:0/2413025832 reap_dead start 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.310+0000 7f9005800640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c190 tx=0x7f8fe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c7dcbcf9be57fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.310+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005ad0 con 0x7f8fe8003970 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.310+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff402d070 con 0x7f8fe8003970 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.310+0000 7f8fffe00640 1 -- 172.21.15.33:0/2413025832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005e90 con 0x7f8fe8003970 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 -- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 msgr2=0x7f8fe8003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c190 tx=0x7f8fe80057f0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 -- 172.21.15.33:0/2413025832 shutdown_connections 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 --2- 172.21.15.33:0/2413025832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 -- 172.21.15.33:0/2413025832 >> 172.21.15.33:0/2413025832 conn(0x7f90000b0510 msgr2=0x7f90000b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 -- 172.21.15.33:0/2413025832 shutdown_connections 2024-09-13T18:59:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.311+0000 7f9008200640 1 -- 172.21.15.33:0/2413025832 wait complete. 2024-09-13T18:59:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.313+0000 7f9008200640 1 Processor -- start 2024-09-13T18:59:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.313+0000 7f9008200640 1 -- start start 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8003970 0x7f9000156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9000151430 0x7f9000147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001583c0 con 0x7f9000157a00 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900015b450 con 0x7f8fe8003970 2024-09-13T18:59:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9008200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9000156ca0 con 0x7f9000151430 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9005800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8003970 0x7f9000156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34096/0 (socket says 172.21.15.33:34096) 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9004e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9000151430 0x7f9000147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 -- 172.21.15.33:0/351356170 learned_addr learned my addr 172.21.15.33:0/351356170 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 -- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9000151430 msgr2=0x7f9000147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9000151430 0x7f9000147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 -- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8003970 msgr2=0x7f9000156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8003970 0x7f9000156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.314+0000 7f9006200640 1 -- 172.21.15.33:0/351356170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000156ef0 con 0x7f9000157a00 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f9006200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f90000cadd0 tx=0x7f8ff800fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8006d60 con 0x7f9000157a00 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8003970 con 0x7f9000157a00 2024-09-13T18:59:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900015ab20 con 0x7f9000157a00 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8003d20 con 0x7f9000157a00 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.315+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900015b0e0 con 0x7f9000157a00 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.316+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900006fa90 con 0x7f9000157a00 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.317+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ff800d6b0 con 0x7f9000157a00 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.318+0000 7f8ffd600640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.318+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ff8088750 con 0x7f9000157a00 2024-09-13T18:59:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.319+0000 7f9005800640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.319+0000 7f9005800640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 0x7f8fe006d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4032000 tx=0x7f8ff402d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.322+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8ff8053940 con 0x7f9000157a00 2024-09-13T18:59:24.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.499+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f900015a4d0 con 0x7f8fe006ac30 2024-09-13T18:59:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.507+0000 7f8ffd600640 1 -- 172.21.15.33:0/351356170 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278486 (secure 0 0 0) 0x7f8ff40016c0 con 0x7f8fe006ac30 2024-09-13T18:59:24.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 msgr2=0x7f8fe006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 0x7f8fe006d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4032000 tx=0x7f8ff402d000 comp rx=0 tx=0).stop 2024-09-13T18:59:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 msgr2=0x7f9000157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f90000cadd0 tx=0x7f8ff800fca0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 shutdown_connections 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9000157a00 0x7f9000157e80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9000151430 0x7f9000147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 --2- 172.21.15.33:0/351356170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8003970 0x7f9000156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 >> 172.21.15.33:0/351356170 conn(0x7f90000b0510 msgr2=0x7f9000071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 shutdown_connections 2024-09-13T18:59:24.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:24.511+0000 7f9008200640 1 -- 172.21.15.33:0/351356170 wait complete. 2024-09-13T18:59:24.530 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-13T18:59:23.125046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222660,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752060,"statfs":{"total":773094113280,"available":772866109440,"internally_reserved":0,"allocated":6647808,"data_stored":3428655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":221236795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.914684"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220068+0000","last_change":"2024-09-13T18:59:17.220068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220068+0000","last_undegraded":"2024-09-13T18:59:17.220068+0000","last_fullsized":"2024-09-13T18:59:17.220068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217247+0000","last_change":"2024-09-13T18:59:17.217247+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217247+0000","last_undegraded":"2024-09-13T18:59:17.217247+0000","last_fullsized":"2024-09-13T18:59:17.217247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218362+0000","last_change":"2024-09-13T18:59:17.218362+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218362+0000","last_undegraded":"2024-09-13T18:59:17.218362+0000","last_fullsized":"2024-09-13T18:59:17.218362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219586+0000","last_change":"2024-09-13T18:59:17.219586+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219586+0000","last_undegraded":"2024-09-13T18:59:17.219586+0000","last_fullsized":"2024-09-13T18:59:17.219586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213516+0000","last_change":"2024-09-13T18:59:17.213516+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213516+0000","last_undegraded":"2024-09-13T18:59:17.213516+0000","last_fullsized":"2024-09-13T18:59:17.213516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219457+0000","last_change":"2024-09-13T18:59:17.219457+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219457+0000","last_undegraded":"2024-09-13T18:59:17.219457+0000","last_fullsized":"2024-09-13T18:59:17.219457+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219920+0000","last_change":"2024-09-13T18:59:17.219920+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219920+0000","last_undegraded":"2024-09-13T18:59:17.219920+0000","last_fullsized":"2024-09-13T18:59:17.219920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213600+0000","last_change":"2024-09-13T18:59:17.213600+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213600+0000","last_undegraded":"2024-09-13T18:59:17.213600+0000","last_fullsized":"2024-09-13T18:59:17.213600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214502+0000","last_change":"2024-09-13T18:59:17.214502+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214502+0000","last_undegraded":"2024-09-13T18:59:17.214502+0000","last_fullsized":"2024-09-13T18:59:17.214502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216410+0000","last_change":"2024-09-13T18:59:17.216410+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216410+0000","last_undegraded":"2024-09-13T18:59:17.216410+0000","last_fullsized":"2024-09-13T18:59:17.216410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214454+0000","last_change":"2024-09-13T18:59:17.214454+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214454+0000","last_undegraded":"2024-09-13T18:59:17.214454+0000","last_fullsized":"2024-09-13T18:59:17.214454+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213676+0000","last_change":"2024-09-13T18:59:17.213676+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213676+0000","last_undegraded":"2024-09-13T18:59:17.213676+0000","last_fullsized":"2024-09-13T18:59:17.213676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.216290+0000","last_change":"2024-09-13T18:59:17.216290+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.216290+0000","last_undegraded":"2024-09-13T18:59:17.216290+0000","last_fullsized":"2024-09-13T18:59:17.216290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221923+0000","last_change":"2024-09-13T18:59:17.221923+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221923+0000","last_undegraded":"2024-09-13T18:59:17.221923+0000","last_fullsized":"2024-09-13T18:59:17.221923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219389+0000","last_change":"2024-09-13T18:59:17.219389+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219389+0000","last_undegraded":"2024-09-13T18:59:17.219389+0000","last_fullsized":"2024-09-13T18:59:17.219389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.214309+0000","last_change":"2024-09-13T18:59:17.214309+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.214309+0000","last_undegraded":"2024-09-13T18:59:17.214309+0000","last_fullsized":"2024-09-13T18:59:17.214309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215501+0000","last_change":"2024-09-13T18:59:17.215501+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215501+0000","last_undegraded":"2024-09-13T18:59:17.215501+0000","last_fullsized":"2024-09-13T18:59:17.215501+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218424+0000","last_change":"2024-09-13T18:59:17.218424+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218424+0000","last_undegraded":"2024-09-13T18:59:17.218424+0000","last_fullsized":"2024-09-13T18:59:17.218424+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219379+0000","last_change":"2024-09-13T18:59:17.219379+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219379+0000","last_undegraded":"2024-09-13T18:59:17.219379+0000","last_fullsized":"2024-09-13T18:59:17.219379+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.218112+0000","last_change":"2024-09-13T18:59:17.218112+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.218112+0000","last_undegraded":"2024-09-13T18:59:17.218112+0000","last_fullsized":"2024-09-13T18:59:17.218112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215482+0000","last_change":"2024-09-13T18:59:17.215482+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215482+0000","last_undegraded":"2024-09-13T18:59:17.215482+0000","last_fullsized":"2024-09-13T18:59:17.215482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220492+0000","last_change":"2024-09-13T18:59:17.220492+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220492+0000","last_undegraded":"2024-09-13T18:59:17.220492+0000","last_fullsized":"2024-09-13T18:59:17.220492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219068+0000","last_change":"2024-09-13T18:59:17.219068+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219068+0000","last_undegraded":"2024-09-13T18:59:17.219068+0000","last_fullsized":"2024-09-13T18:59:17.219068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220304+0000","last_change":"2024-09-13T18:59:17.220304+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220304+0000","last_undegraded":"2024-09-13T18:59:17.220304+0000","last_fullsized":"2024-09-13T18:59:17.220304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.217935+0000","last_change":"2024-09-13T18:59:17.217935+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.217935+0000","last_undegraded":"2024-09-13T18:59:17.217935+0000","last_fullsized":"2024-09-13T18:59:17.217935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221900+0000","last_change":"2024-09-13T18:59:17.221900+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221900+0000","last_undegraded":"2024-09-13T18:59:17.221900+0000","last_fullsized":"2024-09-13T18:59:17.221900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219035+0000","last_change":"2024-09-13T18:59:17.219035+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219035+0000","last_undegraded":"2024-09-13T18:59:17.219035+0000","last_fullsized":"2024-09-13T18:59:17.219035+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.219452+0000","last_change":"2024-09-13T18:59:17.219452+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.219452+0000","last_undegraded":"2024-09-13T18:59:17.219452+0000","last_fullsized":"2024-09-13T18:59:17.219452+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.213620+0000","last_change":"2024-09-13T18:59:17.213620+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.213620+0000","last_undegraded":"2024-09-13T18:59:17.213620+0000","last_fullsized":"2024-09-13T18:59:17.213620+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.220269+0000","last_change":"2024-09-13T18:59:17.220269+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.220269+0000","last_undegraded":"2024-09-13T18:59:17.220269+0000","last_fullsized":"2024-09-13T18:59:17.220269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.215906+0000","last_change":"2024-09-13T18:59:17.215906+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.215906+0000","last_undegraded":"2024-09-13T18:59:17.215906+0000","last_fullsized":"2024-09-13T18:59:17.215906+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:18.210386+0000","last_change":"2024-09-13T18:59:18.210386+0000","last_active":"2024-09-13T18:59:18.210386+0000","last_peered":"2024-09-13T18:59:18.210386+0000","last_clean":"2024-09-13T18:59:18.210386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:18.210386+0000","last_undegraded":"2024-09-13T18:59:18.210386+0000","last_fullsized":"2024-09-13T18:59:18.210386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:59:17.221907+0000","last_change":"2024-09-13T18:59:17.221907+0000","last_active":"2024-09-13T18:59:17.204364+0000","last_peered":"2024-09-13T18:59:17.204364+0000","last_clean":"2024-09-13T18:59:17.204364+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:17.221907+0000","last_undegraded":"2024-09-13T18:59:17.221907+0000","last_fullsized":"2024-09-13T18:59:17.221907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:59:14.583767+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:14.583767+0000","last_peered":"2024-09-13T18:59:14.583767+0000","last_clean":"2024-09-13T18:59:14.583767+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:14.583767+0000","last_undegraded":"2024-09-13T18:59:14.583767+0000","last_fullsized":"2024-09-13T18:59:14.583767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.378},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.78500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.378}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.318}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":872085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.441}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":1.151}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.093},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":1.0309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:27.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.751+0000 7efdbc600640 1 Processor -- start 2024-09-13T18:59:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.751+0000 7efdbc600640 1 -- start start 2024-09-13T18:59:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdbc600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdb4153b20 0x7efdb40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdbc600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb406f660 0x7efdb406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdbc600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb4153f00 con 0x7efdb4159a80 2024-09-13T18:59:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdbc600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb40ce600 con 0x7efdb4153b20 2024-09-13T18:59:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdbc600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4070f90 con 0x7efdb406f660 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdb9c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdb4153b20 0x7efdb40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdb9c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdb4153b20 0x7efdb40b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34108/0 (socket says 172.21.15.33:34108) 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdb9c00640 1 -- 172.21.15.33:0/2771151905 learned_addr learned my addr 172.21.15.33:0/2771151905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.753+0000 7efdba600640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb406f660 0x7efdb406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.754+0000 7efdb9c00640 1 -- 172.21.15.33:0/2771151905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb406f660 msgr2=0x7efdb406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.754+0000 7efdb9c00640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb406f660 0x7efdb406fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.754+0000 7efdb9c00640 1 -- 172.21.15.33:0/2771151905 >> v1:172.21.15.103:6789/0 conn(0x7efdb4159a80 legacy=0x7efdb40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.754+0000 7efdb9c00640 1 -- 172.21.15.33:0/2771151905 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40b1a40 con 0x7efdb4153b20 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdb9c00640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4153b20 0x7efdb40b3990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efda80098a0 tx=0x7efda802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192b212fd8738358 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdb3e00640 1 -- 172.21.15.33:0/2771151905 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8032440 con 0x7efdb4153b20 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdb3e00640 1 -- 172.21.15.33:0/2771151905 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80325a0 con 0x7efdb4153b20 2024-09-13T18:59:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdb3e00640 1 -- 172.21.15.33:0/2771151905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8032930 con 0x7efdb4153b20 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdbc600640 1 -- 172.21.15.33:0/2771151905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4153b20 msgr2=0x7efdb40b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.755+0000 7efdbc600640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4153b20 0x7efdb40b3990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efda80098a0 tx=0x7efda802a250 comp rx=0 tx=0).stop 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 -- 172.21.15.33:0/2771151905 shutdown_connections 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb406f660 0x7efdb406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 --2- 172.21.15.33:0/2771151905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4153b20 0x7efdb40b3990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 -- 172.21.15.33:0/2771151905 >> 172.21.15.33:0/2771151905 conn(0x7efdb40b0510 msgr2=0x7efdb40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 -- 172.21.15.33:0/2771151905 shutdown_connections 2024-09-13T18:59:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.756+0000 7efdbc600640 1 -- 172.21.15.33:0/2771151905 wait complete. 2024-09-13T18:59:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.757+0000 7efdbc600640 1 Processor -- start 2024-09-13T18:59:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.757+0000 7efdbc600640 1 -- start start 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdb406f660 0x7efdb4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb4153b20 0x7efdb4152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41f5af0 con 0x7efdb4159a80 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41f6870 con 0x7efdb406f660 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.758+0000 7efdbc600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41f5d90 con 0x7efdb4153b20 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34112/0 (socket says 172.21.15.33:34112) 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 -- 172.21.15.33:0/2016959502 learned_addr learned my addr 172.21.15.33:0/2016959502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdb9c00640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdb406f660 0x7efdb4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdb9200640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb4153b20 0x7efdb4152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 -- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb4153b20 msgr2=0x7efdb4152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb4153b20 0x7efdb4152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 -- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdb406f660 msgr2=0x7efdb4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdb406f660 0x7efdb4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 -- 172.21.15.33:0/2016959502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80094d0 con 0x7efdb4159a80 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.759+0000 7efdba600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efdac007e60 tx=0x7efdac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.760+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014420 con 0x7efdb4159a80 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.760+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0145a0 con 0x7efdb4159a80 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.760+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb41f6070 con 0x7efdb4159a80 2024-09-13T18:59:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.760+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014950 con 0x7efdb4159a80 2024-09-13T18:59:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.760+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb4156000 con 0x7efdb4159a80 2024-09-13T18:59:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.761+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb4159ef0 con 0x7efdb4159a80 2024-09-13T18:59:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.762+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdac014ab0 con 0x7efdb4159a80 2024-09-13T18:59:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.763+0000 7efdb1600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 0x7efd9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.763+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdac089ba0 con 0x7efdb4159a80 2024-09-13T18:59:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.763+0000 7efdb9c00640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 0x7efd9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.764+0000 7efdb9c00640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 0x7efd9406d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efda8034000 tx=0x7efda802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:27.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.767+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efdb4159ef0 con 0x7efdb4159a80 2024-09-13T18:59:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.942+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdb415a7b0 con 0x7efd9406ac00 2024-09-13T18:59:27.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.951+0000 7efdb1600640 1 -- 172.21.15.33:0/2016959502 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289494 (secure 0 0 0) 0x7efda80042f0 con 0x7efd9406ac00 2024-09-13T18:59:27.957 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:27.959 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:27.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 msgr2=0x7efd9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 0x7efd9406d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efda8034000 tx=0x7efda802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 msgr2=0x7efdb415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efdac007e60 tx=0x7efdac00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 shutdown_connections 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efd9406ac00 0x7efd9406d0c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb4159a80 0x7efdb415c0e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdb4153b20 0x7efdb4152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.954+0000 7efdbc600640 1 --2- 172.21.15.33:0/2016959502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdb406f660 0x7efdb4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.955+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 >> 172.21.15.33:0/2016959502 conn(0x7efdb40b0510 msgr2=0x7efdb415d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.955+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 shutdown_connections 2024-09-13T18:59:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:27.955+0000 7efdbc600640 1 -- 172.21.15.33:0/2016959502 wait complete. 2024-09-13T18:59:27.976 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-13T18:59:27.126201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227112,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":220147,"kb_avail":754747608,"statfs":{"total":773094113280,"available":772861550592,"internally_reserved":0,"allocated":7020544,"data_stored":3593932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":225431099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.466116"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667368+0000","last_change":"2024-09-13T18:59:18.683269+0000","last_active":"2024-09-13T18:59:19.667368+0000","last_peered":"2024-09-13T18:59:19.667368+0000","last_clean":"2024-09-13T18:59:19.667368+0000","last_became_active":"2024-09-13T18:59:18.682996+0000","last_became_peered":"2024-09-13T18:59:18.682996+0000","last_unstale":"2024-09-13T18:59:19.667368+0000","last_undegraded":"2024-09-13T18:59:19.667368+0000","last_fullsized":"2024-09-13T18:59:19.667368+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:44.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387252+0000","last_change":"2024-09-13T18:59:18.688776+0000","last_active":"2024-09-13T18:59:20.387252+0000","last_peered":"2024-09-13T18:59:20.387252+0000","last_clean":"2024-09-13T18:59:20.387252+0000","last_became_active":"2024-09-13T18:59:18.688538+0000","last_became_peered":"2024-09-13T18:59:18.688538+0000","last_unstale":"2024-09-13T18:59:20.387252+0000","last_undegraded":"2024-09-13T18:59:20.387252+0000","last_fullsized":"2024-09-13T18:59:20.387252+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:44.669878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668727+0000","last_change":"2024-09-13T18:59:18.673781+0000","last_active":"2024-09-13T18:59:19.668727+0000","last_peered":"2024-09-13T18:59:19.668727+0000","last_clean":"2024-09-13T18:59:19.668727+0000","last_became_active":"2024-09-13T18:59:18.673415+0000","last_became_peered":"2024-09-13T18:59:18.673415+0000","last_unstale":"2024-09-13T18:59:19.668727+0000","last_undegraded":"2024-09-13T18:59:19.668727+0000","last_fullsized":"2024-09-13T18:59:19.668727+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:38.265683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668579+0000","last_change":"2024-09-13T18:59:18.682695+0000","last_active":"2024-09-13T18:59:19.668579+0000","last_peered":"2024-09-13T18:59:19.668579+0000","last_clean":"2024-09-13T18:59:19.668579+0000","last_became_active":"2024-09-13T18:59:18.682413+0000","last_became_peered":"2024-09-13T18:59:18.682413+0000","last_unstale":"2024-09-13T18:59:19.668579+0000","last_undegraded":"2024-09-13T18:59:19.668579+0000","last_fullsized":"2024-09-13T18:59:19.668579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:20.220163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667099+0000","last_change":"2024-09-13T18:59:18.685257+0000","last_active":"2024-09-13T18:59:19.667099+0000","last_peered":"2024-09-13T18:59:19.667099+0000","last_clean":"2024-09-13T18:59:19.667099+0000","last_became_active":"2024-09-13T18:59:18.685008+0000","last_became_peered":"2024-09-13T18:59:18.685008+0000","last_unstale":"2024-09-13T18:59:19.667099+0000","last_undegraded":"2024-09-13T18:59:19.667099+0000","last_fullsized":"2024-09-13T18:59:19.667099+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:07.308041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.401917+0000","last_change":"2024-09-13T18:59:18.675106+0000","last_active":"2024-09-13T18:59:20.401917+0000","last_peered":"2024-09-13T18:59:20.401917+0000","last_clean":"2024-09-13T18:59:20.401917+0000","last_became_active":"2024-09-13T18:59:18.674678+0000","last_became_peered":"2024-09-13T18:59:18.674678+0000","last_unstale":"2024-09-13T18:59:20.401917+0000","last_undegraded":"2024-09-13T18:59:20.401917+0000","last_fullsized":"2024-09-13T18:59:20.401917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:15.720420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402666+0000","last_change":"2024-09-13T18:59:18.684517+0000","last_active":"2024-09-13T18:59:20.402666+0000","last_peered":"2024-09-13T18:59:20.402666+0000","last_clean":"2024-09-13T18:59:20.402666+0000","last_became_active":"2024-09-13T18:59:18.684235+0000","last_became_peered":"2024-09-13T18:59:18.684235+0000","last_unstale":"2024-09-13T18:59:20.402666+0000","last_undegraded":"2024-09-13T18:59:20.402666+0000","last_fullsized":"2024-09-13T18:59:20.402666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:59.733214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.386917+0000","last_change":"2024-09-13T18:59:18.676366+0000","last_active":"2024-09-13T18:59:20.386917+0000","last_peered":"2024-09-13T18:59:20.386917+0000","last_clean":"2024-09-13T18:59:20.386917+0000","last_became_active":"2024-09-13T18:59:18.675644+0000","last_became_peered":"2024-09-13T18:59:18.675644+0000","last_unstale":"2024-09-13T18:59:20.386917+0000","last_undegraded":"2024-09-13T18:59:20.386917+0000","last_fullsized":"2024-09-13T18:59:20.386917+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:20.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402954+0000","last_change":"2024-09-13T18:59:18.687403+0000","last_active":"2024-09-13T18:59:20.402954+0000","last_peered":"2024-09-13T18:59:20.402954+0000","last_clean":"2024-09-13T18:59:20.402954+0000","last_became_active":"2024-09-13T18:59:18.687122+0000","last_became_peered":"2024-09-13T18:59:18.687122+0000","last_unstale":"2024-09-13T18:59:20.402954+0000","last_undegraded":"2024-09-13T18:59:20.402954+0000","last_fullsized":"2024-09-13T18:59:20.402954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:39.855649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402833+0000","last_change":"2024-09-13T18:59:18.685932+0000","last_active":"2024-09-13T18:59:20.402833+0000","last_peered":"2024-09-13T18:59:20.402833+0000","last_clean":"2024-09-13T18:59:20.402833+0000","last_became_active":"2024-09-13T18:59:18.685595+0000","last_became_peered":"2024-09-13T18:59:18.685595+0000","last_unstale":"2024-09-13T18:59:20.402833+0000","last_undegraded":"2024-09-13T18:59:20.402833+0000","last_fullsized":"2024-09-13T18:59:20.402833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:31.362804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402718+0000","last_change":"2024-09-13T18:59:18.687102+0000","last_active":"2024-09-13T18:59:20.402718+0000","last_peered":"2024-09-13T18:59:20.402718+0000","last_clean":"2024-09-13T18:59:20.402718+0000","last_became_active":"2024-09-13T18:59:18.686852+0000","last_became_peered":"2024-09-13T18:59:18.686852+0000","last_unstale":"2024-09-13T18:59:20.402718+0000","last_undegraded":"2024-09-13T18:59:20.402718+0000","last_fullsized":"2024-09-13T18:59:20.402718+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:09.222000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668688+0000","last_change":"2024-09-13T18:59:18.690873+0000","last_active":"2024-09-13T18:59:19.668688+0000","last_peered":"2024-09-13T18:59:19.668688+0000","last_clean":"2024-09-13T18:59:19.668688+0000","last_became_active":"2024-09-13T18:59:18.690562+0000","last_became_peered":"2024-09-13T18:59:18.690562+0000","last_unstale":"2024-09-13T18:59:19.668688+0000","last_undegraded":"2024-09-13T18:59:19.668688+0000","last_fullsized":"2024-09-13T18:59:19.668688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:39.810146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.403066+0000","last_change":"2024-09-13T18:59:18.689694+0000","last_active":"2024-09-13T18:59:20.403066+0000","last_peered":"2024-09-13T18:59:20.403066+0000","last_clean":"2024-09-13T18:59:20.403066+0000","last_became_active":"2024-09-13T18:59:18.689381+0000","last_became_peered":"2024-09-13T18:59:18.689381+0000","last_unstale":"2024-09-13T18:59:20.403066+0000","last_undegraded":"2024-09-13T18:59:20.403066+0000","last_fullsized":"2024-09-13T18:59:20.403066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:27.522766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402784+0000","last_change":"2024-09-13T18:59:18.679593+0000","last_active":"2024-09-13T18:59:20.402784+0000","last_peered":"2024-09-13T18:59:20.402784+0000","last_clean":"2024-09-13T18:59:20.402784+0000","last_became_active":"2024-09-13T18:59:18.677100+0000","last_became_peered":"2024-09-13T18:59:18.677100+0000","last_unstale":"2024-09-13T18:59:20.402784+0000","last_undegraded":"2024-09-13T18:59:20.402784+0000","last_fullsized":"2024-09-13T18:59:20.402784+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:01.466466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.403038+0000","last_change":"2024-09-13T18:59:18.684000+0000","last_active":"2024-09-13T18:59:20.403038+0000","last_peered":"2024-09-13T18:59:20.403038+0000","last_clean":"2024-09-13T18:59:20.403038+0000","last_became_active":"2024-09-13T18:59:18.683683+0000","last_became_peered":"2024-09-13T18:59:18.683683+0000","last_unstale":"2024-09-13T18:59:20.403038+0000","last_undegraded":"2024-09-13T18:59:20.403038+0000","last_fullsized":"2024-09-13T18:59:20.403038+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:28.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402113+0000","last_change":"2024-09-13T18:59:18.678519+0000","last_active":"2024-09-13T18:59:20.402113+0000","last_peered":"2024-09-13T18:59:20.402113+0000","last_clean":"2024-09-13T18:59:20.402113+0000","last_became_active":"2024-09-13T18:59:18.678259+0000","last_became_peered":"2024-09-13T18:59:18.678259+0000","last_unstale":"2024-09-13T18:59:20.402113+0000","last_undegraded":"2024-09-13T18:59:20.402113+0000","last_fullsized":"2024-09-13T18:59:20.402113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:44.669878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387298+0000","last_change":"2024-09-13T18:59:18.678487+0000","last_active":"2024-09-13T18:59:20.387298+0000","last_peered":"2024-09-13T18:59:20.387298+0000","last_clean":"2024-09-13T18:59:20.387298+0000","last_became_active":"2024-09-13T18:59:18.676740+0000","last_became_peered":"2024-09-13T18:59:18.676740+0000","last_unstale":"2024-09-13T18:59:20.387298+0000","last_undegraded":"2024-09-13T18:59:20.387298+0000","last_fullsized":"2024-09-13T18:59:20.387298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:01.898389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668845+0000","last_change":"2024-09-13T18:59:18.678365+0000","last_active":"2024-09-13T18:59:19.668845+0000","last_peered":"2024-09-13T18:59:19.668845+0000","last_clean":"2024-09-13T18:59:19.668845+0000","last_became_active":"2024-09-13T18:59:18.678109+0000","last_became_peered":"2024-09-13T18:59:18.678109+0000","last_unstale":"2024-09-13T18:59:19.668845+0000","last_undegraded":"2024-09-13T18:59:19.668845+0000","last_fullsized":"2024-09-13T18:59:19.668845+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:39.810146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667193+0000","last_change":"2024-09-13T18:59:18.673516+0000","last_active":"2024-09-13T18:59:19.667193+0000","last_peered":"2024-09-13T18:59:19.667193+0000","last_clean":"2024-09-13T18:59:19.667193+0000","last_became_active":"2024-09-13T18:59:18.672737+0000","last_became_peered":"2024-09-13T18:59:18.672737+0000","last_unstale":"2024-09-13T18:59:19.667193+0000","last_undegraded":"2024-09-13T18:59:19.667193+0000","last_fullsized":"2024-09-13T18:59:19.667193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:41.025701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.386981+0000","last_change":"2024-09-13T18:59:18.694475+0000","last_active":"2024-09-13T18:59:20.386981+0000","last_peered":"2024-09-13T18:59:20.386981+0000","last_clean":"2024-09-13T18:59:20.386981+0000","last_became_active":"2024-09-13T18:59:18.694231+0000","last_became_peered":"2024-09-13T18:59:18.694231+0000","last_unstale":"2024-09-13T18:59:20.386981+0000","last_undegraded":"2024-09-13T18:59:20.386981+0000","last_fullsized":"2024-09-13T18:59:20.386981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:32.536936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668471+0000","last_change":"2024-09-13T18:59:18.687435+0000","last_active":"2024-09-13T18:59:19.668471+0000","last_peered":"2024-09-13T18:59:19.668471+0000","last_clean":"2024-09-13T18:59:19.668471+0000","last_became_active":"2024-09-13T18:59:18.687054+0000","last_became_peered":"2024-09-13T18:59:18.687054+0000","last_unstale":"2024-09-13T18:59:19.668471+0000","last_undegraded":"2024-09-13T18:59:19.668471+0000","last_fullsized":"2024-09-13T18:59:19.668471+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:46.817334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.386850+0000","last_change":"2024-09-13T18:59:18.677641+0000","last_active":"2024-09-13T18:59:20.386850+0000","last_peered":"2024-09-13T18:59:20.386850+0000","last_clean":"2024-09-13T18:59:20.386850+0000","last_became_active":"2024-09-13T18:59:18.677347+0000","last_became_peered":"2024-09-13T18:59:18.677347+0000","last_unstale":"2024-09-13T18:59:20.386850+0000","last_undegraded":"2024-09-13T18:59:20.386850+0000","last_fullsized":"2024-09-13T18:59:20.386850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:10.891653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668572+0000","last_change":"2024-09-13T18:59:18.685907+0000","last_active":"2024-09-13T18:59:19.668572+0000","last_peered":"2024-09-13T18:59:19.668572+0000","last_clean":"2024-09-13T18:59:19.668572+0000","last_became_active":"2024-09-13T18:59:18.683994+0000","last_became_peered":"2024-09-13T18:59:18.683994+0000","last_unstale":"2024-09-13T18:59:19.668572+0000","last_undegraded":"2024-09-13T18:59:19.668572+0000","last_fullsized":"2024-09-13T18:59:19.668572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:19.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402931+0000","last_change":"2024-09-13T18:59:18.678053+0000","last_active":"2024-09-13T18:59:20.402931+0000","last_peered":"2024-09-13T18:59:20.402931+0000","last_clean":"2024-09-13T18:59:20.402931+0000","last_became_active":"2024-09-13T18:59:18.677772+0000","last_became_peered":"2024-09-13T18:59:18.677772+0000","last_unstale":"2024-09-13T18:59:20.402931+0000","last_undegraded":"2024-09-13T18:59:20.402931+0000","last_fullsized":"2024-09-13T18:59:20.402931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:32.628025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667356+0000","last_change":"2024-09-13T18:59:18.686023+0000","last_active":"2024-09-13T18:59:19.667356+0000","last_peered":"2024-09-13T18:59:19.667356+0000","last_clean":"2024-09-13T18:59:19.667356+0000","last_became_active":"2024-09-13T18:59:18.685784+0000","last_became_peered":"2024-09-13T18:59:18.685784+0000","last_unstale":"2024-09-13T18:59:19.667356+0000","last_undegraded":"2024-09-13T18:59:19.667356+0000","last_fullsized":"2024-09-13T18:59:19.667356+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:30.862385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668825+0000","last_change":"2024-09-13T18:59:18.691251+0000","last_active":"2024-09-13T18:59:19.668825+0000","last_peered":"2024-09-13T18:59:19.668825+0000","last_clean":"2024-09-13T18:59:19.668825+0000","last_became_active":"2024-09-13T18:59:18.690975+0000","last_became_peered":"2024-09-13T18:59:18.690975+0000","last_unstale":"2024-09-13T18:59:19.668825+0000","last_undegraded":"2024-09-13T18:59:19.668825+0000","last_fullsized":"2024-09-13T18:59:19.668825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:15.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402307+0000","last_change":"2024-09-13T18:59:18.685578+0000","last_active":"2024-09-13T18:59:20.402307+0000","last_peered":"2024-09-13T18:59:20.402307+0000","last_clean":"2024-09-13T18:59:20.402307+0000","last_became_active":"2024-09-13T18:59:18.679058+0000","last_became_peered":"2024-09-13T18:59:18.679058+0000","last_unstale":"2024-09-13T18:59:20.402307+0000","last_undegraded":"2024-09-13T18:59:20.402307+0000","last_fullsized":"2024-09-13T18:59:20.402307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:20.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667270+0000","last_change":"2024-09-13T18:59:18.694692+0000","last_active":"2024-09-13T18:59:19.667270+0000","last_peered":"2024-09-13T18:59:19.667270+0000","last_clean":"2024-09-13T18:59:19.667270+0000","last_became_active":"2024-09-13T18:59:18.691121+0000","last_became_peered":"2024-09-13T18:59:18.691121+0000","last_unstale":"2024-09-13T18:59:19.667270+0000","last_undegraded":"2024-09-13T18:59:19.667270+0000","last_fullsized":"2024-09-13T18:59:19.667270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:49.243729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387226+0000","last_change":"2024-09-13T18:59:18.687846+0000","last_active":"2024-09-13T18:59:20.387226+0000","last_peered":"2024-09-13T18:59:20.387226+0000","last_clean":"2024-09-13T18:59:20.387226+0000","last_became_active":"2024-09-13T18:59:18.687521+0000","last_became_peered":"2024-09-13T18:59:18.687521+0000","last_unstale":"2024-09-13T18:59:20.387226+0000","last_undegraded":"2024-09-13T18:59:20.387226+0000","last_fullsized":"2024-09-13T18:59:20.387226+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.423816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.669429+0000","last_change":"2024-09-13T18:59:18.673147+0000","last_active":"2024-09-13T18:59:19.669429+0000","last_peered":"2024-09-13T18:59:19.669429+0000","last_clean":"2024-09-13T18:59:19.669429+0000","last_became_active":"2024-09-13T18:59:18.672798+0000","last_became_peered":"2024-09-13T18:59:18.672798+0000","last_unstale":"2024-09-13T18:59:19.669429+0000","last_undegraded":"2024-09-13T18:59:19.669429+0000","last_fullsized":"2024-09-13T18:59:19.669429+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:15.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.667052+0000","last_change":"2024-09-13T18:59:18.674779+0000","last_active":"2024-09-13T18:59:19.667052+0000","last_peered":"2024-09-13T18:59:19.667052+0000","last_clean":"2024-09-13T18:59:19.667052+0000","last_became_active":"2024-09-13T18:59:18.674527+0000","last_became_peered":"2024-09-13T18:59:18.674527+0000","last_unstale":"2024-09-13T18:59:19.667052+0000","last_undegraded":"2024-09-13T18:59:19.667052+0000","last_fullsized":"2024-09-13T18:59:19.667052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:28.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402191+0000","last_change":"2024-09-13T18:59:18.678290+0000","last_active":"2024-09-13T18:59:20.402191+0000","last_peered":"2024-09-13T18:59:20.402191+0000","last_clean":"2024-09-13T18:59:20.402191+0000","last_became_active":"2024-09-13T18:59:18.677838+0000","last_became_peered":"2024-09-13T18:59:18.677838+0000","last_unstale":"2024-09-13T18:59:20.402191+0000","last_undegraded":"2024-09-13T18:59:20.402191+0000","last_fullsized":"2024-09-13T18:59:20.402191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:48.986561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402600+0000","last_change":"2024-09-13T18:59:18.678398+0000","last_active":"2024-09-13T18:59:20.402600+0000","last_peered":"2024-09-13T18:59:20.402600+0000","last_clean":"2024-09-13T18:59:20.402600+0000","last_became_active":"2024-09-13T18:59:18.678142+0000","last_became_peered":"2024-09-13T18:59:18.678142+0000","last_unstale":"2024-09-13T18:59:20.402600+0000","last_undegraded":"2024-09-13T18:59:20.402600+0000","last_fullsized":"2024-09-13T18:59:20.402600+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:41.838440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.700343+0000","last_change":"2024-09-13T18:59:18.244199+0000","last_active":"2024-09-13T18:59:18.700343+0000","last_peered":"2024-09-13T18:59:18.700343+0000","last_clean":"2024-09-13T18:59:18.700343+0000","last_became_active":"2024-09-13T18:59:18.243916+0000","last_became_peered":"2024-09-13T18:59:18.243916+0000","last_unstale":"2024-09-13T18:59:18.700343+0000","last_undegraded":"2024-09-13T18:59:18.700343+0000","last_fullsized":"2024-09-13T18:59:18.700343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:48.701249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402756+0000","last_change":"2024-09-13T18:59:18.686001+0000","last_active":"2024-09-13T18:59:20.402756+0000","last_peered":"2024-09-13T18:59:20.402756+0000","last_clean":"2024-09-13T18:59:20.402756+0000","last_became_active":"2024-09-13T18:59:18.685614+0000","last_became_peered":"2024-09-13T18:59:18.685614+0000","last_unstale":"2024-09-13T18:59:20.402756+0000","last_undegraded":"2024-09-13T18:59:20.402756+0000","last_fullsized":"2024-09-13T18:59:20.402756+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:43.491855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.691879+0000","last_change":"2024-09-13T18:59:18.243635+0000","last_active":"2024-09-13T18:59:18.691879+0000","last_peered":"2024-09-13T18:59:18.691879+0000","last_clean":"2024-09-13T18:59:18.691879+0000","last_became_active":"2024-09-13T18:59:18.243040+0000","last_became_peered":"2024-09-13T18:59:18.243040+0000","last_unstale":"2024-09-13T18:59:18.691879+0000","last_undegraded":"2024-09-13T18:59:18.691879+0000","last_fullsized":"2024-09-13T18:59:18.691879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:00.460444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402375+0000","last_change":"2024-09-13T18:59:18.676722+0000","last_active":"2024-09-13T18:59:20.402375+0000","last_peered":"2024-09-13T18:59:20.402375+0000","last_clean":"2024-09-13T18:59:20.402375+0000","last_became_active":"2024-09-13T18:59:18.676351+0000","last_became_peered":"2024-09-13T18:59:18.676351+0000","last_unstale":"2024-09-13T18:59:20.402375+0000","last_undegraded":"2024-09-13T18:59:20.402375+0000","last_fullsized":"2024-09-13T18:59:20.402375+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:47.664095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.700202+0000","last_change":"2024-09-13T18:59:18.242597+0000","last_active":"2024-09-13T18:59:18.700202+0000","last_peered":"2024-09-13T18:59:18.700202+0000","last_clean":"2024-09-13T18:59:18.700202+0000","last_became_active":"2024-09-13T18:59:18.242336+0000","last_became_peered":"2024-09-13T18:59:18.242336+0000","last_unstale":"2024-09-13T18:59:18.700202+0000","last_undegraded":"2024-09-13T18:59:18.700202+0000","last_fullsized":"2024-09-13T18:59:18.700202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:03.382333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402421+0000","last_change":"2024-09-13T18:59:18.691797+0000","last_active":"2024-09-13T18:59:20.402421+0000","last_peered":"2024-09-13T18:59:20.402421+0000","last_clean":"2024-09-13T18:59:20.402421+0000","last_became_active":"2024-09-13T18:59:18.691538+0000","last_became_peered":"2024-09-13T18:59:18.691538+0000","last_unstale":"2024-09-13T18:59:20.402421+0000","last_undegraded":"2024-09-13T18:59:20.402421+0000","last_fullsized":"2024-09-13T18:59:20.402421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:38.675709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.695980+0000","last_change":"2024-09-13T18:59:18.245922+0000","last_active":"2024-09-13T18:59:18.695980+0000","last_peered":"2024-09-13T18:59:18.695980+0000","last_clean":"2024-09-13T18:59:18.695980+0000","last_became_active":"2024-09-13T18:59:18.245659+0000","last_became_peered":"2024-09-13T18:59:18.245659+0000","last_unstale":"2024-09-13T18:59:18.695980+0000","last_undegraded":"2024-09-13T18:59:18.695980+0000","last_fullsized":"2024-09-13T18:59:18.695980+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387077+0000","last_change":"2024-09-13T18:59:18.677466+0000","last_active":"2024-09-13T18:59:20.387077+0000","last_peered":"2024-09-13T18:59:20.387077+0000","last_clean":"2024-09-13T18:59:20.387077+0000","last_became_active":"2024-09-13T18:59:18.677179+0000","last_became_peered":"2024-09-13T18:59:18.677179+0000","last_unstale":"2024-09-13T18:59:20.387077+0000","last_undegraded":"2024-09-13T18:59:20.387077+0000","last_fullsized":"2024-09-13T18:59:20.387077+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:09.847461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.696353+0000","last_change":"2024-09-13T18:59:18.246772+0000","last_active":"2024-09-13T18:59:18.696353+0000","last_peered":"2024-09-13T18:59:18.696353+0000","last_clean":"2024-09-13T18:59:18.696353+0000","last_became_active":"2024-09-13T18:59:18.246466+0000","last_became_peered":"2024-09-13T18:59:18.246466+0000","last_unstale":"2024-09-13T18:59:18.696353+0000","last_undegraded":"2024-09-13T18:59:18.696353+0000","last_fullsized":"2024-09-13T18:59:18.696353+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387106+0000","last_change":"2024-09-13T18:59:18.695501+0000","last_active":"2024-09-13T18:59:20.387106+0000","last_peered":"2024-09-13T18:59:20.387106+0000","last_clean":"2024-09-13T18:59:20.387106+0000","last_became_active":"2024-09-13T18:59:18.695209+0000","last_became_peered":"2024-09-13T18:59:18.695209+0000","last_unstale":"2024-09-13T18:59:20.387106+0000","last_undegraded":"2024-09-13T18:59:20.387106+0000","last_fullsized":"2024-09-13T18:59:20.387106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:24.453600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.700317+0000","last_change":"2024-09-13T18:59:18.243087+0000","last_active":"2024-09-13T18:59:18.700317+0000","last_peered":"2024-09-13T18:59:18.700317+0000","last_clean":"2024-09-13T18:59:18.700317+0000","last_became_active":"2024-09-13T18:59:18.242798+0000","last_became_peered":"2024-09-13T18:59:18.242798+0000","last_unstale":"2024-09-13T18:59:18.700317+0000","last_undegraded":"2024-09-13T18:59:18.700317+0000","last_fullsized":"2024-09-13T18:59:18.700317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:38.849626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402651+0000","last_change":"2024-09-13T18:59:18.679262+0000","last_active":"2024-09-13T18:59:20.402651+0000","last_peered":"2024-09-13T18:59:20.402651+0000","last_clean":"2024-09-13T18:59:20.402651+0000","last_became_active":"2024-09-13T18:59:18.677780+0000","last_became_peered":"2024-09-13T18:59:18.677780+0000","last_unstale":"2024-09-13T18:59:20.402651+0000","last_undegraded":"2024-09-13T18:59:20.402651+0000","last_fullsized":"2024-09-13T18:59:20.402651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:26.121851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.676640+0000","last_change":"2024-09-13T18:59:18.243350+0000","last_active":"2024-09-13T18:59:18.676640+0000","last_peered":"2024-09-13T18:59:18.676640+0000","last_clean":"2024-09-13T18:59:18.676640+0000","last_became_active":"2024-09-13T18:59:18.243013+0000","last_became_peered":"2024-09-13T18:59:18.243013+0000","last_unstale":"2024-09-13T18:59:18.676640+0000","last_undegraded":"2024-09-13T18:59:18.676640+0000","last_fullsized":"2024-09-13T18:59:18.676640+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.386911+0000","last_change":"2024-09-13T18:59:18.680801+0000","last_active":"2024-09-13T18:59:20.386911+0000","last_peered":"2024-09-13T18:59:20.386911+0000","last_clean":"2024-09-13T18:59:20.386911+0000","last_became_active":"2024-09-13T18:59:18.679862+0000","last_became_peered":"2024-09-13T18:59:18.679862+0000","last_unstale":"2024-09-13T18:59:20.386911+0000","last_undegraded":"2024-09-13T18:59:20.386911+0000","last_fullsized":"2024-09-13T18:59:20.386911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:21.420991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.670530+0000","last_change":"2024-09-13T18:59:18.240938+0000","last_active":"2024-09-13T18:59:18.670530+0000","last_peered":"2024-09-13T18:59:18.670530+0000","last_clean":"2024-09-13T18:59:18.670530+0000","last_became_active":"2024-09-13T18:59:18.240651+0000","last_became_peered":"2024-09-13T18:59:18.240651+0000","last_unstale":"2024-09-13T18:59:18.670530+0000","last_undegraded":"2024-09-13T18:59:18.670530+0000","last_fullsized":"2024-09-13T18:59:18.670530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.403165+0000","last_change":"2024-09-13T18:59:18.689764+0000","last_active":"2024-09-13T18:59:20.403165+0000","last_peered":"2024-09-13T18:59:20.403165+0000","last_clean":"2024-09-13T18:59:20.403165+0000","last_became_active":"2024-09-13T18:59:18.689479+0000","last_became_peered":"2024-09-13T18:59:18.689479+0000","last_unstale":"2024-09-13T18:59:20.403165+0000","last_undegraded":"2024-09-13T18:59:20.403165+0000","last_fullsized":"2024-09-13T18:59:20.403165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:00.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.666724+0000","last_change":"2024-09-13T18:59:18.246363+0000","last_active":"2024-09-13T18:59:18.666724+0000","last_peered":"2024-09-13T18:59:18.666724+0000","last_clean":"2024-09-13T18:59:18.666724+0000","last_became_active":"2024-09-13T18:59:18.246032+0000","last_became_peered":"2024-09-13T18:59:18.246032+0000","last_unstale":"2024-09-13T18:59:18.666724+0000","last_undegraded":"2024-09-13T18:59:18.666724+0000","last_fullsized":"2024-09-13T18:59:18.666724+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:08.215977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.669312+0000","last_change":"2024-09-13T18:59:18.677859+0000","last_active":"2024-09-13T18:59:19.669312+0000","last_peered":"2024-09-13T18:59:19.669312+0000","last_clean":"2024-09-13T18:59:19.669312+0000","last_became_active":"2024-09-13T18:59:18.676323+0000","last_became_peered":"2024-09-13T18:59:18.676323+0000","last_unstale":"2024-09-13T18:59:19.669312+0000","last_undegraded":"2024-09-13T18:59:19.669312+0000","last_fullsized":"2024-09-13T18:59:19.669312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:04.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.665815+0000","last_change":"2024-09-13T18:59:18.243806+0000","last_active":"2024-09-13T18:59:18.665815+0000","last_peered":"2024-09-13T18:59:18.665815+0000","last_clean":"2024-09-13T18:59:18.665815+0000","last_became_active":"2024-09-13T18:59:18.243380+0000","last_became_peered":"2024-09-13T18:59:18.243380+0000","last_unstale":"2024-09-13T18:59:18.665815+0000","last_undegraded":"2024-09-13T18:59:18.665815+0000","last_fullsized":"2024-09-13T18:59:18.665815+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:59.811236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402494+0000","last_change":"2024-09-13T18:59:18.680040+0000","last_active":"2024-09-13T18:59:20.402494+0000","last_peered":"2024-09-13T18:59:20.402494+0000","last_clean":"2024-09-13T18:59:20.402494+0000","last_became_active":"2024-09-13T18:59:18.679312+0000","last_became_peered":"2024-09-13T18:59:18.679312+0000","last_unstale":"2024-09-13T18:59:20.402494+0000","last_undegraded":"2024-09-13T18:59:20.402494+0000","last_fullsized":"2024-09-13T18:59:20.402494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:19.642949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.698142+0000","last_change":"2024-09-13T18:59:18.248285+0000","last_active":"2024-09-13T18:59:18.698142+0000","last_peered":"2024-09-13T18:59:18.698142+0000","last_clean":"2024-09-13T18:59:18.698142+0000","last_became_active":"2024-09-13T18:59:18.247949+0000","last_became_peered":"2024-09-13T18:59:18.247949+0000","last_unstale":"2024-09-13T18:59:18.698142+0000","last_undegraded":"2024-09-13T18:59:18.698142+0000","last_fullsized":"2024-09-13T18:59:18.698142+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668815+0000","last_change":"2024-09-13T18:59:18.676884+0000","last_active":"2024-09-13T18:59:19.668815+0000","last_peered":"2024-09-13T18:59:19.668815+0000","last_clean":"2024-09-13T18:59:19.668815+0000","last_became_active":"2024-09-13T18:59:18.674830+0000","last_became_peered":"2024-09-13T18:59:18.674830+0000","last_unstale":"2024-09-13T18:59:19.668815+0000","last_undegraded":"2024-09-13T18:59:19.668815+0000","last_fullsized":"2024-09-13T18:59:19.668815+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:41.838440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.701390+0000","last_change":"2024-09-13T18:59:18.242902+0000","last_active":"2024-09-13T18:59:18.701390+0000","last_peered":"2024-09-13T18:59:18.701390+0000","last_clean":"2024-09-13T18:59:18.701390+0000","last_became_active":"2024-09-13T18:59:18.242588+0000","last_became_peered":"2024-09-13T18:59:18.242588+0000","last_unstale":"2024-09-13T18:59:18.701390+0000","last_undegraded":"2024-09-13T18:59:18.701390+0000","last_fullsized":"2024-09-13T18:59:18.701390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668279+0000","last_change":"2024-09-13T18:59:18.690747+0000","last_active":"2024-09-13T18:59:19.668279+0000","last_peered":"2024-09-13T18:59:19.668279+0000","last_clean":"2024-09-13T18:59:19.668279+0000","last_became_active":"2024-09-13T18:59:18.690436+0000","last_became_peered":"2024-09-13T18:59:18.690436+0000","last_unstale":"2024-09-13T18:59:19.668279+0000","last_undegraded":"2024-09-13T18:59:19.668279+0000","last_fullsized":"2024-09-13T18:59:19.668279+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:28.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.698936+0000","last_change":"2024-09-13T18:59:18.246027+0000","last_active":"2024-09-13T18:59:18.698936+0000","last_peered":"2024-09-13T18:59:18.698936+0000","last_clean":"2024-09-13T18:59:18.698936+0000","last_became_active":"2024-09-13T18:59:18.245809+0000","last_became_peered":"2024-09-13T18:59:18.245809+0000","last_unstale":"2024-09-13T18:59:18.698936+0000","last_undegraded":"2024-09-13T18:59:18.698936+0000","last_fullsized":"2024-09-13T18:59:18.698936+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:27.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668551+0000","last_change":"2024-09-13T18:59:18.677691+0000","last_active":"2024-09-13T18:59:19.668551+0000","last_peered":"2024-09-13T18:59:19.668551+0000","last_clean":"2024-09-13T18:59:19.668551+0000","last_became_active":"2024-09-13T18:59:18.676769+0000","last_became_peered":"2024-09-13T18:59:18.676769+0000","last_unstale":"2024-09-13T18:59:19.668551+0000","last_undegraded":"2024-09-13T18:59:19.668551+0000","last_fullsized":"2024-09-13T18:59:19.668551+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:00.835253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.665781+0000","last_change":"2024-09-13T18:59:18.238947+0000","last_active":"2024-09-13T18:59:18.665781+0000","last_peered":"2024-09-13T18:59:18.665781+0000","last_clean":"2024-09-13T18:59:18.665781+0000","last_became_active":"2024-09-13T18:59:18.238694+0000","last_became_peered":"2024-09-13T18:59:18.238694+0000","last_unstale":"2024-09-13T18:59:18.665781+0000","last_undegraded":"2024-09-13T18:59:18.665781+0000","last_fullsized":"2024-09-13T18:59:18.665781+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.967044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402949+0000","last_change":"2024-09-13T18:59:18.676504+0000","last_active":"2024-09-13T18:59:20.402949+0000","last_peered":"2024-09-13T18:59:20.402949+0000","last_clean":"2024-09-13T18:59:20.402949+0000","last_became_active":"2024-09-13T18:59:18.676259+0000","last_became_peered":"2024-09-13T18:59:18.676259+0000","last_unstale":"2024-09-13T18:59:20.402949+0000","last_undegraded":"2024-09-13T18:59:20.402949+0000","last_fullsized":"2024-09-13T18:59:20.402949+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:29.783916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.676739+0000","last_change":"2024-09-13T18:59:18.243930+0000","last_active":"2024-09-13T18:59:18.676739+0000","last_peered":"2024-09-13T18:59:18.676739+0000","last_clean":"2024-09-13T18:59:18.676739+0000","last_became_active":"2024-09-13T18:59:18.243619+0000","last_became_peered":"2024-09-13T18:59:18.243619+0000","last_unstale":"2024-09-13T18:59:18.676739+0000","last_undegraded":"2024-09-13T18:59:18.676739+0000","last_fullsized":"2024-09-13T18:59:18.676739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:18.636926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668719+0000","last_change":"2024-09-13T18:59:18.686103+0000","last_active":"2024-09-13T18:59:19.668719+0000","last_peered":"2024-09-13T18:59:19.668719+0000","last_clean":"2024-09-13T18:59:19.668719+0000","last_became_active":"2024-09-13T18:59:18.683175+0000","last_became_peered":"2024-09-13T18:59:18.683175+0000","last_unstale":"2024-09-13T18:59:19.668719+0000","last_undegraded":"2024-09-13T18:59:19.668719+0000","last_fullsized":"2024-09-13T18:59:19.668719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:20.220163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.695997+0000","last_change":"2024-09-13T18:59:18.242861+0000","last_active":"2024-09-13T18:59:18.695997+0000","last_peered":"2024-09-13T18:59:18.695997+0000","last_clean":"2024-09-13T18:59:18.695997+0000","last_became_active":"2024-09-13T18:59:18.242581+0000","last_became_peered":"2024-09-13T18:59:18.242581+0000","last_unstale":"2024-09-13T18:59:18.695997+0000","last_undegraded":"2024-09-13T18:59:18.695997+0000","last_fullsized":"2024-09-13T18:59:18.695997+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668925+0000","last_change":"2024-09-13T18:59:18.674693+0000","last_active":"2024-09-13T18:59:19.668925+0000","last_peered":"2024-09-13T18:59:19.668925+0000","last_clean":"2024-09-13T18:59:19.668925+0000","last_became_active":"2024-09-13T18:59:18.674416+0000","last_became_peered":"2024-09-13T18:59:18.674416+0000","last_unstale":"2024-09-13T18:59:19.668925+0000","last_undegraded":"2024-09-13T18:59:19.668925+0000","last_fullsized":"2024-09-13T18:59:19.668925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.728704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.698492+0000","last_change":"2024-09-13T18:59:18.244282+0000","last_active":"2024-09-13T18:59:18.698492+0000","last_peered":"2024-09-13T18:59:18.698492+0000","last_clean":"2024-09-13T18:59:18.698492+0000","last_became_active":"2024-09-13T18:59:18.243982+0000","last_became_peered":"2024-09-13T18:59:18.243982+0000","last_unstale":"2024-09-13T18:59:18.698492+0000","last_undegraded":"2024-09-13T18:59:18.698492+0000","last_fullsized":"2024-09-13T18:59:18.698492+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.727192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668835+0000","last_change":"2024-09-13T18:59:18.688140+0000","last_active":"2024-09-13T18:59:19.668835+0000","last_peered":"2024-09-13T18:59:19.668835+0000","last_clean":"2024-09-13T18:59:19.668835+0000","last_became_active":"2024-09-13T18:59:18.687882+0000","last_became_peered":"2024-09-13T18:59:18.687882+0000","last_unstale":"2024-09-13T18:59:19.668835+0000","last_undegraded":"2024-09-13T18:59:19.668835+0000","last_fullsized":"2024-09-13T18:59:19.668835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:00.835253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.701077+0000","last_change":"2024-09-13T18:59:18.246299+0000","last_active":"2024-09-13T18:59:18.701077+0000","last_peered":"2024-09-13T18:59:18.701077+0000","last_clean":"2024-09-13T18:59:18.701077+0000","last_became_active":"2024-09-13T18:59:18.246064+0000","last_became_peered":"2024-09-13T18:59:18.246064+0000","last_unstale":"2024-09-13T18:59:18.701077+0000","last_undegraded":"2024-09-13T18:59:18.701077+0000","last_fullsized":"2024-09-13T18:59:18.701077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:02.598225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387132+0000","last_change":"2024-09-13T18:59:18.678424+0000","last_active":"2024-09-13T18:59:20.387132+0000","last_peered":"2024-09-13T18:59:20.387132+0000","last_clean":"2024-09-13T18:59:20.387132+0000","last_became_active":"2024-09-13T18:59:18.678102+0000","last_became_peered":"2024-09-13T18:59:18.678102+0000","last_unstale":"2024-09-13T18:59:20.387132+0000","last_undegraded":"2024-09-13T18:59:20.387132+0000","last_fullsized":"2024-09-13T18:59:20.387132+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:38.675709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.694921+0000","last_change":"2024-09-13T18:59:18.243945+0000","last_active":"2024-09-13T18:59:18.694921+0000","last_peered":"2024-09-13T18:59:18.694921+0000","last_clean":"2024-09-13T18:59:18.694921+0000","last_became_active":"2024-09-13T18:59:18.243670+0000","last_became_peered":"2024-09-13T18:59:18.243670+0000","last_unstale":"2024-09-13T18:59:18.694921+0000","last_undegraded":"2024-09-13T18:59:18.694921+0000","last_fullsized":"2024-09-13T18:59:18.694921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:30.356781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668902+0000","last_change":"2024-09-13T18:59:18.676732+0000","last_active":"2024-09-13T18:59:19.668902+0000","last_peered":"2024-09-13T18:59:19.668902+0000","last_clean":"2024-09-13T18:59:19.668902+0000","last_became_active":"2024-09-13T18:59:18.675203+0000","last_became_peered":"2024-09-13T18:59:18.675203+0000","last_unstale":"2024-09-13T18:59:19.668902+0000","last_undegraded":"2024-09-13T18:59:19.668902+0000","last_fullsized":"2024-09-13T18:59:19.668902+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:08.864508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.672058+0000","last_change":"2024-09-13T18:59:18.248856+0000","last_active":"2024-09-13T18:59:18.672058+0000","last_peered":"2024-09-13T18:59:18.672058+0000","last_clean":"2024-09-13T18:59:18.672058+0000","last_became_active":"2024-09-13T18:59:18.247113+0000","last_became_peered":"2024-09-13T18:59:18.247113+0000","last_unstale":"2024-09-13T18:59:18.672058+0000","last_undegraded":"2024-09-13T18:59:18.672058+0000","last_fullsized":"2024-09-13T18:59:18.672058+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:26.197648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668392+0000","last_change":"2024-09-13T18:59:18.688155+0000","last_active":"2024-09-13T18:59:19.668392+0000","last_peered":"2024-09-13T18:59:19.668392+0000","last_clean":"2024-09-13T18:59:19.668392+0000","last_became_active":"2024-09-13T18:59:18.683703+0000","last_became_peered":"2024-09-13T18:59:18.683703+0000","last_unstale":"2024-09-13T18:59:19.668392+0000","last_undegraded":"2024-09-13T18:59:19.668392+0000","last_fullsized":"2024-09-13T18:59:19.668392+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:01.466466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.695188+0000","last_change":"2024-09-13T18:59:18.244707+0000","last_active":"2024-09-13T18:59:18.695188+0000","last_peered":"2024-09-13T18:59:18.695188+0000","last_clean":"2024-09-13T18:59:18.695188+0000","last_became_active":"2024-09-13T18:59:18.244412+0000","last_became_peered":"2024-09-13T18:59:18.244412+0000","last_unstale":"2024-09-13T18:59:18.695188+0000","last_undegraded":"2024-09-13T18:59:18.695188+0000","last_fullsized":"2024-09-13T18:59:18.695188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402126+0000","last_change":"2024-09-13T18:59:18.677525+0000","last_active":"2024-09-13T18:59:20.402126+0000","last_peered":"2024-09-13T18:59:20.402126+0000","last_clean":"2024-09-13T18:59:20.402126+0000","last_became_active":"2024-09-13T18:59:18.677262+0000","last_became_peered":"2024-09-13T18:59:18.677262+0000","last_unstale":"2024-09-13T18:59:20.402126+0000","last_undegraded":"2024-09-13T18:59:20.402126+0000","last_fullsized":"2024-09-13T18:59:20.402126+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:54.990857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.671235+0000","last_change":"2024-09-13T18:59:18.242733+0000","last_active":"2024-09-13T18:59:18.671235+0000","last_peered":"2024-09-13T18:59:18.671235+0000","last_clean":"2024-09-13T18:59:18.671235+0000","last_became_active":"2024-09-13T18:59:18.241962+0000","last_became_peered":"2024-09-13T18:59:18.241962+0000","last_unstale":"2024-09-13T18:59:18.671235+0000","last_undegraded":"2024-09-13T18:59:18.671235+0000","last_fullsized":"2024-09-13T18:59:18.671235+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:26.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.401954+0000","last_change":"2024-09-13T18:59:18.675824+0000","last_active":"2024-09-13T18:59:20.401954+0000","last_peered":"2024-09-13T18:59:20.401954+0000","last_clean":"2024-09-13T18:59:20.401954+0000","last_became_active":"2024-09-13T18:59:18.675477+0000","last_became_peered":"2024-09-13T18:59:18.675477+0000","last_unstale":"2024-09-13T18:59:20.401954+0000","last_undegraded":"2024-09-13T18:59:20.401954+0000","last_fullsized":"2024-09-13T18:59:20.401954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:19.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.678193+0000","last_change":"2024-09-13T18:59:18.243774+0000","last_active":"2024-09-13T18:59:18.678193+0000","last_peered":"2024-09-13T18:59:18.678193+0000","last_clean":"2024-09-13T18:59:18.678193+0000","last_became_active":"2024-09-13T18:59:18.243220+0000","last_became_peered":"2024-09-13T18:59:18.243220+0000","last_unstale":"2024-09-13T18:59:18.678193+0000","last_undegraded":"2024-09-13T18:59:18.678193+0000","last_fullsized":"2024-09-13T18:59:18.678193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:23.198553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668971+0000","last_change":"2024-09-13T18:59:18.694452+0000","last_active":"2024-09-13T18:59:19.668971+0000","last_peered":"2024-09-13T18:59:19.668971+0000","last_clean":"2024-09-13T18:59:19.668971+0000","last_became_active":"2024-09-13T18:59:18.693566+0000","last_became_peered":"2024-09-13T18:59:18.693566+0000","last_unstale":"2024-09-13T18:59:19.668971+0000","last_undegraded":"2024-09-13T18:59:19.668971+0000","last_fullsized":"2024-09-13T18:59:19.668971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:38.265683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.693794+0000","last_change":"2024-09-13T18:59:18.240790+0000","last_active":"2024-09-13T18:59:18.693794+0000","last_peered":"2024-09-13T18:59:18.693794+0000","last_clean":"2024-09-13T18:59:18.693794+0000","last_became_active":"2024-09-13T18:59:18.240468+0000","last_became_peered":"2024-09-13T18:59:18.240468+0000","last_unstale":"2024-09-13T18:59:18.693794+0000","last_undegraded":"2024-09-13T18:59:18.693794+0000","last_fullsized":"2024-09-13T18:59:18.693794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.669005+0000","last_change":"2024-09-13T18:59:18.693328+0000","last_active":"2024-09-13T18:59:19.669005+0000","last_peered":"2024-09-13T18:59:19.669005+0000","last_clean":"2024-09-13T18:59:19.669005+0000","last_became_active":"2024-09-13T18:59:18.692140+0000","last_became_peered":"2024-09-13T18:59:18.692140+0000","last_unstale":"2024-09-13T18:59:19.669005+0000","last_undegraded":"2024-09-13T18:59:19.669005+0000","last_fullsized":"2024-09-13T18:59:19.669005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:08.728704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.675887+0000","last_change":"2024-09-13T18:59:18.243827+0000","last_active":"2024-09-13T18:59:18.675887+0000","last_peered":"2024-09-13T18:59:18.675887+0000","last_clean":"2024-09-13T18:59:18.675887+0000","last_became_active":"2024-09-13T18:59:18.243563+0000","last_became_peered":"2024-09-13T18:59:18.243563+0000","last_unstale":"2024-09-13T18:59:18.675887+0000","last_undegraded":"2024-09-13T18:59:18.675887+0000","last_fullsized":"2024-09-13T18:59:18.675887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:28.777894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402592+0000","last_change":"2024-09-13T18:59:18.680315+0000","last_active":"2024-09-13T18:59:20.402592+0000","last_peered":"2024-09-13T18:59:20.402592+0000","last_clean":"2024-09-13T18:59:20.402592+0000","last_became_active":"2024-09-13T18:59:18.680060+0000","last_became_peered":"2024-09-13T18:59:18.680060+0000","last_unstale":"2024-09-13T18:59:20.402592+0000","last_undegraded":"2024-09-13T18:59:20.402592+0000","last_fullsized":"2024-09-13T18:59:20.402592+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:57.009954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.664844+0000","last_change":"2024-09-13T18:59:18.235802+0000","last_active":"2024-09-13T18:59:18.664844+0000","last_peered":"2024-09-13T18:59:18.664844+0000","last_clean":"2024-09-13T18:59:18.664844+0000","last_became_active":"2024-09-13T18:59:18.234970+0000","last_became_peered":"2024-09-13T18:59:18.234970+0000","last_unstale":"2024-09-13T18:59:18.664844+0000","last_undegraded":"2024-09-13T18:59:18.664844+0000","last_fullsized":"2024-09-13T18:59:18.664844+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:43.384053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402529+0000","last_change":"2024-09-13T18:59:18.691932+0000","last_active":"2024-09-13T18:59:20.402529+0000","last_peered":"2024-09-13T18:59:20.402529+0000","last_clean":"2024-09-13T18:59:20.402529+0000","last_became_active":"2024-09-13T18:59:18.691603+0000","last_became_peered":"2024-09-13T18:59:18.691603+0000","last_unstale":"2024-09-13T18:59:20.402529+0000","last_undegraded":"2024-09-13T18:59:20.402529+0000","last_fullsized":"2024-09-13T18:59:20.402529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:06.316972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.678501+0000","last_change":"2024-09-13T18:59:18.243939+0000","last_active":"2024-09-13T18:59:18.678501+0000","last_peered":"2024-09-13T18:59:18.678501+0000","last_clean":"2024-09-13T18:59:18.678501+0000","last_became_active":"2024-09-13T18:59:18.243676+0000","last_became_peered":"2024-09-13T18:59:18.243676+0000","last_unstale":"2024-09-13T18:59:18.678501+0000","last_undegraded":"2024-09-13T18:59:18.678501+0000","last_fullsized":"2024-09-13T18:59:18.678501+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.485832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387028+0000","last_change":"2024-09-13T18:59:18.685686+0000","last_active":"2024-09-13T18:59:20.387028+0000","last_peered":"2024-09-13T18:59:20.387028+0000","last_clean":"2024-09-13T18:59:20.387028+0000","last_became_active":"2024-09-13T18:59:18.685359+0000","last_became_peered":"2024-09-13T18:59:18.685359+0000","last_unstale":"2024-09-13T18:59:20.387028+0000","last_undegraded":"2024-09-13T18:59:20.387028+0000","last_fullsized":"2024-09-13T18:59:20.387028+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:15.720420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.671377+0000","last_change":"2024-09-13T18:59:18.244902+0000","last_active":"2024-09-13T18:59:18.671377+0000","last_peered":"2024-09-13T18:59:18.671377+0000","last_clean":"2024-09-13T18:59:18.671377+0000","last_became_active":"2024-09-13T18:59:18.241947+0000","last_became_peered":"2024-09-13T18:59:18.241947+0000","last_unstale":"2024-09-13T18:59:18.671377+0000","last_undegraded":"2024-09-13T18:59:18.671377+0000","last_fullsized":"2024-09-13T18:59:18.671377+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:31.622003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:19.668691+0000","last_change":"2024-09-13T18:59:18.680131+0000","last_active":"2024-09-13T18:59:19.668691+0000","last_peered":"2024-09-13T18:59:19.668691+0000","last_clean":"2024-09-13T18:59:19.668691+0000","last_became_active":"2024-09-13T18:59:18.679110+0000","last_became_peered":"2024-09-13T18:59:18.679110+0000","last_unstale":"2024-09-13T18:59:19.668691+0000","last_undegraded":"2024-09-13T18:59:19.668691+0000","last_fullsized":"2024-09-13T18:59:19.668691+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:48.986561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.670905+0000","last_change":"2024-09-13T18:59:18.242909+0000","last_active":"2024-09-13T18:59:18.670905+0000","last_peered":"2024-09-13T18:59:18.670905+0000","last_clean":"2024-09-13T18:59:18.670905+0000","last_became_active":"2024-09-13T18:59:18.242596+0000","last_became_peered":"2024-09-13T18:59:18.242596+0000","last_unstale":"2024-09-13T18:59:18.670905+0000","last_undegraded":"2024-09-13T18:59:18.670905+0000","last_fullsized":"2024-09-13T18:59:18.670905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:26.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.402059+0000","last_change":"2024-09-13T18:59:18.678873+0000","last_active":"2024-09-13T18:59:20.402059+0000","last_peered":"2024-09-13T18:59:20.402059+0000","last_clean":"2024-09-13T18:59:20.402059+0000","last_became_active":"2024-09-13T18:59:18.678643+0000","last_became_peered":"2024-09-13T18:59:18.678643+0000","last_unstale":"2024-09-13T18:59:20.402059+0000","last_undegraded":"2024-09-13T18:59:20.402059+0000","last_fullsized":"2024-09-13T18:59:20.402059+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:03.251879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.671267+0000","last_change":"2024-09-13T18:59:18.236435+0000","last_active":"2024-09-13T18:59:18.671267+0000","last_peered":"2024-09-13T18:59:18.671267+0000","last_clean":"2024-09-13T18:59:18.671267+0000","last_became_active":"2024-09-13T18:59:18.236125+0000","last_became_peered":"2024-09-13T18:59:18.236125+0000","last_unstale":"2024-09-13T18:59:18.671267+0000","last_undegraded":"2024-09-13T18:59:18.671267+0000","last_fullsized":"2024-09-13T18:59:18.671267+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:25.115829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387178+0000","last_change":"2024-09-13T18:59:18.679851+0000","last_active":"2024-09-13T18:59:20.387178+0000","last_peered":"2024-09-13T18:59:20.387178+0000","last_clean":"2024-09-13T18:59:20.387178+0000","last_became_active":"2024-09-13T18:59:18.679520+0000","last_became_peered":"2024-09-13T18:59:18.679520+0000","last_unstale":"2024-09-13T18:59:20.387178+0000","last_undegraded":"2024-09-13T18:59:20.387178+0000","last_fullsized":"2024-09-13T18:59:20.387178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:06.900988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.669061+0000","last_change":"2024-09-13T18:59:18.242699+0000","last_active":"2024-09-13T18:59:18.669061+0000","last_peered":"2024-09-13T18:59:18.669061+0000","last_clean":"2024-09-13T18:59:18.669061+0000","last_became_active":"2024-09-13T18:59:18.242316+0000","last_became_peered":"2024-09-13T18:59:18.242316+0000","last_unstale":"2024-09-13T18:59:18.669061+0000","last_undegraded":"2024-09-13T18:59:18.669061+0000","last_fullsized":"2024-09-13T18:59:18.669061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:07.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:59:20.387095+0000","last_change":"2024-09-13T18:59:18.680595+0000","last_active":"2024-09-13T18:59:20.387095+0000","last_peered":"2024-09-13T18:59:20.387095+0000","last_clean":"2024-09-13T18:59:20.387095+0000","last_became_active":"2024-09-13T18:59:18.680308+0000","last_became_peered":"2024-09-13T18:59:18.680308+0000","last_unstale":"2024-09-13T18:59:20.387095+0000","last_undegraded":"2024-09-13T18:59:20.387095+0000","last_fullsized":"2024-09-13T18:59:20.387095+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:18.210386+0000","last_clean_scrub_stamp":"2024-09-13T18:59:18.210386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:35.404103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.665249+0000","last_change":"2024-09-13T18:59:18.241312+0000","last_active":"2024-09-13T18:59:18.665249+0000","last_peered":"2024-09-13T18:59:18.665249+0000","last_clean":"2024-09-13T18:59:18.665249+0000","last_became_active":"2024-09-13T18:59:18.241006+0000","last_became_peered":"2024-09-13T18:59:18.241006+0000","last_unstale":"2024-09-13T18:59:18.665249+0000","last_undegraded":"2024-09-13T18:59:18.665249+0000","last_fullsized":"2024-09-13T18:59:18.665249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:17.204364+0000","last_clean_scrub_stamp":"2024-09-13T18:59:17.204364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:29.856363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:59:18.665266+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:18.665266+0000","last_peered":"2024-09-13T18:59:18.665266+0000","last_clean":"2024-09-13T18:59:18.665266+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:18.665266+0000","last_undegraded":"2024-09-13T18:59:18.665266+0000","last_fullsized":"2024-09-13T18:59:18.665266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1323008,"data_stored":891587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.502},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":301059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.629}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.747}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.72299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.749},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.5}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.71699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":302623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.436}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":301149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.442}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.92600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.94699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":893573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.503},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":0.91800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:59:27.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:59:28.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.175+0000 7f6766e00640 1 Processor -- start 2024-09-13T18:59:28.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.175+0000 7f6766e00640 1 -- start start 2024-09-13T18:59:28.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6766e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f676006f830 0x7f676006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6766e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600ce490 con 0x7f6760070420 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6766e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676006b7c0 con 0x7f6760154ad0 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6766e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676006b5b0 con 0x7f676006f830 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6757e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f676006f830 0x7f676006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6764e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6760070420 0x7f67600cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39634/0 (socket says 172.21.15.33:39634) 2024-09-13T18:59:28.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.176+0000 7f6764e00640 1 -- 172.21.15.33:0/3655825340 learned_addr learned my addr 172.21.15.33:0/3655825340 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:28.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.177+0000 7f6757e00640 1 -- 172.21.15.33:0/3655825340 >> v1:172.21.15.103:6789/0 conn(0x7f6760154ad0 legacy=0x7f67600cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.177+0000 7f6757e00640 1 -- 172.21.15.33:0/3655825340 >> v1:172.21.15.33:6789/0 conn(0x7f6760070420 legacy=0x7f67600cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.177+0000 7f675f400640 1 -- 172.21.15.33:0/3655825340 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90405080 0 0) 0x7f67600ce490 con 0x7f6760070420 2024-09-13T18:59:28.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.177+0000 7f6757e00640 1 -- 172.21.15.33:0/3655825340 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676006baa0 con 0x7f676006f830 2024-09-13T18:59:28.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.178+0000 7f6757e00640 1 --2- 172.21.15.33:0/3655825340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f676006f830 0x7f676006fee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67480097a0 tx=0x7f674802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919ab6aac234af54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.178+0000 7f675f400640 1 -- 172.21.15.33:0/3655825340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748032440 con 0x7f676006f830 2024-09-13T18:59:28.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.178+0000 7f675f400640 1 -- 172.21.15.33:0/3655825340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67480325a0 con 0x7f676006f830 2024-09-13T18:59:28.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.178+0000 7f675f400640 1 -- 172.21.15.33:0/3655825340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748032930 con 0x7f676006f830 2024-09-13T18:59:28.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 -- 172.21.15.33:0/3655825340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f676006f830 msgr2=0x7f676006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 --2- 172.21.15.33:0/3655825340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f676006f830 0x7f676006fee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67480097a0 tx=0x7f674802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 -- 172.21.15.33:0/3655825340 shutdown_connections 2024-09-13T18:59:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 --2- 172.21.15.33:0/3655825340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f676006f830 0x7f676006fee0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 -- 172.21.15.33:0/3655825340 >> 172.21.15.33:0/3655825340 conn(0x7f67600b0580 msgr2=0x7f67600b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 -- 172.21.15.33:0/3655825340 shutdown_connections 2024-09-13T18:59:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.179+0000 7f6766e00640 1 -- 172.21.15.33:0/3655825340 wait complete. 2024-09-13T18:59:28.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.181+0000 7f6766e00640 1 Processor -- start 2024-09-13T18:59:28.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.181+0000 7f6766e00640 1 -- start start 2024-09-13T18:59:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 0x7f67601f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67601f2650 0x7f6760153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676014ece0 con 0x7f6760070420 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760147760 con 0x7f67601f2650 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6766e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760146ae0 con 0x7f6760154ad0 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f675fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f675fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34130/0 (socket says 172.21.15.33:34130) 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f675fe00640 1 -- 172.21.15.33:0/1305258497 learned_addr learned my addr 172.21.15.33:0/1305258497 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6757e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 0x7f67601f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.182+0000 7f6764e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67601f2650 0x7f6760153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 -- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 msgr2=0x7f67601f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 0x7f67601f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 -- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67601f2650 msgr2=0x7f6760153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67601f2650 0x7f6760153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 -- 172.21.15.33:0/1305258497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009400 con 0x7f6760070420 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f6757e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 0x7f67601f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675fe00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f675000c400 tx=0x7f675000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500052d0 con 0x7f6760070420 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6750005430 con 0x7f6760070420 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760146d30 con 0x7f6760070420 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750003830 con 0x7f6760070420 2024-09-13T18:59:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.183+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6760150900 con 0x7f6760070420 2024-09-13T18:59:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.184+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67600cc260 con 0x7f6760070420 2024-09-13T18:59:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.185+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6750003990 con 0x7f6760070420 2024-09-13T18:59:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.186+0000 7f675cc00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 0x7f673c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.186+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6750088a30 con 0x7f6760070420 2024-09-13T18:59:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.187+0000 7f6757e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 0x7f673c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.187+0000 7f6757e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 0x7f673c06d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6748034000 tx=0x7f674802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.190+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6750053ae0 con 0x7f6760070420 2024-09-13T18:59:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.433+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f676015e2b0 con 0x7f6760070420 2024-09-13T18:59:28.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.438+0000 7f675cc00640 1 -- 172.21.15.33:0/1305258497 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6750017020 con 0x7f6760070420 2024-09-13T18:59:28.441 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T18:59:28.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 msgr2=0x7f673c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 0x7f673c06d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6748034000 tx=0x7f674802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 msgr2=0x7f67601464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f675000c400 tx=0x7f675000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 shutdown_connections 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f673c06ac00 0x7f673c06d0c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67601f2650 0x7f6760153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6760154ad0 0x7f67601f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 --2- 172.21.15.33:0/1305258497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6760070420 0x7f67601464c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 >> 172.21.15.33:0/1305258497 conn(0x7f67600b0580 msgr2=0x7f676006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 shutdown_connections 2024-09-13T18:59:28.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.440+0000 7f6766e00640 1 -- 172.21.15.33:0/1305258497 wait complete. 2024-09-13T18:59:28.459 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.610+0000 7f3c6ae00640 1 Processor -- start 2024-09-13T18:59:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.610+0000 7f3c6ae00640 1 -- start start 2024-09-13T18:59:28.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c6ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c64159a80 0x7f3c6406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c6ae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c64153f00 con 0x7f3c64153b20 2024-09-13T18:59:28.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c6ae00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640b1a40 con 0x7f3c640b3990 2024-09-13T18:59:28.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c6ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c640ce600 con 0x7f3c64159a80 2024-09-13T18:59:28.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c63e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3c64153b20 0x7f3c640b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39642/0 (socket says 172.21.15.33:39642) 2024-09-13T18:59:28.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c63e00640 1 -- 172.21.15.33:0/615847506 learned_addr learned my addr 172.21.15.33:0/615847506 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:28.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.612+0000 7f3c68e00640 1 --2- 172.21.15.33:0/615847506 >> v2:172.21.15.103:3300/0 conn(0x7f3c64159a80 0x7f3c6406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.613+0000 7f3c63400640 1 -- 172.21.15.33:0/615847506 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443416100 0 0) 0x7f3c64153f00 con 0x7f3c64153b20 2024-09-13T18:59:28.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.613+0000 7f3c63400640 1 -- 172.21.15.33:0/615847506 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c48003520 con 0x7f3c64153b20 2024-09-13T18:59:28.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.613+0000 7f3c68e00640 1 -- 172.21.15.33:0/615847506 >> v1:172.21.15.103:6789/0 conn(0x7f3c640b3990 legacy=0x7f3c6406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.613+0000 7f3c68e00640 1 -- 172.21.15.33:0/615847506 >> v1:172.21.15.33:6789/0 conn(0x7f3c64153b20 legacy=0x7f3c640b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.613+0000 7f3c68e00640 1 -- 172.21.15.33:0/615847506 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6415a1f0 con 0x7f3c64159a80 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.614+0000 7f3c68e00640 1 --2- 172.21.15.33:0/615847506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64159a80 0x7f3c6406d060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be99c019c5c1a637 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.614+0000 7f3c63400640 1 -- 172.21.15.33:0/615847506 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c007740 con 0x7f3c64159a80 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.614+0000 7f3c63400640 1 -- 172.21.15.33:0/615847506 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c02d050 con 0x7f3c64159a80 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.614+0000 7f3c63400640 1 -- 172.21.15.33:0/615847506 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c007ac0 con 0x7f3c64159a80 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 -- 172.21.15.33:0/615847506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64159a80 msgr2=0x7f3c6406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/615847506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64159a80 0x7f3c6406d060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009d90 tx=0x7f3c5c02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 -- 172.21.15.33:0/615847506 shutdown_connections 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/615847506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64159a80 0x7f3c6406d060 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 -- 172.21.15.33:0/615847506 >> 172.21.15.33:0/615847506 conn(0x7f3c640b0510 msgr2=0x7f3c640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 -- 172.21.15.33:0/615847506 shutdown_connections 2024-09-13T18:59:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.615+0000 7f3c6ae00640 1 -- 172.21.15.33:0/615847506 wait complete. 2024-09-13T18:59:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.616+0000 7f3c6ae00640 1 Processor -- start 2024-09-13T18:59:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.616+0000 7f3c6ae00640 1 -- start start 2024-09-13T18:59:28.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c640b3990 0x7f3c640afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64159a80 0x7f3c6414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640b0310 con 0x7f3c64153b20 2024-09-13T18:59:28.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c641579f0 con 0x7f3c640b3990 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.617+0000 7f3c6ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64157cd0 con 0x7f3c64159a80 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34136/0 (socket says 172.21.15.33:34136) 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 -- 172.21.15.33:0/3089224684 learned_addr learned my addr 172.21.15.33:0/3089224684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c63e00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c640b3990 0x7f3c640afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c68e00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64159a80 0x7f3c6414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 -- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64159a80 msgr2=0x7f3c6414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64159a80 0x7f3c6414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 -- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c640b3990 msgr2=0x7f3c640afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c640b3990 0x7f3c640afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 -- 172.21.15.33:0/3089224684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009a70 con 0x7f3c64153b20 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.618+0000 7f3c5be00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c400 tx=0x7f3c4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.619+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0052d0 con 0x7f3c64153b20 2024-09-13T18:59:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.619+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c005430 con 0x7f3c64153b20 2024-09-13T18:59:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.619+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c003830 con 0x7f3c64153b20 2024-09-13T18:59:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.619+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64157fb0 con 0x7f3c64153b20 2024-09-13T18:59:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.619+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c64158570 con 0x7f3c64153b20 2024-09-13T18:59:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.620+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c640b1ed0 con 0x7f3c64153b20 2024-09-13T18:59:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.621+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c4c003990 con 0x7f3c64153b20 2024-09-13T18:59:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.622+0000 7f3c60c00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 0x7f3c4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.622+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c4c0888d0 con 0x7f3c64153b20 2024-09-13T18:59:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.622+0000 7f3c63e00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 0x7f3c4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.623+0000 7f3c63e00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 0x7f3c4006d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c540011e0 tx=0x7f3c54007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:28.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.626+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c4c053ac0 con 0x7f3c64153b20 2024-09-13T18:59:28.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.839+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c640b2280 con 0x7f3c64153b20 2024-09-13T18:59:28.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.839+0000 7f3c60c00640 1 -- 172.21.15.33:0/3089224684 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f3c4c017090 con 0x7f3c64153b20 2024-09-13T18:59:28.843 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:28.843 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:28.843 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 msgr2=0x7f3c4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 0x7f3c4006d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c540011e0 tx=0x7f3c54007d30 comp rx=0 tx=0).stop 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 msgr2=0x7f3c64152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c400 tx=0x7f3c4c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 shutdown_connections 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3c4006ac00 0x7f3c4006d0c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64159a80 0x7f3c6414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c64153b20 0x7f3c64152990 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 --2- 172.21.15.33:0/3089224684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c640b3990 0x7f3c640afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:28.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 >> 172.21.15.33:0/3089224684 conn(0x7f3c640b0510 msgr2=0x7f3c640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:28.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.841+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 shutdown_connections 2024-09-13T18:59:28.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:28.842+0000 7f3c6ae00640 1 -- 172.21.15.33:0/3089224684 wait complete. 2024-09-13T18:59:29.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:59:18.657429+0000', 'modified': '2024-09-13T18:59:21.672200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5907}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5907': {'gid': 5907, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6835/2343612269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6833', 'nonce': 2343612269}, {'type': 'v1', 'addr': '172.21.15.33:6835', 'nonce': 2343612269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:59:29.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:59:29.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:59:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.419+0000 7fbed6000640 1 Processor -- start 2024-09-13T18:59:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.419+0000 7fbed6000640 1 -- start start 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbed6000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbed006c310 0x7fbed00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbed6000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00b1f00 con 0x7fbed0070950 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbed6000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed015c650 con 0x7fbed015c270 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbed6000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed0070dc0 con 0x7fbed006c310 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbec6a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbed0070950 0x7fbed006bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39652/0 (socket says 172.21.15.33:39652) 2024-09-13T18:59:29.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbec6a00640 1 -- 172.21.15.33:0/48775604 learned_addr learned my addr 172.21.15.33:0/48775604 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbecfe00640 1 --2- 172.21.15.33:0/48775604 >> v2:172.21.15.103:3300/0 conn(0x7fbed006c310 0x7fbed00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695773544 0 0) 0x7fbed00b1f00 con 0x7fbed0070950 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.420+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb4003440 con 0x7fbed0070950 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685512376 0 0) 0x7fbed015c650 con 0x7fbed015c270 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed00b1f00 con 0x7fbed015c270 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecfe00640 1 -- 172.21.15.33:0/48775604 >> v1:172.21.15.103:6789/0 conn(0x7fbed015c270 legacy=0x7fbed006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155136683 0 0) 0x7fbeb4003440 con 0x7fbed0070950 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecfe00640 1 -- 172.21.15.33:0/48775604 >> v1:172.21.15.33:6789/0 conn(0x7fbed0070950 legacy=0x7fbed006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.421+0000 7fbecfe00640 1 -- 172.21.15.33:0/48775604 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00712c0 con 0x7fbed006c310 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.422+0000 7fbecfe00640 1 --2- 172.21.15.33:0/48775604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed00b33a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbed00714b0 tx=0x7fbec802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d08e0b94fc5881 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.422+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8001670 con 0x7fbed006c310 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.422+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec802d050 con 0x7fbed006c310 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.422+0000 7fbecea00640 1 -- 172.21.15.33:0/48775604 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007760 con 0x7fbed006c310 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 -- 172.21.15.33:0/48775604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 msgr2=0x7fbed00b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 --2- 172.21.15.33:0/48775604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed00b33a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbed00714b0 tx=0x7fbec802a680 comp rx=0 tx=0).stop 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 -- 172.21.15.33:0/48775604 shutdown_connections 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 --2- 172.21.15.33:0/48775604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed00b33a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 -- 172.21.15.33:0/48775604 >> 172.21.15.33:0/48775604 conn(0x7fbed00b0510 msgr2=0x7fbed00b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 -- 172.21.15.33:0/48775604 shutdown_connections 2024-09-13T18:59:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.423+0000 7fbed6000640 1 -- 172.21.15.33:0/48775604 wait complete. 2024-09-13T18:59:29.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 Processor -- start 2024-09-13T18:59:29.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 -- start start 2024-09-13T18:59:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed0143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 0x7fbed00afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0146aa0 con 0x7fbed0070950 2024-09-13T18:59:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01f64a0 con 0x7fbed006c310 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbed6000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0146450 con 0x7fbed015c270 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34152/0 (socket says 172.21.15.33:34152) 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbec6a00640 1 -- 172.21.15.33:0/2713179620 learned_addr learned my addr 172.21.15.33:0/2713179620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbecf400640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed0143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.426+0000 7fbecfe00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 0x7fbed00afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 -- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 msgr2=0x7fbed00afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 0x7fbed00afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 -- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 msgr2=0x7fbed0143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed0143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 -- 172.21.15.33:0/2713179620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8009a70 con 0x7fbed0070950 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbecfe00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 0x7fbed00afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80010e0 tx=0x7fbeb800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec7e00640 1 -- 172.21.15.33:0/2713179620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8005ad0 con 0x7fbed0070950 2024-09-13T18:59:29.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec7e00640 1 -- 172.21.15.33:0/2713179620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8005c30 con 0x7fbed0070950 2024-09-13T18:59:29.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbec7e00640 1 -- 172.21.15.33:0/2713179620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8007070 con 0x7fbed0070950 2024-09-13T18:59:29.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed0146730 con 0x7fbed0070950 2024-09-13T18:59:29.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.427+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed0147110 con 0x7fbed0070950 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.429+0000 7fbec7e00640 1 -- 172.21.15.33:0/2713179620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbeb80071d0 con 0x7fbed0070950 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.430+0000 7fbec7e00640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 0x7fbeac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.430+0000 7fbec7e00640 1 -- 172.21.15.33:0/2713179620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeb8088a40 con 0x7fbed0070950 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.430+0000 7fbecf400640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 0x7fbeac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.431+0000 7fbed8fe1740 1 Processor -- start 2024-09-13T18:59:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.431+0000 7fbed8fe1740 1 -- start start 2024-09-13T18:59:29.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.431+0000 7fbecf400640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 0x7fbeac06d0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbec00011e0 tx=0x7fbec0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 0x55eab5f86ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5ea2ab0 con 0x55eab5f396d0 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5ea0240 con 0x55eab5f36e90 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eab5e9bb30 con 0x55eab5f60b80 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34168/0 (socket says 172.21.15.33:34168) 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 -- 172.21.15.33:0/178672269 learned_addr learned my addr 172.21.15.33:0/178672269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbec6a00640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 0x55eab5f86ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecfe00640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 -- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 msgr2=0x55eab5f870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f870e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 -- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 msgr2=0x55eab5f86ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 0x55eab5f86ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbecf400640 1 -- 172.21.15.33:0/178672269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eab5e66bd0 con 0x55eab5f396d0 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.432+0000 7fbec6a00640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 0x55eab5f86ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbecf400640 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbec000f850 tx=0x7fbec0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375626dd94cb5096 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbebfe00640 1 -- 172.21.15.33:0/178672269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00149d0 con 0x55eab5f396d0 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbebfe00640 1 -- 172.21.15.33:0/178672269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0014b50 con 0x55eab5f396d0 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbebfe00640 1 -- 172.21.15.33:0/178672269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0020410 con 0x55eab5f396d0 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbed8fe1740 1 -- 172.21.15.33:0/178672269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 msgr2=0x55eab5f39ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.433+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbec000f850 tx=0x7fbec0012000 comp rx=0 tx=0).stop 2024-09-13T18:59:29.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 -- 172.21.15.33:0/178672269 shutdown_connections 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f36e90 0x55eab5f86ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/178672269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f396d0 0x55eab5f39ab0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 -- 172.21.15.33:0/178672269 >> 172.21.15.33:0/178672269 conn(0x55eab5f35e00 msgr2=0x55eab5f7e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 -- 172.21.15.33:0/178672269 shutdown_connections 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 -- 172.21.15.33:0/178672269 wait complete. 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 -- start start 2024-09-13T18:59:29.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.434+0000 7fbed8fe1740 1 Processor -- start 2024-09-13T18:59:29.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f7b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 0x55eab5f62f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5e3d260 con 0x55eab5f60b80 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5e3cf00 con 0x55eab5f396d0 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.435+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eab5c02f20 con 0x55eab5f64660 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbed8fe1740 10 client.0 _ll_register_callbacks cb 0x55eab5e951a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34182/0 (socket says 172.21.15.33:34182) 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 -- 172.21.15.33:0/1732134835 learned_addr learned my addr 172.21.15.33:0/1732134835 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbecfe00640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 0x55eab5f62f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbecf400640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f7b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 -- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 msgr2=0x55eab5f62f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 0x55eab5f62f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 -- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 msgr2=0x55eab5f7b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f7b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbec6a00640 1 -- 172.21.15.33:0/1732134835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00b1f00 con 0x55eab5f60b80 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbecfe00640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 0x55eab5f62f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.436+0000 7fbecf400640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f7b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbec6a00640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8005880 tx=0x7fbeb805b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa152549fc34610b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbebcc00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb806f180 con 0x55eab5f60b80 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeb805f7a0 con 0x55eab5f60b80 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eab5ec5cd0 con 0x55eab5f60b80 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeb805f960 con 0x55eab5f60b80 2024-09-13T18:59:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbed8fe1740 10 client.6072 fetch_fsmap learned FSMap version 32 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.437+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55eab5e9a1b0 con 0x55eab5f60b80 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eab5ec5cd0 con 0x55eab5f60b80 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbeb805b1b0 con 0x55eab5f60b80 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 10 client.6072 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 10 client.6072 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 20 client.6072 populate_metadata read hostname 'smithi033' 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5f99260 0x55eab5f9b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 4 client.6072 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 --> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eab5b8f3c0 con 0x55eab5f99260 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.439+0000 7fbecf400640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5f99260 0x55eab5f9b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.440+0000 7fbecf400640 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5f99260 0x55eab5f9b650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d01f5a5834563ce server_cookie=b00bff1086ffee0a in_seq=0 out_seq=0 2024-09-13T18:59:29.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.440+0000 7fbebcc00640 10 client.6072 ms_handle_connect on v2:172.21.15.33:6833/2343612269 2024-09-13T18:59:29.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbebcc00640 1 -- 172.21.15.33:0/1732134835 <== mds.0 v2:172.21.15.33:6833/2343612269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55eab5b8f3c0 con 0x55eab5f99260 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbebcc00640 10 client.6072 handle_command_reply: tid=0 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 client.6072 shutdown 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 msgr2=0x55eab5f4ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8005880 tx=0x7fbeb805b730 comp rx=0 tx=0).stop 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 shutdown_connections 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f64660 0x55eab5f62f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5f99260 0x55eab5f9b650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f4ab90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/1732134835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f7b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbebcc00640 0 client.6072 ms_handle_reset on v2:172.21.15.33:6833/2343612269 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.441+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 >> 172.21.15.33:0/1732134835 conn(0x55eab5f36e90 msgr2=0x55eab5f7d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.442+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 shutdown_connections 2024-09-13T18:59:29.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.442+0000 7fbed8fe1740 1 -- 172.21.15.33:0/1732134835 wait complete. 2024-09-13T18:59:29.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.442+0000 7fbed8fe1740 20 client.6072 trim_cache size 0 max 16384 2024-09-13T18:59:29.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.457+0000 7fbed8fe1740 1 Processor -- start 2024-09-13T18:59:29.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.457+0000 7fbed8fe1740 1 -- start start 2024-09-13T18:59:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f4ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f35b70 con 0x55eab5f64660 2024-09-13T18:59:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f9df50 con 0x55eab5f396d0 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.458+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f35430 con 0x55eab5f60b80 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34188/0 (socket says 172.21.15.33:34188) 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 -- 172.21.15.33:0/3380579662 learned_addr learned my addr 172.21.15.33:0/3380579662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecf400640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbec6a00640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f4ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 -- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 msgr2=0x55eab5f4ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f4ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 -- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 msgr2=0x55eab5f38ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f38ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 -- 172.21.15.33:0/3380579662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eab5ecf170 con 0x55eab5f64660 2024-09-13T18:59:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbec6a00640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f4ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.459+0000 7fbecfe00640 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009e80 tx=0x7fbec802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716fcdbb0099e5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbec4c00640 1 -- 172.21.15.33:0/3380579662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8042070 con 0x55eab5f64660 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbec4c00640 1 -- 172.21.15.33:0/3380579662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8007650 con 0x55eab5f64660 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbec4c00640 1 -- 172.21.15.33:0/3380579662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec80079e0 con 0x55eab5f64660 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 -- 172.21.15.33:0/3380579662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 msgr2=0x55eab5f35630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009e80 tx=0x7fbec802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 -- 172.21.15.33:0/3380579662 shutdown_connections 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f64660 0x55eab5f35630 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f60b80 0x55eab5f4ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/3380579662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f396d0 0x55eab5f38ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 -- 172.21.15.33:0/3380579662 >> 172.21.15.33:0/3380579662 conn(0x55eab5f36e90 msgr2=0x55eab5f2f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 -- 172.21.15.33:0/3380579662 shutdown_connections 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.460+0000 7fbed8fe1740 1 -- 172.21.15.33:0/3380579662 wait complete. 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.461+0000 7fbed8fe1740 1 -- start start 2024-09-13T18:59:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.461+0000 7fbed8fe1740 1 Processor -- start 2024-09-13T18:59:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f396d0 0x55eab5fe5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 0x55eab5f7b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f650e0 con 0x55eab5f60b80 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f65250 con 0x55eab5f64660 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eab5f5e860 con 0x55eab5f396d0 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbed8fe1740 10 client.0 _ll_register_callbacks cb 0x7fbeb8001ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbec6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34200/0 (socket says 172.21.15.33:34200) 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.462+0000 7fbec6a00640 1 -- 172.21.15.33:0/2109468755 learned_addr learned my addr 172.21.15.33:0/2109468755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbecf400640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f396d0 0x55eab5fe5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbecfe00640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 0x55eab5f7b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 -- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f396d0 msgr2=0x55eab5fe5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f396d0 0x55eab5fe5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 -- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 msgr2=0x55eab5f7b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 0x55eab5f7b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 -- 172.21.15.33:0/2109468755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00712c0 con 0x55eab5f60b80 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbecfe00640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 0x55eab5f7b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbec6a00640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8054310 tx=0x7fbeb8086da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5b4cc568b1093f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbebcc00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80762f0 con 0x55eab5f60b80 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeb8077c40 con 0x55eab5f60b80 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.463+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbec0014b50 con 0x55eab5f60b80 2024-09-13T18:59:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeb8007480 con 0x55eab5f60b80 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 10 client.6078 fetch_fsmap learned FSMap version 32 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55eab5e3c470 con 0x55eab5f60b80 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb807f020 con 0x55eab5f60b80 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbeb80075e0 con 0x55eab5f60b80 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 10 client.6078 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 10 client.6078 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 20 client.6078 populate_metadata read hostname 'smithi033' 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5fe8680 0x55eab5fe8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 4 client.6078 mds_command: new command op to 5907 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 --> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eab5ba06c0 con 0x55eab5fe8680 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.464+0000 7fbecf400640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5fe8680 0x55eab5fe8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbecf400640 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5fe8680 0x55eab5fe8a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3b2f7586653920 server_cookie=563a1c8f296b0f07 in_seq=0 out_seq=0 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbebcc00640 10 client.6078 ms_handle_connect on v2:172.21.15.33:6833/2343612269 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbebcc00640 1 -- 172.21.15.33:0/2109468755 <== mds.0 v2:172.21.15.33:6833/2343612269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55eab5ba06c0 con 0x55eab5fe8680 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbebcc00640 10 client.6078 handle_command_reply: tid=0 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 client.6078 shutdown 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 msgr2=0x55eab5f5e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8054310 tx=0x7fbeb8086da0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 shutdown_connections 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55eab5f64660 0x55eab5f7b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:6833/2343612269,v1:172.21.15.33:6835/2343612269] conn(0x55eab5fe8680 0x55eab5fe8a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eab5f60b80 0x55eab5f5e320 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 --2- 172.21.15.33:0/2109468755 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55eab5f396d0 0x55eab5fe5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbebcc00640 0 client.6078 ms_handle_reset on v2:172.21.15.33:6833/2343612269 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 >> 172.21.15.33:0/2109468755 conn(0x55eab5f36e90 msgr2=0x55eab5f4ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 shutdown_connections 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.465+0000 7fbed8fe1740 1 -- 172.21.15.33:0/2109468755 wait complete. 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed8fe1740 20 client.6078 trim_cache size 0 max 16384 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5907, 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T18:59:29.475 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.806610307, 2024-09-13T18:59:29.476 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 32, 2024-09-13T18:59:29.476 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 60, 2024-09-13T18:59:29.476 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 60, 2024-09-13T18:59:29.476 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 15.928995865999999 2024-09-13T18:59:29.476 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 msgr2=0x7fbeac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 0x7fbeac06d0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbec00011e0 tx=0x7fbec0009040 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 msgr2=0x7fbed00af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80010e0 tx=0x7fbeb800cb70 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 shutdown_connections 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbeac06ac00 0x7fbeac06d0c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbed015c270 0x7fbed00afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbed0070950 0x7fbed00af630 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 --2- 172.21.15.33:0/2713179620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbed006c310 0x7fbed0143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 >> 172.21.15.33:0/2713179620 conn(0x7fbed00b0510 msgr2=0x7fbed00ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 shutdown_connections 2024-09-13T18:59:29.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.466+0000 7fbed6000640 1 -- 172.21.15.33:0/2713179620 wait complete. 2024-09-13T18:59:29.486 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:59:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.637+0000 7f32d3200640 1 Processor -- start 2024-09-13T18:59:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.639+0000 7f32d3200640 1 -- start start 2024-09-13T18:59:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d3200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32d40712e0 0x7f32d40b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 0x7f32d415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d3200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d40716c0 con 0x7f32d415d1a0 2024-09-13T18:59:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d3200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d415cf60 con 0x7f32d40712e0 2024-09-13T18:59:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40b2b80 con 0x7f32d415c590 2024-09-13T18:59:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32d40712e0 0x7f32d40b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32cbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f32d415d1a0 0x7f32d40b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39664/0 (socket says 172.21.15.33:39664) 2024-09-13T18:59:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32cbe00640 1 -- 172.21.15.33:0/3546024685 learned_addr learned my addr 172.21.15.33:0/3546024685 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1e00640 1 -- 172.21.15.33:0/3546024685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 msgr2=0x7f32d415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d2800640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 0x7f32d415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1e00640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 0x7f32d415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1e00640 1 -- 172.21.15.33:0/3546024685 >> v1:172.21.15.33:6789/0 conn(0x7f32d415d1a0 legacy=0x7f32d40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1e00640 1 -- 172.21.15.33:0/3546024685 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40b2e60 con 0x7f32d40712e0 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d1400640 1 -- 172.21.15.33:0/3546024685 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485588690 0 0) 0x7f32d40716c0 con 0x7f32d415d1a0 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.640+0000 7f32d2800640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 0x7f32d415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d1e00640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d40712e0 0x7f32d40b3c20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f32c40097a0 tx=0x7f32c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ef7ef48335a1a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d1400640 1 -- 172.21.15.33:0/3546024685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4032440 con 0x7f32d40712e0 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d1400640 1 -- 172.21.15.33:0/3546024685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c40325a0 con 0x7f32d40712e0 2024-09-13T18:59:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d1400640 1 -- 172.21.15.33:0/3546024685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4032930 con 0x7f32d40712e0 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d3200640 1 -- 172.21.15.33:0/3546024685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d40712e0 msgr2=0x7f32d40b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.641+0000 7f32d3200640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d40712e0 0x7f32d40b3c20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f32c40097a0 tx=0x7f32c402a180 comp rx=0 tx=0).stop 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 -- 172.21.15.33:0/3546024685 shutdown_connections 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d415c590 0x7f32d415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 --2- 172.21.15.33:0/3546024685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d40712e0 0x7f32d40b3c20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 -- 172.21.15.33:0/3546024685 >> 172.21.15.33:0/3546024685 conn(0x7f32d40ae310 msgr2=0x7f32d40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 -- 172.21.15.33:0/3546024685 shutdown_connections 2024-09-13T18:59:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.642+0000 7f32d3200640 1 -- 172.21.15.33:0/3546024685 wait complete. 2024-09-13T18:59:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.643+0000 7f32d3200640 1 Processor -- start 2024-09-13T18:59:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.643+0000 7f32d3200640 1 -- start start 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d40712e0 0x7f32d41e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d415c590 0x7f32d41e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d41e3b20 con 0x7f32d415d1a0 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4156560 con 0x7f32d415c590 2024-09-13T18:59:29.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.644+0000 7f32d3200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d41e2ea0 con 0x7f32d40712e0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34218/0 (socket says 172.21.15.33:34218) 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 -- 172.21.15.33:0/712382515 learned_addr learned my addr 172.21.15.33:0/712382515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d1e00640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d40712e0 0x7f32d41e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32cbe00640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d415c590 0x7f32d41e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 -- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d40712e0 msgr2=0x7f32d41e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d40712e0 0x7f32d41e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 -- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d415c590 msgr2=0x7f32d41e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d415c590 0x7f32d41e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 -- 172.21.15.33:0/712382515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4009400 con 0x7f32d415d1a0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.645+0000 7f32d2800640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00cef0 tx=0x7f32cc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.646+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00d840 con 0x7f32d415d1a0 2024-09-13T18:59:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.646+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc00d9c0 con 0x7f32d415d1a0 2024-09-13T18:59:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.646+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00dd70 con 0x7f32d415d1a0 2024-09-13T18:59:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.646+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d41e3180 con 0x7f32d415d1a0 2024-09-13T18:59:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.646+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d41e3740 con 0x7f32d415d1a0 2024-09-13T18:59:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.647+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d4067360 con 0x7f32d415d1a0 2024-09-13T18:59:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.648+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32cc01e3b0 con 0x7f32d415d1a0 2024-09-13T18:59:29.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.650+0000 7f32ca000640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 0x7f32b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:29.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.650+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32cc089d90 con 0x7f32d415d1a0 2024-09-13T18:59:29.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.650+0000 7f32d1e00640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 0x7f32b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:29.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.650+0000 7f32d1e00640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 0x7f32b006d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f32c4034000 tx=0x7f32c402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:29.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.653+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f32cc0550d0 con 0x7f32d415d1a0 2024-09-13T18:59:29.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.868+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32d40b3c20 con 0x7f32d415d1a0 2024-09-13T18:59:29.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.868+0000 7f32ca000640 1 -- 172.21.15.33:0/712382515 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32cc01a020 con 0x7f32d415d1a0 2024-09-13T18:59:29.872 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 msgr2=0x7f32b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 0x7f32b006d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f32c4034000 tx=0x7f32c402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 msgr2=0x7f32d41f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00cef0 tx=0x7f32cc00a710 comp rx=0 tx=0).stop 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 shutdown_connections 2024-09-13T18:59:29.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f32b006ac00 0x7f32b006d0c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d415d1a0 0x7f32d41f18a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32d415c590 0x7f32d41e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 --2- 172.21.15.33:0/712382515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32d40712e0 0x7f32d41e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 >> 172.21.15.33:0/712382515 conn(0x7f32d40ae310 msgr2=0x7f32d40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 shutdown_connections 2024-09-13T18:59:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:29.870+0000 7f32d3200640 1 -- 172.21.15.33:0/712382515 wait complete. 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:59:29.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:59:29.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:59:29.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:59:29.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:29.891 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T18:59:29.927 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:59:29.927 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:59:29.927 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:59:29.927 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.927 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:59:29.928 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42562sec preferred_lft 42562sec 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.929 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:29.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:29.930 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:59:30.020 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T18:59:30.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.024 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:59:30.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:59:30.061 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T18:59:30.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.208 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T18:59:30.243 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:59:30.243 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:59:30.244 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:59:30.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T18:59:30.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:59:30.340 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:59:30.376 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:59:30.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:59:30.376 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:59:30.450 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:59:30.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.451 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:59:30.580 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:59:30.580 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:59:30.580 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:59:30.595 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:59:30.596 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:59:30.596 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:59:30.596 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:59:30.596 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:59:30.618 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:59:30.619 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:59:30.620 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:59:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:59:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:59:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:59:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:59:30.623 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:59:30.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.623 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:59:30.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:30.681 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:59:30.723 INFO:teuthology.orchestra.run.smithi033.stdout:client5426 2024-09-13T18:59:30.723 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:30.724 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:30.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:59:30.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.993+0000 7febd6400640 1 Processor -- start 2024-09-13T18:59:30.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.993+0000 7febd6400640 1 -- start start 2024-09-13T18:59:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.994+0000 7febd6400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.994+0000 7febd6400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.994+0000 7febd6400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd0153f00 con 0x7febd00b2410 2024-09-13T18:59:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.994+0000 7febd6400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00ce600 con 0x7febd0159a80 2024-09-13T18:59:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.994+0000 7febd6400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0070f90 con 0x7febd0153b20 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febc7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:60390/0 (socket says 172.21.15.33:60390) 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febcf400640 1 -- 172.21.15.33:0/322653751 learned_addr learned my addr 172.21.15.33:0/322653751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febc7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:59904/0 (socket says 172.21.15.33:59904) 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.995+0000 7febcfe00640 1 --1- 172.21.15.33:0/322653751 >> v1:172.21.15.103:6789/0 conn(0x7febd00b2410 0x7febd006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:54270/0 (socket says 172.21.15.33:54270) 2024-09-13T18:59:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.996+0000 7febcf400640 1 -- 172.21.15.33:0/322653751 >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 msgr2=0x7febd00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.996+0000 7febcf400640 1 --2- 172.21.15.33:0/322653751 >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.996+0000 7febcf400640 1 -- 172.21.15.33:0/322653751 >> v1:172.21.15.103:6789/0 conn(0x7febd00b2410 legacy=0x7febd006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.996+0000 7febcf400640 1 -- 172.21.15.33:0/322653751 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00b1a40 con 0x7febd0153b20 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.996+0000 7febc7e00640 1 --2- 172.21.15.33:0/322653751 >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.997+0000 7febcf400640 1 --2- 172.21.15.33:0/322653751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febc000bb10 tx=0x7febc002c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd76f33322f4ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.997+0000 7febcea00640 1 -- 172.21.15.33:0/322653751 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0032820 con 0x7febd0153b20 2024-09-13T18:59:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.997+0000 7febcea00640 1 -- 172.21.15.33:0/322653751 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc002e040 con 0x7febd0153b20 2024-09-13T18:59:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.997+0000 7febcea00640 1 -- 172.21.15.33:0/322653751 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0032ba0 con 0x7febd0153b20 2024-09-13T18:59:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 -- 172.21.15.33:0/322653751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 msgr2=0x7febd00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 --2- 172.21.15.33:0/322653751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febc000bb10 tx=0x7febc002c920 comp rx=0 tx=0).stop 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 -- 172.21.15.33:0/322653751 shutdown_connections 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 --2- 172.21.15.33:0/322653751 >> v2:172.21.15.103:3300/0 conn(0x7febd0159a80 0x7febd00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 --2- 172.21.15.33:0/322653751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0153b20 0x7febd00b3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 -- 172.21.15.33:0/322653751 >> 172.21.15.33:0/322653751 conn(0x7febd00b0510 msgr2=0x7febd00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 -- 172.21.15.33:0/322653751 shutdown_connections 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.998+0000 7febd6400640 1 -- 172.21.15.33:0/322653751 wait complete. 2024-09-13T18:59:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:30.999+0000 7febd6400640 1 Processor -- start 2024-09-13T18:59:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 -- start start 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febd0153b20 0x7febd0143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0159a80 0x7febd00af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0159530 con 0x7febd00b2410 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0156460 con 0x7febd0153b20 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.000+0000 7febd6400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0156740 con 0x7febd0159a80 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34234/0 (socket says 172.21.15.33:34234) 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 -- 172.21.15.33:0/2464691026 learned_addr learned my addr 172.21.15.33:0/2464691026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febc7e00640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febd0153b20 0x7febd0143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcfe00640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0159a80 0x7febd00af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 -- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0159a80 msgr2=0x7febd00af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0159a80 0x7febd00af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 -- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febd0153b20 msgr2=0x7febd0143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febd0153b20 0x7febd0143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.001+0000 7febcf400640 1 -- 172.21.15.33:0/2464691026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8009400 con 0x7febd00b2410 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febcf400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7febc002c960 tx=0x7febc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc003b7b0 con 0x7febd00b2410 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc003b910 con 0x7febd00b2410 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc000b770 con 0x7febd00b2410 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc003bcc0 con 0x7febd00b2410 2024-09-13T18:59:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.002+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd0156d00 con 0x7febd00b2410 2024-09-13T18:59:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.003+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd00b3990 con 0x7febd00b2410 2024-09-13T18:59:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.004+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febc004e3b0 con 0x7febd00b2410 2024-09-13T18:59:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.005+0000 7febc7400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 0x7febac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.006+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc00ac810 con 0x7febd00b2410 2024-09-13T18:59:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.006+0000 7febc7e00640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 0x7febac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:31.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.007+0000 7febc7e00640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 0x7febac06d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7febd0158f80 tx=0x7febb8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.010+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7febc0077970 con 0x7febd00b2410 2024-09-13T18:59:31.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.227+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7febd006d520 con 0x7febd00b2410 2024-09-13T18:59:31.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.228+0000 7febc7400640 1 -- 172.21.15.33:0/2464691026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7febc0036070 con 0x7febd00b2410 2024-09-13T18:59:31.230 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:59:31.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 msgr2=0x7febac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:31.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 0x7febac06d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7febd0158f80 tx=0x7febb8009190 comp rx=0 tx=0).stop 2024-09-13T18:59:31.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 msgr2=0x7febd0158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7febc002c960 tx=0x7febc0004730 comp rx=0 tx=0).stop 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 shutdown_connections 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febac06ac00 0x7febac06d0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7febd0159a80 0x7febd00af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7febd0153b20 0x7febd0143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 --2- 172.21.15.33:0/2464691026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febd00b2410 0x7febd0158ff0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 >> 172.21.15.33:0/2464691026 conn(0x7febd00b0510 msgr2=0x7febd006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 shutdown_connections 2024-09-13T18:59:31.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:31.230+0000 7febd6400640 1 -- 172.21.15.33:0/2464691026 wait complete. 2024-09-13T18:59:31.248 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:59:31.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:59:31.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:59:31.249 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:59:31.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.249 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T18:59:31.290 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:59:31.290 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:59:31.290 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:59:31.290 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T18:59:31.291 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42578sec preferred_lft 42578sec 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:59:31.292 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T18:59:31.293 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:59:31.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.294 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:59:31.388 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T18:59:31.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.391 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:59:31.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:59:31.430 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T18:59:31.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.576 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T18:59:31.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:59:31.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:59:31.611 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:59:31.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T18:59:31.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:59:31.707 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:31.741 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:59:31.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:59:31.742 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:31.817 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:59:31.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:59:31.945 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:59:31.946 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:59:31.946 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:59:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:59:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:59:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:59:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:59:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:59:31.983 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:59:31.983 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:59:31.983 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T18:59:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T18:59:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:59:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T18:59:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T18:59:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T18:59:31.985 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:59:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:59:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:59:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:59:31.985 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:59:31.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:59:31.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:31.988 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:32.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.044 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:59:32.085 INFO:teuthology.orchestra.run.smithi103.stdout:client5875 2024-09-13T18:59:32.086 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:32.086 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:32.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.162 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T18:59:32.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.209 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:32.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:59:32.289 INFO:teuthology.orchestra.run.smithi033.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-13T18:59:32.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.290 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10K ./subdir) 2024-09-13T18:59:32.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.370 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:32.449 INFO:teuthology.orchestra.run.smithi033.stdout:10240 2024-09-13T18:59:32.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.450 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Ki ./subdir) 2024-09-13T18:59:32.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.531 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:32.608 INFO:teuthology.orchestra.run.smithi033.stdout:102400 2024-09-13T18:59:32.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.608 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10M ./subdir) 2024-09-13T18:59:32.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.688 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:32.764 INFO:teuthology.orchestra.run.smithi033.stdout:10485760 2024-09-13T18:59:32.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.765 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Mi ./subdir) 2024-09-13T18:59:32.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.844 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:32.921 INFO:teuthology.orchestra.run.smithi033.stdout:104857600 2024-09-13T18:59:32.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:32.922 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2G ./subdir) 2024-09-13T18:59:33.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:33.076 INFO:teuthology.orchestra.run.smithi033.stdout:2147483648 2024-09-13T18:59:33.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.076 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 4Gi ./subdir) 2024-09-13T18:59:33.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.155 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:33.231 INFO:teuthology.orchestra.run.smithi033.stdout:4294967296 2024-09-13T18:59:33.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.231 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1T ./subdir) 2024-09-13T18:59:33.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.310 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:33.386 INFO:teuthology.orchestra.run.smithi033.stdout:1099511627776 2024-09-13T18:59:33.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.387 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2Ti ./subdir) 2024-09-13T18:59:33.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:33.466 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-13T18:59:33.542 INFO:teuthology.orchestra.run.smithi033.stdout:2199023255552 2024-09-13T18:59:33.542 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:59:33.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:33.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:33.760 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:59:33.760 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:33.760 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:33.796 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:33.796 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:33.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.064+0000 7f4313400640 1 Processor -- start 2024-09-13T18:59:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.064+0000 7f4313400640 1 -- start start 2024-09-13T18:59:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.065+0000 7f4313400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 0x7f430c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.065+0000 7f4313400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f430c0b32d0 0x7f430c070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.065+0000 7f4313400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c15a430 con 0x7f430c0b2220 2024-09-13T18:59:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.065+0000 7f4313400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c1598b0 con 0x7f430c0b32d0 2024-09-13T18:59:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f4313400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c159b90 con 0x7f430c0b1e40 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f430be00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f430c0b2220 0x7f430c0b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:56322/0 (socket says 172.21.15.33:56322) 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f430be00640 1 -- 172.21.15.33:0/3548337015 learned_addr learned my addr 172.21.15.33:0/3548337015 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f4310a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 0x7f430c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f4311400640 1 --2- 172.21.15.33:0/3548337015 >> v2:172.21.15.103:3300/0 conn(0x7f430c0b32d0 0x7f430c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.066+0000 7f430b400640 1 -- 172.21.15.33:0/3548337015 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585060595 0 0) 0x7f430c15a430 con 0x7f430c0b2220 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.067+0000 7f4311400640 1 -- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 msgr2=0x7f430c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.067+0000 7f4311400640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 0x7f430c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.067+0000 7f4311400640 1 -- 172.21.15.33:0/3548337015 >> v1:172.21.15.103:6789/0 conn(0x7f430c0b2220 legacy=0x7f430c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.067+0000 7f4311400640 1 -- 172.21.15.33:0/3548337015 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c159e70 con 0x7f430c0b32d0 2024-09-13T18:59:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.067+0000 7f4310a00640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 0x7f430c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4311400640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b32d0 0x7f430c070720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4304009d90 tx=0x7f430402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42af37b570290451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f430b400640 1 -- 172.21.15.33:0/3548337015 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304031600 con 0x7f430c0b32d0 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f430b400640 1 -- 172.21.15.33:0/3548337015 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430402d050 con 0x7f430c0b32d0 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f430b400640 1 -- 172.21.15.33:0/3548337015 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304031980 con 0x7f430c0b32d0 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 -- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b32d0 msgr2=0x7f430c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b32d0 0x7f430c070720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4304009d90 tx=0x7f430402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 -- 172.21.15.33:0/3548337015 shutdown_connections 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b32d0 0x7f430c070720 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 --2- 172.21.15.33:0/3548337015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b1e40 0x7f430c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.068+0000 7f4313400640 1 -- 172.21.15.33:0/3548337015 >> 172.21.15.33:0/3548337015 conn(0x7f430c0b0510 msgr2=0x7f430c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.069+0000 7f4313400640 1 -- 172.21.15.33:0/3548337015 shutdown_connections 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.069+0000 7f4313400640 1 -- 172.21.15.33:0/3548337015 wait complete. 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.070+0000 7f4313400640 1 Processor -- start 2024-09-13T18:59:34.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.070+0000 7f4313400640 1 -- start start 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b2220 0x7f430c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b32d0 0x7f430c0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1390f0 con 0x7f430c0b1e40 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c137150 con 0x7f430c0b2220 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4313400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1384e0 con 0x7f430c0b32d0 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.071+0000 7f4310a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47334/0 (socket says 172.21.15.33:47334) 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 -- 172.21.15.33:0/3120757943 learned_addr learned my addr 172.21.15.33:0/3120757943 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f430be00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b2220 0x7f430c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4311400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b32d0 0x7f430c0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 -- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b32d0 msgr2=0x7f430c0cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b32d0 0x7f430c0cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 -- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b2220 msgr2=0x7f430c0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b2220 0x7f430c0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 -- 172.21.15.33:0/3120757943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009400 con 0x7f430c0b1e40 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.072+0000 7f4310a00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f430000ebe0 tx=0x7f430000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.073+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300009760 con 0x7f430c0b1e40 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.073+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000cc30 con 0x7f430c0b1e40 2024-09-13T18:59:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.073+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000eee0 con 0x7f430c0b1e40 2024-09-13T18:59:34.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.073+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4304009a70 con 0x7f430c0b1e40 2024-09-13T18:59:34.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.073+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c0b2960 con 0x7f430c0b1e40 2024-09-13T18:59:34.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.074+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c0cac40 con 0x7f430c0b1e40 2024-09-13T18:59:34.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.075+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4300013470 con 0x7f430c0b1e40 2024-09-13T18:59:34.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.076+0000 7f4308c00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 0x7f42ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.076+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4300089710 con 0x7f430c0b1e40 2024-09-13T18:59:34.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.076+0000 7f430be00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 0x7f42ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.077+0000 7f430be00640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 0x7f42ec06d0f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f430c0cdf60 tx=0x7f42f8007b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.080+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f43000547d0 con 0x7f430c0b1e40 2024-09-13T18:59:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.262+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f430c159210 con 0x7f430c0b1e40 2024-09-13T18:59:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.263+0000 7f4308c00640 1 -- 172.21.15.33:0/3120757943 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f4300057df0 con 0x7f430c0b1e40 2024-09-13T18:59:34.266 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:34.266 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.265+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 msgr2=0x7f42ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.265+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 0x7f42ec06d0f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f430c0cdf60 tx=0x7f42f8007b50 comp rx=0 tx=0).stop 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.265+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 msgr2=0x7f430c136c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.265+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f430000ebe0 tx=0x7f430000c520 comp rx=0 tx=0).stop 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 shutdown_connections 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f42ec06ac30 0x7f42ec06d0f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f430c0b32d0 0x7f430c0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c0b2220 0x7f430c0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 --2- 172.21.15.33:0/3120757943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f430c0b1e40 0x7f430c136c10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 >> 172.21.15.33:0/3120757943 conn(0x7f430c0b0510 msgr2=0x7f430c06cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 shutdown_connections 2024-09-13T18:59:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.266+0000 7f4313400640 1 -- 172.21.15.33:0/3120757943 wait complete. 2024-09-13T18:59:34.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:16.657564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:17.640729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:34.286 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:34.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.442+0000 7fec41e00640 1 Processor -- start 2024-09-13T18:59:34.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.442+0000 7fec41e00640 1 -- start start 2024-09-13T18:59:34.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec41e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec3c070170 0x7fec3c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec41e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec41e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3c06fce0 con 0x7fec3c1566f0 2024-09-13T18:59:34.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec41e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0ae320 con 0x7fec3c070170 2024-09-13T18:59:34.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec41e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06c550 con 0x7fec3c0ade90 2024-09-13T18:59:34.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec3aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fec3c1566f0 0x7fec3c06be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39136/0 (socket says 172.21.15.33:39136) 2024-09-13T18:59:34.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.443+0000 7fec3aa00640 1 -- 172.21.15.33:0/3067681257 learned_addr learned my addr 172.21.15.33:0/3067681257 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec3b400640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec3a000640 1 --2- 172.21.15.33:0/3067681257 >> v2:172.21.15.103:3300/0 conn(0x7fec3c070170 0x7fec3c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429887953 0 0) 0x7fec3c06fce0 con 0x7fec3c1566f0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec20003520 con 0x7fec3c1566f0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472136735 0 0) 0x7fec20003520 con 0x7fec3c1566f0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 msgr2=0x7fec3c15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 >> v2:172.21.15.103:3300/0 conn(0x7fec3c070170 msgr2=0x7fec3c0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 --2- 172.21.15.33:0/3067681257 >> v2:172.21.15.103:3300/0 conn(0x7fec3c070170 0x7fec3c0ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c06c820 con 0x7fec3c1566f0 2024-09-13T18:59:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fec2c001670 con 0x7fec3c1566f0 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 >> v1:172.21.15.33:6789/0 conn(0x7fec3c1566f0 legacy=0x7fec3c06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec20003970 0x7fec20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.444+0000 7fec39600640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec39600640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec20004d00 0x7fec20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0ae320 con 0x7fec20004d00 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06c550 con 0x7fec20003970 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2000db90 con 0x7fec3c0ade90 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3b400640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec20004d00 0x7fec20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3aa00640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec20003970 0x7fec20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 -- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec20003970 msgr2=0x7fec20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec20003970 0x7fec20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 -- 172.21.15.33:0/3067681257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec20004d00 msgr2=0x7fec20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec20004d00 0x7fec20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3a000640 1 -- 172.21.15.33:0/3067681257 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20003520 con 0x7fec3c0ade90 2024-09-13T18:59:34.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.445+0000 7fec3b400640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec20004d00 0x7fec20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.446+0000 7fec3a000640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec200047c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec28009ac0 tx=0x7fec200057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcc27cb4560bdc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28031400 con 0x7fec3c0ade90 2024-09-13T18:59:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2802d050 con 0x7fec3c0ade90 2024-09-13T18:59:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec39600640 1 -- 172.21.15.33:0/3067681257 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28031780 con 0x7fec3c0ade90 2024-09-13T18:59:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 -- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 msgr2=0x7fec200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 --2- 172.21.15.33:0/3067681257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec200047c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec28009ac0 tx=0x7fec200057f0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec3b400640 1 -- 172.21.15.33:0/3067681257 reap_dead start 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 -- 172.21.15.33:0/3067681257 shutdown_connections 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 -- 172.21.15.33:0/3067681257 >> 172.21.15.33:0/3067681257 conn(0x7fec3c0b0580 msgr2=0x7fec3c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 -- 172.21.15.33:0/3067681257 shutdown_connections 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.447+0000 7fec41e00640 1 -- 172.21.15.33:0/3067681257 wait complete. 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.449+0000 7fec41e00640 1 Processor -- start 2024-09-13T18:59:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.449+0000 7fec41e00640 1 -- start start 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec3c159260 0x7fec3c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c151a40 con 0x7fec3c151070 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c1f32a0 con 0x7fec3c159260 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec41e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c15a230 con 0x7fec3c0ade90 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec3b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec3b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47358/0 (socket says 172.21.15.33:47358) 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec3b400640 1 -- 172.21.15.33:0/203047501 learned_addr learned my addr 172.21.15.33:0/203047501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec3a000640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec3c159260 0x7fec3c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.450+0000 7fec3aa00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 -- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 msgr2=0x7fec3c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 -- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec3c159260 msgr2=0x7fec3c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec3c159260 0x7fec3c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 -- 172.21.15.33:0/203047501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c1f2c50 con 0x7fec3c151070 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec3b400640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec3c06d6e0 tx=0x7fec3400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400e040 con 0x7fec3c151070 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400f040 con 0x7fec3c151070 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34003dd0 con 0x7fec3c151070 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c1f2f30 con 0x7fec3c151070 2024-09-13T18:59:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.451+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c155dc0 con 0x7fec3c151070 2024-09-13T18:59:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.452+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c1f3430 con 0x7fec3c151070 2024-09-13T18:59:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.453+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec34003f30 con 0x7fec3c151070 2024-09-13T18:59:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.454+0000 7fec33400640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 0x7fec1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.454+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec34089a10 con 0x7fec3c151070 2024-09-13T18:59:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.455+0000 7fec3aa00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 0x7fec1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.455+0000 7fec3aa00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 0x7fec1c06d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000fb0 tx=0x7fec2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.459+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec34054be0 con 0x7fec3c151070 2024-09-13T18:59:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.634+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec3c0b2cf0 con 0x7fec3c151070 2024-09-13T18:59:34.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.634+0000 7fec33400640 1 -- 172.21.15.33:0/203047501 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec34009c10 con 0x7fec3c151070 2024-09-13T18:59:34.637 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:34.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.636+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 msgr2=0x7fec1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.636+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 0x7fec1c06d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000fb0 tx=0x7fec2c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:34.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.636+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 msgr2=0x7fec3c151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.636+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec3c06d6e0 tx=0x7fec3400f580 comp rx=0 tx=0).stop 2024-09-13T18:59:34.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 shutdown_connections 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec1c06ac00 0x7fec1c06d0c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec3c151070 0x7fec3c151500 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec3c159260 0x7fec3c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 --2- 172.21.15.33:0/203047501 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec3c0ade90 0x7fec3c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 >> 172.21.15.33:0/203047501 conn(0x7fec3c0b0580 msgr2=0x7fec3c15cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 shutdown_connections 2024-09-13T18:59:34.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.637+0000 7fec41e00640 1 -- 172.21.15.33:0/203047501 wait complete. 2024-09-13T18:59:34.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:59:34.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.815+0000 7f64f8c00640 1 Processor -- start 2024-09-13T18:59:34.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.815+0000 7f64f8c00640 1 -- start start 2024-09-13T18:59:34.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f8c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64f406b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f8c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f406bb70 con 0x7f64f4156f30 2024-09-13T18:59:34.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f8c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f4157310 con 0x7f64f40b1db0 2024-09-13T18:59:34.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f8c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415a910 con 0x7f64f415a460 2024-09-13T18:59:34.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f3400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f64f4156f30 0x7f64f40b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39148/0 (socket says 172.21.15.33:39148) 2024-09-13T18:59:34.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f3400640 1 -- 172.21.15.33:0/2840461718 learned_addr learned my addr 172.21.15.33:0/2840461718 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:34.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.816+0000 7f64f3e00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64f406b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173922724 0 0) 0x7f64f406bb70 con 0x7f64f4156f30 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d8005730 con 0x7f64f4156f30 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396619125 0 0) 0x7f64d8005730 con 0x7f64f4156f30 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 msgr2=0x7f64f406b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64f406b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 >> v1:172.21.15.103:6789/0 conn(0x7f64f40b1db0 legacy=0x7f64f40cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40b29c0 con 0x7f64f4156f30 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f64e4001670 con 0x7f64f4156f30 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 >> v1:172.21.15.33:6789/0 conn(0x7f64f4156f30 legacy=0x7f64f40b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64d8005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64d8006560 0x7f64d8006a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64d8007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415a910 con 0x7f64d8005bb0 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800db90 con 0x7f64d8006560 2024-09-13T18:59:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.817+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800dd50 con 0x7f64f415a460 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64d8005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3e00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64d8007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64ebe00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64d8006560 0x7f64d8006a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 -- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 msgr2=0x7f64d8007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f415a460 0x7f64d8007290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 -- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64d8006560 msgr2=0x7f64d8006a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64d8006560 0x7f64d8006a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.818+0000 7f64f3400640 1 -- 172.21.15.33:0/2840461718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8005730 con 0x7f64d8005bb0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.819+0000 7f64f3400640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64d8005f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c190 tx=0x7f64d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943552c1a0c55400 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.819+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4005ad0 con 0x7f64d8005bb0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.819+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e402d070 con 0x7f64d8005bb0 2024-09-13T18:59:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.819+0000 7f64f2a00640 1 -- 172.21.15.33:0/2840461718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4005e90 con 0x7f64d8005bb0 2024-09-13T18:59:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 -- 172.21.15.33:0/2840461718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 msgr2=0x7f64d8005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2840461718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64d8005f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c190 tx=0x7f64d8007a00 comp rx=0 tx=0).stop 2024-09-13T18:59:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f3e00640 1 -- 172.21.15.33:0/2840461718 reap_dead start 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 -- 172.21.15.33:0/2840461718 shutdown_connections 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 -- 172.21.15.33:0/2840461718 >> 172.21.15.33:0/2840461718 conn(0x7f64f4069ed0 msgr2=0x7f64f406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 -- 172.21.15.33:0/2840461718 shutdown_connections 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.820+0000 7f64f8c00640 1 -- 172.21.15.33:0/2840461718 wait complete. 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.822+0000 7f64f8c00640 1 Processor -- start 2024-09-13T18:59:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.822+0000 7f64f8c00640 1 -- start start 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f415c1d0 0x7f64f40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f40b0700 0x7f64f40b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40b10f0 con 0x7f64d8005bb0 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f414e5a0 con 0x7f64f415c1d0 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f8c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40aec60 con 0x7f64f40b0700 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47368/0 (socket says 172.21.15.33:47368) 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f3400640 1 -- 172.21.15.33:0/2744414920 learned_addr learned my addr 172.21.15.33:0/2744414920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64ebe00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f415c1d0 0x7f64f40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.823+0000 7f64f3e00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f40b0700 0x7f64f40b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 -- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f40b0700 msgr2=0x7f64f40b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f40b0700 0x7f64f40b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 -- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f415c1d0 msgr2=0x7f64f40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f415c1d0 0x7f64f40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 -- 172.21.15.33:0/2744414920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40aef40 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f3400640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c2b0 tx=0x7f64e4001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4042030 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4000ef0 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4004bf0 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f40af220 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.824+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f40af7e0 con 0x7f64d8005bb0 2024-09-13T18:59:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.826+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f40af9a0 con 0x7f64d8005bb0 2024-09-13T18:59:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.826+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64e4045070 con 0x7f64d8005bb0 2024-09-13T18:59:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.827+0000 7f64eb400640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 0x7f64d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.827+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64e4043070 con 0x7f64d8005bb0 2024-09-13T18:59:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.828+0000 7f64ebe00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 0x7f64d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:34.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.828+0000 7f64ebe00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 0x7f64d006d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f64f40cb240 tx=0x7f64dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:34.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:34.831+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f64e40dc9c0 con 0x7f64d8005bb0 2024-09-13T18:59:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.009+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64f40af9a0 con 0x7f64d8005bb0 2024-09-13T18:59:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.009+0000 7f64eb400640 1 -- 172.21.15.33:0/2744414920 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64e40742a0 con 0x7f64d8005bb0 2024-09-13T18:59:35.012 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:59:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 msgr2=0x7f64d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 0x7f64d006d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f64f40cb240 tx=0x7f64dc009040 comp rx=0 tx=0).stop 2024-09-13T18:59:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 msgr2=0x7f64f414e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c2b0 tx=0x7f64e4001980 comp rx=0 tx=0).stop 2024-09-13T18:59:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 shutdown_connections 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f64d006ac00 0x7f64d006d0c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f64f40b0700 0x7f64f40b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f415c1d0 0x7f64f40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 --2- 172.21.15.33:0/2744414920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64d8005bb0 0x7f64f414e060 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 >> 172.21.15.33:0/2744414920 conn(0x7f64f4069ed0 msgr2=0x7f64f406f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 shutdown_connections 2024-09-13T18:59:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.012+0000 7f64f8c00640 1 -- 172.21.15.33:0/2744414920 wait complete. 2024-09-13T18:59:35.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:59:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.187+0000 7f9fc2200640 1 Processor -- start 2024-09-13T18:59:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.187+0000 7f9fc2200640 1 -- start start 2024-09-13T18:59:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fc2200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fbc0b31b0 0x7f9fbc06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fc2200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0b2890 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fc2200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0b1880 con 0x7f9fbc1461c0 2024-09-13T18:59:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fc2200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0b1ad0 con 0x7f9fbc0b31b0 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fbbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9fbc06c3e0 0x7f9fbc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39150/0 (socket says 172.21.15.33:39150) 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fbbe00640 1 -- 172.21.15.33:0/491339884 learned_addr learned my addr 172.21.15.33:0/491339884 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/491339884 >> v2:172.21.15.103:3300/0 conn(0x7f9fbc0b31b0 0x7f9fbc06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.189+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264100979 0 0) 0x7f9fbc0b2890 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa0003520 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663178498 0 0) 0x7f9fbc0b1880 con 0x7f9fbc1461c0 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fbc0b2890 con 0x7f9fbc1461c0 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090740466 0 0) 0x7f9fa0003520 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 >> v2:172.21.15.103:3300/0 conn(0x7f9fbc0b31b0 msgr2=0x7f9fbc06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 --2- 172.21.15.33:0/491339884 >> v2:172.21.15.103:3300/0 conn(0x7f9fbc0b31b0 0x7f9fbc06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 >> v1:172.21.15.103:6789/0 conn(0x7f9fbc1461c0 legacy=0x7f9fbc0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0b1db0 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f9fb40019f0 con 0x7f9fbc06c3e0 2024-09-13T18:59:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/491339884 >> v2:172.21.15.103:3300/0 conn(0x7f9fbc0b31b0 0x7f9fbc06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:35.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 >> v1:172.21.15.33:6789/0 conn(0x7f9fbc06c3e0 legacy=0x7f9fbc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 0x7f9fa0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa00051d0 0x7f9fa000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0b1ad0 con 0x7f9fa0003b50 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000c100 con 0x7f9fa00051d0 2024-09-13T18:59:35.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000c2c0 con 0x7f9fa00047c0 2024-09-13T18:59:35.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbb400640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 0x7f9fa0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa00051d0 0x7f9fa000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.190+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbb400640 1 -- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa00047c0 msgr2=0x7f9fa0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:35.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbb400640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa00047c0 0x7f9fa0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbb400640 1 -- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa00051d0 msgr2=0x7f9fa000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbb400640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa00051d0 0x7f9fa000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbb400640 1 -- 172.21.15.33:0/491339884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0003520 con 0x7f9fa0003b50 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa00051d0 0x7f9fa000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.191+0000 7f9fbbe00640 1 -- 172.21.15.33:0/491339884 reap_dead start 2024-09-13T18:59:35.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.192+0000 7f9fbb400640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 0x7f9fa0003f50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0018d0 tx=0x7f9fa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc05110631643cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.194+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0052d0 con 0x7f9fa0003b50 2024-09-13T18:59:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.194+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac005430 con 0x7f9fa0003b50 2024-09-13T18:59:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.194+0000 7f9fbaa00640 1 -- 172.21.15.33:0/491339884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02ac80 con 0x7f9fa0003b50 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 -- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 msgr2=0x7f9fa0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 0x7f9fa0003f50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0018d0 tx=0x7f9fa00057f0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 -- 172.21.15.33:0/491339884 shutdown_connections 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 --2- 172.21.15.33:0/491339884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa0003b50 0x7f9fa0003f50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 -- 172.21.15.33:0/491339884 >> 172.21.15.33:0/491339884 conn(0x7f9fbc0b0580 msgr2=0x7f9fbc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 -- 172.21.15.33:0/491339884 shutdown_connections 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.195+0000 7f9fc2200640 1 -- 172.21.15.33:0/491339884 wait complete. 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.197+0000 7f9fc2200640 1 Processor -- start 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.197+0000 7f9fc2200640 1 -- start start 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa0003b50 0x7f9fbc15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 0x7f9fbc157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc15a700 con 0x7f9fbc15ab90 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc159b60 con 0x7f9fbc0aff60 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fc2200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc159dd0 con 0x7f9fa0003b50 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fbbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47384/0 (socket says 172.21.15.33:47384) 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fbb400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa0003b50 0x7f9fbc15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fb3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 0x7f9fbc157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.198+0000 7f9fbbe00640 1 -- 172.21.15.33:0/928770070 learned_addr learned my addr 172.21.15.33:0/928770070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 -- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa0003b50 msgr2=0x7f9fbc15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa0003b50 0x7f9fbc15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 -- 172.21.15.33:0/928770070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 msgr2=0x7f9fbc15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 -- 172.21.15.33:0/928770070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc15a0b0 con 0x7f9fbc0aff60 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fbbe00640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.199+0000 7f9fb3e00640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 0x7f9fbc157500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40116f0 tx=0x7f9fa4011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.201+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004230 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.201+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4004390 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.201+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc15a390 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.201+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400f9c0 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.201+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc157a40 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.202+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc06bea0 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.203+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9fa400fb20 con 0x7f9fbc0aff60 2024-09-13T18:59:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.204+0000 7f9fb3400640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 0x7f9f9806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.204+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa4089640 con 0x7f9fbc0aff60 2024-09-13T18:59:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.204+0000 7f9fbb400640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 0x7f9f9806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.205+0000 7f9fbb400640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 0x7f9f9806d140 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fac032000 tx=0x7f9fac009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.210+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9fa40548b0 con 0x7f9fbc0aff60 2024-09-13T18:59:35.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.388+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fbc0ad550 con 0x7f9fbc0aff60 2024-09-13T18:59:35.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.389+0000 7f9fb3400640 1 -- 172.21.15.33:0/928770070 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fa4057ed0 con 0x7f9fbc0aff60 2024-09-13T18:59:35.392 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:59:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 msgr2=0x7f9f9806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 0x7f9f9806d140 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fac032000 tx=0x7f9fac009030 comp rx=0 tx=0).stop 2024-09-13T18:59:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 msgr2=0x7f9fbc157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 0x7f9fbc157500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40116f0 tx=0x7f9fa4011bb0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 shutdown_connections 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9f9806ac80 0x7f9f9806d140 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fbc15ab90 0x7f9fbc15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fbc0aff60 0x7f9fbc157500 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 --2- 172.21.15.33:0/928770070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9fa0003b50 0x7f9fbc15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 >> 172.21.15.33:0/928770070 conn(0x7f9fbc0b0580 msgr2=0x7f9fbc15ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 shutdown_connections 2024-09-13T18:59:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.392+0000 7f9fc2200640 1 -- 172.21.15.33:0/928770070 wait complete. 2024-09-13T18:59:35.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:59:35.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.564+0000 7f5a0aa00640 1 Processor -- start 2024-09-13T18:59:35.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.564+0000 7f5a0aa00640 1 -- start start 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a040cb3d0 0x7f5a04069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0aa00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 0x7f5a04070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0aa00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040cb8d0 con 0x7f5a0415dc30 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0aa00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0415e010 con 0x7f5a040cb3d0 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0aa00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a040ce100 con 0x7f5a0406a410 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a040cb3d0 0x7f5a04069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a040cb3d0 0x7f5a04069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47386/0 (socket says 172.21.15.33:47386) 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 -- 172.21.15.33:0/3567358011 learned_addr learned my addr 172.21.15.33:0/3567358011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0a000640 1 --2- 172.21.15.33:0/3567358011 >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 0x7f5a04070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 -- 172.21.15.33:0/3567358011 >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 msgr2=0x7f5a04070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:35.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 --2- 172.21.15.33:0/3567358011 >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 0x7f5a04070430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 -- 172.21.15.33:0/3567358011 >> v1:172.21.15.103:6789/0 conn(0x7f5a0415dc30 legacy=0x7f5a040cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:35.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a08c00640 1 -- 172.21.15.33:0/3567358011 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040cbbb0 con 0x7f5a040cb3d0 2024-09-13T18:59:35.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.566+0000 7f5a0a000640 1 --2- 172.21.15.33:0/3567358011 >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 0x7f5a04070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.567+0000 7f5a08c00640 1 --2- 172.21.15.33:0/3567358011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a040cb3d0 0x7f5a04069ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a0406f9e0 tx=0x7f59f002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de271308385d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a03e00640 1 -- 172.21.15.33:0/3567358011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0032440 con 0x7f5a040cb3d0 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a03e00640 1 -- 172.21.15.33:0/3567358011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f00325a0 con 0x7f5a040cb3d0 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a03e00640 1 -- 172.21.15.33:0/3567358011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0032930 con 0x7f5a040cb3d0 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 -- 172.21.15.33:0/3567358011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a040cb3d0 msgr2=0x7f5a04069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/3567358011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a040cb3d0 0x7f5a04069ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a0406f9e0 tx=0x7f59f002a250 comp rx=0 tx=0).stop 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 -- 172.21.15.33:0/3567358011 shutdown_connections 2024-09-13T18:59:35.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/3567358011 >> v2:172.21.15.103:3300/0 conn(0x7f5a0406a410 0x7f5a04070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/3567358011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a040cb3d0 0x7f5a04069ed0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 -- 172.21.15.33:0/3567358011 >> 172.21.15.33:0/3567358011 conn(0x7f5a040affd0 msgr2=0x7f5a040b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 -- 172.21.15.33:0/3567358011 shutdown_connections 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.568+0000 7f5a0aa00640 1 -- 172.21.15.33:0/3567358011 wait complete. 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.570+0000 7f5a0aa00640 1 Processor -- start 2024-09-13T18:59:35.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.570+0000 7f5a0aa00640 1 -- start start 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a0406a410 0x7f5a040af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a040cb3d0 0x7f5a0414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0414fed0 con 0x7f5a0415dc30 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04150400 con 0x7f5a040cb3d0 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04159e40 con 0x7f5a0406a410 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47396/0 (socket says 172.21.15.33:47396) 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a0a000640 1 -- 172.21.15.33:0/2683435082 learned_addr learned my addr 172.21.15.33:0/2683435082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a08c00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a040cb3d0 0x7f5a0414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.571+0000 7f5a09600640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a0406a410 0x7f5a040af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 -- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a0406a410 msgr2=0x7f5a040af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a0406a410 0x7f5a040af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 -- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a040cb3d0 msgr2=0x7f5a0414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a040cb3d0 0x7f5a0414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 -- 172.21.15.33:0/2683435082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00094d0 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0a000640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00cef0 tx=0x7f59fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00d840 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc00d9c0 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00dd70 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.572+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0415a120 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.573+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04154020 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.574+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a04067320 con 0x7f5a0415dc30 2024-09-13T18:59:35.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.574+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59fc01e3b0 con 0x7f5a0415dc30 2024-09-13T18:59:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.575+0000 7f5a01600640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.575+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59fc089d90 con 0x7f5a0415dc30 2024-09-13T18:59:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.576+0000 7f5a09600640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.576+0000 7f5a09600640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 0x7f59e406d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a040ad5d0 tx=0x7f59f8009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.580+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f59fc0550d0 con 0x7f5a0415dc30 2024-09-13T18:59:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.775+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a04154210 con 0x7f5a0415dc30 2024-09-13T18:59:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.775+0000 7f5a01600640 1 -- 172.21.15.33:0/2683435082 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f59fc01a020 con 0x7f5a0415dc30 2024-09-13T18:59:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:59:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 msgr2=0x7f59e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 0x7f59e406d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a040ad5d0 tx=0x7f59f8009060 comp rx=0 tx=0).stop 2024-09-13T18:59:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 msgr2=0x7f5a040ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00cef0 tx=0x7f59fc00a710 comp rx=0 tx=0).stop 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 shutdown_connections 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a0415dc30 0x7f5a040ade40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a040cb3d0 0x7f5a0414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 --2- 172.21.15.33:0/2683435082 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5a0406a410 0x7f5a040af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 >> 172.21.15.33:0/2683435082 conn(0x7f5a040affd0 msgr2=0x7f5a040ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 shutdown_connections 2024-09-13T18:59:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:35.778+0000 7f5a0aa00640 1 -- 172.21.15.33:0/2683435082 wait complete. 2024-09-13T18:59:35.796 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:59:35.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:35.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:59:35.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T18:59:35.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:35.859 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:59:35.895 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:35.895 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:35.935 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:35.936 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:36.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.169+0000 7f3a55a00640 1 Processor -- start 2024-09-13T18:59:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.169+0000 7f3a55a00640 1 -- start start 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a50153b20 0x7f3a500b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a50159a80 0x7f3a500b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a500b2410 0x7f3a5006f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500ce600 con 0x7f3a50159a80 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a50070f90 con 0x7f3a50153b20 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a55a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50153f00 con 0x7f3a500b2410 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a47e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a50159a80 0x7f3a500b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a47e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3a50159a80 0x7f3a500b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47402/0 (socket says 172.21.15.33:47402) 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.170+0000 7f3a47e00640 1 -- 172.21.15.33:0/1676121131 learned_addr learned my addr 172.21.15.33:0/1676121131 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a4f400640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a500b2410 0x7f3a5006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a4ea00640 1 --2- 172.21.15.33:0/1676121131 >> v2:172.21.15.103:3300/0 conn(0x7f3a50153b20 0x7f3a500b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a47e00640 1 -- 172.21.15.33:0/1676121131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a500b2410 msgr2=0x7f3a5006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:36.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a47e00640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a500b2410 0x7f3a5006f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a47e00640 1 -- 172.21.15.33:0/1676121131 >> v2:172.21.15.103:3300/0 conn(0x7f3a50153b20 msgr2=0x7f3a500b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:36.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a47e00640 1 --2- 172.21.15.33:0/1676121131 >> v2:172.21.15.103:3300/0 conn(0x7f3a50153b20 0x7f3a500b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.171+0000 7f3a47e00640 1 -- 172.21.15.33:0/1676121131 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500b1a40 con 0x7f3a50159a80 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a47e00640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a50159a80 0x7f3a500b1ed0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3a500b14f0 tx=0x7f3a3802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83c46f159bd849a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a4e000640 1 -- 172.21.15.33:0/1676121131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38032440 con 0x7f3a50159a80 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a4e000640 1 -- 172.21.15.33:0/1676121131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a380325a0 con 0x7f3a50159a80 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a4e000640 1 -- 172.21.15.33:0/1676121131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38032930 con 0x7f3a50159a80 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a55a00640 1 -- 172.21.15.33:0/1676121131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a50159a80 msgr2=0x7f3a500b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.172+0000 7f3a55a00640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a50159a80 0x7f3a500b1ed0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3a500b14f0 tx=0x7f3a3802a210 comp rx=0 tx=0).stop 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 -- 172.21.15.33:0/1676121131 shutdown_connections 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a500b2410 0x7f3a5006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 --2- 172.21.15.33:0/1676121131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a50159a80 0x7f3a500b1ed0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 --2- 172.21.15.33:0/1676121131 >> v2:172.21.15.103:3300/0 conn(0x7f3a50153b20 0x7f3a500b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 -- 172.21.15.33:0/1676121131 >> 172.21.15.33:0/1676121131 conn(0x7f3a500b0510 msgr2=0x7f3a500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 -- 172.21.15.33:0/1676121131 shutdown_connections 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.173+0000 7f3a55a00640 1 -- 172.21.15.33:0/1676121131 wait complete. 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.174+0000 7f3a55a00640 1 Processor -- start 2024-09-13T18:59:36.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.174+0000 7f3a55a00640 1 -- start start 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a50153b20 0x7f3a500aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 0x7f3a5014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014ee60 con 0x7f3a500b2410 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014e250 con 0x7f3a50159a80 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.175+0000 7f3a55a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5014e530 con 0x7f3a50153b20 2024-09-13T18:59:36.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47418/0 (socket says 172.21.15.33:47418) 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 -- 172.21.15.33:0/4113504828 learned_addr learned my addr 172.21.15.33:0/4113504828 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4f400640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 0x7f3a5014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a47e00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a50153b20 0x7f3a500aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 -- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a50153b20 msgr2=0x7f3a500aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a50153b20 0x7f3a500aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 -- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 msgr2=0x7f3a5014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 0x7f3a5014a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 -- 172.21.15.33:0/4113504828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a380094d0 con 0x7f3a500b2410 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4f400640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 0x7f3a5014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.176+0000 7f3a4ea00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000d5f0 tx=0x7f3a4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.177+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400125f0 con 0x7f3a500b2410 2024-09-13T18:59:36.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.177+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40012750 con 0x7f3a500b2410 2024-09-13T18:59:36.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.177+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40012b00 con 0x7f3a500b2410 2024-09-13T18:59:36.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.177+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5014e810 con 0x7f3a500b2410 2024-09-13T18:59:36.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.177+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50159470 con 0x7f3a500b2410 2024-09-13T18:59:36.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.178+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500b3990 con 0x7f3a500b2410 2024-09-13T18:59:36.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.179+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a40012c60 con 0x7f3a500b2410 2024-09-13T18:59:36.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.180+0000 7f3a46a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 0x7f3a2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.180+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a40089830 con 0x7f3a500b2410 2024-09-13T18:59:36.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.180+0000 7f3a47e00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 0x7f3a2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.181+0000 7f3a47e00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 0x7f3a2c06d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3a38034000 tx=0x7f3a3802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.184+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a40054970 con 0x7f3a500b2410 2024-09-13T18:59:36.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.365+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a500cdd40 con 0x7f3a500b2410 2024-09-13T18:59:36.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.367+0000 7f3a46a00640 1 -- 172.21.15.33:0/4113504828 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f3a40057f90 con 0x7f3a500b2410 2024-09-13T18:59:36.369 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:36.369 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 msgr2=0x7f3a2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 0x7f3a2c06d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3a38034000 tx=0x7f3a3802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 msgr2=0x7f3a500ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000d5f0 tx=0x7f3a4000dab0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 shutdown_connections 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a2c06ac00 0x7f3a2c06d0c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a50159a80 0x7f3a5014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a50153b20 0x7f3a500aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 --2- 172.21.15.33:0/4113504828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a500b2410 0x7f3a500ae630 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 >> 172.21.15.33:0/4113504828 conn(0x7f3a500b0510 msgr2=0x7f3a500ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 shutdown_connections 2024-09-13T18:59:36.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.369+0000 7f3a55a00640 1 -- 172.21.15.33:0/4113504828 wait complete. 2024-09-13T18:59:36.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:16.657564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:17.640729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:36.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:36.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.544+0000 7fe224a00640 1 Processor -- start 2024-09-13T18:59:36.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.544+0000 7fe224a00640 1 -- start start 2024-09-13T18:59:36.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe224a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 0x7fe22015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe224a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22015ff80 con 0x7fe2200ae2f0 2024-09-13T18:59:36.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe224a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22015dba0 con 0x7fe2200b2120 2024-09-13T18:59:36.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe224a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22015e4b0 con 0x7fe22015fba0 2024-09-13T18:59:36.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe217e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe2200ae2f0 0x7fe22015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39152/0 (socket says 172.21.15.33:39152) 2024-09-13T18:59:36.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.545+0000 7fe217e00640 1 -- 172.21.15.33:0/1764672193 learned_addr learned my addr 172.21.15.33:0/1764672193 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:36.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21e800640 1 --2- 172.21.15.33:0/1764672193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 0x7fe22015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617027952 0 0) 0x7fe22015ff80 con 0x7fe2200ae2f0 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe204003520 con 0x7fe2200ae2f0 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21e800640 1 -- 172.21.15.33:0/1764672193 >> v1:172.21.15.103:6789/0 conn(0x7fe2200b2120 legacy=0x7fe2200cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545925834 0 0) 0x7fe22015dba0 con 0x7fe2200b2120 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21e800640 1 -- 172.21.15.33:0/1764672193 >> v1:172.21.15.33:6789/0 conn(0x7fe2200ae2f0 legacy=0x7fe22015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.546+0000 7fe21e800640 1 -- 172.21.15.33:0/1764672193 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200ae890 con 0x7fe22015fba0 2024-09-13T18:59:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.547+0000 7fe21e800640 1 --2- 172.21.15.33:0/1764672193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 0x7fe22015d660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097d0 tx=0x7fe21002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f56ea8f492906d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210032440 con 0x7fe22015fba0 2024-09-13T18:59:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100325a0 con 0x7fe22015fba0 2024-09-13T18:59:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe21de00640 1 -- 172.21.15.33:0/1764672193 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210032910 con 0x7fe22015fba0 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 -- 172.21.15.33:0/1764672193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 msgr2=0x7fe22015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 --2- 172.21.15.33:0/1764672193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 0x7fe22015d660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097d0 tx=0x7fe21002a180 comp rx=0 tx=0).stop 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 -- 172.21.15.33:0/1764672193 shutdown_connections 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 --2- 172.21.15.33:0/1764672193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe22015fba0 0x7fe22015d660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 -- 172.21.15.33:0/1764672193 >> 172.21.15.33:0/1764672193 conn(0x7fe2200cc6b0 msgr2=0x7fe220069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 -- 172.21.15.33:0/1764672193 shutdown_connections 2024-09-13T18:59:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.548+0000 7fe224a00640 1 -- 172.21.15.33:0/1764672193 wait complete. 2024-09-13T18:59:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.550+0000 7fe224a00640 1 Processor -- start 2024-09-13T18:59:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.550+0000 7fe224a00640 1 -- start start 2024-09-13T18:59:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2200ae2f0 0x7fe2201e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2200b2120 0x7fe2200af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220140c20 con 0x7fe22015fba0 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220143420 con 0x7fe2200b2120 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe224a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2201e8b40 con 0x7fe2200ae2f0 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe21f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe21f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47424/0 (socket says 172.21.15.33:47424) 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.551+0000 7fe21f200640 1 -- 172.21.15.33:0/820137639 learned_addr learned my addr 172.21.15.33:0/820137639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21e800640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2200ae2f0 0x7fe2201e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe217e00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2200b2120 0x7fe2200af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 -- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2200ae2f0 msgr2=0x7fe2201e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2200ae2f0 0x7fe2201e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 -- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2200b2120 msgr2=0x7fe2200af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2200b2120 0x7fe2200af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 -- 172.21.15.33:0/820137639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009400 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe21f200640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c790 tx=0x7fe21800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800cea0 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe218003da0 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2180052b0 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2201e5520 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.552+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220140560 con 0x7fe22015fba0 2024-09-13T18:59:36.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.553+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2201403c0 con 0x7fe22015fba0 2024-09-13T18:59:36.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.554+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe218005410 con 0x7fe22015fba0 2024-09-13T18:59:36.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.555+0000 7fe216a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 0x7fe1fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.555+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe218089270 con 0x7fe22015fba0 2024-09-13T18:59:36.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.556+0000 7fe21e800640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 0x7fe1fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.557+0000 7fe21e800640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 0x7fe1fc06d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe210034000 tx=0x7fe21002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.560+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe2201403c0 con 0x7fe22015fba0 2024-09-13T18:59:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.738+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2201403c0 con 0x7fe22015fba0 2024-09-13T18:59:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.738+0000 7fe216a00640 1 -- 172.21.15.33:0/820137639 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2201403c0 con 0x7fe22015fba0 2024-09-13T18:59:36.741 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.740+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 msgr2=0x7fe1fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.740+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 0x7fe1fc06d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe210034000 tx=0x7fe21002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.740+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 msgr2=0x7fe2200af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.740+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c790 tx=0x7fe21800cc50 comp rx=0 tx=0).stop 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 shutdown_connections 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe1fc06ac00 0x7fe1fc06d0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe22015fba0 0x7fe2200af620 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2200b2120 0x7fe2200af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 --2- 172.21.15.33:0/820137639 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2200ae2f0 0x7fe2201e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 >> 172.21.15.33:0/820137639 conn(0x7fe2200cc6b0 msgr2=0x7fe22006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 shutdown_connections 2024-09-13T18:59:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.741+0000 7fe224a00640 1 -- 172.21.15.33:0/820137639 wait complete. 2024-09-13T18:59:36.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:59:36.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.916+0000 7f0c57e00640 1 Processor -- start 2024-09-13T18:59:36.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.916+0000 7f0c57e00640 1 -- start start 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c57e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c580b1ed0 0x7f0c580cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c57e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580b30e0 con 0x7f0c5815a420 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c57e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5815a800 con 0x7f0c580cdae0 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c57e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580b24d0 con 0x7f0c580b1ed0 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c56a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0c5815a420 0x7f0c580cbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39156/0 (socket says 172.21.15.33:39156) 2024-09-13T18:59:36.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c56a00640 1 -- 172.21.15.33:0/2848280166 learned_addr learned my addr 172.21.15.33:0/2848280166 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:36.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.917+0000 7f0c4fe00640 1 --2- 172.21.15.33:0/2848280166 >> v2:172.21.15.103:3300/0 conn(0x7f0c580b1ed0 0x7f0c580cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660411013 0 0) 0x7f0c580b30e0 con 0x7f0c5815a420 2024-09-13T18:59:36.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c003520 con 0x7f0c5815a420 2024-09-13T18:59:36.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931870152 0 0) 0x7f0c3c003520 con 0x7f0c5815a420 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 >> v2:172.21.15.103:3300/0 conn(0x7f0c580b1ed0 msgr2=0x7f0c580cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 --2- 172.21.15.33:0/2848280166 >> v2:172.21.15.103:3300/0 conn(0x7f0c580b1ed0 0x7f0c580cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 >> v1:172.21.15.103:6789/0 conn(0x7f0c580cdae0 legacy=0x7f0c5806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580b27b0 con 0x7f0c5815a420 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f0c48001670 con 0x7f0c5815a420 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 >> v1:172.21.15.33:6789/0 conn(0x7f0c5815a420 legacy=0x7f0c580cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c003970 0x7f0c3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c3c0047c0 0x7f0c3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b24d0 con 0x7f0c3c005180 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00c020 con 0x7f0c3c003970 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00c1e0 con 0x7f0c3c0047c0 2024-09-13T18:59:36.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c57400640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c4fe00640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c3c0047c0 0x7f0c3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.918+0000 7f0c56a00640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c003970 0x7f0c3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.919+0000 7f0c57400640 1 -- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c3c0047c0 msgr2=0x7f0c3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.919+0000 7f0c57400640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c3c0047c0 0x7f0c3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.919+0000 7f0c57400640 1 -- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c003970 msgr2=0x7f0c3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.919+0000 7f0c57400640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c003970 0x7f0c3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.919+0000 7f0c57400640 1 -- 172.21.15.33:0/2848280166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c003520 con 0x7f0c3c005180 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c57400640 1 -- 172.21.15.33:0/2848280166 reap_dead start 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c57400640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c3c00b980 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e50 tx=0x7f0c3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc5d84978dfda97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5002ae70 con 0x7f0c3c005180 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50003970 con 0x7f0c3c005180 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c56000640 1 -- 172.21.15.33:0/2848280166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003d20 con 0x7f0c3c005180 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c57e00640 1 -- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 msgr2=0x7f0c3c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.920+0000 7f0c57e00640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c3c00b980 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e50 tx=0x7f0c3c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.921+0000 7f0c57e00640 1 -- 172.21.15.33:0/2848280166 shutdown_connections 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.921+0000 7f0c57e00640 1 --2- 172.21.15.33:0/2848280166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c3c00b980 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.921+0000 7f0c57e00640 1 -- 172.21.15.33:0/2848280166 >> 172.21.15.33:0/2848280166 conn(0x7f0c58069ed0 msgr2=0x7f0c5806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.921+0000 7f0c57e00640 1 -- 172.21.15.33:0/2848280166 shutdown_connections 2024-09-13T18:59:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.921+0000 7f0c57e00640 1 -- 172.21.15.33:0/2848280166 wait complete. 2024-09-13T18:59:36.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.922+0000 7f0c57e00640 1 Processor -- start 2024-09-13T18:59:36.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.922+0000 7f0c57e00640 1 -- start start 2024-09-13T18:59:36.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.923+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.923+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c5815e220 0x7f0c58151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5815e6a0 0x7f0c58151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c57e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5814ca50 con 0x7f0c3c005180 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c57e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5814cd30 con 0x7f0c5815e6a0 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c57e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5814d010 con 0x7f0c5815e220 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47440/0 (socket says 172.21.15.33:47440) 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 -- 172.21.15.33:0/3145824871 learned_addr learned my addr 172.21.15.33:0/3145824871 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c4fe00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c5815e220 0x7f0c58151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c57400640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5815e6a0 0x7f0c58151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 -- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c5815e220 msgr2=0x7f0c58151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c5815e220 0x7f0c58151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 -- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5815e6a0 msgr2=0x7f0c58151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5815e6a0 0x7f0c58151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.924+0000 7f0c56a00640 1 -- 172.21.15.33:0/3145824871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5814d2f0 con 0x7f0c3c005180 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c56a00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007290 tx=0x7f0c48007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48004ea0 con 0x7f0c3c005180 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800f9c0 con 0x7f0c3c005180 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5814d5d0 con 0x7f0c3c005180 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800fd90 con 0x7f0c3c005180 2024-09-13T18:59:36.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.925+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5814f1c0 con 0x7f0c3c005180 2024-09-13T18:59:36.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.926+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5814d7f0 con 0x7f0c3c005180 2024-09-13T18:59:36.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.927+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c4801d460 con 0x7f0c3c005180 2024-09-13T18:59:36.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.928+0000 7f0c4ea00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:36.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.928+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c48089560 con 0x7f0c3c005180 2024-09-13T18:59:36.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.928+0000 7f0c4fe00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:36.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.929+0000 7f0c4fe00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 0x7f0c3406d0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b1b30 tx=0x7f0c40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:36.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:36.932+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c480546a0 con 0x7f0c3c005180 2024-09-13T18:59:37.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.110+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c580cbb00 con 0x7f0c3c005180 2024-09-13T18:59:37.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.111+0000 7f0c4ea00640 1 -- 172.21.15.33:0/3145824871 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c48057cc0 con 0x7f0c3c005180 2024-09-13T18:59:37.114 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 msgr2=0x7f0c3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 0x7f0c3406d0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b1b30 tx=0x7f0c40008040 comp rx=0 tx=0).stop 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 msgr2=0x7f0c5814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007290 tx=0x7f0c48007750 comp rx=0 tx=0).stop 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 shutdown_connections 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5815e6a0 0x7f0c58151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0c5815e220 0x7f0c58151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 --2- 172.21.15.33:0/3145824871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c3c005180 0x7f0c5814b330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 >> 172.21.15.33:0/3145824871 conn(0x7f0c58069ed0 msgr2=0x7f0c58154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:37.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 shutdown_connections 2024-09-13T18:59:37.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.113+0000 7f0c57e00640 1 -- 172.21.15.33:0/3145824871 wait complete. 2024-09-13T18:59:37.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:59:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.287+0000 7f6f5b400640 1 Processor -- start 2024-09-13T18:59:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.288+0000 7f6f5b400640 1 -- start start 2024-09-13T18:59:37.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f5b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f54071690 0x7f6f5415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f5b400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6f540cafa0 0x7f6f540cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f5b400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5406f5f0 con 0x7f6f54156f60 2024-09-13T18:59:37.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f5b400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5415aa30 con 0x7f6f54071690 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f5b400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f54070450 con 0x7f6f540cafa0 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f53e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f54071690 0x7f6f5415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f53e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f54071690 0x7f6f5415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47456/0 (socket says 172.21.15.33:47456) 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f53e00640 1 -- 172.21.15.33:0/2859665378 learned_addr learned my addr 172.21.15.33:0/2859665378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.289+0000 7f6f59400640 1 --2- 172.21.15.33:0/2859665378 >> v2:172.21.15.103:3300/0 conn(0x7f6f540cafa0 0x7f6f540cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.290+0000 7f6f53e00640 1 -- 172.21.15.33:0/2859665378 >> v2:172.21.15.103:3300/0 conn(0x7f6f540cafa0 msgr2=0x7f6f540cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.290+0000 7f6f53e00640 1 --2- 172.21.15.33:0/2859665378 >> v2:172.21.15.103:3300/0 conn(0x7f6f540cafa0 0x7f6f540cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.290+0000 7f6f53e00640 1 -- 172.21.15.33:0/2859665378 >> v1:172.21.15.103:6789/0 conn(0x7f6f54156f60 legacy=0x7f6f54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.290+0000 7f6f53e00640 1 -- 172.21.15.33:0/2859665378 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5406f840 con 0x7f6f54071690 2024-09-13T18:59:37.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f53e00640 1 --2- 172.21.15.33:0/2859665378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54071690 0x7f6f5415a4f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f54159a70 tx=0x7f6f4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da112c5c52ad9869 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f53400640 1 -- 172.21.15.33:0/2859665378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40032440 con 0x7f6f54071690 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f53400640 1 -- 172.21.15.33:0/2859665378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400325a0 con 0x7f6f54071690 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f53400640 1 -- 172.21.15.33:0/2859665378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40032930 con 0x7f6f54071690 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f5b400640 1 -- 172.21.15.33:0/2859665378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54071690 msgr2=0x7f6f5415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.291+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2859665378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54071690 0x7f6f5415a4f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f54159a70 tx=0x7f6f4002a270 comp rx=0 tx=0).stop 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 -- 172.21.15.33:0/2859665378 shutdown_connections 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2859665378 >> v2:172.21.15.103:3300/0 conn(0x7f6f540cafa0 0x7f6f540cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2859665378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54071690 0x7f6f5415a4f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 -- 172.21.15.33:0/2859665378 >> 172.21.15.33:0/2859665378 conn(0x7f6f540b0580 msgr2=0x7f6f540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 -- 172.21.15.33:0/2859665378 shutdown_connections 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.292+0000 7f6f5b400640 1 -- 172.21.15.33:0/2859665378 wait complete. 2024-09-13T18:59:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.293+0000 7f6f5b400640 1 Processor -- start 2024-09-13T18:59:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.293+0000 7f6f5b400640 1 -- start start 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f54071690 0x7f6f54142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f540cafa0 0x7f6f54157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54148cf0 con 0x7f6f54156f60 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54157a90 con 0x7f6f54071690 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f5b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f541480e0 con 0x7f6f540cafa0 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f59400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f59400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47472/0 (socket says 172.21.15.33:47472) 2024-09-13T18:59:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.294+0000 7f6f59400640 1 -- 172.21.15.33:0/2676639982 learned_addr learned my addr 172.21.15.33:0/2676639982 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 -- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f540cafa0 msgr2=0x7f6f54157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f540cafa0 0x7f6f54157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 -- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f54071690 msgr2=0x7f6f54142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f54071690 0x7f6f54142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 -- 172.21.15.33:0/2676639982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094d0 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f59400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00efc0 tx=0x7f6f4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c014480 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00f040 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f541483c0 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.295+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c014840 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.296+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f54148980 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.297+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f541f2740 con 0x7f6f54156f60 2024-09-13T18:59:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.297+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f4c0149a0 con 0x7f6f54156f60 2024-09-13T18:59:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.298+0000 7f6f50c00640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 0x7f6f3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.298+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f4c08a400 con 0x7f6f54156f60 2024-09-13T18:59:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.299+0000 7f6f58a00640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 0x7f6f3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.300+0000 7f6f58a00640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 0x7f6f3406d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f60 tx=0x7f6f480079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.302+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f4c055540 con 0x7f6f54156f60 2024-09-13T18:59:37.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.480+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f54157340 con 0x7f6f54156f60 2024-09-13T18:59:37.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.481+0000 7f6f50c00640 1 -- 172.21.15.33:0/2676639982 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f4c058b60 con 0x7f6f54156f60 2024-09-13T18:59:37.483 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 msgr2=0x7f6f3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 0x7f6f3406d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f60 tx=0x7f6f480079b0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 msgr2=0x7f6f5414a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00efc0 tx=0x7f6f4c00c490 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 shutdown_connections 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6f3406ac00 0x7f6f3406d0c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f54156f60 0x7f6f5414a8a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f540cafa0 0x7f6f54157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 --2- 172.21.15.33:0/2676639982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f54071690 0x7f6f54142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 >> 172.21.15.33:0/2676639982 conn(0x7f6f540b0580 msgr2=0x7f6f540cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 shutdown_connections 2024-09-13T18:59:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.483+0000 7f6f5b400640 1 -- 172.21.15.33:0/2676639982 wait complete. 2024-09-13T18:59:37.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:59:37.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.654+0000 7f854ae00640 1 Processor -- start 2024-09-13T18:59:37.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.654+0000 7f854ae00640 1 -- start start 2024-09-13T18:59:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.655+0000 7f854ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8544159610 0x7f8544070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.655+0000 7f854ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85440b3790 0x7f85440cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.655+0000 7f854ae00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85440709e0 con 0x7f8544070540 2024-09-13T18:59:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.655+0000 7f854ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85441599f0 con 0x7f85440b3790 2024-09-13T18:59:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.655+0000 7f854ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8544070cc0 con 0x7f8544159610 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8548e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85440b3790 0x7f85440cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f853b400640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8544070540 0x7f85440b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:56376/0 (socket says 172.21.15.33:56376) 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f853b400640 1 -- 172.21.15.33:0/3937380927 learned_addr learned my addr 172.21.15.33:0/3937380927 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8543e00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8544159610 0x7f8544070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8548e00640 1 -- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8544159610 msgr2=0x7f8544070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8548e00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8544159610 0x7f8544070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8548e00640 1 -- 172.21.15.33:0/3937380927 >> v1:172.21.15.103:6789/0 conn(0x7f8544070540 legacy=0x7f85440b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.656+0000 7f8548e00640 1 -- 172.21.15.33:0/3937380927 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544070fa0 con 0x7f85440b3790 2024-09-13T18:59:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.657+0000 7f8548e00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85440b3790 0x7f85440cd080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c02c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3c6ef4443f5037e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f8543400640 1 -- 172.21.15.33:0/3937380927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c032770 con 0x7f85440b3790 2024-09-13T18:59:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f8543400640 1 -- 172.21.15.33:0/3937380927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0328d0 con 0x7f85440b3790 2024-09-13T18:59:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f8543400640 1 -- 172.21.15.33:0/3937380927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c032c60 con 0x7f85440b3790 2024-09-13T18:59:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f854ae00640 1 -- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85440b3790 msgr2=0x7f85440cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f854ae00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85440b3790 0x7f85440cd080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c02c870 comp rx=0 tx=0).stop 2024-09-13T18:59:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.658+0000 7f854ae00640 1 -- 172.21.15.33:0/3937380927 shutdown_connections 2024-09-13T18:59:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.659+0000 7f854ae00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85440b3790 0x7f85440cd080 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.659+0000 7f854ae00640 1 --2- 172.21.15.33:0/3937380927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8544159610 0x7f8544070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.659+0000 7f854ae00640 1 -- 172.21.15.33:0/3937380927 >> 172.21.15.33:0/3937380927 conn(0x7f85440b0510 msgr2=0x7f85440b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.659+0000 7f854ae00640 1 -- 172.21.15.33:0/3937380927 shutdown_connections 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.659+0000 7f854ae00640 1 -- 172.21.15.33:0/3937380927 wait complete. 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.660+0000 7f854ae00640 1 Processor -- start 2024-09-13T18:59:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.660+0000 7f854ae00640 1 -- start start 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8544070540 0x7f854414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85440b3790 0x7f854414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854415aca0 con 0x7f8544159610 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854415a020 con 0x7f8544070540 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.661+0000 7f854ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854415a300 con 0x7f85440b3790 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47486/0 (socket says 172.21.15.33:47486) 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8543e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8544070540 0x7f854414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f853b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85440b3790 0x7f854414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 -- 172.21.15.33:0/269825665 learned_addr learned my addr 172.21.15.33:0/269825665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 -- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85440b3790 msgr2=0x7f854414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85440b3790 0x7f854414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 -- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8544070540 msgr2=0x7f854414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8544070540 0x7f854414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.662+0000 7f8548e00640 1 -- 172.21.15.33:0/269825665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009a70 con 0x7f8544159610 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f8548e00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c033890 con 0x7f8544159610 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c033a10 con 0x7f8544159610 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c033dc0 con 0x7f8544159610 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854415a5e0 con 0x7f8544159610 2024-09-13T18:59:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.663+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854414d600 con 0x7f8544159610 2024-09-13T18:59:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.664+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854414d790 con 0x7f8544159610 2024-09-13T18:59:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.665+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f853c04f440 con 0x7f8544159610 2024-09-13T18:59:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.666+0000 7f8540c00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 0x7f852006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.666+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f853c0aa690 con 0x7f8544159610 2024-09-13T18:59:37.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.667+0000 7f8543e00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 0x7f852006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:37.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.667+0000 7f8543e00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 0x7f852006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85440b33c0 tx=0x7f8534009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:37.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.671+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f854414d790 con 0x7f8544159610 2024-09-13T18:59:37.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.862+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f854415ade0 con 0x7f8544159610 2024-09-13T18:59:37.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.862+0000 7f8540c00640 1 -- 172.21.15.33:0/269825665 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f854415ade0 con 0x7f8544159610 2024-09-13T18:59:37.865 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T18:59:37.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 msgr2=0x7f852006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 0x7f852006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85440b33c0 tx=0x7f8534009190 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 msgr2=0x7f8544150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f853c009d90 tx=0x7f853c004ab0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 shutdown_connections 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f852006ac00 0x7f852006d0c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8544159610 0x7f8544150820 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85440b3790 0x7f854414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 --2- 172.21.15.33:0/269825665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8544070540 0x7f854414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 >> 172.21.15.33:0/269825665 conn(0x7f85440b0510 msgr2=0x7f85440ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 shutdown_connections 2024-09-13T18:59:37.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:37.865+0000 7f854ae00640 1 -- 172.21.15.33:0/269825665 wait complete. 2024-09-13T18:59:37.883 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:59:37.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:37.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:59:37.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T18:59:37.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:59:37.953 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:59:37.991 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:37.991 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:38.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:38.027 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:38.027 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:38.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:38.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.220+0000 7efdeb200640 1 Processor -- start 2024-09-13T18:59:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.221+0000 7efdeb200640 1 -- start start 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdeb200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdeb200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdec15b9b0 0x7efdec0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdeb200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0cbfc0 con 0x7efdec0cbac0 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdeb200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0cce20 con 0x7efdec15b9b0 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdeb200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0707a0 con 0x7efdec15a5c0 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdea800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdec15b9b0 0x7efdec0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdea800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efdec15b9b0 0x7efdec0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47494/0 (socket says 172.21.15.33:47494) 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdea800640 1 -- 172.21.15.33:0/2278001976 learned_addr learned my addr 172.21.15.33:0/2278001976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efde9e00640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdea800640 1 -- 172.21.15.33:0/2278001976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 msgr2=0x7efdec0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.222+0000 7efdea800640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.223+0000 7efdea800640 1 -- 172.21.15.33:0/2278001976 >> v1:172.21.15.103:6789/0 conn(0x7efdec0cbac0 legacy=0x7efdec06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.223+0000 7efdea800640 1 -- 172.21.15.33:0/2278001976 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec070a80 con 0x7efdec15b9b0 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.223+0000 7efdea800640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec0b3ef0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4419c5e2dff19da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efde9400640 1 -- 172.21.15.33:0/2278001976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde402aea0 con 0x7efdec15b9b0 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efde9400640 1 -- 172.21.15.33:0/2278001976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde402d050 con 0x7efdec15b9b0 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efde9400640 1 -- 172.21.15.33:0/2278001976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4031820 con 0x7efdec15b9b0 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 -- 172.21.15.33:0/2278001976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 msgr2=0x7efdec0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec0b3ef0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde402a680 comp rx=0 tx=0).stop 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 -- 172.21.15.33:0/2278001976 shutdown_connections 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec0b3ef0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 --2- 172.21.15.33:0/2278001976 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 -- 172.21.15.33:0/2278001976 >> 172.21.15.33:0/2278001976 conn(0x7efdec0ae310 msgr2=0x7efdec0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.224+0000 7efdeb200640 1 -- 172.21.15.33:0/2278001976 shutdown_connections 2024-09-13T18:59:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.225+0000 7efdeb200640 1 -- 172.21.15.33:0/2278001976 wait complete. 2024-09-13T18:59:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.226+0000 7efdeb200640 1 Processor -- start 2024-09-13T18:59:38.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.226+0000 7efdeb200640 1 -- start start 2024-09-13T18:59:38.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdec0cbac0 0x7efdec1f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b37b0 con 0x7efdec15b9b0 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b1b10 con 0x7efdec0cbac0 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdeb200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b1df0 con 0x7efdec15a5c0 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.227+0000 7efdea800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47508/0 (socket says 172.21.15.33:47508) 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 -- 172.21.15.33:0/1530174445 learned_addr learned my addr 172.21.15.33:0/1530174445 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efde9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdec0cbac0 0x7efdec1f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efde1400640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 -- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 msgr2=0x7efdec151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 -- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdec0cbac0 msgr2=0x7efdec1f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdec0cbac0 0x7efdec1f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 -- 172.21.15.33:0/1530174445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4009b30 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efdea800640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.228+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde403b820 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.229+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde403b980 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.229+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde403bd30 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.229+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec0b20d0 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.229+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec0b2690 con 0x7efdec15b9b0 2024-09-13T18:59:38.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.230+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec067360 con 0x7efdec15b9b0 2024-09-13T18:59:38.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.231+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efde4038050 con 0x7efdec15b9b0 2024-09-13T18:59:38.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.231+0000 7efde2a00640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 0x7efdc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.232+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde40a9be0 con 0x7efdec15b9b0 2024-09-13T18:59:38.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.232+0000 7efde9e00640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 0x7efdc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.233+0000 7efde9e00640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 0x7efdc806d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efddc009b40 tx=0x7efddc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.235+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efde4074dd0 con 0x7efdec15b9b0 2024-09-13T18:59:38.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.448+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdec0b2880 con 0x7efdec15b9b0 2024-09-13T18:59:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.448+0000 7efde2a00640 1 -- 172.21.15.33:0/1530174445 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7efde404b090 con 0x7efdec15b9b0 2024-09-13T18:59:38.454 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:38.454 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 msgr2=0x7efdc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 0x7efdc806d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efddc009b40 tx=0x7efddc009190 comp rx=0 tx=0).stop 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 msgr2=0x7efdec156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efde4009e50 tx=0x7efde4004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 shutdown_connections 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efdc806ac00 0x7efdc806d0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdec15b9b0 0x7efdec156700 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efdec15a5c0 0x7efdec151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 --2- 172.21.15.33:0/1530174445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdec0cbac0 0x7efdec1f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 >> 172.21.15.33:0/1530174445 conn(0x7efdec0ae310 msgr2=0x7efdec0aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:38.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.450+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 shutdown_connections 2024-09-13T18:59:38.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.451+0000 7efdeb200640 1 -- 172.21.15.33:0/1530174445 wait complete. 2024-09-13T18:59:38.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.622+0000 7f17a1800640 1 Processor -- start 2024-09-13T18:59:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.622+0000 7f17a1800640 1 -- start start 2024-09-13T18:59:38.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f17a1800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f179c153b20 0x7f179c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f17a1800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c153f00 con 0x7f179c06f660 2024-09-13T18:59:38.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f17a1800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0b1a40 con 0x7f179c159a80 2024-09-13T18:59:38.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f17a1800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0ce600 con 0x7f179c153b20 2024-09-13T18:59:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f179b400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f179c06f660 0x7f179c06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39164/0 (socket says 172.21.15.33:39164) 2024-09-13T18:59:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f179b400640 1 -- 172.21.15.33:0/3040288063 learned_addr learned my addr 172.21.15.33:0/3040288063 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.623+0000 7f179aa00640 1 --2- 172.21.15.33:0/3040288063 >> v2:172.21.15.103:3300/0 conn(0x7f179c153b20 0x7f179c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633495603 0 0) 0x7f179c0b1a40 con 0x7f179c159a80 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1780003520 con 0x7f179c159a80 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894292407 0 0) 0x7f179c153f00 con 0x7f179c06f660 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f179c0b1a40 con 0x7f179c06f660 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f179aa00640 1 -- 172.21.15.33:0/3040288063 >> v1:172.21.15.103:6789/0 conn(0x7f179c159a80 legacy=0x7f179c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f179aa00640 1 -- 172.21.15.33:0/3040288063 >> v1:172.21.15.33:6789/0 conn(0x7f179c06f660 legacy=0x7f179c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.624+0000 7f179aa00640 1 -- 172.21.15.33:0/3040288063 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c15a1f0 con 0x7f179c153b20 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.625+0000 7f179aa00640 1 --2- 172.21.15.33:0/3040288063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c153b20 0x7f179c0b3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f178c0097a0 tx=0x7f178c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e26b2389c62b5ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.625+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c032440 con 0x7f179c153b20 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.625+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0325a0 con 0x7f179c153b20 2024-09-13T18:59:38.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.625+0000 7f1799600640 1 -- 172.21.15.33:0/3040288063 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c032930 con 0x7f179c153b20 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 -- 172.21.15.33:0/3040288063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c153b20 msgr2=0x7f179c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 --2- 172.21.15.33:0/3040288063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c153b20 0x7f179c0b3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f178c0097a0 tx=0x7f178c02a230 comp rx=0 tx=0).stop 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 -- 172.21.15.33:0/3040288063 shutdown_connections 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 --2- 172.21.15.33:0/3040288063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c153b20 0x7f179c0b3990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 -- 172.21.15.33:0/3040288063 >> 172.21.15.33:0/3040288063 conn(0x7f179c0b0510 msgr2=0x7f179c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 -- 172.21.15.33:0/3040288063 shutdown_connections 2024-09-13T18:59:38.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.626+0000 7f17a1800640 1 -- 172.21.15.33:0/3040288063 wait complete. 2024-09-13T18:59:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.628+0000 7f17a1800640 1 Processor -- start 2024-09-13T18:59:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.628+0000 7f17a1800640 1 -- start start 2024-09-13T18:59:38.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c06f660 0x7f179c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f179c159a80 0x7f179c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c156860 con 0x7f179c153b20 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c157020 con 0x7f179c06f660 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f17a1800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c154150 con 0x7f179c159a80 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47520/0 (socket says 172.21.15.33:47520) 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 -- 172.21.15.33:0/781653784 learned_addr learned my addr 172.21.15.33:0/781653784 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179aa00640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c06f660 0x7f179c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179b400640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f179c159a80 0x7f179c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 -- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f179c159a80 msgr2=0x7f179c142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f179c159a80 0x7f179c142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 -- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c06f660 msgr2=0x7f179c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c06f660 0x7f179c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.629+0000 7f179a000640 1 -- 172.21.15.33:0/781653784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009400 con 0x7f179c153b20 2024-09-13T18:59:38.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f179a000640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f178800c4d0 tx=0x7f178800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880052d0 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788005430 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788012870 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c154430 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.630+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c152e80 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.631+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c156d40 con 0x7f179c153b20 2024-09-13T18:59:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.632+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17880129d0 con 0x7f179c153b20 2024-09-13T18:59:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.633+0000 7f1792a00640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 0x7f177c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.633+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1788088f00 con 0x7f179c153b20 2024-09-13T18:59:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.633+0000 7f179aa00640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 0x7f177c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.634+0000 7f179aa00640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 0x7f177c06d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f178c034000 tx=0x7f178c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:38.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.637+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f179c156d40 con 0x7f179c153b20 2024-09-13T18:59:38.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.851+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f179c156d40 con 0x7f179c153b20 2024-09-13T18:59:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.852+0000 7f1792a00640 1 -- 172.21.15.33:0/781653784 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f179c156d40 con 0x7f179c153b20 2024-09-13T18:59:38.857 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:38.858 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.854+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 msgr2=0x7f177c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.854+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 0x7f177c06d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f178c034000 tx=0x7f178c02e000 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.854+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 msgr2=0x7f179c0af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.854+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f178800c4d0 tx=0x7f178800c990 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.854+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 shutdown_connections 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f177c06ac00 0x7f177c06d0c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f179c159a80 0x7f179c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179c153b20 0x7f179c0af640 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 --2- 172.21.15.33:0/781653784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f179c06f660 0x7f179c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 >> 172.21.15.33:0/781653784 conn(0x7f179c0b0510 msgr2=0x7f179c0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 shutdown_connections 2024-09-13T18:59:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:38.855+0000 7f17a1800640 1 -- 172.21.15.33:0/781653784 wait complete. 2024-09-13T18:59:38.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:16.657564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:17.640729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:38.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:39.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.030+0000 7fef77000640 1 Processor -- start 2024-09-13T18:59:39.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.030+0000 7fef77000640 1 -- start start 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 0x7fef700b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef70069ed0 0x7fef7006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef70160510 0x7fef701609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7006a850 con 0x7fef70069ed0 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef700b2900 con 0x7fef70160510 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef77000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef70161240 con 0x7fef7015c7e0 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef67400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef70069ed0 0x7fef7006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef67400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef70069ed0 0x7fef7006a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47530/0 (socket says 172.21.15.33:47530) 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.031+0000 7fef67400640 1 -- 172.21.15.33:0/1136570541 learned_addr learned my addr 172.21.15.33:0/1136570541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef6fe00640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 0x7fef700b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef75000640 1 --2- 172.21.15.33:0/1136570541 >> v2:172.21.15.103:3300/0 conn(0x7fef70160510 0x7fef701609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef67400640 1 -- 172.21.15.33:0/1136570541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 msgr2=0x7fef700b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef67400640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 0x7fef700b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef67400640 1 -- 172.21.15.33:0/1136570541 >> v2:172.21.15.103:3300/0 conn(0x7fef70160510 msgr2=0x7fef701609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef67400640 1 --2- 172.21.15.33:0/1136570541 >> v2:172.21.15.103:3300/0 conn(0x7fef70160510 0x7fef701609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef67400640 1 -- 172.21.15.33:0/1136570541 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700b2ba0 con 0x7fef70069ed0 2024-09-13T18:59:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.032+0000 7fef6fe00640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 0x7fef700b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef67400640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef70069ed0 0x7fef7006a310 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fef7006bb60 tx=0x7fef5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de6cbc09efbbda6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef6f400640 1 -- 172.21.15.33:0/1136570541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58032440 con 0x7fef70069ed0 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef6f400640 1 -- 172.21.15.33:0/1136570541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580325a0 con 0x7fef70069ed0 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef6f400640 1 -- 172.21.15.33:0/1136570541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58032930 con 0x7fef70069ed0 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef77000640 1 -- 172.21.15.33:0/1136570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef70069ed0 msgr2=0x7fef7006a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.033+0000 7fef77000640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef70069ed0 0x7fef7006a310 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fef7006bb60 tx=0x7fef5802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 -- 172.21.15.33:0/1136570541 shutdown_connections 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 --2- 172.21.15.33:0/1136570541 >> v2:172.21.15.103:3300/0 conn(0x7fef70160510 0x7fef701609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef70069ed0 0x7fef7006a310 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 --2- 172.21.15.33:0/1136570541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef7015c7e0 0x7fef700b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 -- 172.21.15.33:0/1136570541 >> 172.21.15.33:0/1136570541 conn(0x7fef7006afe0 msgr2=0x7fef7006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 -- 172.21.15.33:0/1136570541 shutdown_connections 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.034+0000 7fef77000640 1 -- 172.21.15.33:0/1136570541 wait complete. 2024-09-13T18:59:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.035+0000 7fef77000640 1 Processor -- start 2024-09-13T18:59:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.035+0000 7fef77000640 1 -- start start 2024-09-13T18:59:39.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef70069ed0 0x7fef70157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef70160510 0x7fef70157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700ce740 con 0x7fef7015c7e0 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700cea20 con 0x7fef70160510 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.036+0000 7fef77000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef700ced00 con 0x7fef70069ed0 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47536/0 (socket says 172.21.15.33:47536) 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 -- 172.21.15.33:0/2306575475 learned_addr learned my addr 172.21.15.33:0/2306575475 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef6fe00640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef70069ed0 0x7fef70157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef75000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef70160510 0x7fef70157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 -- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef70069ed0 msgr2=0x7fef70157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef70069ed0 0x7fef70157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 -- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef70160510 msgr2=0x7fef70157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef70160510 0x7fef70157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 -- 172.21.15.33:0/2306575475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580094d0 con 0x7fef7015c7e0 2024-09-13T18:59:39.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.037+0000 7fef67400640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fef5802a220 tx=0x7fef580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.038+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58032440 con 0x7fef7015c7e0 2024-09-13T18:59:39.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.038+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58030ba0 con 0x7fef7015c7e0 2024-09-13T18:59:39.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.038+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5803d440 con 0x7fef7015c7e0 2024-09-13T18:59:39.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.038+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef700cefe0 con 0x7fef7015c7e0 2024-09-13T18:59:39.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.038+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef70157a80 con 0x7fef7015c7e0 2024-09-13T18:59:39.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.039+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7015cbc0 con 0x7fef7015c7e0 2024-09-13T18:59:39.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.040+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef58039040 con 0x7fef7015c7e0 2024-09-13T18:59:39.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.041+0000 7fef6cc00640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.041+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef580a9e80 con 0x7fef7015c7e0 2024-09-13T18:59:39.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.041+0000 7fef6fe00640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.042+0000 7fef6fe00640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 0x7fef4c06d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef60006b10 tx=0x7fef60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.045+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef58075070 con 0x7fef7015c7e0 2024-09-13T18:59:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.227+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef7006bd50 con 0x7fef7015c7e0 2024-09-13T18:59:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.228+0000 7fef6cc00640 1 -- 172.21.15.33:0/2306575475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef580410a0 con 0x7fef7015c7e0 2024-09-13T18:59:39.231 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 msgr2=0x7fef4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 0x7fef4c06d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef60006b10 tx=0x7fef60008040 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 msgr2=0x7fef7015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fef5802a220 tx=0x7fef580046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 shutdown_connections 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fef4c06ac30 0x7fef4c06d0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef70160510 0x7fef70157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7015c7e0 0x7fef7015cdd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 --2- 172.21.15.33:0/2306575475 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef70069ed0 0x7fef70157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 >> 172.21.15.33:0/2306575475 conn(0x7fef7006afe0 msgr2=0x7fef70158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 shutdown_connections 2024-09-13T18:59:39.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.230+0000 7fef77000640 1 -- 172.21.15.33:0/2306575475 wait complete. 2024-09-13T18:59:39.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:59:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.403+0000 7f310f200640 1 Processor -- start 2024-09-13T18:59:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.404+0000 7f310f200640 1 -- start start 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310f200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f311006c760 0x7f31101650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100b30e0 con 0x7f311015a420 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310f200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311015a800 con 0x7f31100b1ed0 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310f200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100b24d0 con 0x7f311006c760 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310e800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f311006c760 0x7f31101650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310de00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f311015a420 0x7f31100cbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39172/0 (socket says 172.21.15.33:39172) 2024-09-13T18:59:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.405+0000 7f310de00640 1 -- 172.21.15.33:0/1724839383 learned_addr learned my addr 172.21.15.33:0/1724839383 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.406+0000 7f310d400640 1 -- 172.21.15.33:0/1724839383 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816285107 0 0) 0x7f31100b30e0 con 0x7f311015a420 2024-09-13T18:59:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.406+0000 7f310e800640 1 -- 172.21.15.33:0/1724839383 >> v1:172.21.15.103:6789/0 conn(0x7f31100b1ed0 legacy=0x7f31100cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.406+0000 7f310e800640 1 -- 172.21.15.33:0/1724839383 >> v1:172.21.15.33:6789/0 conn(0x7f311015a420 legacy=0x7f31100cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.406+0000 7f310e800640 1 -- 172.21.15.33:0/1724839383 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100b27b0 con 0x7f311006c760 2024-09-13T18:59:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310e800640 1 --2- 172.21.15.33:0/1724839383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311006c760 0x7f31101650d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3108009d90 tx=0x7f310802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eccc798b1576ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310d400640 1 -- 172.21.15.33:0/1724839383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108007740 con 0x7f311006c760 2024-09-13T18:59:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310d400640 1 -- 172.21.15.33:0/1724839383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310802d050 con 0x7f311006c760 2024-09-13T18:59:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310d400640 1 -- 172.21.15.33:0/1724839383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108007ac0 con 0x7f311006c760 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310f200640 1 -- 172.21.15.33:0/1724839383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311006c760 msgr2=0x7f31101650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310f200640 1 --2- 172.21.15.33:0/1724839383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311006c760 0x7f31101650d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3108009d90 tx=0x7f310802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310f200640 1 -- 172.21.15.33:0/1724839383 shutdown_connections 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310f200640 1 --2- 172.21.15.33:0/1724839383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311006c760 0x7f31101650d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.407+0000 7f310f200640 1 -- 172.21.15.33:0/1724839383 >> 172.21.15.33:0/1724839383 conn(0x7f3110069ed0 msgr2=0x7f311006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.408+0000 7f310f200640 1 -- 172.21.15.33:0/1724839383 shutdown_connections 2024-09-13T18:59:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.408+0000 7f310f200640 1 -- 172.21.15.33:0/1724839383 wait complete. 2024-09-13T18:59:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.409+0000 7f310f200640 1 Processor -- start 2024-09-13T18:59:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.409+0000 7f310f200640 1 -- start start 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f311006c760 0x7f3110140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31100b1ed0 0x7f3110154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110150190 con 0x7f311015a420 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110150470 con 0x7f311006c760 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110150750 con 0x7f31100b1ed0 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47550/0 (socket says 172.21.15.33:47550) 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.410+0000 7f310e800640 1 -- 172.21.15.33:0/3086277742 learned_addr learned my addr 172.21.15.33:0/3086277742 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f3107e00640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31100b1ed0 0x7f3110154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310de00640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f311006c760 0x7f3110140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 -- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31100b1ed0 msgr2=0x7f3110154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31100b1ed0 0x7f3110154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 -- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f311006c760 msgr2=0x7f3110140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f311006c760 0x7f3110140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 -- 172.21.15.33:0/3086277742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009a70 con 0x7f311015a420 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310e800640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3108009d90 tx=0x7f3108004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108003b90 con 0x7f311015a420 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108003cf0 con 0x7f311015a420 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108031a50 con 0x7f311015a420 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.411+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3110150a30 con 0x7f311015a420 2024-09-13T18:59:39.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.412+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3110151130 con 0x7f311015a420 2024-09-13T18:59:39.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.413+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31101512c0 con 0x7f311015a420 2024-09-13T18:59:39.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.413+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3108031bb0 con 0x7f311015a420 2024-09-13T18:59:39.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.414+0000 7f3106000640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 0x7f30ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.414+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31080aab30 con 0x7f311015a420 2024-09-13T18:59:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.415+0000 7f310de00640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 0x7f30ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.415+0000 7f310de00640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 0x7f30ec06d0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3100000f60 tx=0x7f3100007d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.418+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3108075c70 con 0x7f311015a420 2024-09-13T18:59:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.595+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31101502d0 con 0x7f311015a420 2024-09-13T18:59:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.595+0000 7f3106000640 1 -- 172.21.15.33:0/3086277742 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3108040020 con 0x7f311015a420 2024-09-13T18:59:39.598 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 msgr2=0x7f30ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 0x7f30ec06d0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3100000f60 tx=0x7f3100007d00 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 msgr2=0x7f31101554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3108009d90 tx=0x7f3108004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 shutdown_connections 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f30ec06ac30 0x7f30ec06d0f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f311015a420 0x7f31101554f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31100b1ed0 0x7f3110154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 --2- 172.21.15.33:0/3086277742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f311006c760 0x7f3110140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 >> 172.21.15.33:0/3086277742 conn(0x7f3110069ed0 msgr2=0x7f31100cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.597+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 shutdown_connections 2024-09-13T18:59:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.598+0000 7f310f200640 1 -- 172.21.15.33:0/3086277742 wait complete. 2024-09-13T18:59:39.616 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:59:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.772+0000 7f7cc6000640 1 Processor -- start 2024-09-13T18:59:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.772+0000 7f7cc6000640 1 -- start start 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cc6000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7cc0156f60 0x7f7cc015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cc6000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc0071690 0x7f7cc00cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cc6000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc006f5f0 con 0x7f7cc00cafa0 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cc6000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc015aa30 con 0x7f7cc0156f60 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cc6000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0070450 con 0x7f7cc0071690 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cbf400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7cc0156f60 0x7f7cc015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cb7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7cc00cafa0 0x7f7cc0070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39176/0 (socket says 172.21.15.33:39176) 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cb7e00640 1 -- 172.21.15.33:0/1925378820 learned_addr learned my addr 172.21.15.33:0/1925378820 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.773+0000 7f7cbfe00640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc0071690 0x7f7cc00cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.774+0000 7f7cbf400640 1 -- 172.21.15.33:0/1925378820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc0071690 msgr2=0x7f7cc00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.774+0000 7f7cbf400640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc0071690 0x7f7cc00cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.774+0000 7f7cbf400640 1 -- 172.21.15.33:0/1925378820 >> v1:172.21.15.33:6789/0 conn(0x7f7cc00cafa0 legacy=0x7f7cc0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.774+0000 7f7cbea00640 1 -- 172.21.15.33:0/1925378820 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429525327 0 0) 0x7f7cc006f5f0 con 0x7f7cc00cafa0 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.774+0000 7f7cbf400640 1 -- 172.21.15.33:0/1925378820 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc006f840 con 0x7f7cc0156f60 2024-09-13T18:59:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.775+0000 7f7cbf400640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0156f60 0x7f7cc015a4f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097a0 tx=0x7f7cb002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c20fb5445a45d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.775+0000 7f7cbea00640 1 -- 172.21.15.33:0/1925378820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0032440 con 0x7f7cc0156f60 2024-09-13T18:59:39.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.775+0000 7f7cbea00640 1 -- 172.21.15.33:0/1925378820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb00325a0 con 0x7f7cc0156f60 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.775+0000 7f7cbea00640 1 -- 172.21.15.33:0/1925378820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0032930 con 0x7f7cc0156f60 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 -- 172.21.15.33:0/1925378820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0156f60 msgr2=0x7f7cc015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0156f60 0x7f7cc015a4f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097a0 tx=0x7f7cb002a180 comp rx=0 tx=0).stop 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 -- 172.21.15.33:0/1925378820 shutdown_connections 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc0071690 0x7f7cc00cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 --2- 172.21.15.33:0/1925378820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0156f60 0x7f7cc015a4f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 -- 172.21.15.33:0/1925378820 >> 172.21.15.33:0/1925378820 conn(0x7f7cc00b0580 msgr2=0x7f7cc00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 -- 172.21.15.33:0/1925378820 shutdown_connections 2024-09-13T18:59:39.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.776+0000 7f7cc6000640 1 -- 172.21.15.33:0/1925378820 wait complete. 2024-09-13T18:59:39.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.778+0000 7f7cc6000640 1 Processor -- start 2024-09-13T18:59:39.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.778+0000 7f7cc6000640 1 -- start start 2024-09-13T18:59:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc00cafa0 0x7f7cc00adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0156f60 0x7f7cc013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc013ec90 con 0x7f7cc0071690 2024-09-13T18:59:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc013f530 con 0x7f7cc0156f60 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cc6000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0159740 con 0x7f7cc00cafa0 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47556/0 (socket says 172.21.15.33:47556) 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 -- 172.21.15.33:0/166515168 learned_addr learned my addr 172.21.15.33:0/166515168 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cb7e00640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc00cafa0 0x7f7cc00adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbfe00640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0156f60 0x7f7cc013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 -- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc00cafa0 msgr2=0x7f7cc00adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc00cafa0 0x7f7cc00adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 -- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0156f60 msgr2=0x7f7cc013f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0156f60 0x7f7cc013f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.779+0000 7f7cbf400640 1 -- 172.21.15.33:0/166515168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009400 con 0x7f7cc0071690 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cbf400640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7cb002a770 tx=0x7f7cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0006e10 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0032e90 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc0140bc0 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0030ba0 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.780+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc013f1c0 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.781+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc00cb630 con 0x7f7cc0071690 2024-09-13T18:59:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.782+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7cb0039040 con 0x7f7cc0071690 2024-09-13T18:59:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.783+0000 7f7cb7400640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.783+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb00a9de0 con 0x7f7cc0071690 2024-09-13T18:59:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.783+0000 7f7cb7e00640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:39.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.784+0000 7f7cb7e00640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7cc01562f0 tx=0x7f7ca8007b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.787+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7cb0075040 con 0x7f7cc0071690 2024-09-13T18:59:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.964+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cc0157340 con 0x7f7cc0071690 2024-09-13T18:59:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.965+0000 7f7cb7400640 1 -- 172.21.15.33:0/166515168 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cb0078660 con 0x7f7cc0071690 2024-09-13T18:59:39.967 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T18:59:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 msgr2=0x7f7c9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7cc01562f0 tx=0x7f7ca8007b70 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 msgr2=0x7f7cc013bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7cb002a770 tx=0x7f7cb00046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 shutdown_connections 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0156f60 0x7f7cc013f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7cc00cafa0 0x7f7cc00adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 --2- 172.21.15.33:0/166515168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc0071690 0x7f7cc013bed0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 >> 172.21.15.33:0/166515168 conn(0x7f7cc00b0580 msgr2=0x7f7cc00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 shutdown_connections 2024-09-13T18:59:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:39.967+0000 7f7cc6000640 1 -- 172.21.15.33:0/166515168 wait complete. 2024-09-13T18:59:39.985 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.138+0000 7f4c23200640 1 Processor -- start 2024-09-13T18:59:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.139+0000 7f4c23200640 1 -- start start 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c1c06a140 0x7f4c1c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 0x7f4c1c0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 0x7f4c1c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b3910 con 0x7f4c1c06a140 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0713b0 con 0x7f4c1c06a520 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c23200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b3bb0 con 0x7f4c1c0aeb80 2024-09-13T18:59:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c21e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c1c06a140 0x7f4c1c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c21e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c1c06a140 0x7f4c1c070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47562/0 (socket says 172.21.15.33:47562) 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.140+0000 7f4c21e00640 1 -- 172.21.15.33:0/2750535252 learned_addr learned my addr 172.21.15.33:0/2750535252 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21400640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 0x7f4c1c0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c22800640 1 --2- 172.21.15.33:0/2750535252 >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 0x7f4c1c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21e00640 1 -- 172.21.15.33:0/2750535252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 msgr2=0x7f4c1c0b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21e00640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 0x7f4c1c0b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21e00640 1 -- 172.21.15.33:0/2750535252 >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 msgr2=0x7f4c1c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21e00640 1 --2- 172.21.15.33:0/2750535252 >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 0x7f4c1c0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21e00640 1 -- 172.21.15.33:0/2750535252 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0b3e90 con 0x7f4c1c06a140 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c22800640 1 --2- 172.21.15.33:0/2750535252 >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 0x7f4c1c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.141+0000 7f4c21400640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 0x7f4c1c0b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.142+0000 7f4c21e00640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c070b60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0cd610 tx=0x7f4c1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0c08950fe00c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.142+0000 7f4c20a00640 1 -- 172.21.15.33:0/2750535252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032440 con 0x7f4c1c06a140 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.142+0000 7f4c20a00640 1 -- 172.21.15.33:0/2750535252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c100325a0 con 0x7f4c1c06a140 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.142+0000 7f4c20a00640 1 -- 172.21.15.33:0/2750535252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032930 con 0x7f4c1c06a140 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 -- 172.21.15.33:0/2750535252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 msgr2=0x7f4c1c070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c070b60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0cd610 tx=0x7f4c1002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 -- 172.21.15.33:0/2750535252 shutdown_connections 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c0aeb80 0x7f4c1c0b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 --2- 172.21.15.33:0/2750535252 >> v2:172.21.15.103:3300/0 conn(0x7f4c1c06a520 0x7f4c1c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 --2- 172.21.15.33:0/2750535252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c070b60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 -- 172.21.15.33:0/2750535252 >> 172.21.15.33:0/2750535252 conn(0x7f4c1c0cf4f0 msgr2=0x7f4c1c0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 -- 172.21.15.33:0/2750535252 shutdown_connections 2024-09-13T18:59:40.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.143+0000 7f4c23200640 1 -- 172.21.15.33:0/2750535252 wait complete. 2024-09-13T18:59:40.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.144+0000 7f4c23200640 1 Processor -- start 2024-09-13T18:59:40.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.145+0000 7f4c23200640 1 -- start start 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.145+0000 7f4c23200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.145+0000 7f4c23200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c06a520 0x7f4c1c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.145+0000 7f4c23200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 0x7f4c1c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.145+0000 7f4c23200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1576e0 con 0x7f4c1c06a140 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c23200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c06c0f0 con 0x7f4c1c0aeb80 2024-09-13T18:59:40.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c23200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c06c3d0 con 0x7f4c1c06a520 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47578/0 (socket says 172.21.15.33:47578) 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 -- 172.21.15.33:0/1589575319 learned_addr learned my addr 172.21.15.33:0/1589575319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21400640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c06a520 0x7f4c1c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c22800640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 0x7f4c1c146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 -- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c06a520 msgr2=0x7f4c1c157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c06a520 0x7f4c1c157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 -- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 msgr2=0x7f4c1c146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 0x7f4c1c146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c21e00640 1 -- 172.21.15.33:0/1589575319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094d0 con 0x7f4c1c06a140 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.146+0000 7f4c22800640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 0x7f4c1c146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c21e00640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c10000c00 tx=0x7f4c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032440 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10030b80 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1003b400 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c06c6b0 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.147+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c147500 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.148+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c06cbd0 con 0x7f4c1c06a140 2024-09-13T18:59:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.149+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4c10039040 con 0x7f4c1c06a140 2024-09-13T18:59:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.150+0000 7f4c16000640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 0x7f4c0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.150+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c100a9b30 con 0x7f4c1c06a140 2024-09-13T18:59:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.150+0000 7f4c21400640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 0x7f4c0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.151+0000 7f4c21400640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 0x7f4c0006d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c15c8b0 tx=0x7f4c0c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.154+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4c10074e50 con 0x7f4c1c06a140 2024-09-13T18:59:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.369+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c1c070b60 con 0x7f4c1c06a140 2024-09-13T18:59:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.369+0000 7f4c16000640 1 -- 172.21.15.33:0/1589575319 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f4c10037090 con 0x7f4c1c06a140 2024-09-13T18:59:40.372 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:40.372 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 msgr2=0x7f4c0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 0x7f4c0006d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c15c8b0 tx=0x7f4c0c008040 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 msgr2=0x7f4c1c1f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c10000c00 tx=0x7f4c100046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 shutdown_connections 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4c0006ac00 0x7f4c0006d0c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c1c0aeb80 0x7f4c1c146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c1c06a520 0x7f4c1c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 --2- 172.21.15.33:0/1589575319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c1c06a140 0x7f4c1c1f1a80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 >> 172.21.15.33:0/1589575319 conn(0x7f4c1c0cf4f0 msgr2=0x7f4c1c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 shutdown_connections 2024-09-13T18:59:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.371+0000 7f4c23200640 1 -- 172.21.15.33:0/1589575319 wait complete. 2024-09-13T18:59:40.389 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:40.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.542+0000 7fc3eb200640 1 Processor -- start 2024-09-13T18:59:40.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.542+0000 7fc3eb200640 1 -- start start 2024-09-13T18:59:40.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3eb200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc3e4153b20 0x7fc3e40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3eb200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e4153f00 con 0x7fc3e406f660 2024-09-13T18:59:40.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3eb200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e40b1a40 con 0x7fc3e4159a80 2024-09-13T18:59:40.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3eb200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40ce600 con 0x7fc3e4153b20 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3e9200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc3e406f660 0x7fc3e406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39184/0 (socket says 172.21.15.33:39184) 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3e9200640 1 -- 172.21.15.33:0/1343978070 learned_addr learned my addr 172.21.15.33:0/1343978070 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.543+0000 7fc3e3e00640 1 --2- 172.21.15.33:0/1343978070 >> v2:172.21.15.103:3300/0 conn(0x7fc3e4153b20 0x7fc3e40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539883759 0 0) 0x7fc3e4153f00 con 0x7fc3e406f660 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c8003520 con 0x7fc3e406f660 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174640109 0 0) 0x7fc3e40b1a40 con 0x7fc3e4159a80 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e4153f00 con 0x7fc3e4159a80 2024-09-13T18:59:40.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3e00640 1 -- 172.21.15.33:0/1343978070 >> v1:172.21.15.103:6789/0 conn(0x7fc3e4159a80 legacy=0x7fc3e40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3e00640 1 -- 172.21.15.33:0/1343978070 >> v1:172.21.15.33:6789/0 conn(0x7fc3e406f660 legacy=0x7fc3e406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.544+0000 7fc3e3e00640 1 -- 172.21.15.33:0/1343978070 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e415a1f0 con 0x7fc3e4153b20 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.545+0000 7fc3e3e00640 1 --2- 172.21.15.33:0/1343978070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e4153b20 0x7fc3e40b3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40097a0 tx=0x7fc3d402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b66fd2b9f53107b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4032440 con 0x7fc3e4153b20 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d40325a0 con 0x7fc3e4153b20 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3e3400640 1 -- 172.21.15.33:0/1343978070 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4032930 con 0x7fc3e4153b20 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 -- 172.21.15.33:0/1343978070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e4153b20 msgr2=0x7fc3e40b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 --2- 172.21.15.33:0/1343978070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e4153b20 0x7fc3e40b3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40097a0 tx=0x7fc3d402a230 comp rx=0 tx=0).stop 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 -- 172.21.15.33:0/1343978070 shutdown_connections 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 --2- 172.21.15.33:0/1343978070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e4153b20 0x7fc3e40b3990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 -- 172.21.15.33:0/1343978070 >> 172.21.15.33:0/1343978070 conn(0x7fc3e40b0510 msgr2=0x7fc3e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 -- 172.21.15.33:0/1343978070 shutdown_connections 2024-09-13T18:59:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.546+0000 7fc3eb200640 1 -- 172.21.15.33:0/1343978070 wait complete. 2024-09-13T18:59:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.548+0000 7fc3eb200640 1 Processor -- start 2024-09-13T18:59:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.548+0000 7fc3eb200640 1 -- start start 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e406f660 0x7fc3e4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3e4153b20 0x7fc3e4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41f26e0 con 0x7fc3e4159a80 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41f29c0 con 0x7fc3e406f660 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3eb200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41f2ca0 con 0x7fc3e4153b20 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3e9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3e9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47580/0 (socket says 172.21.15.33:47580) 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3e9200640 1 -- 172.21.15.33:0/57841205 learned_addr learned my addr 172.21.15.33:0/57841205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3e3e00640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e406f660 0x7fc3e4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.549+0000 7fc3dbe00640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3e4153b20 0x7fc3e4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 -- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3e4153b20 msgr2=0x7fc3e4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3e4153b20 0x7fc3e4158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 -- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e406f660 msgr2=0x7fc3e4152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e406f660 0x7fc3e4152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 -- 172.21.15.33:0/57841205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4009400 con 0x7fc3e4159a80 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e9200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00caa0 tx=0x7fc3dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00ac00 con 0x7fc3e4159a80 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00ad80 con 0x7fc3e4159a80 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e41f2f80 con 0x7fc3e4159a80 2024-09-13T18:59:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.550+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc012640 con 0x7fc3e4159a80 2024-09-13T18:59:40.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.551+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e41593c0 con 0x7fc3e4159a80 2024-09-13T18:59:40.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.552+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e41f31a0 con 0x7fc3e4159a80 2024-09-13T18:59:40.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.552+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3dc007070 con 0x7fc3e4159a80 2024-09-13T18:59:40.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.553+0000 7fc3e0c00640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 0x7fc3c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.553+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3dc0892d0 con 0x7fc3e4159a80 2024-09-13T18:59:40.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.554+0000 7fc3e3e00640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 0x7fc3c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.555+0000 7fc3e3e00640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 0x7fc3c006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4034000 tx=0x7fc3d402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.558+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc3dc0544c0 con 0x7fc3e4159a80 2024-09-13T18:59:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.741+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3e40b3990 con 0x7fc3e4159a80 2024-09-13T18:59:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.743+0000 7fc3e0c00640 1 -- 172.21.15.33:0/57841205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fc3dc057ae0 con 0x7fc3e4159a80 2024-09-13T18:59:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:40.745 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 msgr2=0x7fc3c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 0x7fc3c006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4034000 tx=0x7fc3d402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 msgr2=0x7fc3e40ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00caa0 tx=0x7fc3dc00cf60 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 shutdown_connections 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3c006ac00 0x7fc3c006d0c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e4159a80 0x7fc3e40ac870 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3e4153b20 0x7fc3e4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 --2- 172.21.15.33:0/57841205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e406f660 0x7fc3e4152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 >> 172.21.15.33:0/57841205 conn(0x7fc3e40b0510 msgr2=0x7fc3e40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 shutdown_connections 2024-09-13T18:59:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.745+0000 7fc3eb200640 1 -- 172.21.15.33:0/57841205 wait complete. 2024-09-13T18:59:40.763 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:59:40.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:40.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.916+0000 7fa080a00640 1 Processor -- start 2024-09-13T18:59:40.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.916+0000 7fa080a00640 1 -- start start 2024-09-13T18:59:40.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.917+0000 7fa080a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c160370 0x7fa07c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.917+0000 7fa080a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa07c0b2e90 0x7fa07c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.917+0000 7fa080a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c13fbc0 con 0x7fa07c0b3a40 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.917+0000 7fa080a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c06cca0 con 0x7fa07c0b2e90 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.917+0000 7fa080a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c15ce80 con 0x7fa07c160370 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa07c0b2e90 0x7fa07c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa07c0b2e90 0x7fa07c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47588/0 (socket says 172.21.15.33:47588) 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 -- 172.21.15.33:0/1530441301 learned_addr learned my addr 172.21.15.33:0/1530441301 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa079400640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c160370 0x7fa07c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 -- 172.21.15.33:0/1530441301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c160370 msgr2=0x7fa07c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c160370 0x7fa07c0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 -- 172.21.15.33:0/1530441301 >> v1:172.21.15.103:6789/0 conn(0x7fa07c0b3a40 legacy=0x7fa07c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.918+0000 7fa07a800640 1 -- 172.21.15.33:0/1530441301 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c160910 con 0x7fa07c0b2e90 2024-09-13T18:59:40.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.919+0000 7fa07a800640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c0b2e90 0x7fa07c0ac870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa07402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70e4add1a9f4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.919+0000 7fa078a00640 1 -- 172.21.15.33:0/1530441301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07402aea0 con 0x7fa07c0b2e90 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.919+0000 7fa078a00640 1 -- 172.21.15.33:0/1530441301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07402d050 con 0x7fa07c0b2e90 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.919+0000 7fa078a00640 1 -- 172.21.15.33:0/1530441301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074031820 con 0x7fa07c0b2e90 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 -- 172.21.15.33:0/1530441301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c0b2e90 msgr2=0x7fa07c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c0b2e90 0x7fa07c0ac870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa07402a680 comp rx=0 tx=0).stop 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 -- 172.21.15.33:0/1530441301 shutdown_connections 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c0b2e90 0x7fa07c0ac870 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 --2- 172.21.15.33:0/1530441301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c160370 0x7fa07c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 -- 172.21.15.33:0/1530441301 >> 172.21.15.33:0/1530441301 conn(0x7fa07c0b0510 msgr2=0x7fa07c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 -- 172.21.15.33:0/1530441301 shutdown_connections 2024-09-13T18:59:40.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.920+0000 7fa080a00640 1 -- 172.21.15.33:0/1530441301 wait complete. 2024-09-13T18:59:40.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.922+0000 7fa080a00640 1 Processor -- start 2024-09-13T18:59:40.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.922+0000 7fa080a00640 1 -- start start 2024-09-13T18:59:40.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c0b2e90 0x7fa07c13ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0b3a40 0x7fa07c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c157440 con 0x7fa07c160370 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c157690 con 0x7fa07c0b3a40 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa080a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c157970 con 0x7fa07c0b2e90 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47598/0 (socket says 172.21.15.33:47598) 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 -- 172.21.15.33:0/3788625702 learned_addr learned my addr 172.21.15.33:0/3788625702 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa079400640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0b3a40 0x7fa07c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa079e00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c0b2e90 0x7fa07c13ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 -- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c0b2e90 msgr2=0x7fa07c13ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c0b2e90 0x7fa07c13ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 -- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0b3a40 msgr2=0x7fa07c1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:40.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0b3a40 0x7fa07c1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:40.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.923+0000 7fa07a800640 1 -- 172.21.15.33:0/3788625702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009b30 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa07a800640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07403d860 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07403d9c0 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07403dd70 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c157c50 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.924+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c156f60 con 0x7fa07c160370 2024-09-13T18:59:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.925+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c158110 con 0x7fa07c160370 2024-09-13T18:59:40.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.926+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa07403b400 con 0x7fa07c160370 2024-09-13T18:59:40.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.927+0000 7fa072000640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 0x7fa05c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:40.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.927+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0740a9ff0 con 0x7fa07c160370 2024-09-13T18:59:40.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.928+0000 7fa079e00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 0x7fa05c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:40.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.928+0000 7fa079e00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 0x7fa05c06d0f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b1e60 tx=0x7fa06c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:40.932+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa074075220 con 0x7fa07c160370 2024-09-13T18:59:41.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.147+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa07c0ad140 con 0x7fa07c160370 2024-09-13T18:59:41.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.147+0000 7fa072000640 1 -- 172.21.15.33:0/3788625702 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fa074009510 con 0x7fa07c160370 2024-09-13T18:59:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:41.150 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:41.150 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 msgr2=0x7fa05c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 0x7fa05c06d0f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b1e60 tx=0x7fa06c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 msgr2=0x7fa07c15ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa074009e50 tx=0x7fa074004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 shutdown_connections 2024-09-13T18:59:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa05c06ac30 0x7fa05c06d0f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa07c160370 0x7fa07c15ecd0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0b3a40 0x7fa07c1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 --2- 172.21.15.33:0/3788625702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa07c0b2e90 0x7fa07c13ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 >> 172.21.15.33:0/3788625702 conn(0x7fa07c0b0510 msgr2=0x7fa07c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 shutdown_connections 2024-09-13T18:59:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.149+0000 7fa080a00640 1 -- 172.21.15.33:0/3788625702 wait complete. 2024-09-13T18:59:41.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:41.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.321+0000 7fdc01800640 1 Processor -- start 2024-09-13T18:59:41.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.321+0000 7fdc01800640 1 -- start start 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.322+0000 7fdc01800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdbfc159a80 0x7fdbfc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdc01800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc153f00 con 0x7fdbfc0b3990 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdc01800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0b1a40 con 0x7fdbfc153b20 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdc01800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ce600 con 0x7fdbfc159a80 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbfb400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdbfc159a80 0x7fdbfc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbf3e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdbfc0b3990 0x7fdbfc06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39198/0 (socket says 172.21.15.33:39198) 2024-09-13T18:59:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbf3e00640 1 -- 172.21.15.33:0/2782728939 learned_addr learned my addr 172.21.15.33:0/2782728939 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:41.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbfb400640 1 -- 172.21.15.33:0/2782728939 >> v1:172.21.15.103:6789/0 conn(0x7fdbfc153b20 legacy=0x7fdbfc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbfb400640 1 -- 172.21.15.33:0/2782728939 >> v1:172.21.15.33:6789/0 conn(0x7fdbfc0b3990 legacy=0x7fdbfc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbfb400640 1 -- 172.21.15.33:0/2782728939 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc15a1f0 con 0x7fdbfc159a80 2024-09-13T18:59:41.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.323+0000 7fdbfa000640 1 -- 172.21.15.33:0/2782728939 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603314493 0 0) 0x7fdbfc153f00 con 0x7fdbfc0b3990 2024-09-13T18:59:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.324+0000 7fdbfb400640 1 --2- 172.21.15.33:0/2782728939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc06d060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa042119424674c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdbfa000640 1 -- 172.21.15.33:0/2782728939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4007740 con 0x7fdbfc159a80 2024-09-13T18:59:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdbfa000640 1 -- 172.21.15.33:0/2782728939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf402d050 con 0x7fdbfc159a80 2024-09-13T18:59:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdbfa000640 1 -- 172.21.15.33:0/2782728939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4007ac0 con 0x7fdbfc159a80 2024-09-13T18:59:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdc01800640 1 -- 172.21.15.33:0/2782728939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 msgr2=0x7fdbfc06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdc01800640 1 --2- 172.21.15.33:0/2782728939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc06d060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009d90 tx=0x7fdbf402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdc01800640 1 -- 172.21.15.33:0/2782728939 shutdown_connections 2024-09-13T18:59:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdc01800640 1 --2- 172.21.15.33:0/2782728939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc06d060 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.325+0000 7fdc01800640 1 -- 172.21.15.33:0/2782728939 >> 172.21.15.33:0/2782728939 conn(0x7fdbfc0b0510 msgr2=0x7fdbfc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:41.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.326+0000 7fdc01800640 1 -- 172.21.15.33:0/2782728939 shutdown_connections 2024-09-13T18:59:41.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.326+0000 7fdc01800640 1 -- 172.21.15.33:0/2782728939 wait complete. 2024-09-13T18:59:41.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.327+0000 7fdc01800640 1 Processor -- start 2024-09-13T18:59:41.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.327+0000 7fdc01800640 1 -- start start 2024-09-13T18:59:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbfc0b3990 0x7fdbfc159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbfc153b20 0x7fdbfc155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc156040 con 0x7fdbfc159a80 2024-09-13T18:59:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc155450 con 0x7fdbfc0b3990 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdc01800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc154a80 con 0x7fdbfc153b20 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdbfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdbfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47614/0 (socket says 172.21.15.33:47614) 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.328+0000 7fdbfb400640 1 -- 172.21.15.33:0/1099762186 learned_addr learned my addr 172.21.15.33:0/1099762186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbf3e00640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbfc153b20 0x7fdbfc155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfaa00640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbfc0b3990 0x7fdbfc159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 -- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbfc153b20 msgr2=0x7fdbfc155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbfc153b20 0x7fdbfc155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 -- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbfc0b3990 msgr2=0x7fdbfc159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbfc0b3990 0x7fdbfc159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 -- 172.21.15.33:0/1099762186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009a70 con 0x7fdbfc159a80 2024-09-13T18:59:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbfb400640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdbf402ace0 tx=0x7fdbf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4031910 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.329+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4031a70 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.330+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4031de0 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.330+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc156230 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.330+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc154430 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.331+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc0acf80 con 0x7fdbfc159a80 2024-09-13T18:59:41.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.331+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbf403c420 con 0x7fdbfc159a80 2024-09-13T18:59:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.332+0000 7fdbf2a00640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 0x7fdbd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.332+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbf40aaa90 con 0x7fdbfc159a80 2024-09-13T18:59:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.333+0000 7fdbfaa00640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 0x7fdbd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.334+0000 7fdbfaa00640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 0x7fdbd806d0f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000f60 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.337+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdbf4075b40 con 0x7fdbfc159a80 2024-09-13T18:59:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.550+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbfc0b1ed0 con 0x7fdbfc159a80 2024-09-13T18:59:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.550+0000 7fdbf2a00640 1 -- 172.21.15.33:0/1099762186 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fdbf4040090 con 0x7fdbfc159a80 2024-09-13T18:59:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:41.553 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:18.657429+0000","modified":"2024-09-13T18:59:21.672200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5907":{"gid":5907,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6835/2343612269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2343612269},{"type":"v1","addr":"172.21.15.33:6835","nonce":2343612269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:59:41.553 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 msgr2=0x7fdbd806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 0x7fdbd806d0f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000f60 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 msgr2=0x7fdbfc154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdbf402ace0 tx=0x7fdbf4004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 shutdown_connections 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdbd806ac30 0x7fdbd806d0f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbfc159a80 0x7fdbfc154f10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdbfc153b20 0x7fdbfc155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 --2- 172.21.15.33:0/1099762186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbfc0b3990 0x7fdbfc159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 >> 172.21.15.33:0/1099762186 conn(0x7fdbfc0b0510 msgr2=0x7fdbfc0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:41.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.552+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 shutdown_connections 2024-09-13T18:59:41.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.553+0000 7fdc01800640 1 -- 172.21.15.33:0/1099762186 wait complete. 2024-09-13T18:59:41.570 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:41.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.722+0000 7f013b200640 1 Processor -- start 2024-09-13T18:59:41.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.723+0000 7f013b200640 1 -- start start 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f013b200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f013415a5c0 0x7f01340b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f013b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f01340b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f013b200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01340cbfc0 con 0x7f01340afe10 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f013b200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340cce20 con 0x7f013415a5c0 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f013b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01340707a0 con 0x7f01340cbac0 2024-09-13T18:59:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f0139e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f013415a5c0 0x7f01340b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f0139e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f013415a5c0 0x7f01340b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47620/0 (socket says 172.21.15.33:47620) 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f0139e00640 1 -- 172.21.15.33:0/1117090743 learned_addr learned my addr 172.21.15.33:0/1117090743 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.724+0000 7f0139400640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f01340b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.725+0000 7f0139e00640 1 -- 172.21.15.33:0/1117090743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 msgr2=0x7f01340b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.725+0000 7f0139e00640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f01340b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.725+0000 7f0139e00640 1 -- 172.21.15.33:0/1117090743 >> v1:172.21.15.103:6789/0 conn(0x7f01340afe10 legacy=0x7f013406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.725+0000 7f0139e00640 1 -- 172.21.15.33:0/1117090743 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134070a80 con 0x7f013415a5c0 2024-09-13T18:59:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f0139e00640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f01340b39b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0128009870 tx=0x7f012802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b296aa8d38d679c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f0138a00640 1 -- 172.21.15.33:0/1117090743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128032440 con 0x7f013415a5c0 2024-09-13T18:59:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f0138a00640 1 -- 172.21.15.33:0/1117090743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01280325a0 con 0x7f013415a5c0 2024-09-13T18:59:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f0138a00640 1 -- 172.21.15.33:0/1117090743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128032930 con 0x7f013415a5c0 2024-09-13T18:59:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f013b200640 1 -- 172.21.15.33:0/1117090743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 msgr2=0x7f01340b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.726+0000 7f013b200640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f01340b39b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0128009870 tx=0x7f012802a270 comp rx=0 tx=0).stop 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 -- 172.21.15.33:0/1117090743 shutdown_connections 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f01340b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 --2- 172.21.15.33:0/1117090743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f01340b39b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 -- 172.21.15.33:0/1117090743 >> 172.21.15.33:0/1117090743 conn(0x7f01340ae310 msgr2=0x7f01340ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 -- 172.21.15.33:0/1117090743 shutdown_connections 2024-09-13T18:59:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.727+0000 7f013b200640 1 -- 172.21.15.33:0/1117090743 wait complete. 2024-09-13T18:59:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.728+0000 7f013b200640 1 Processor -- start 2024-09-13T18:59:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.728+0000 7f013b200640 1 -- start start 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 0x7f0134154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f013414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013414ffc0 con 0x7f013415a5c0 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01341519a0 con 0x7f01340afe10 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.729+0000 7f013b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0134150330 con 0x7f01340cbac0 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f0139e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 0x7f0134154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47634/0 (socket says 172.21.15.33:47634) 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 -- 172.21.15.33:0/3117124541 learned_addr learned my addr 172.21.15.33:0/3117124541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:41.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f0139400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f013414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 -- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 msgr2=0x7f013414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f013414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 -- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 msgr2=0x7f0134154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 0x7f0134154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 -- 172.21.15.33:0/3117124541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280094d0 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f0139e00640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 0x7f0134154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.730+0000 7f013a800640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f013000c6b0 tx=0x7f013000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.731+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130003b70 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.731+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130003cd0 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.731+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130005310 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.731+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0134154e10 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.731+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0134151c10 con 0x7f013415a5c0 2024-09-13T18:59:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.732+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0134067360 con 0x7f013415a5c0 2024-09-13T18:59:41.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.733+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0130005470 con 0x7f013415a5c0 2024-09-13T18:59:41.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.734+0000 7f012e000640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:41.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.734+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0130088fc0 con 0x7f013415a5c0 2024-09-13T18:59:41.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.734+0000 7f0139e00640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:41.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.735+0000 7f0139e00640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f012802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:41.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.738+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0130054240 con 0x7f013415a5c0 2024-09-13T18:59:41.878 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:59:41.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:59:41.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.919+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01340b39b0 con 0x7f013415a5c0 2024-09-13T18:59:41.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.920+0000 7f012e000640 1 -- 172.21.15.33:0/3117124541 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f0130057860 con 0x7f013415a5c0 2024-09-13T18:59:41.922 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:41.923 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":60,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:19.659866+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:16.657564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:17.640729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 msgr2=0x7f011806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f012802e000 comp rx=0 tx=0).stop 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 msgr2=0x7f0134155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f013000c6b0 tx=0x7f013000cb70 comp rx=0 tx=0).stop 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 shutdown_connections 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013415a5c0 0x7f0134155f70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01340cbac0 0x7f013414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 --2- 172.21.15.33:0/3117124541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01340afe10 0x7f0134154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.922+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 >> 172.21.15.33:0/3117124541 conn(0x7f01340ae310 msgr2=0x7f01340ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.923+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 shutdown_connections 2024-09-13T18:59:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:41.923+0000 7f013b200640 1 -- 172.21.15.33:0/3117124541 wait complete. 2024-09-13T18:59:41.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:59:42.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.163+0000 7f13b1400640 1 Processor -- start 2024-09-13T18:59:42.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.163+0000 7f13b1400640 1 -- start start 2024-09-13T18:59:42.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.164+0000 7f13b1400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f13ac146250 0x7f13ac06ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.164+0000 7f13b1400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac146630 con 0x7f13ac0ac870 2024-09-13T18:59:42.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.164+0000 7f13b1400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac06c190 con 0x7f13ac0acce0 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.164+0000 7f13b1400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac0708a0 con 0x7f13ac146250 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13a3e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f13ac0ac870 0x7f13ac06b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39208/0 (socket says 172.21.15.33:39208) 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13a3e00640 1 -- 172.21.15.33:0/914352916 learned_addr learned my addr 172.21.15.33:0/914352916 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13aa800640 1 --2- 172.21.15.33:0/914352916 >> v2:172.21.15.103:3300/0 conn(0x7f13ac146250 0x7f13ac06ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160670964 0 0) 0x7f13ac146630 con 0x7f13ac0ac870 2024-09-13T18:59:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1390003520 con 0x7f13ac0ac870 2024-09-13T18:59:42.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622527434 0 0) 0x7f1390003520 con 0x7f13ac0ac870 2024-09-13T18:59:42.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13aa800640 1 -- 172.21.15.33:0/914352916 >> v1:172.21.15.103:6789/0 conn(0x7f13ac0acce0 legacy=0x7f13ac06ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13aa800640 1 -- 172.21.15.33:0/914352916 >> v1:172.21.15.33:6789/0 conn(0x7f13ac0ac870 legacy=0x7f13ac06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.165+0000 7f13aa800640 1 -- 172.21.15.33:0/914352916 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac070ab0 con 0x7f13ac146250 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.167+0000 7f13aa800640 1 --2- 172.21.15.33:0/914352916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac146250 0x7f13ac06ffb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f139c0097a0 tx=0x7f139c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66642aba5ad33909 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.167+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394001670 con 0x7f13ac146250 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.167+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c02ac50 con 0x7f13ac146250 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.167+0000 7f13a9e00640 1 -- 172.21.15.33:0/914352916 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c032440 con 0x7f13ac146250 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 -- 172.21.15.33:0/914352916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac146250 msgr2=0x7f13ac06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 --2- 172.21.15.33:0/914352916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac146250 0x7f13ac06ffb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f139c0097a0 tx=0x7f139c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 -- 172.21.15.33:0/914352916 shutdown_connections 2024-09-13T18:59:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 --2- 172.21.15.33:0/914352916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac146250 0x7f13ac06ffb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 -- 172.21.15.33:0/914352916 >> 172.21.15.33:0/914352916 conn(0x7f13ac0b0510 msgr2=0x7f13ac0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 -- 172.21.15.33:0/914352916 shutdown_connections 2024-09-13T18:59:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.168+0000 7f13b1400640 1 -- 172.21.15.33:0/914352916 wait complete. 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.170+0000 7f13b1400640 1 Processor -- start 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.170+0000 7f13b1400640 1 -- start start 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13ac0ac870 0x7f13ac1e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac0acce0 0x7f13ac1448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1e5830 con 0x7f13ac146250 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0c46b0 con 0x7f13ac0acce0 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13b1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1e53a0 con 0x7f13ac0ac870 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.171+0000 7f13ab200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47646/0 (socket says 172.21.15.33:47646) 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 -- 172.21.15.33:0/2968873837 learned_addr learned my addr 172.21.15.33:0/2968873837 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13a3e00640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac0acce0 0x7f13ac1448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13aa800640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13ac0ac870 0x7f13ac1e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 -- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13ac0ac870 msgr2=0x7f13ac1e3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13ac0ac870 0x7f13ac1e3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 -- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac0acce0 msgr2=0x7f13ac1448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac0acce0 0x7f13ac1448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 -- 172.21.15.33:0/2968873837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c009400 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.172+0000 7f13ab200640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7d0 tx=0x7f13a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.173+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4003b70 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.173+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4003cf0 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.173+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400aa90 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.173+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac1e4a70 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.173+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac1e5030 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.174+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac1e5550 con 0x7f13ac146250 2024-09-13T18:59:42.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.175+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13a400abf0 con 0x7f13ac146250 2024-09-13T18:59:42.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.175+0000 7f13a2a00640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 0x7f138806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.176+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13a4089180 con 0x7f13ac146250 2024-09-13T18:59:42.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.176+0000 7f13aa800640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 0x7f138806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.177+0000 7f13aa800640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 0x7f138806d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f139c034000 tx=0x7f139c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.180+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13ac1e5550 con 0x7f13ac146250 2024-09-13T18:59:42.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.396+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13ac1e5510 con 0x7f13ac146250 2024-09-13T18:59:42.399 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T18:59:42.397+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:59:42.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.408+0000 7f13a2a00640 1 -- 172.21.15.33:0/2968873837 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13a4054350 con 0x7f13ac146250 2024-09-13T18:59:42.410 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 msgr2=0x7f138806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 0x7f138806d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f139c034000 tx=0x7f139c02e000 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 msgr2=0x7f13ac144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7d0 tx=0x7f13a400cc90 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 shutdown_connections 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f138806ac00 0x7f138806d0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13ac146250 0x7f13ac144e10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13ac0acce0 0x7f13ac1448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 --2- 172.21.15.33:0/2968873837 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13ac0ac870 0x7f13ac1e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 >> 172.21.15.33:0/2968873837 conn(0x7f13ac0b0510 msgr2=0x7f13ac0ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 shutdown_connections 2024-09-13T18:59:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.410+0000 7f13b1400640 1 -- 172.21.15.33:0/2968873837 wait complete. 2024-09-13T18:59:42.418 INFO:tasks.ceph.mds.c.smithi033.stderr: -4382> 2024-09-13T18:59:24.203+0000 7f1e5ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:59:42.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:59:42.467 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:59:42.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.588+0000 7fae5ce00640 1 Processor -- start 2024-09-13T18:59:42.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.588+0000 7fae5ce00640 1 -- start start 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae5ce00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae581591b0 0x7fae580adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae5ce00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fae580b1db0 0x7fae580b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae5ce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5806b5c0 con 0x7fae580cd050 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae5ce00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580ae0d0 con 0x7fae580b1db0 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae5ce00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580cc600 con 0x7fae581591b0 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae57e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fae580b1db0 0x7fae580b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae57e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fae580b1db0 0x7fae580b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47668/0 (socket says 172.21.15.33:47668) 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.589+0000 7fae57e00640 1 -- 172.21.15.33:0/224860177 learned_addr learned my addr 172.21.15.33:0/224860177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.590+0000 7fae57400640 1 --2- 172.21.15.33:0/224860177 >> v2:172.21.15.103:3300/0 conn(0x7fae581591b0 0x7fae580adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.590+0000 7fae57e00640 1 -- 172.21.15.33:0/224860177 >> v2:172.21.15.103:3300/0 conn(0x7fae581591b0 msgr2=0x7fae580adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.590+0000 7fae57e00640 1 --2- 172.21.15.33:0/224860177 >> v2:172.21.15.103:3300/0 conn(0x7fae581591b0 0x7fae580adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.590+0000 7fae57e00640 1 -- 172.21.15.33:0/224860177 >> v1:172.21.15.103:6789/0 conn(0x7fae580cd050 legacy=0x7fae580b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.590+0000 7fae57e00640 1 -- 172.21.15.33:0/224860177 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5806b810 con 0x7fae580b1db0 2024-09-13T18:59:42.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.591+0000 7fae57e00640 1 --2- 172.21.15.33:0/224860177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae580b2f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fae5806d630 tx=0x7fae5002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed17be9caf6af412 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.591+0000 7fae56a00640 1 -- 172.21.15.33:0/224860177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50031600 con 0x7fae580b1db0 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.591+0000 7fae56a00640 1 -- 172.21.15.33:0/224860177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5002d050 con 0x7fae580b1db0 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.591+0000 7fae56a00640 1 -- 172.21.15.33:0/224860177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50031980 con 0x7fae580b1db0 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 -- 172.21.15.33:0/224860177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 msgr2=0x7fae580b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 --2- 172.21.15.33:0/224860177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae580b2f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fae5806d630 tx=0x7fae5002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 -- 172.21.15.33:0/224860177 shutdown_connections 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 --2- 172.21.15.33:0/224860177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae580b2f70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 --2- 172.21.15.33:0/224860177 >> v2:172.21.15.103:3300/0 conn(0x7fae581591b0 0x7fae580adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 -- 172.21.15.33:0/224860177 >> 172.21.15.33:0/224860177 conn(0x7fae58069ed0 msgr2=0x7fae5806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 -- 172.21.15.33:0/224860177 shutdown_connections 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.592+0000 7fae5ce00640 1 -- 172.21.15.33:0/224860177 wait complete. 2024-09-13T18:59:42.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.593+0000 7fae5ce00640 1 Processor -- start 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.593+0000 7fae5ce00640 1 -- start start 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae580cd050 0x7fae58148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 0x7fae581582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58152ba0 con 0x7fae580b1db0 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58157e10 con 0x7fae580cd050 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae5ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae581516d0 con 0x7fae581591b0 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.594+0000 7fae57400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47682/0 (socket says 172.21.15.33:47682) 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 -- 172.21.15.33:0/2097294853 learned_addr learned my addr 172.21.15.33:0/2097294853 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57e00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 0x7fae581582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae4ea00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae580cd050 0x7fae58148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 -- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 msgr2=0x7fae581582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 0x7fae581582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 -- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae580cd050 msgr2=0x7fae58148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae580cd050 0x7fae58148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 -- 172.21.15.33:0/2097294853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50009b30 con 0x7fae580b1db0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57e00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 0x7fae581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.595+0000 7fae57400640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fae4800d5f0 tx=0x7fae4800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.596+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480125f0 con 0x7fae580b1db0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.596+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48012750 con 0x7fae580b1db0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.596+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae581519b0 con 0x7fae580b1db0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.596+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48012b00 con 0x7fae580b1db0 2024-09-13T18:59:42.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.596+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae58151c90 con 0x7fae580b1db0 2024-09-13T18:59:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.597+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae580b1bd0 con 0x7fae580b1db0 2024-09-13T18:59:42.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.598+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae48012c60 con 0x7fae580b1db0 2024-09-13T18:59:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.598+0000 7fae4fe00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 0x7fae3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.598+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fae48089910 con 0x7fae580b1db0 2024-09-13T18:59:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.599+0000 7fae4ea00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 0x7fae3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.600+0000 7fae4ea00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 0x7fae3406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae580ad720 tx=0x7fae40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:42.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.602+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae480549f0 con 0x7fae580b1db0 2024-09-13T18:59:42.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:42.821+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae580ce150 con 0x7fae580b1db0 2024-09-13T18:59:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.413+0000 7fae4fe00640 1 -- 172.21.15.33:0/2097294853 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae48058010 con 0x7fae580b1db0 2024-09-13T18:59:43.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.415+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 msgr2=0x7fae3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.415+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 0x7fae3406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae580ad720 tx=0x7fae40009040 comp rx=0 tx=0).stop 2024-09-13T18:59:43.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 msgr2=0x7fae58152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fae4800d5f0 tx=0x7fae4800dab0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 shutdown_connections 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae3406ac00 0x7fae3406d0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fae581591b0 0x7fae581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae580cd050 0x7fae58148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 --2- 172.21.15.33:0/2097294853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae580b1db0 0x7fae58152660 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 >> 172.21.15.33:0/2097294853 conn(0x7fae58069ed0 msgr2=0x7fae5806ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 shutdown_connections 2024-09-13T18:59:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.416+0000 7fae5ce00640 1 -- 172.21.15.33:0/2097294853 wait complete. 2024-09-13T18:59:43.435 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:59:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.634+0000 7fc21fe00640 1 Processor -- start 2024-09-13T18:59:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.634+0000 7fc21fe00640 1 -- start start 2024-09-13T18:59:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21fe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2181461a0 0x7fc2180b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21fe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2180ad200 con 0x7fc2180acdb0 2024-09-13T18:59:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21fe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21806b3e0 con 0x7fc2181461a0 2024-09-13T18:59:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b3370 con 0x7fc2180b2d60 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:42360/0 (socket says 172.21.15.33:42360) 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21ca00640 1 -- 172.21.15.33:0/1402307107 learned_addr learned my addr 172.21.15.33:0/1402307107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.636+0000 7fc21d400640 1 --2- 172.21.15.33:0/1402307107 >> v2:172.21.15.103:3300/0 conn(0x7fc2181461a0 0x7fc2180b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.637+0000 7fc21ca00640 1 -- 172.21.15.33:0/1402307107 >> v2:172.21.15.103:3300/0 conn(0x7fc2181461a0 msgr2=0x7fc2180b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.637+0000 7fc21ca00640 1 --2- 172.21.15.33:0/1402307107 >> v2:172.21.15.103:3300/0 conn(0x7fc2181461a0 0x7fc2180b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.637+0000 7fc21ca00640 1 -- 172.21.15.33:0/1402307107 >> v1:172.21.15.103:6789/0 conn(0x7fc2180acdb0 legacy=0x7fc218160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.637+0000 7fc21ca00640 1 -- 172.21.15.33:0/1402307107 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180b3650 con 0x7fc2180b2d60 2024-09-13T18:59:43.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.638+0000 7fc21ca00640 1 --2- 172.21.15.33:0/1402307107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e737681c30f5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:43.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.638+0000 7fc217e00640 1 -- 172.21.15.33:0/1402307107 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204032440 con 0x7fc2180b2d60 2024-09-13T18:59:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.638+0000 7fc217e00640 1 -- 172.21.15.33:0/1402307107 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040325a0 con 0x7fc2180b2d60 2024-09-13T18:59:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.638+0000 7fc217e00640 1 -- 172.21.15.33:0/1402307107 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204032930 con 0x7fc2180b2d60 2024-09-13T18:59:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 -- 172.21.15.33:0/1402307107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 msgr2=0x7fc2180ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 --2- 172.21.15.33:0/1402307107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20402a270 comp rx=0 tx=0).stop 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 -- 172.21.15.33:0/1402307107 shutdown_connections 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 --2- 172.21.15.33:0/1402307107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2180b2d60 0x7fc2180ac870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 --2- 172.21.15.33:0/1402307107 >> v2:172.21.15.103:3300/0 conn(0x7fc2181461a0 0x7fc2180b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 -- 172.21.15.33:0/1402307107 >> 172.21.15.33:0/1402307107 conn(0x7fc2180b0510 msgr2=0x7fc2180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 -- 172.21.15.33:0/1402307107 shutdown_connections 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.639+0000 7fc21fe00640 1 -- 172.21.15.33:0/1402307107 wait complete. 2024-09-13T18:59:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.640+0000 7fc21fe00640 1 Processor -- start 2024-09-13T18:59:43.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 -- start start 2024-09-13T18:59:43.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 0x7fc218140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2181461a0 0x7fc218140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2181e20b0 con 0x7fc2180acdb0 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21813c8e0 con 0x7fc2180b2d60 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.641+0000 7fc21fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21813c340 con 0x7fc2181461a0 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36966/0 (socket says 172.21.15.33:36966) 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 -- 172.21.15.33:0/3024371296 learned_addr learned my addr 172.21.15.33:0/3024371296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21de00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2181461a0 0x7fc218140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21ca00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 0x7fc218140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 -- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2181461a0 msgr2=0x7fc218140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2181461a0 0x7fc218140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 -- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 msgr2=0x7fc218140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 0x7fc218140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21d400640 1 -- 172.21.15.33:0/3024371296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040094d0 con 0x7fc2180acdb0 2024-09-13T18:59:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.642+0000 7fc21ca00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 0x7fc218140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc21d400640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e870 tx=0x7fc20c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0094f0 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00c940 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc218159c90 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ccf0 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.643+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2181e1a60 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.644+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180ac870 con 0x7fc2180acdb0 2024-09-13T18:59:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.645+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc20c013470 con 0x7fc2180acdb0 2024-09-13T18:59:43.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.646+0000 7fc215600640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 0x7fc1f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:43.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.646+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc20c0898d0 con 0x7fc2180acdb0 2024-09-13T18:59:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.647+0000 7fc21ca00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 0x7fc1f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:43.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.647+0000 7fc21ca00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 0x7fc1f806d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc20402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.651+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc20c0549e0 con 0x7fc2180acdb0 2024-09-13T18:59:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:43.830+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc21806fb90 con 0x7fc2180acdb0 2024-09-13T18:59:44.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.415+0000 7fc215600640 1 -- 172.21.15.33:0/3024371296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc20c058000 con 0x7fc2180acdb0 2024-09-13T18:59:44.417 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.418+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 msgr2=0x7fc1f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.418+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 0x7fc1f806d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc20402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.418+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 msgr2=0x7fc218158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.418+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e870 tx=0x7fc20c00ed30 comp rx=0 tx=0).stop 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 shutdown_connections 2024-09-13T18:59:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc1f806ac00 0x7fc1f806d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2181461a0 0x7fc218140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2180b2d60 0x7fc218140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 --2- 172.21.15.33:0/3024371296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2180acdb0 0x7fc218158e70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 >> 172.21.15.33:0/3024371296 conn(0x7fc2180b0510 msgr2=0x7fc218070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 shutdown_connections 2024-09-13T18:59:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.419+0000 7fc21fe00640 1 -- 172.21.15.33:0/3024371296 wait complete. 2024-09-13T18:59:44.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:59:44.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.598+0000 7ff42c600640 1 Processor -- start 2024-09-13T18:59:44.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.598+0000 7ff42c600640 1 -- start start 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.599+0000 7ff42c600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 0x7ff4240acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.599+0000 7ff42c600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff42406b8c0 0x7ff42406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42c600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42406b3e0 con 0x7ff4241461a0 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42c600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240ad240 con 0x7ff42406b8c0 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42c600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240b3370 con 0x7ff4240ac870 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42a600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff42406b8c0 0x7ff42406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff429c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff4241461a0 0x7ff4240b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59784/0 (socket says 172.21.15.33:59784) 2024-09-13T18:59:44.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff429c00640 1 -- 172.21.15.33:0/153225341 learned_addr learned my addr 172.21.15.33:0/153225341 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff429200640 1 --2- 172.21.15.33:0/153225341 >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 0x7ff4240acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42a600640 1 -- 172.21.15.33:0/153225341 >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 msgr2=0x7ff4240acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42a600640 1 --2- 172.21.15.33:0/153225341 >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 0x7ff4240acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42a600640 1 -- 172.21.15.33:0/153225341 >> v1:172.21.15.33:6789/0 conn(0x7ff4241461a0 legacy=0x7ff4240b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff42a600640 1 -- 172.21.15.33:0/153225341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240b3650 con 0x7ff42406b8c0 2024-09-13T18:59:44.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.600+0000 7ff429200640 1 --2- 172.21.15.33:0/153225341 >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 0x7ff4240acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.601+0000 7ff42a600640 1 --2- 172.21.15.33:0/153225341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff42406b8c0 0x7ff42406bcd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff424160190 tx=0x7ff41c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f11e20941d6a52e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.601+0000 7ff423e00640 1 -- 172.21.15.33:0/153225341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c02aea0 con 0x7ff42406b8c0 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff423e00640 1 -- 172.21.15.33:0/153225341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c02d050 con 0x7ff42406b8c0 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff423e00640 1 -- 172.21.15.33:0/153225341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c007960 con 0x7ff42406b8c0 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 -- 172.21.15.33:0/153225341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff42406b8c0 msgr2=0x7ff42406bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 --2- 172.21.15.33:0/153225341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff42406b8c0 0x7ff42406bcd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff424160190 tx=0x7ff41c02a680 comp rx=0 tx=0).stop 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 -- 172.21.15.33:0/153225341 shutdown_connections 2024-09-13T18:59:44.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 --2- 172.21.15.33:0/153225341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff42406b8c0 0x7ff42406bcd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 --2- 172.21.15.33:0/153225341 >> v2:172.21.15.103:3300/0 conn(0x7ff4240ac870 0x7ff4240acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 -- 172.21.15.33:0/153225341 >> 172.21.15.33:0/153225341 conn(0x7ff4240b0510 msgr2=0x7ff4240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 -- 172.21.15.33:0/153225341 shutdown_connections 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.602+0000 7ff42c600640 1 -- 172.21.15.33:0/153225341 wait complete. 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.604+0000 7ff42c600640 1 Processor -- start 2024-09-13T18:59:44.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.604+0000 7ff42c600640 1 -- start start 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff42406b8c0 0x7ff4241f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4240ac870 0x7ff4241ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4241ec780 con 0x7ff4241461a0 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424136e70 con 0x7ff4240ac870 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42c600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4241412e0 con 0x7ff42406b8c0 2024-09-13T18:59:44.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36974/0 (socket says 172.21.15.33:36974) 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff42a600640 1 -- 172.21.15.33:0/922353173 learned_addr learned my addr 172.21.15.33:0/922353173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff429c00640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff42406b8c0 0x7ff4241f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.605+0000 7ff429200640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4240ac870 0x7ff4241ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 -- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff42406b8c0 msgr2=0x7ff4241f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff42406b8c0 0x7ff4241f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 -- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4240ac870 msgr2=0x7ff4241ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4240ac870 0x7ff4241ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 -- 172.21.15.33:0/922353173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c009a70 con 0x7ff4241461a0 2024-09-13T18:59:44.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42a600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff41c02ac70 tx=0x7ff41c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:44.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c03c830 con 0x7ff4241461a0 2024-09-13T18:59:44.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c03c990 con 0x7ff4241461a0 2024-09-13T18:59:44.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c03cd00 con 0x7ff4241461a0 2024-09-13T18:59:44.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff424140a40 con 0x7ff4241461a0 2024-09-13T18:59:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.606+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff424141000 con 0x7ff4241461a0 2024-09-13T18:59:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.607+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240acd00 con 0x7ff4241461a0 2024-09-13T18:59:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.608+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff41c031400 con 0x7ff4241461a0 2024-09-13T18:59:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.609+0000 7ff421600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 0x7ff40406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.609+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ff41c0aabe0 con 0x7ff4241461a0 2024-09-13T18:59:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.610+0000 7ff429c00640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 0x7ff40406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.610+0000 7ff429c00640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 0x7ff40406d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff418005880 tx=0x7ff418009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.614+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff41c075f40 con 0x7ff4241461a0 2024-09-13T18:59:44.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:44.792+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff424136fb0 con 0x7ff4241461a0 2024-09-13T18:59:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.421+0000 7ff421600640 1 -- 172.21.15.33:0/922353173 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff41c03ce60 con 0x7ff4241461a0 2024-09-13T18:59:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T18:59:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 msgr2=0x7ff40406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 0x7ff40406d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff418005880 tx=0x7ff418009040 comp rx=0 tx=0).stop 2024-09-13T18:59:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 msgr2=0x7ff424140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff41c02ac70 tx=0x7ff41c004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 shutdown_connections 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff40406ac00 0x7ff40406d0c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4241461a0 0x7ff424140210 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4240ac870 0x7ff4241ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 --2- 172.21.15.33:0/922353173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff42406b8c0 0x7ff4241f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 >> 172.21.15.33:0/922353173 conn(0x7ff4240b0510 msgr2=0x7ff42406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 shutdown_connections 2024-09-13T18:59:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.424+0000 7ff42c600640 1 -- 172.21.15.33:0/922353173 wait complete. 2024-09-13T18:59:45.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:59:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.600+0000 7f557c600640 1 Processor -- start 2024-09-13T18:59:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.600+0000 7f557c600640 1 -- start start 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557c600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f55740b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557c600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f557406f660 0x7f557406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557c600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5574153f00 con 0x7f5574159a80 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557c600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740ce600 con 0x7f557406f660 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557c600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5574070f90 con 0x7f5574153b20 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.601+0000 7f557a600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f557406f660 0x7f557406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f557406f660 0x7f557406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36986/0 (socket says 172.21.15.33:36986) 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 -- 172.21.15.33:0/1851798772 learned_addr learned my addr 172.21.15.33:0/1851798772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f5579c00640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f55740b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 -- 172.21.15.33:0/1851798772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 msgr2=0x7f55740b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f55740b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 -- 172.21.15.33:0/1851798772 >> v1:172.21.15.103:6789/0 conn(0x7f5574159a80 legacy=0x7f55740b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.602+0000 7f557a600640 1 -- 172.21.15.33:0/1851798772 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740b1a40 con 0x7f557406f660 2024-09-13T18:59:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.603+0000 7f557a600640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f557406f660 0x7f557406faf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f556c009e80 tx=0x7f556c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24274e129050b13b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.603+0000 7f5573e00640 1 -- 172.21.15.33:0/1851798772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c031600 con 0x7f557406f660 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.603+0000 7f5573e00640 1 -- 172.21.15.33:0/1851798772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c02d050 con 0x7f557406f660 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.603+0000 7f5573e00640 1 -- 172.21.15.33:0/1851798772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c031980 con 0x7f557406f660 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 -- 172.21.15.33:0/1851798772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f557406f660 msgr2=0x7f557406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f557406f660 0x7f557406faf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f556c009e80 tx=0x7f556c02a750 comp rx=0 tx=0).stop 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 -- 172.21.15.33:0/1851798772 shutdown_connections 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f557406f660 0x7f557406faf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 --2- 172.21.15.33:0/1851798772 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f55740b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 -- 172.21.15.33:0/1851798772 >> 172.21.15.33:0/1851798772 conn(0x7f55740b0510 msgr2=0x7f55740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 -- 172.21.15.33:0/1851798772 shutdown_connections 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.604+0000 7f557c600640 1 -- 172.21.15.33:0/1851798772 wait complete. 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.605+0000 7f557c600640 1 Processor -- start 2024-09-13T18:59:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.605+0000 7f557c600640 1 -- start start 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557406f660 0x7f557414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f5574165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574158e00 con 0x7f5574159a80 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55741558f0 con 0x7f557406f660 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.606+0000 7f557c600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5574154ce0 con 0x7f5574153b20 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37000/0 (socket says 172.21.15.33:37000) 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 -- 172.21.15.33:0/3104763859 learned_addr learned my addr 172.21.15.33:0/3104763859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f5579c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557406f660 0x7f557414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f5579200640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f5574165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 -- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 msgr2=0x7f5574165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f5574165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 -- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557406f660 msgr2=0x7f557414baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557406f660 0x7f557414baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 -- 172.21.15.33:0/3104763859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c009b30 con 0x7f5574159a80 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.607+0000 7f557a600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f556c034040 tx=0x7f556c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.608+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c03d860 con 0x7f5574159a80 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.608+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c03d9e0 con 0x7f5574159a80 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.608+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c03dd90 con 0x7f5574159a80 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.608+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5574154fc0 con 0x7f5574159a80 2024-09-13T18:59:45.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.608+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5574155580 con 0x7f5574159a80 2024-09-13T18:59:45.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.609+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557406faf0 con 0x7f5574159a80 2024-09-13T18:59:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.610+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f556c03b400 con 0x7f5574159a80 2024-09-13T18:59:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.611+0000 7f5571600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 0x7f555406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.611+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f556c0a9d80 con 0x7f5574159a80 2024-09-13T18:59:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.611+0000 7f5579c00640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 0x7f555406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.612+0000 7f5579c00640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 0x7f555406d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5574166030 tx=0x7f5568009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.615+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f556c075270 con 0x7f5574159a80 2024-09-13T18:59:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.793+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f55740cabb0 con 0x7f5574159a80 2024-09-13T18:59:45.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.798+0000 7f5571600640 1 -- 172.21.15.33:0/3104763859 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f556c009510 con 0x7f5574159a80 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 msgr2=0x7f555406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 0x7f555406d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5574166030 tx=0x7f5568009190 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 msgr2=0x7f55741659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f556c034040 tx=0x7f556c004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 shutdown_connections 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f555406ac30 0x7f555406d0f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5574159a80 0x7f55741659d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5574153b20 0x7f5574165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 --2- 172.21.15.33:0/3104763859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557406f660 0x7f557414baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 >> 172.21.15.33:0/3104763859 conn(0x7f55740b0510 msgr2=0x7f557406bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:45.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 shutdown_connections 2024-09-13T18:59:45.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.800+0000 7f557c600640 1 -- 172.21.15.33:0/3104763859 wait complete. 2024-09-13T18:59:45.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-13T18:59:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.973+0000 7f994fe00640 1 Processor -- start 2024-09-13T18:59:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.973+0000 7f994fe00640 1 -- start start 2024-09-13T18:59:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.974+0000 7f994fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f99480b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.974+0000 7f994fe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480b1f00 con 0x7f994815c270 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.974+0000 7f994fe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994815c650 con 0x7f9948070950 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9948070dc0 con 0x7f994806c310 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994d400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f994815c270 0x7f994806ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59792/0 (socket says 172.21.15.33:59792) 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994d400640 1 -- 172.21.15.33:0/1658114385 learned_addr learned my addr 172.21.15.33:0/1658114385 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994de00640 1 --2- 172.21.15.33:0/1658114385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f99480b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144261129 0 0) 0x7f99480b1f00 con 0x7f994815c270 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9930003520 con 0x7f994815c270 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712515078 0 0) 0x7f994815c650 con 0x7f9948070950 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994de00640 1 -- 172.21.15.33:0/1658114385 >> v1:172.21.15.103:6789/0 conn(0x7f9948070950 legacy=0x7f994806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994de00640 1 -- 172.21.15.33:0/1658114385 >> v1:172.21.15.33:6789/0 conn(0x7f994815c270 legacy=0x7f994806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.975+0000 7f994de00640 1 -- 172.21.15.33:0/1658114385 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99480712c0 con 0x7f994806c310 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f994de00640 1 --2- 172.21.15.33:0/1658114385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f99480b33a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9940009dc0 tx=0x7f994002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7d0935ebdbfe98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940007740 con 0x7f994806c310 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994002d050 con 0x7f994806c310 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f9947e00640 1 -- 172.21.15.33:0/1658114385 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940007ac0 con 0x7f994806c310 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f994fe00640 1 -- 172.21.15.33:0/1658114385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 msgr2=0x7f99480b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f994fe00640 1 --2- 172.21.15.33:0/1658114385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f99480b33a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9940009dc0 tx=0x7f994002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f994fe00640 1 -- 172.21.15.33:0/1658114385 shutdown_connections 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.977+0000 7f994fe00640 1 --2- 172.21.15.33:0/1658114385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f99480b33a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.978+0000 7f994fe00640 1 -- 172.21.15.33:0/1658114385 >> 172.21.15.33:0/1658114385 conn(0x7f99480b0510 msgr2=0x7f99480b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.978+0000 7f994fe00640 1 -- 172.21.15.33:0/1658114385 shutdown_connections 2024-09-13T18:59:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.978+0000 7f994fe00640 1 -- 172.21.15.33:0/1658114385 wait complete. 2024-09-13T18:59:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.979+0000 7f994fe00640 1 Processor -- start 2024-09-13T18:59:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.979+0000 7f994fe00640 1 -- start start 2024-09-13T18:59:45.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f9948145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 0x7f9948149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948150fb0 con 0x7f994815c270 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948151290 con 0x7f9948070950 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994fe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99481475d0 con 0x7f994806c310 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.980+0000 7f994de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37014/0 (socket says 172.21.15.33:37014) 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 -- 172.21.15.33:0/1723325197 learned_addr learned my addr 172.21.15.33:0/1723325197 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994d400640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f9948145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 -- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 msgr2=0x7f9948145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994ca00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 0x7f9948149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f9948145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 -- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 msgr2=0x7f9948149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 0x7f9948149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 -- 172.21.15.33:0/1723325197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940009a70 con 0x7f994815c270 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994ca00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 0x7f9948149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.981+0000 7f994de00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f994002acc0 tx=0x7f9940004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.982+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994003c830 con 0x7f994815c270 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.982+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994003c990 con 0x7f994815c270 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.982+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994003cd00 con 0x7f994815c270 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.982+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99481478b0 con 0x7f994815c270 2024-09-13T18:59:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.982+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99481584a0 con 0x7f994815c270 2024-09-13T18:59:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.983+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948151420 con 0x7f994815c270 2024-09-13T18:59:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.984+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9940031400 con 0x7f994815c270 2024-09-13T18:59:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.984+0000 7f9945600640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 0x7f992806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.984+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f99400aa880 con 0x7f994815c270 2024-09-13T18:59:45.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.985+0000 7f994d400640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 0x7f992806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:45.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.986+0000 7f994d400640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 0x7f992806d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f993c000f60 tx=0x7f993c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:45.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:45.989+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9940075cd0 con 0x7f994815c270 2024-09-13T18:59:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.235+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) v1 -- 0x7f994806ffb0 con 0x7f994815c270 2024-09-13T18:59:46.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.423+0000 7f9945600640 1 -- 172.21.15.33:0/1723325197 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v163) v1 ==== 145+0+0 (secure 0 0 0) 0x7f994003ce60 con 0x7f994815c270 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 msgr2=0x7f992806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 0x7f992806d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f993c000f60 tx=0x7f993c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 msgr2=0x7f99480cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f994002acc0 tx=0x7f9940004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 shutdown_connections 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f992806ac00 0x7f992806d0c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f994815c270 0x7f99480cd180 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9948070950 0x7f9948149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 --2- 172.21.15.33:0/1723325197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f994806c310 0x7f9948145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 >> 172.21.15.33:0/1723325197 conn(0x7f99480b0510 msgr2=0x7f99480b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.425+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 shutdown_connections 2024-09-13T18:59:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.426+0000 7f994fe00640 1 -- 172.21.15.33:0/1723325197 wait complete. 2024-09-13T18:59:46.444 INFO:tasks.cephfs_test_runner:test human-readable values for setting ceph.quota.max_bytes ... ok 2024-09-13T18:59:46.444 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_df (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-13T18:59:46.444 INFO:tasks.cephfs_test_runner:test_remote_update_df (tasks.cephfs.test_quota.TestQuota) 2024-09-13T18:59:46.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:46.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.598+0000 7f5696e00640 1 Processor -- start 2024-09-13T18:59:46.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.598+0000 7f5696e00640 1 -- start start 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.599+0000 7f5696e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 0x7f56900cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5696e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 0x7f569015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5696e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569006bea0 con 0x7f569015a520 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5696e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569006c180 con 0x7f56900b1b00 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5696e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569006c460 con 0x7f56900cde50 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f568fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f569015a520 0x7f569006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59800/0 (socket says 172.21.15.33:59800) 2024-09-13T18:59:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f568fe00640 1 -- 172.21.15.33:0/756942425 learned_addr learned my addr 172.21.15.33:0/756942425 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5687400640 1 --2- 172.21.15.33:0/756942425 >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 0x7f56900cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f5694e00640 1 --2- 172.21.15.33:0/756942425 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 0x7f569015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684394506 0 0) 0x7f569006bea0 con 0x7f569015a520 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.600+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5674003520 con 0x7f569015a520 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f5694e00640 1 -- 172.21.15.33:0/756942425 >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 msgr2=0x7f56900cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:46.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f5694e00640 1 --2- 172.21.15.33:0/756942425 >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 0x7f56900cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 573453232 0 0) 0x7f5674003520 con 0x7f569015a520 2024-09-13T18:59:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f5694e00640 1 -- 172.21.15.33:0/756942425 >> v1:172.21.15.33:6789/0 conn(0x7f569015a520 legacy=0x7f569006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f5694e00640 1 -- 172.21.15.33:0/756942425 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569006c740 con 0x7f56900cde50 2024-09-13T18:59:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.601+0000 7f5687400640 1 --2- 172.21.15.33:0/756942425 >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 0x7f56900cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.602+0000 7f5694e00640 1 --2- 172.21.15.33:0/756942425 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 0x7f569015a900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d0d3d7a2c62f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.602+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680001670 con 0x7f56900cde50 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.602+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568802d050 con 0x7f56900cde50 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.602+0000 7f568f400640 1 -- 172.21.15.33:0/756942425 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688007740 con 0x7f56900cde50 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 -- 172.21.15.33:0/756942425 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 msgr2=0x7f569015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 --2- 172.21.15.33:0/756942425 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 0x7f569015a900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 -- 172.21.15.33:0/756942425 shutdown_connections 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 --2- 172.21.15.33:0/756942425 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900cde50 0x7f569015a900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 --2- 172.21.15.33:0/756942425 >> v2:172.21.15.103:3300/0 conn(0x7f56900b1b00 0x7f56900cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 -- 172.21.15.33:0/756942425 >> 172.21.15.33:0/756942425 conn(0x7f56900b0510 msgr2=0x7f56900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:46.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 -- 172.21.15.33:0/756942425 shutdown_connections 2024-09-13T18:59:46.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.603+0000 7f5696e00640 1 -- 172.21.15.33:0/756942425 wait complete. 2024-09-13T18:59:46.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.604+0000 7f5696e00640 1 Processor -- start 2024-09-13T18:59:46.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.604+0000 7f5696e00640 1 -- start start 2024-09-13T18:59:46.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 0x7f5690148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 0x7f56900ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569014b1f0 con 0x7f569015a520 2024-09-13T18:59:46.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569014bfa0 con 0x7f56900cde50 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.605+0000 7f5696e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569014b3d0 con 0x7f56900b1b00 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37028/0 (socket says 172.21.15.33:37028) 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 -- 172.21.15.33:0/3561384331 learned_addr learned my addr 172.21.15.33:0/3561384331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f568fe00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 0x7f5690148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5687400640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 0x7f56900ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 -- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 msgr2=0x7f5690148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 0x7f5690148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 -- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 msgr2=0x7f56900ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 0x7f56900ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 -- 172.21.15.33:0/3561384331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678009400 con 0x7f569015a520 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5687400640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 0x7f56900ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f568fe00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 0x7f5690148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:46.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.606+0000 7f5694e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5688009eb0 tx=0x7f5688004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.607+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568803c830 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.607+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568803c990 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.607+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568803cd20 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.607+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688009a70 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.607+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569014b950 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.608+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569014c110 con 0x7f569015a520 2024-09-13T18:59:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.609+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f568802ad50 con 0x7f569015a520 2024-09-13T18:59:46.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.610+0000 7f568cc00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 0x7f566c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.610+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56880aa290 con 0x7f569015a520 2024-09-13T18:59:46.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.610+0000 7f568fe00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 0x7f566c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.611+0000 7f568fe00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 0x7f566c06d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5680005880 tx=0x7f5680009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.614+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f56880756d0 con 0x7f569015a520 2024-09-13T18:59:46.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.795+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56900cd910 con 0x7f569015a520 2024-09-13T18:59:46.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.796+0000 7f568cc00640 1 -- 172.21.15.33:0/3561384331 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f5688078cf0 con 0x7f569015a520 2024-09-13T18:59:46.798 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:46.798 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":63,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:45.413969+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6835/2343612269":"2024-09-14T18:59:42.397548+0000","172.21.15.33:6833/2343612269":"2024-09-14T18:59:42.397548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:46.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 msgr2=0x7f566c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 0x7f566c06d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5680005880 tx=0x7f5680009040 comp rx=0 tx=0).stop 2024-09-13T18:59:46.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 msgr2=0x7f56900acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5688009eb0 tx=0x7f5688004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 shutdown_connections 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f566c06ac00 0x7f566c06d0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569015a520 0x7f56900acdb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56900cde50 0x7f56900ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 --2- 172.21.15.33:0/3561384331 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56900b1b00 0x7f5690148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 >> 172.21.15.33:0/3561384331 conn(0x7f56900b0510 msgr2=0x7f569006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 shutdown_connections 2024-09-13T18:59:46.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.798+0000 7f5696e00640 1 -- 172.21.15.33:0/3561384331 wait complete. 2024-09-13T18:59:46.817 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:46.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.973+0000 7fa75e600640 1 Processor -- start 2024-09-13T18:59:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.973+0000 7fa75e600640 1 -- start start 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa75e600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa75806f830 0x7fa75806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa75e600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa758070420 0x7fa7580cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa75e600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7580ce490 con 0x7fa758154ad0 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa75e600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75806b5b0 con 0x7fa758070420 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa75e600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75806b7c0 con 0x7fa75806f830 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa757e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa758070420 0x7fa7580cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa757e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa758070420 0x7fa7580cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37042/0 (socket says 172.21.15.33:37042) 2024-09-13T18:59:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.974+0000 7fa757e00640 1 -- 172.21.15.33:0/3967679345 learned_addr learned my addr 172.21.15.33:0/3967679345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.975+0000 7fa756a00640 1 --2- 172.21.15.33:0/3967679345 >> v2:172.21.15.103:3300/0 conn(0x7fa75806f830 0x7fa75806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.975+0000 7fa757e00640 1 -- 172.21.15.33:0/3967679345 >> v2:172.21.15.103:3300/0 conn(0x7fa75806f830 msgr2=0x7fa75806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.975+0000 7fa757e00640 1 --2- 172.21.15.33:0/3967679345 >> v2:172.21.15.103:3300/0 conn(0x7fa75806f830 0x7fa75806fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.975+0000 7fa757e00640 1 -- 172.21.15.33:0/3967679345 >> v1:172.21.15.103:6789/0 conn(0x7fa758154ad0 legacy=0x7fa7580cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.975+0000 7fa757e00640 1 -- 172.21.15.33:0/3967679345 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75806baa0 con 0x7fa758070420 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.976+0000 7fa757e00640 1 --2- 172.21.15.33:0/3967679345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758070420 0x7fa7580cbac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ae4c0 tx=0x7fa75002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4497ebc1118f35bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.976+0000 7fa756000640 1 -- 172.21.15.33:0/3967679345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031600 con 0x7fa758070420 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.976+0000 7fa756000640 1 -- 172.21.15.33:0/3967679345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75002d050 con 0x7fa758070420 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.976+0000 7fa756000640 1 -- 172.21.15.33:0/3967679345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031980 con 0x7fa758070420 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 -- 172.21.15.33:0/3967679345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758070420 msgr2=0x7fa7580cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 --2- 172.21.15.33:0/3967679345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758070420 0x7fa7580cbac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ae4c0 tx=0x7fa75002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 -- 172.21.15.33:0/3967679345 shutdown_connections 2024-09-13T18:59:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 --2- 172.21.15.33:0/3967679345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758070420 0x7fa7580cbac0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 --2- 172.21.15.33:0/3967679345 >> v2:172.21.15.103:3300/0 conn(0x7fa75806f830 0x7fa75806fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 -- 172.21.15.33:0/3967679345 >> 172.21.15.33:0/3967679345 conn(0x7fa7580b0580 msgr2=0x7fa7580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 -- 172.21.15.33:0/3967679345 shutdown_connections 2024-09-13T18:59:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.977+0000 7fa75e600640 1 -- 172.21.15.33:0/3967679345 wait complete. 2024-09-13T18:59:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.979+0000 7fa75e600640 1 Processor -- start 2024-09-13T18:59:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.979+0000 7fa75e600640 1 -- start start 2024-09-13T18:59:46.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 0x7fa7581445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 0x7fa758159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815c900 con 0x7fa758154ad0 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75814ec50 con 0x7fa7581f64f0 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa75e600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815a9b0 con 0x7fa758070420 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37044/0 (socket says 172.21.15.33:37044) 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 -- 172.21.15.33:0/2816793026 learned_addr learned my addr 172.21.15.33:0/2816793026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa757e00640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 0x7fa758159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa757400640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 0x7fa7581445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 -- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 msgr2=0x7fa7581445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 0x7fa7581445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 -- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 msgr2=0x7fa758159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 0x7fa758159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:46.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa756a00640 1 -- 172.21.15.33:0/2816793026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009b30 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa757400640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 0x7fa7581445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.980+0000 7fa757e00640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 0x7fa758159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa756a00640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e9e0 tx=0x7fa74400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744009670 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400c9d0 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400cd80 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75815b250 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.981+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75815ac00 con 0x7fa758154ad0 2024-09-13T18:59:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.982+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75815b3e0 con 0x7fa758154ad0 2024-09-13T18:59:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.983+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa744013470 con 0x7fa758154ad0 2024-09-13T18:59:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.984+0000 7fa74f400640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 0x7fa73806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.984+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa744089210 con 0x7fa758154ad0 2024-09-13T18:59:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.984+0000 7fa757400640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 0x7fa73806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.985+0000 7fa757400640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 0x7fa73806d0f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa748007fd0 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:46.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:46.988+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa7440546f0 con 0x7fa758154ad0 2024-09-13T18:59:47.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.168+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa75806fee0 con 0x7fa758154ad0 2024-09-13T18:59:47.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.169+0000 7fa74f400640 1 -- 172.21.15.33:0/2816793026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa744087e60 con 0x7fa758154ad0 2024-09-13T18:59:47.171 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:47.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 msgr2=0x7fa73806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 0x7fa73806d0f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa748007fd0 tx=0x7fa748009040 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 msgr2=0x7fa7581595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e9e0 tx=0x7fa74400eea0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 shutdown_connections 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa73806ac30 0x7fa73806d0f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7581f64f0 0x7fa758159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758154ad0 0x7fa7581595c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 --2- 172.21.15.33:0/2816793026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa758070420 0x7fa7581445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 >> 172.21.15.33:0/2816793026 conn(0x7fa7580b0580 msgr2=0x7fa7581522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 shutdown_connections 2024-09-13T18:59:47.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.172+0000 7fa75e600640 1 -- 172.21.15.33:0/2816793026 wait complete. 2024-09-13T18:59:47.192 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-13T18:59:47.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.345+0000 7f7fd2c00640 1 Processor -- start 2024-09-13T18:59:47.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.345+0000 7f7fd2c00640 1 -- start start 2024-09-13T18:59:47.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.346+0000 7f7fd2c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 0x7f7fcc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.346+0000 7f7fd2c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7fcc0b4520 0x7f7fcc0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.346+0000 7f7fd2c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0b5cb0 con 0x7f7fcc15c8b0 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.346+0000 7f7fd2c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b4ef0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.346+0000 7f7fd2c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0d07e0 con 0x7f7fcc0d1cd0 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd2200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7fcc0b4520 0x7f7fcc0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd0e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 0x7f7fcc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd1800640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7fcc15c8b0 0x7f7fcc0b55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:50656/0 (socket says 172.21.15.33:50656) 2024-09-13T18:59:47.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd1800640 1 -- 172.21.15.33:0/3958683852 learned_addr learned my addr 172.21.15.33:0/3958683852 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:47.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd2200640 1 -- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 msgr2=0x7f7fcc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:47.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd2200640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 0x7f7fcc0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd2200640 1 -- 172.21.15.33:0/3958683852 >> v1:172.21.15.103:6789/0 conn(0x7f7fcc15c8b0 legacy=0x7f7fcc0b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd2200640 1 -- 172.21.15.33:0/3958683852 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0cd4e0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.347+0000 7f7fd0e00640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 0x7f7fcc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2200640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc0b49b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009d90 tx=0x7f7fc402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6536c5544bb614 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fcbe00640 1 -- 172.21.15.33:0/3958683852 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4007740 con 0x7f7fcc0b4520 2024-09-13T18:59:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fcbe00640 1 -- 172.21.15.33:0/3958683852 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc402d050 con 0x7f7fcc0b4520 2024-09-13T18:59:47.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fcbe00640 1 -- 172.21.15.33:0/3958683852 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4007ac0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 -- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0b4520 msgr2=0x7f7fcc0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc0b49b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009d90 tx=0x7f7fc402a660 comp rx=0 tx=0).stop 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 -- 172.21.15.33:0/3958683852 shutdown_connections 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc0b49b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/3958683852 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc0d1cd0 0x7f7fcc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.349+0000 7f7fd2c00640 1 -- 172.21.15.33:0/3958683852 >> 172.21.15.33:0/3958683852 conn(0x7f7fcc0cf540 msgr2=0x7f7fcc0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.350+0000 7f7fd2c00640 1 -- 172.21.15.33:0/3958683852 shutdown_connections 2024-09-13T18:59:47.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.350+0000 7f7fd2c00640 1 -- 172.21.15.33:0/3958683852 wait complete. 2024-09-13T18:59:47.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.351+0000 7f7fd2c00640 1 Processor -- start 2024-09-13T18:59:47.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.351+0000 7f7fd2c00640 1 -- start start 2024-09-13T18:59:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0d1cd0 0x7f7fcc15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc15c8b0 0x7f7fcc0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc15f950 con 0x7f7fcc0b4520 2024-09-13T18:59:47.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1f2c80 con 0x7f7fcc0d1cd0 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd2c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1efdf0 con 0x7f7fcc15c8b0 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37050/0 (socket says 172.21.15.33:37050) 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.352+0000 7f7fd1800640 1 -- 172.21.15.33:0/840678363 learned_addr learned my addr 172.21.15.33:0/840678363 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd2200640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc15c8b0 0x7f7fcc0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd0e00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0d1cd0 0x7f7fcc15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 -- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc15c8b0 msgr2=0x7f7fcc0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc15c8b0 0x7f7fcc0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 -- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0d1cd0 msgr2=0x7f7fcc15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0d1cd0 0x7f7fcc15b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 -- 172.21.15.33:0/840678363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009400 con 0x7f7fcc0b4520 2024-09-13T18:59:47.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fd1800640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c480 tx=0x7f7fc000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.353+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0005ce0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.354+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0005e40 con 0x7f7fcc0b4520 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.354+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00072f0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.354+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4009a70 con 0x7f7fcc0b4520 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.354+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc1f3670 con 0x7f7fcc0b4520 2024-09-13T18:59:47.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.355+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0b49b0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.356+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fc0007510 con 0x7f7fcc0b4520 2024-09-13T18:59:47.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.356+0000 7f7fc9600640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 0x7f7fac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:47.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.357+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fc00885c0 con 0x7f7fcc0b4520 2024-09-13T18:59:47.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.357+0000 7f7fd0e00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 0x7f7fac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:47.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.358+0000 7f7fd0e00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 0x7f7fac06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc1ef8b0 tx=0x7f7fb8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:47.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.361+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7fc0053b40 con 0x7f7fcc0b4520 2024-09-13T18:59:47.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:47.607+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7f7fcc0ce510 con 0x7f7fcc0b4520 2024-09-13T18:59:48.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.430+0000 7f7fc9600640 1 -- 172.21.15.33:0/840678363 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v165) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7fc00170d0 con 0x7f7fcc0b4520 2024-09-13T18:59:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 msgr2=0x7f7fac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 0x7f7fac06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc1ef8b0 tx=0x7f7fb8009190 comp rx=0 tx=0).stop 2024-09-13T18:59:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 msgr2=0x7f7fcc1f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c480 tx=0x7f7fc000c940 comp rx=0 tx=0).stop 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 shutdown_connections 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7fac06ac00 0x7f7fac06d0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7fcc15c8b0 0x7f7fcc0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fcc0d1cd0 0x7f7fcc15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 --2- 172.21.15.33:0/840678363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fcc0b4520 0x7f7fcc1f2740 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 >> 172.21.15.33:0/840678363 conn(0x7f7fcc0cf540 msgr2=0x7f7fcc0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 shutdown_connections 2024-09-13T18:59:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.433+0000 7f7fd2c00640 1 -- 172.21.15.33:0/840678363 wait complete. 2024-09-13T18:59:48.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:59:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.611+0000 7ff7a7a00640 1 Processor -- start 2024-09-13T18:59:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.611+0000 7ff7a7a00640 1 -- start start 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.612+0000 7ff7a7a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.612+0000 7ff7a7a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7a00ade90 0x7ff7a015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff7a7a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a006fce0 con 0x7ff7a01566f0 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff7a7a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a00ae340 con 0x7ff7a00ade90 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff7a7a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a006c550 con 0x7ff7a0070170 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff7a5a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7a00ade90 0x7ff7a015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff797e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff797e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:42478/0 (socket says 172.21.15.33:42478) 2024-09-13T18:59:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff7a5000640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff7a01566f0 0x7ff7a006be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:50664/0 (socket says 172.21.15.33:50664) 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff797e00640 1 -- 172.21.15.33:0/2336093055 learned_addr learned my addr 172.21.15.33:0/2336093055 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff79fe00640 1 -- 172.21.15.33:0/2336093055 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866754294 0 0) 0x7ff7a006fce0 con 0x7ff7a01566f0 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.613+0000 7ff79fe00640 1 -- 172.21.15.33:0/2336093055 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff784003520 con 0x7ff7a01566f0 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.614+0000 7ff797e00640 1 -- 172.21.15.33:0/2336093055 >> v2:172.21.15.103:3300/0 conn(0x7ff7a00ade90 msgr2=0x7ff7a015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.614+0000 7ff797e00640 1 --2- 172.21.15.33:0/2336093055 >> v2:172.21.15.103:3300/0 conn(0x7ff7a00ade90 0x7ff7a015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.614+0000 7ff797e00640 1 -- 172.21.15.33:0/2336093055 >> v1:172.21.15.103:6789/0 conn(0x7ff7a01566f0 legacy=0x7ff7a006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.614+0000 7ff797e00640 1 -- 172.21.15.33:0/2336093055 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a006c820 con 0x7ff7a0070170 2024-09-13T18:59:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff797e00640 1 --2- 172.21.15.33:0/2336093055 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff788009870 tx=0x7ff78802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82fb85d692691c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff79fe00640 1 -- 172.21.15.33:0/2336093055 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788032440 con 0x7ff7a0070170 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff79fe00640 1 -- 172.21.15.33:0/2336093055 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880325a0 con 0x7ff7a0070170 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff79fe00640 1 -- 172.21.15.33:0/2336093055 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788032930 con 0x7ff7a0070170 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff7a7a00640 1 -- 172.21.15.33:0/2336093055 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 msgr2=0x7ff7a00ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.615+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/2336093055 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff788009870 tx=0x7ff78802a250 comp rx=0 tx=0).stop 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 -- 172.21.15.33:0/2336093055 shutdown_connections 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/2336093055 >> v2:172.21.15.103:3300/0 conn(0x7ff7a00ade90 0x7ff7a015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/2336093055 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a00ad950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 -- 172.21.15.33:0/2336093055 >> 172.21.15.33:0/2336093055 conn(0x7ff7a00b0580 msgr2=0x7ff7a00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 -- 172.21.15.33:0/2336093055 shutdown_connections 2024-09-13T18:59:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.616+0000 7ff7a7a00640 1 -- 172.21.15.33:0/2336093055 wait complete. 2024-09-13T18:59:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.617+0000 7ff7a7a00640 1 Processor -- start 2024-09-13T18:59:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.617+0000 7ff7a7a00640 1 -- start start 2024-09-13T18:59:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a01566f0 0x7ff7a00cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00cd6b0 con 0x7ff7a00ade90 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00ce130 con 0x7ff7a01566f0 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.618+0000 7ff7a7a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00cd890 con 0x7ff7a0070170 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37060/0 (socket says 172.21.15.33:37060) 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 -- 172.21.15.33:0/3078612401 learned_addr learned my addr 172.21.15.33:0/3078612401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff7a5000640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff7a5a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a01566f0 0x7ff7a00cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 -- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 msgr2=0x7ff7a01552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a01552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 -- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a01566f0 msgr2=0x7ff7a00cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a01566f0 0x7ff7a00cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.619+0000 7ff797e00640 1 -- 172.21.15.33:0/3078612401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7880094d0 con 0x7ff7a00ade90 2024-09-13T18:59:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff797e00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff788000c00 tx=0x7ff7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78803d830 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78803d990 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78803dd40 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a00cdb70 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.620+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a01497c0 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.621+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0149620 con 0x7ff7a00ade90 2024-09-13T18:59:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.622+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff788039040 con 0x7ff7a00ade90 2024-09-13T18:59:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.623+0000 7ff79d600640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 0x7ff77c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.623+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7880a9a60 con 0x7ff7a00ade90 2024-09-13T18:59:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.623+0000 7ff7a5000640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 0x7ff77c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.624+0000 7ff7a5000640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 0x7ff77c06d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7900011e0 tx=0x7ff790007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.627+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7a0149620 con 0x7ff7a00ade90 2024-09-13T18:59:48.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.804+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff7a0149620 con 0x7ff7a00ade90 2024-09-13T18:59:48.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.808+0000 7ff79d600640 1 -- 172.21.15.33:0/3078612401 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff7a0149620 con 0x7ff7a00ade90 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 msgr2=0x7ff77c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 0x7ff77c06d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7900011e0 tx=0x7ff790007d30 comp rx=0 tx=0).stop 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 msgr2=0x7ff7a01408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff788000c00 tx=0x7ff7880046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 shutdown_connections 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff77c06ac00 0x7ff77c06d0c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a01566f0 0x7ff7a00cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a00ade90 0x7ff7a01408f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 --2- 172.21.15.33:0/3078612401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a0070170 0x7ff7a01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:48.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 >> 172.21.15.33:0/3078612401 conn(0x7ff7a00b0580 msgr2=0x7ff7a00cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:48.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 shutdown_connections 2024-09-13T18:59:48.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:48.811+0000 7ff7a7a00640 1 -- 172.21.15.33:0/3078612401 wait complete. 2024-09-13T18:59:48.829 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:59:48.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:48.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:59:49.017 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:59:49.017 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:49.017 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:49.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:49.053 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:49.053 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:49.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:49.090 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T18:59:49.090 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:49.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:59:49.129 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T18:59:49.129 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:59:49.166 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:59:49.166 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:59:49.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:49.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.321+0000 7ff169600640 1 Processor -- start 2024-09-13T18:59:49.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.321+0000 7ff169600640 1 -- start start 2024-09-13T18:59:49.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff169600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff16415a520 0x7ff16406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff169600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1640b1b00 0x7ff1640cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff169600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16406bc00 con 0x7ff1640cde50 2024-09-13T18:59:49.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff169600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16406bea0 con 0x7ff1640b1b00 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff169600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16406c180 con 0x7ff16415a520 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.322+0000 7ff162000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1640b1b00 0x7ff1640cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1640b1b00 0x7ff1640cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37076/0 (socket says 172.21.15.33:37076) 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 -- 172.21.15.33:0/2747628274 learned_addr learned my addr 172.21.15.33:0/2747628274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162a00640 1 --2- 172.21.15.33:0/2747628274 >> v2:172.21.15.103:3300/0 conn(0x7ff16415a520 0x7ff16406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 -- 172.21.15.33:0/2747628274 >> v2:172.21.15.103:3300/0 conn(0x7ff16415a520 msgr2=0x7ff16406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 --2- 172.21.15.33:0/2747628274 >> v2:172.21.15.103:3300/0 conn(0x7ff16415a520 0x7ff16406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 -- 172.21.15.33:0/2747628274 >> v1:172.21.15.103:6789/0 conn(0x7ff1640cde50 legacy=0x7ff1640b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.323+0000 7ff162000640 1 -- 172.21.15.33:0/2747628274 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16406c460 con 0x7ff1640b1b00 2024-09-13T18:59:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.324+0000 7ff162000640 1 --2- 172.21.15.33:0/2747628274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff1640cd910 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff1640b14f0 tx=0x7ff15002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad62fa43c4afe2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.324+0000 7ff161600640 1 -- 172.21.15.33:0/2747628274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150032440 con 0x7ff1640b1b00 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.324+0000 7ff161600640 1 -- 172.21.15.33:0/2747628274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500325a0 con 0x7ff1640b1b00 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.324+0000 7ff161600640 1 -- 172.21.15.33:0/2747628274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150032930 con 0x7ff1640b1b00 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 -- 172.21.15.33:0/2747628274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 msgr2=0x7ff1640cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 --2- 172.21.15.33:0/2747628274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff1640cd910 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff1640b14f0 tx=0x7ff15002a270 comp rx=0 tx=0).stop 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 -- 172.21.15.33:0/2747628274 shutdown_connections 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 --2- 172.21.15.33:0/2747628274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff1640cd910 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 --2- 172.21.15.33:0/2747628274 >> v2:172.21.15.103:3300/0 conn(0x7ff16415a520 0x7ff16406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 -- 172.21.15.33:0/2747628274 >> 172.21.15.33:0/2747628274 conn(0x7ff1640b0510 msgr2=0x7ff1640b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 -- 172.21.15.33:0/2747628274 shutdown_connections 2024-09-13T18:59:49.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.325+0000 7ff169600640 1 -- 172.21.15.33:0/2747628274 wait complete. 2024-09-13T18:59:49.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.327+0000 7ff169600640 1 Processor -- start 2024-09-13T18:59:49.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.327+0000 7ff169600640 1 -- start start 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1640cde50 0x7ff164150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff16415a520 0x7ff1641f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16413dba0 con 0x7ff1640b1b00 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16415cf90 con 0x7ff1640cde50 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff169600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16415d270 con 0x7ff16415a520 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37088/0 (socket says 172.21.15.33:37088) 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff162a00640 1 -- 172.21.15.33:0/3633327193 learned_addr learned my addr 172.21.15.33:0/3633327193 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff163400640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff16415a520 0x7ff1641f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.328+0000 7ff162000640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1640cde50 0x7ff164150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 -- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff16415a520 msgr2=0x7ff1641f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff16415a520 0x7ff1641f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 -- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1640cde50 msgr2=0x7ff164150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1640cde50 0x7ff164150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 -- 172.21.15.33:0/3633327193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500094d0 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff162a00640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff15400e870 tx=0x7ff15400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540094f0 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400c940 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16415d550 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400ccf0 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.329+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16415cc40 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.330+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1640cd910 con 0x7ff1640b1b00 2024-09-13T18:59:49.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.331+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff154013470 con 0x7ff1640b1b00 2024-09-13T18:59:49.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.332+0000 7ff15aa00640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 0x7ff14406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.332+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff1540891c0 con 0x7ff1640b1b00 2024-09-13T18:59:49.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.332+0000 7ff162000640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 0x7ff14406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.333+0000 7ff162000640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 0x7ff14406d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff150034000 tx=0x7ff15002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.336+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff1540546b0 con 0x7ff1640b1b00 2024-09-13T18:59:49.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.554+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1640b0020 con 0x7ff1640b1b00 2024-09-13T18:59:49.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.554+0000 7ff15aa00640 1 -- 172.21.15.33:0/3633327193 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff154017de0 con 0x7ff1640b1b00 2024-09-13T18:59:49.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2489277163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":2489277163},{"type":"v1","addr":"172.21.15.103:6837","nonce":2489277163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5728,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1484090619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1484090619},{"type":"v1","addr":"172.21.15.103:6836","nonce":1484090619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1442082760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1442082760},{"type":"v1","addr":"172.21.15.33:6834","nonce":1442082760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3215055875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":3215055875},{"type":"v1","addr":"172.21.15.33:6835","nonce":3215055875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2024-09-13T18:59:49.557 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 34 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 msgr2=0x7ff14406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 0x7ff14406d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff150034000 tx=0x7ff15002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 msgr2=0x7ff164150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff15400e870 tx=0x7ff15400ed30 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 shutdown_connections 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff14406ac00 0x7ff14406d0c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff16415a520 0x7ff1641f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1640cde50 0x7ff164150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 --2- 172.21.15.33:0/3633327193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1640b1b00 0x7ff164150450 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.556+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 >> 172.21.15.33:0/3633327193 conn(0x7ff1640b0510 msgr2=0x7ff1640ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.557+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 shutdown_connections 2024-09-13T18:59:49.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.557+0000 7ff169600640 1 -- 172.21.15.33:0/3633327193 wait complete. 2024-09-13T18:59:49.575 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:59:49.575 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:59:49.575 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:59:49.575 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:49.576 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:59:49.576 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:59:49.576 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:59:49.576 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:49.576 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:59:49.576 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:59:49.576 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:59:49.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:49.577 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:59:49.577 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:59:49.577 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:59:49.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:59:49.590 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:59:49.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:59:49.591 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:59:49.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:59:49.594 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:59:49.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:59:49.595 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:59:49.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:59:49.634 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:59:49.635 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:49.637 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:59:49.637 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:49.638 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:59:49.638 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:49.640 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:59:49.641 DEBUG:teuthology.parallel:result is None 2024-09-13T18:59:49.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:59:49.766 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T18:59:49.767 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T18:59:49.768 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T18:59:49.768 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T18:59:49.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.809+0000 7f341fc00640 1 Processor -- start 2024-09-13T18:59:49.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.810+0000 7f341fc00640 1 -- start start 2024-09-13T18:59:49.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3418151590 0x7f341806b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341fc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34180b1b30 0x7f34180cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341fc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180b2270 con 0x7f34180cba50 2024-09-13T18:59:49.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341fc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180b2550 con 0x7f34180b1b30 2024-09-13T18:59:49.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180b2830 con 0x7f3418151590 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f3417e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34180b1b30 0x7f34180cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f341d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3418151590 0x7f341806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f3417e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34180b1b30 0x7f34180cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37116/0 (socket says 172.21.15.33:37116) 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.811+0000 7f3417e00640 1 -- 172.21.15.33:0/3146342891 learned_addr learned my addr 172.21.15.33:0/3146342891 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.812+0000 7f3417e00640 1 -- 172.21.15.33:0/3146342891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3418151590 msgr2=0x7f341806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.812+0000 7f3417e00640 1 --2- 172.21.15.33:0/3146342891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3418151590 0x7f341806b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.812+0000 7f3417e00640 1 -- 172.21.15.33:0/3146342891 >> v1:172.21.15.103:6789/0 conn(0x7f34180cba50 legacy=0x7f34180b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.812+0000 7f3417e00640 1 -- 172.21.15.33:0/3146342891 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180b2b10 con 0x7f34180b1b30 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f3417e00640 1 --2- 172.21.15.33:0/3146342891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f34180cdda0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3404009870 tx=0x7f340402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a99aca8f3ca26b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f3417400640 1 -- 172.21.15.33:0/3146342891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404032440 con 0x7f34180b1b30 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f3417400640 1 -- 172.21.15.33:0/3146342891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040325a0 con 0x7f34180b1b30 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f3417400640 1 -- 172.21.15.33:0/3146342891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404032930 con 0x7f34180b1b30 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 -- 172.21.15.33:0/3146342891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 msgr2=0x7f34180cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 --2- 172.21.15.33:0/3146342891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f34180cdda0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3404009870 tx=0x7f340402a270 comp rx=0 tx=0).stop 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 -- 172.21.15.33:0/3146342891 shutdown_connections 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 --2- 172.21.15.33:0/3146342891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f34180cdda0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 --2- 172.21.15.33:0/3146342891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3418151590 0x7f341806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.813+0000 7f341fc00640 1 -- 172.21.15.33:0/3146342891 >> 172.21.15.33:0/3146342891 conn(0x7f34180b0510 msgr2=0x7f34180b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.814+0000 7f341fc00640 1 -- 172.21.15.33:0/3146342891 shutdown_connections 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.814+0000 7f341fc00640 1 -- 172.21.15.33:0/3146342891 wait complete. 2024-09-13T18:59:49.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.815+0000 7f341fc00640 1 Processor -- start 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.815+0000 7f341fc00640 1 -- start start 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34180cba50 0x7f3418151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3418151590 0x7f341815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3418153780 con 0x7f34180b1b30 2024-09-13T18:59:49.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3418152280 con 0x7f3418151590 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341fc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34181542e0 con 0x7f34180cba50 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37124/0 (socket says 172.21.15.33:37124) 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.816+0000 7f341d200640 1 -- 172.21.15.33:0/3341543575 learned_addr learned my addr 172.21.15.33:0/3341543575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f3417e00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34180cba50 0x7f3418151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341dc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3418151590 0x7f341815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 -- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34180cba50 msgr2=0x7f3418151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34180cba50 0x7f3418151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 -- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3418151590 msgr2=0x7f341815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3418151590 0x7f341815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 -- 172.21.15.33:0/3341543575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040094d0 con 0x7f34180b1b30 2024-09-13T18:59:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f341d200640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f340c00e8a0 tx=0x7f340c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.817+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0094f0 con 0x7f34180b1b30 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.818+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00c940 con 0x7f34180b1b30 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.818+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ccf0 con 0x7f34180b1b30 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.818+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34181539b0 con 0x7f34180b1b30 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.818+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3418153f70 con 0x7f34180b1b30 2024-09-13T18:59:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.819+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341815e1d0 con 0x7f34180b1b30 2024-09-13T18:59:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.820+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f340c013470 con 0x7f34180b1b30 2024-09-13T18:59:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.821+0000 7f3414c00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 0x7f33f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.821+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f340c0894f0 con 0x7f34180b1b30 2024-09-13T18:59:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.821+0000 7f3417e00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 0x7f33f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.822+0000 7f3417e00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 0x7f33f806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3404034000 tx=0x7f340402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:49.825+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f340c054950 con 0x7f34180b1b30 2024-09-13T18:59:50.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.015+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f341815ed30 con 0x7f34180b1b30 2024-09-13T18:59:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.812+0000 7f3414c00640 1 -- 172.21.15.33:0/3341543575 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f340c017080 con 0x7f34180b1b30 2024-09-13T18:59:50.815 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T18:59:50.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.814+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 msgr2=0x7f33f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:50.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.814+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 0x7f33f806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3404034000 tx=0x7f340402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:50.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 msgr2=0x7f3418154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f340c00e8a0 tx=0x7f340c00ed60 comp rx=0 tx=0).stop 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 shutdown_connections 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33f806ac00 0x7f33f806d0c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3418151590 0x7f341815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34180cba50 0x7f3418151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 --2- 172.21.15.33:0/3341543575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34180b1b30 0x7f3418154770 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 >> 172.21.15.33:0/3341543575 conn(0x7f34180b0510 msgr2=0x7f34180b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 shutdown_connections 2024-09-13T18:59:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.815+0000 7f341fc00640 1 -- 172.21.15.33:0/3341543575 wait complete. 2024-09-13T18:59:50.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:59:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.993+0000 7f03b7800640 1 Processor -- start 2024-09-13T18:59:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.993+0000 7f03b7800640 1 -- start start 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03b00b3a40 0x7f03b01428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b00b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03b00b2e90 0x7f03b00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b006cca0 con 0x7f03b00b2e90 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b013fbc0 con 0x7f03b00b3a40 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b7800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b015ce80 con 0x7f03b0160370 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b5800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03b00b2e90 0x7f03b00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.994+0000 7f03b5800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03b00b2e90 0x7f03b00ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37138/0 (socket says 172.21.15.33:37138) 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 -- 172.21.15.33:0/3781074515 learned_addr learned my addr 172.21.15.33:0/3781074515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b4e00640 1 --2- 172.21.15.33:0/3781074515 >> v2:172.21.15.103:3300/0 conn(0x7f03b00b3a40 0x7f03b01428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03afe00640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b00b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 -- 172.21.15.33:0/3781074515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 msgr2=0x7f03b00b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b00b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 -- 172.21.15.33:0/3781074515 >> v2:172.21.15.103:3300/0 conn(0x7f03b00b3a40 msgr2=0x7f03b01428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 --2- 172.21.15.33:0/3781074515 >> v2:172.21.15.103:3300/0 conn(0x7f03b00b3a40 0x7f03b01428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.995+0000 7f03b5800640 1 -- 172.21.15.33:0/3781074515 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0142de0 con 0x7f03b00b2e90 2024-09-13T18:59:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.996+0000 7f03b5800640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b00ac870 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f03b00b1420 tx=0x7f03a802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894664b4b3ef1a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.996+0000 7f03af400640 1 -- 172.21.15.33:0/3781074515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8031600 con 0x7f03b00b2e90 2024-09-13T18:59:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.996+0000 7f03af400640 1 -- 172.21.15.33:0/3781074515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a802d050 con 0x7f03b00b2e90 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.996+0000 7f03af400640 1 -- 172.21.15.33:0/3781074515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8031980 con 0x7f03b00b2e90 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 -- 172.21.15.33:0/3781074515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 msgr2=0x7f03b00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b00ac870 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f03b00b1420 tx=0x7f03a802a610 comp rx=0 tx=0).stop 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 -- 172.21.15.33:0/3781074515 shutdown_connections 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b00b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 --2- 172.21.15.33:0/3781074515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b00ac870 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 --2- 172.21.15.33:0/3781074515 >> v2:172.21.15.103:3300/0 conn(0x7f03b00b3a40 0x7f03b01428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 -- 172.21.15.33:0/3781074515 >> 172.21.15.33:0/3781074515 conn(0x7f03b00b0510 msgr2=0x7f03b00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 -- 172.21.15.33:0/3781074515 shutdown_connections 2024-09-13T18:59:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.997+0000 7f03b7800640 1 -- 172.21.15.33:0/3781074515 wait complete. 2024-09-13T18:59:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.999+0000 7f03b7800640 1 Processor -- start 2024-09-13T18:59:51.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:50.999+0000 7f03b7800640 1 -- start start 2024-09-13T18:59:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03b00b3a40 0x7f03b0140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b0154910 con 0x7f03b00b2e90 2024-09-13T18:59:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b01f3200 con 0x7f03b00b3a40 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b7800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b0154b80 con 0x7f03b0160370 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37148/0 (socket says 172.21.15.33:37148) 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 -- 172.21.15.33:0/1749338104 learned_addr learned my addr 172.21.15.33:0/1749338104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03afe00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03b00b3a40 0x7f03b0140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b5800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 -- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 msgr2=0x7f03b01412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b01412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 -- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03b00b3a40 msgr2=0x7f03b0140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03b00b3a40 0x7f03b0140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.000+0000 7f03b4e00640 1 -- 172.21.15.33:0/1749338104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009b30 con 0x7f03b00b2e90 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03b4e00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f03a400d800 tx=0x7f03a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40096a0 con 0x7f03b00b2e90 2024-09-13T18:59:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4009800 con 0x7f03b00b2e90 2024-09-13T18:59:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4009b90 con 0x7f03b00b2e90 2024-09-13T18:59:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b0154e60 con 0x7f03b00b2e90 2024-09-13T18:59:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.001+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b01f66a0 con 0x7f03b00b2e90 2024-09-13T18:59:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.002+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b01428a0 con 0x7f03b00b2e90 2024-09-13T18:59:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.003+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03a4009cf0 con 0x7f03b00b2e90 2024-09-13T18:59:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.004+0000 7f03acc00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 0x7f039006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.004+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03a4089390 con 0x7f03b00b2e90 2024-09-13T18:59:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.004+0000 7f03afe00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 0x7f039006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.005+0000 7f03afe00640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 0x7f039006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03b00b0b10 tx=0x7f039c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.009+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f03a40548d0 con 0x7f03b00b2e90 2024-09-13T18:59:51.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.252+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f03b00ce4d0 con 0x7f03b00b2e90 2024-09-13T18:59:51.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.252+0000 7f03acc00640 1 -- 172.21.15.33:0/1749338104 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f03a400b440 con 0x7f03b00b2e90 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T18:59:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T18:59:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T18:59:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T18:59:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T18:59:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T18:59:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T18:59:51.271 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T18:59:51.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 msgr2=0x7f039006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 0x7f039006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03b00b0b10 tx=0x7f039c008040 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 msgr2=0x7f03b01f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f03a400d800 tx=0x7f03a400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 shutdown_connections 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f039006ac00 0x7f039006d0c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03b0160370 0x7f03b01412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03b00b3a40 0x7f03b0140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.254+0000 7f03b7800640 1 --2- 172.21.15.33:0/1749338104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03b00b2e90 0x7f03b01f2cc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.255+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 >> 172.21.15.33:0/1749338104 conn(0x7f03b00b0510 msgr2=0x7f03b015fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.255+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 shutdown_connections 2024-09-13T18:59:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.255+0000 7f03b7800640 1 -- 172.21.15.33:0/1749338104 wait complete. 2024-09-13T18:59:51.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.428+0000 7f3db0200640 1 Processor -- start 2024-09-13T18:59:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.428+0000 7f3db0200640 1 -- start start 2024-09-13T18:59:51.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.429+0000 7f3db0200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 0x7f3da8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.429+0000 7f3db0200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3da806f660 0x7f3da806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.429+0000 7f3db0200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da8159fc0 con 0x7f3da8153b20 2024-09-13T18:59:51.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.429+0000 7f3db0200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80b3df0 con 0x7f3da806f660 2024-09-13T18:59:51.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.429+0000 7f3db0200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80ce600 con 0x7f3da80b3990 2024-09-13T18:59:51.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dae200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3da806f660 0x7f3da806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dace00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 0x7f3da8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dad800640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3da8153b20 0x7f3da80b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:50724/0 (socket says 172.21.15.33:50724) 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dad800640 1 -- 172.21.15.33:0/897023262 learned_addr learned my addr 172.21.15.33:0/897023262 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dae200640 1 -- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 msgr2=0x7f3da8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dae200640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 0x7f3da8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dae200640 1 -- 172.21.15.33:0/897023262 >> v1:172.21.15.103:6789/0 conn(0x7f3da8153b20 legacy=0x7f3da80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dae200640 1 -- 172.21.15.33:0/897023262 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8153f00 con 0x7f3da806f660 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3da7e00640 1 -- 172.21.15.33:0/897023262 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131101027 0 0) 0x7f3da8159fc0 con 0x7f3da8153b20 2024-09-13T18:59:51.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.430+0000 7f3dace00640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 0x7f3da8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:51.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.431+0000 7f3dae200640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da806f660 0x7f3da806faf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009d90 tx=0x7f3da002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f0b198d8760f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3da7e00640 1 -- 172.21.15.33:0/897023262 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0007740 con 0x7f3da806f660 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3da7e00640 1 -- 172.21.15.33:0/897023262 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da002d050 con 0x7f3da806f660 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3da7e00640 1 -- 172.21.15.33:0/897023262 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0007ac0 con 0x7f3da806f660 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 -- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da806f660 msgr2=0x7f3da806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da806f660 0x7f3da806faf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009d90 tx=0x7f3da002a660 comp rx=0 tx=0).stop 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 -- 172.21.15.33:0/897023262 shutdown_connections 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da806f660 0x7f3da806faf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 --2- 172.21.15.33:0/897023262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da80b3990 0x7f3da8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 -- 172.21.15.33:0/897023262 >> 172.21.15.33:0/897023262 conn(0x7f3da80b0510 msgr2=0x7f3da80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 -- 172.21.15.33:0/897023262 shutdown_connections 2024-09-13T18:59:51.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.432+0000 7f3db0200640 1 -- 172.21.15.33:0/897023262 wait complete. 2024-09-13T18:59:51.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.434+0000 7f3db0200640 1 Processor -- start 2024-09-13T18:59:51.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.434+0000 7f3db0200640 1 -- start start 2024-09-13T18:59:51.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 0x7f3da81f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 0x7f3da81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da81f39b0 con 0x7f3da8153b20 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da81f3c80 con 0x7f3da80b3990 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3db0200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da81f3f60 con 0x7f3da806f660 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dad800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 0x7f3da81f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dae200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 0x7f3da81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dace00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dad800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 0x7f3da81f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:42580/0 (socket says 172.21.15.33:42580) 2024-09-13T18:59:51.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dace00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:47902/0 (socket says 172.21.15.33:47902) 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.435+0000 7f3dad800640 1 -- 172.21.15.33:0/786661427 learned_addr learned my addr 172.21.15.33:0/786661427 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 -- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 msgr2=0x7f3da81f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 0x7f3da81f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 -- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 msgr2=0x7f3da8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 -- 172.21.15.33:0/786661427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009400 con 0x7f3da8153b20 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dace00640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3dae200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 0x7f3da81550e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3da0031000 tx=0x7f3da0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.436+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da003b820 con 0x7f3da8153b20 2024-09-13T18:59:51.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.437+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da003b9a0 con 0x7f3da8153b20 2024-09-13T18:59:51.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.437+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da003bd50 con 0x7f3da8153b20 2024-09-13T18:59:51.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.437+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0009a70 con 0x7f3da8153b20 2024-09-13T18:59:51.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.437+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80ac970 con 0x7f3da8153b20 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.438+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da815a7b0 con 0x7f3da8153b20 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.439+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3da0031400 con 0x7f3da8153b20 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.440+0000 7f3da5600640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.440+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3da00aa800 con 0x7f3da8153b20 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.440+0000 7f3dad800640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.441+0000 7f3dad800640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 0x7f3d8806d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c007e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.445+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3da0075ef0 con 0x7f3da8153b20 2024-09-13T18:59:51.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.626+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3da8071710 con 0x7f3da8153b20 2024-09-13T18:59:51.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.627+0000 7f3da5600640 1 -- 172.21.15.33:0/786661427 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f3da0079510 con 0x7f3da8153b20 2024-09-13T18:59:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:51.630 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:50.808309+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:51.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 msgr2=0x7f3d8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 0x7f3d8806d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c007e10 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 msgr2=0x7f3da81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 0x7f3da81550e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3da0031000 tx=0x7f3da0004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 shutdown_connections 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3da8153b20 0x7f3da81550e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da80b3990 0x7f3da8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 --2- 172.21.15.33:0/786661427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3da806f660 0x7f3da81f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 >> 172.21.15.33:0/786661427 conn(0x7f3da80b0510 msgr2=0x7f3da80b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 shutdown_connections 2024-09-13T18:59:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.630+0000 7f3db0200640 1 -- 172.21.15.33:0/786661427 wait complete. 2024-09-13T18:59:51.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:59:51.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:59:51.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.804+0000 7f5caf200640 1 Processor -- start 2024-09-13T18:59:51.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.805+0000 7f5caf200640 1 -- start start 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5caf200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5cb01594a0 0x7f5cb00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5caf200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00cc370 con 0x7f5cb00b2e20 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5caf200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00cd1b0 con 0x7f5cb015d980 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5caf200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb0159880 con 0x7f5cb01594a0 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5cae800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5cb00b2e20 0x7f5cb006f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59830/0 (socket says 172.21.15.33:59830) 2024-09-13T18:59:51.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5cae800640 1 -- 172.21.15.33:0/1792812505 learned_addr learned my addr 172.21.15.33:0/1792812505 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.806+0000 7f5cade00640 1 --2- 172.21.15.33:0/1792812505 >> v2:172.21.15.103:3300/0 conn(0x7f5cb01594a0 0x7f5cb00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.807+0000 7f5cad400640 1 -- 172.21.15.33:0/1792812505 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208705776 0 0) 0x7f5cb00cc370 con 0x7f5cb00b2e20 2024-09-13T18:59:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.807+0000 7f5cad400640 1 -- 172.21.15.33:0/1792812505 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c94003520 con 0x7f5cb00b2e20 2024-09-13T18:59:51.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.807+0000 7f5cade00640 1 -- 172.21.15.33:0/1792812505 >> v1:172.21.15.103:6789/0 conn(0x7f5cb015d980 legacy=0x7f5cb00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.807+0000 7f5cade00640 1 -- 172.21.15.33:0/1792812505 >> v1:172.21.15.33:6789/0 conn(0x7f5cb00b2e20 legacy=0x7f5cb006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.807+0000 7f5cade00640 1 -- 172.21.15.33:0/1792812505 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00cc5a0 con 0x7f5cb01594a0 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.808+0000 7f5cade00640 1 --2- 172.21.15.33:0/1792812505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb01594a0 0x7f5cb00cdf10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00097a0 tx=0x7f5ca002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00c951033edfe94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.808+0000 7f5cad400640 1 -- 172.21.15.33:0/1792812505 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0032440 con 0x7f5cb01594a0 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.808+0000 7f5cad400640 1 -- 172.21.15.33:0/1792812505 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca00325a0 con 0x7f5cb01594a0 2024-09-13T18:59:51.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.808+0000 7f5cad400640 1 -- 172.21.15.33:0/1792812505 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0032930 con 0x7f5cb01594a0 2024-09-13T18:59:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 -- 172.21.15.33:0/1792812505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb01594a0 msgr2=0x7f5cb00cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 --2- 172.21.15.33:0/1792812505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb01594a0 0x7f5cb00cdf10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00097a0 tx=0x7f5ca002a230 comp rx=0 tx=0).stop 2024-09-13T18:59:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 -- 172.21.15.33:0/1792812505 shutdown_connections 2024-09-13T18:59:51.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 --2- 172.21.15.33:0/1792812505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb01594a0 0x7f5cb00cdf10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 -- 172.21.15.33:0/1792812505 >> 172.21.15.33:0/1792812505 conn(0x7f5cb00b0200 msgr2=0x7f5cb00b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:51.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 -- 172.21.15.33:0/1792812505 shutdown_connections 2024-09-13T18:59:51.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.809+0000 7f5caf200640 1 -- 172.21.15.33:0/1792812505 wait complete. 2024-09-13T18:59:51.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.811+0000 7f5caf200640 1 Processor -- start 2024-09-13T18:59:51.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.811+0000 7f5caf200640 1 -- start start 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 0x7f5cb0147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 0x7f5cb01e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb015a420 con 0x7f5cb01594a0 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb015a700 con 0x7f5cb00b2e20 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5caf200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb015a9e0 con 0x7f5cb015d980 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37170/0 (socket says 172.21.15.33:37170) 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 -- 172.21.15.33:0/4122645471 learned_addr learned my addr 172.21.15.33:0/4122645471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5cade00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 0x7f5cb0147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5cae800640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 0x7f5cb01e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 -- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 msgr2=0x7f5cb01e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 0x7f5cb01e46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 -- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 msgr2=0x7f5cb0147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 0x7f5cb0147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5ca7e00640 1 -- 172.21.15.33:0/4122645471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009400 con 0x7f5cb01594a0 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5cade00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 0x7f5cb0147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.812+0000 7f5cae800640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 0x7f5cb01e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:59:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.813+0000 7f5ca7e00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c400 tx=0x7f5c9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.814+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980052d0 con 0x7f5cb01594a0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.814+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98005430 con 0x7f5cb01594a0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.814+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003830 con 0x7f5cb01594a0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.814+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb015acc0 con 0x7f5cb01594a0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.814+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb01e2f50 con 0x7f5cb01594a0 2024-09-13T18:59:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.816+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb015b1e0 con 0x7f5cb01594a0 2024-09-13T18:59:51.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.816+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c98003990 con 0x7f5cb01594a0 2024-09-13T18:59:51.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.817+0000 7f5ca6000640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 0x7f5c8c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:51.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.817+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c98088580 con 0x7f5cb01594a0 2024-09-13T18:59:51.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.818+0000 7f5cade00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 0x7f5c8c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:51.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.819+0000 7f5cade00640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 0x7f5c8c06d0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0034000 tx=0x7f5ca002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:51.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.821+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5cb015b1e0 con 0x7f5cb01594a0 2024-09-13T18:59:52.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.998+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cb015b1e0 con 0x7f5cb01594a0 2024-09-13T18:59:52.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:51.998+0000 7f5ca6000640 1 -- 172.21.15.33:0/4122645471 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cb015b1e0 con 0x7f5cb01594a0 2024-09-13T18:59:52.001 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 msgr2=0x7f5c8c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 0x7f5c8c06d0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0034000 tx=0x7f5ca002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 msgr2=0x7f5cb01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c400 tx=0x7f5c9800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 shutdown_connections 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c8c06ac30 0x7f5c8c06d0f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5cb015d980 0x7f5cb01e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cb01594a0 0x7f5cb01599f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 --2- 172.21.15.33:0/4122645471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cb00b2e20 0x7f5cb0147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 >> 172.21.15.33:0/4122645471 conn(0x7f5cb00b0200 msgr2=0x7f5cb006fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:52.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 shutdown_connections 2024-09-13T18:59:52.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.000+0000 7f5caf200640 1 -- 172.21.15.33:0/4122645471 wait complete. 2024-09-13T18:59:52.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:59:52.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.171+0000 7fd1ace00640 1 Processor -- start 2024-09-13T18:59:52.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.171+0000 7fd1ace00640 1 -- start start 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1ace00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 0x7fd1a8165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1ace00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a806d510 con 0x7fd1a806ce90 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1ace00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80b17b0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1ace00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a806d300 con 0x7fd1a80b32a0 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd19ea00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd1a806ce90 0x7fd1a80cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59832/0 (socket says 172.21.15.33:59832) 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd19ea00640 1 -- 172.21.15.33:0/3231529672 learned_addr learned my addr 172.21.15.33:0/3231529672 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1a7e00640 1 --2- 172.21.15.33:0/3231529672 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 0x7fd1a8165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.173+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782800991 0 0) 0x7fd1a806d510 con 0x7fd1a806ce90 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd18c003520 con 0x7fd1a806ce90 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138898515 0 0) 0x7fd1a80b17b0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a806d510 con 0x7fd1a815a3d0 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a7e00640 1 -- 172.21.15.33:0/3231529672 >> v1:172.21.15.103:6789/0 conn(0x7fd1a815a3d0 legacy=0x7fd1a80cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2324992582 0 0) 0x7fd18c003520 con 0x7fd1a806ce90 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a7e00640 1 -- 172.21.15.33:0/3231529672 >> v1:172.21.15.33:6789/0 conn(0x7fd1a806ce90 legacy=0x7fd1a80cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.174+0000 7fd1a7e00640 1 -- 172.21.15.33:0/3231529672 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80b1a90 con 0x7fd1a80b32a0 2024-09-13T18:59:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.175+0000 7fd1a7e00640 1 --2- 172.21.15.33:0/3231529672 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 0x7fd1a8165330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009df0 tx=0x7fd1a002a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33c95dee8346eadc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.175+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190001670 con 0x7fd1a80b32a0 2024-09-13T18:59:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.175+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a002d050 con 0x7fd1a80b32a0 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.175+0000 7fd1a6a00640 1 -- 172.21.15.33:0/3231529672 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0007540 con 0x7fd1a80b32a0 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 -- 172.21.15.33:0/3231529672 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 msgr2=0x7fd1a8165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 --2- 172.21.15.33:0/3231529672 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 0x7fd1a8165330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009df0 tx=0x7fd1a002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 -- 172.21.15.33:0/3231529672 shutdown_connections 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 --2- 172.21.15.33:0/3231529672 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a80b32a0 0x7fd1a8165330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 -- 172.21.15.33:0/3231529672 >> 172.21.15.33:0/3231529672 conn(0x7fd1a80b0330 msgr2=0x7fd1a80b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 -- 172.21.15.33:0/3231529672 shutdown_connections 2024-09-13T18:59:52.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.176+0000 7fd1ace00640 1 -- 172.21.15.33:0/3231529672 wait complete. 2024-09-13T18:59:52.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.178+0000 7fd1ace00640 1 Processor -- start 2024-09-13T18:59:52.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.178+0000 7fd1ace00640 1 -- start start 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a806ce90 0x7fd1a8156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1a80b32a0 0x7fd1a81e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a815b180 con 0x7fd1a815a3d0 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8156570 con 0x7fd1a80b32a0 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1ace00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a81e8300 con 0x7fd1a806ce90 2024-09-13T18:59:52.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37186/0 (socket says 172.21.15.33:37186) 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1a7e00640 1 -- 172.21.15.33:0/2087244070 learned_addr learned my addr 172.21.15.33:0/2087244070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd19ea00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1a80b32a0 0x7fd1a81e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.179+0000 7fd1a7400640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a806ce90 0x7fd1a8156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 -- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a806ce90 msgr2=0x7fd1a8156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a806ce90 0x7fd1a8156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 -- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1a80b32a0 msgr2=0x7fd1a81e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1a80b32a0 0x7fd1a81e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 -- 172.21.15.33:0/2087244070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0009a70 con 0x7fd1a815a3d0 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1a7e00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009df0 tx=0x7fd1a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0004880 con 0x7fd1a815a3d0 2024-09-13T18:59:52.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a0003e10 con 0x7fd1a815a3d0 2024-09-13T18:59:52.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0007760 con 0x7fd1a815a3d0 2024-09-13T18:59:52.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.180+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a815a930 con 0x7fd1a815a3d0 2024-09-13T18:59:52.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.181+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a81e88c0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.181+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80b17b0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.182+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1a00078c0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.183+0000 7fd19fe00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 0x7fd18406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.183+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1a00aa0c0 con 0x7fd1a815a3d0 2024-09-13T18:59:52.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.184+0000 7fd1a7400640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 0x7fd18406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.184+0000 7fd1a7400640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 0x7fd18406d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1980011e0 tx=0x7fd198009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.187+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd1a0075570 con 0x7fd1a815a3d0 2024-09-13T18:59:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.367+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1a8073410 con 0x7fd1a815a3d0 2024-09-13T18:59:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.368+0000 7fd19fe00640 1 -- 172.21.15.33:0/2087244070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd1a0078b90 con 0x7fd1a815a3d0 2024-09-13T18:59:52.370 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:52.370 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T18:59:52.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T18:59:52.371 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T18:59:52.371 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T18:59:52.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T18:59:52.371 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T18:59:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 msgr2=0x7fd18406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 0x7fd18406d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1980011e0 tx=0x7fd198009040 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 msgr2=0x7fd1a81e7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009df0 tx=0x7fd1a0004a40 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 shutdown_connections 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd18406ac30 0x7fd18406d0f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a815a3d0 0x7fd1a81e7c80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1a80b32a0 0x7fd1a81e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 --2- 172.21.15.33:0/2087244070 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1a806ce90 0x7fd1a8156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 >> 172.21.15.33:0/2087244070 conn(0x7fd1a80b0330 msgr2=0x7fd1a806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 shutdown_connections 2024-09-13T18:59:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.370+0000 7fd1ace00640 1 -- 172.21.15.33:0/2087244070 wait complete. 2024-09-13T18:59:52.388 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:59:52.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:59:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.545+0000 7f209ae00640 1 Processor -- start 2024-09-13T18:59:52.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.545+0000 7f209ae00640 1 -- start start 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f209ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20940cdf80 0x7f20940b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f209ae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2094151a20 con 0x7f209415b770 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f209ae00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20940cc430 con 0x7f209406cd60 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f209ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940b1bb0 con 0x7f20940cdf80 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f208b400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f209415b770 0x7f20940cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59846/0 (socket says 172.21.15.33:59846) 2024-09-13T18:59:52.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f208b400640 1 -- 172.21.15.33:0/2216718546 learned_addr learned my addr 172.21.15.33:0/2216718546 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f2098e00640 1 --2- 172.21.15.33:0/2216718546 >> v2:172.21.15.103:3300/0 conn(0x7f20940cdf80 0x7f20940b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557581633 0 0) 0x7f2094151a20 con 0x7f209415b770 2024-09-13T18:59:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2078003520 con 0x7f209415b770 2024-09-13T18:59:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912260981 0 0) 0x7f20940cc430 con 0x7f209406cd60 2024-09-13T18:59:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.547+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2094151a20 con 0x7f209406cd60 2024-09-13T18:59:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.548+0000 7f2098e00640 1 -- 172.21.15.33:0/2216718546 >> v1:172.21.15.103:6789/0 conn(0x7f209406cd60 legacy=0x7f20940cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.548+0000 7f2098e00640 1 -- 172.21.15.33:0/2216718546 >> v1:172.21.15.33:6789/0 conn(0x7f209415b770 legacy=0x7f20940cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.548+0000 7f2098e00640 1 -- 172.21.15.33:0/2216718546 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20940b1e70 con 0x7f20940cdf80 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f2098e00640 1 --2- 172.21.15.33:0/2216718546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20940cdf80 0x7f20940b2950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f208c009d90 tx=0x7f208c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe20d8b7c4a2154 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c007740 con 0x7f20940cdf80 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c02d050 con 0x7f20940cdf80 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f2093400640 1 -- 172.21.15.33:0/2216718546 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c007ac0 con 0x7f20940cdf80 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f209ae00640 1 -- 172.21.15.33:0/2216718546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20940cdf80 msgr2=0x7f20940b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.549+0000 7f209ae00640 1 --2- 172.21.15.33:0/2216718546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20940cdf80 0x7f20940b2950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f208c009d90 tx=0x7f208c02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.550+0000 7f209ae00640 1 -- 172.21.15.33:0/2216718546 shutdown_connections 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.550+0000 7f209ae00640 1 --2- 172.21.15.33:0/2216718546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20940cdf80 0x7f20940b2950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.550+0000 7f209ae00640 1 -- 172.21.15.33:0/2216718546 >> 172.21.15.33:0/2216718546 conn(0x7f20940b0510 msgr2=0x7f20940b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.550+0000 7f209ae00640 1 -- 172.21.15.33:0/2216718546 shutdown_connections 2024-09-13T18:59:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.550+0000 7f209ae00640 1 -- 172.21.15.33:0/2216718546 wait complete. 2024-09-13T18:59:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.551+0000 7f209ae00640 1 Processor -- start 2024-09-13T18:59:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 -- start start 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20940cdf80 0x7f20941544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209415b770 0x7f2094152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094144800 con 0x7f209406cd60 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094154a00 con 0x7f209415b770 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.552+0000 7f209ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2094153420 con 0x7f20940cdf80 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37194/0 (socket says 172.21.15.33:37194) 2024-09-13T18:59:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 -- 172.21.15.33:0/3982244380 learned_addr learned my addr 172.21.15.33:0/3982244380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f208b400640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20940cdf80 0x7f20941544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2098e00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209415b770 0x7f2094152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 -- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20940cdf80 msgr2=0x7f20941544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20940cdf80 0x7f20941544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 -- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209415b770 msgr2=0x7f2094152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209415b770 0x7f2094152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.553+0000 7f2093e00640 1 -- 172.21.15.33:0/3982244380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009a70 con 0x7f209406cd60 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f2093e00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f208400c490 tx=0x7f208400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20840052d0 con 0x7f209406cd60 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084005430 con 0x7f209406cd60 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084012870 con 0x7f209406cd60 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2094153700 con 0x7f209406cd60 2024-09-13T18:59:52.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.554+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2094153cc0 con 0x7f209406cd60 2024-09-13T18:59:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.555+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940b2950 con 0x7f209406cd60 2024-09-13T18:59:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.556+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20840129d0 con 0x7f209406cd60 2024-09-13T18:59:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.557+0000 7f2090c00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 0x7f207006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.557+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2084088b60 con 0x7f209406cd60 2024-09-13T18:59:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.557+0000 7f208b400640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 0x7f207006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:52.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.558+0000 7f208b400640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 0x7f207006d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2094150f30 tx=0x7f207c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.561+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f20840540a0 con 0x7f209406cd60 2024-09-13T18:59:52.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:52.739+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20940b0a90 con 0x7f209406cd60 2024-09-13T18:59:53.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.462+0000 7f2090c00640 1 -- 172.21.15.33:0/3982244380 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20840576c0 con 0x7f209406cd60 2024-09-13T18:59:53.464 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T18:59:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 msgr2=0x7f207006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 0x7f207006d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2094150f30 tx=0x7f207c009040 comp rx=0 tx=0).stop 2024-09-13T18:59:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 msgr2=0x7f20941442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f208400c490 tx=0x7f208400c950 comp rx=0 tx=0).stop 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 shutdown_connections 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f207006ac00 0x7f207006d0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f209415b770 0x7f2094152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20940cdf80 0x7f20941544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 --2- 172.21.15.33:0/3982244380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f209406cd60 0x7f20941442c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 >> 172.21.15.33:0/3982244380 conn(0x7f20940b0510 msgr2=0x7f2094151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 shutdown_connections 2024-09-13T18:59:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.465+0000 7f209ae00640 1 -- 172.21.15.33:0/3982244380 wait complete. 2024-09-13T18:59:53.488 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:59:53.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.649+0000 7f03a8a00640 1 Processor -- start 2024-09-13T18:59:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.649+0000 7f03a8a00640 1 -- start start 2024-09-13T18:59:53.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.650+0000 7f03a8a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a4071690 0x7f03a415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.650+0000 7f03a8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 0x7f03a40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.650+0000 7f03a8a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a406f5f0 con 0x7f03a4156f60 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f03a8a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a415aa30 con 0x7f03a4071690 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f03a8a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a4070450 con 0x7f03a40cafa0 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a4071690 0x7f03a415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a4071690 0x7f03a415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43078/0 (socket says 172.21.15.33:43078) 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 -- 172.21.15.33:0/2825330408 learned_addr learned my addr 172.21.15.33:0/2825330408 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f03a2800640 1 --2- 172.21.15.33:0/2825330408 >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 0x7f03a40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 -- 172.21.15.33:0/2825330408 >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 msgr2=0x7f03a40cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 --2- 172.21.15.33:0/2825330408 >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 0x7f03a40cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 -- 172.21.15.33:0/2825330408 >> v1:172.21.15.103:6789/0 conn(0x7f03a4156f60 legacy=0x7f03a4070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f0399400640 1 -- 172.21.15.33:0/2825330408 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a406f840 con 0x7f03a4071690 2024-09-13T18:59:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.651+0000 7f03a2800640 1 --2- 172.21.15.33:0/2825330408 >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 0x7f03a40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.652+0000 7f0399400640 1 --2- 172.21.15.33:0/2825330408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a415a4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f03a4159a70 tx=0x7f038c02c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bacba84636d6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a1400640 1 -- 172.21.15.33:0/2825330408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c031710 con 0x7f03a4071690 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a1400640 1 -- 172.21.15.33:0/2825330408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c02f050 con 0x7f03a4071690 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a1400640 1 -- 172.21.15.33:0/2825330408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c031a90 con 0x7f03a4071690 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 -- 172.21.15.33:0/2825330408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 msgr2=0x7f03a415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 --2- 172.21.15.33:0/2825330408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a415a4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f03a4159a70 tx=0x7f038c02c480 comp rx=0 tx=0).stop 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 -- 172.21.15.33:0/2825330408 shutdown_connections 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 --2- 172.21.15.33:0/2825330408 >> v2:172.21.15.103:3300/0 conn(0x7f03a40cafa0 0x7f03a40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 --2- 172.21.15.33:0/2825330408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a415a4f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 -- 172.21.15.33:0/2825330408 >> 172.21.15.33:0/2825330408 conn(0x7f03a40b0580 msgr2=0x7f03a40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 -- 172.21.15.33:0/2825330408 shutdown_connections 2024-09-13T18:59:53.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.653+0000 7f03a8a00640 1 -- 172.21.15.33:0/2825330408 wait complete. 2024-09-13T18:59:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.655+0000 7f03a8a00640 1 Processor -- start 2024-09-13T18:59:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.655+0000 7f03a8a00640 1 -- start start 2024-09-13T18:59:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03a40cafa0 0x7f03a415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03a4156f60 0x7f03a40b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4153500 con 0x7f03a4071690 2024-09-13T18:59:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a41537e0 con 0x7f03a40cafa0 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4153ac0 con 0x7f03a4156f60 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43080/0 (socket says 172.21.15.33:43080) 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a1e00640 1 -- 172.21.15.33:0/4150240091 learned_addr learned my addr 172.21.15.33:0/4150240091 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f0399400640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03a40cafa0 0x7f03a415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.656+0000 7f03a2800640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03a4156f60 0x7f03a40b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 -- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03a4156f60 msgr2=0x7f03a40b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03a4156f60 0x7f03a40b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 -- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03a40cafa0 msgr2=0x7f03a415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03a40cafa0 0x7f03a415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 -- 172.21.15.33:0/4150240091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0094d0 con 0x7f03a4071690 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a1e00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f039400c400 tx=0x7f039400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940052d0 con 0x7f03a4071690 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394005430 con 0x7f03a4071690 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394003830 con 0x7f03a4071690 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a4153da0 con 0x7f03a4071690 2024-09-13T18:59:53.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.657+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a414b610 con 0x7f03a4071690 2024-09-13T18:59:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.658+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a4157340 con 0x7f03a4071690 2024-09-13T18:59:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.659+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0394003990 con 0x7f03a4071690 2024-09-13T18:59:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.660+0000 7f039aa00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 0x7f038006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.660+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f03940886e0 con 0x7f03a4071690 2024-09-13T18:59:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.661+0000 7f0399400640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 0x7f038006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.661+0000 7f0399400640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 0x7f038006d0c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f038c035000 tx=0x7f038c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.665+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0394053ab0 con 0x7f03a4071690 2024-09-13T18:59:53.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:53.844+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f03a40c3c80 con 0x7f03a4071690 2024-09-13T18:59:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.468+0000 7f039aa00640 1 -- 172.21.15.33:0/4150240091 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0394088020 con 0x7f03a4071690 2024-09-13T18:59:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T18:59:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.474+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 msgr2=0x7f038006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.474+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 0x7f038006d0c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f038c035000 tx=0x7f038c008030 comp rx=0 tx=0).stop 2024-09-13T18:59:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.474+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 msgr2=0x7f03a414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.474+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f039400c400 tx=0x7f039400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 shutdown_connections 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f038006ac00 0x7f038006d0c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03a4156f60 0x7f03a40b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03a40cafa0 0x7f03a415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 --2- 172.21.15.33:0/4150240091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a4071690 0x7f03a414b0d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.475+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 >> 172.21.15.33:0/4150240091 conn(0x7f03a40b0580 msgr2=0x7f03a40cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:54.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.477+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 shutdown_connections 2024-09-13T18:59:54.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.477+0000 7f03a8a00640 1 -- 172.21.15.33:0/4150240091 wait complete. 2024-09-13T18:59:54.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:59:54.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.663+0000 7f7459600640 1 Processor -- start 2024-09-13T18:59:54.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.663+0000 7f7459600640 1 -- start start 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.664+0000 7f7459600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 0x7f745415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.664+0000 7f7459600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.664+0000 7f7459600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745406f5f0 con 0x7f7454156f60 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.664+0000 7f7459600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745415aa30 con 0x7f7454071690 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.664+0000 7f7459600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454070450 con 0x7f74540cafa0 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7452000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 0x7f745415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:35294/0 (socket says 172.21.15.33:35294) 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 -- 172.21.15.33:0/792592078 learned_addr learned my addr 172.21.15.33:0/792592078 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7452a00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7454156f60 0x7f7454070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:38598/0 (socket says 172.21.15.33:38598) 2024-09-13T18:59:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7451600640 1 -- 172.21.15.33:0/792592078 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016659605 0 0) 0x7f745406f5f0 con 0x7f7454156f60 2024-09-13T18:59:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7451600640 1 -- 172.21.15.33:0/792592078 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7438003520 con 0x7f7454156f60 2024-09-13T18:59:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 -- 172.21.15.33:0/792592078 >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 msgr2=0x7f745415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 --2- 172.21.15.33:0/792592078 >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 0x7f745415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 -- 172.21.15.33:0/792592078 >> v1:172.21.15.103:6789/0 conn(0x7f7454156f60 legacy=0x7f7454070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7453400640 1 -- 172.21.15.33:0/792592078 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745406f840 con 0x7f74540cafa0 2024-09-13T18:59:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.665+0000 7f7452000640 1 --2- 172.21.15.33:0/792592078 >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 0x7f745415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.666+0000 7f7453400640 1 --2- 172.21.15.33:0/792592078 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d150 tx=0x7f744c02c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8217ea9bdb497f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7451600640 1 -- 172.21.15.33:0/792592078 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c009600 con 0x7f74540cafa0 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7451600640 1 -- 172.21.15.33:0/792592078 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c02e040 con 0x7f74540cafa0 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7451600640 1 -- 172.21.15.33:0/792592078 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c009960 con 0x7f74540cafa0 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 -- 172.21.15.33:0/792592078 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 msgr2=0x7f74540cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 --2- 172.21.15.33:0/792592078 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d150 tx=0x7f744c02c920 comp rx=0 tx=0).stop 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 -- 172.21.15.33:0/792592078 shutdown_connections 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 --2- 172.21.15.33:0/792592078 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74540cafa0 0x7f74540cc8b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 --2- 172.21.15.33:0/792592078 >> v2:172.21.15.103:3300/0 conn(0x7f7454071690 0x7f745415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 -- 172.21.15.33:0/792592078 >> 172.21.15.33:0/792592078 conn(0x7f74540b0580 msgr2=0x7f74540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 -- 172.21.15.33:0/792592078 shutdown_connections 2024-09-13T18:59:54.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.667+0000 7f7459600640 1 -- 172.21.15.33:0/792592078 wait complete. 2024-09-13T18:59:54.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.669+0000 7f7459600640 1 Processor -- start 2024-09-13T18:59:54.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.669+0000 7f7459600640 1 -- start start 2024-09-13T18:59:54.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74540cafa0 0x7f74541585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7454156f60 0x7f7454158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745415af60 con 0x7f7454071690 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745415b170 con 0x7f74540cafa0 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7459600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745415b450 con 0x7f7454156f60 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7452a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7452a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43094/0 (socket says 172.21.15.33:43094) 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7452a00640 1 -- 172.21.15.33:0/4198782072 learned_addr learned my addr 172.21.15.33:0/4198782072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7452000640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74540cafa0 0x7f74541585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.670+0000 7f7453400640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7454156f60 0x7f7454158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 -- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7454156f60 msgr2=0x7f7454158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7454156f60 0x7f7454158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 -- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74540cafa0 msgr2=0x7f74541585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74540cafa0 0x7f74541585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 -- 172.21.15.33:0/4198782072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440009400 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7452a00640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f744400c390 tx=0x7f744400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440074e0 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444007660 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444004a20 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.671+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c00bd40 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.672+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745415ba10 con 0x7f7454071690 2024-09-13T18:59:54.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.673+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7454157340 con 0x7f7454071690 2024-09-13T18:59:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.674+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7444004b80 con 0x7f7454071690 2024-09-13T18:59:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.675+0000 7f744aa00640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 0x7f743406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.675+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7444088be0 con 0x7f7454071690 2024-09-13T18:59:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.676+0000 7f7452000640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 0x7f743406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.676+0000 7f7452000640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 0x7f743406d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f745415e0f0 tx=0x7f7440009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.680+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7444053f90 con 0x7f7454071690 2024-09-13T18:59:54.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.897+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74540ce590 con 0x7f7454071690 2024-09-13T18:59:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.905+0000 7f744aa00640 1 -- 172.21.15.33:0/4198782072 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f74440575b0 con 0x7f7454071690 2024-09-13T18:59:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 10 and data pool 11 2024-09-13T18:59:54.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.910+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 msgr2=0x7f743406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.910+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 0x7f743406d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f745415e0f0 tx=0x7f7440009190 comp rx=0 tx=0).stop 2024-09-13T18:59:54.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.910+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 msgr2=0x7f74541480e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:54.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.910+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f744400c390 tx=0x7f744400c850 comp rx=0 tx=0).stop 2024-09-13T18:59:54.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 shutdown_connections 2024-09-13T18:59:54.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f743406ac00 0x7f743406d0c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7454156f60 0x7f7454158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74540cafa0 0x7f74541585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 --2- 172.21.15.33:0/4198782072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7454071690 0x7f74541480e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:54.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.913+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 >> 172.21.15.33:0/4198782072 conn(0x7f74540b0580 msgr2=0x7f74540ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:54.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.914+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 shutdown_connections 2024-09-13T18:59:54.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:54.914+0000 7f7459600640 1 -- 172.21.15.33:0/4198782072 wait complete. 2024-09-13T18:59:54.944 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:55.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.095+0000 7f3b5cc00640 1 Processor -- start 2024-09-13T18:59:55.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.095+0000 7f3b5cc00640 1 -- start start 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b5cc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b580b40c0 0x7f3b5815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b5cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 0x7f3b5815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b5cc00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580cbfc0 con 0x7f3b5815a5c0 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b5cc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580cce20 con 0x7f3b580b40c0 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b5cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580707a0 con 0x7f3b580cbac0 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b57400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b5815a5c0 0x7f3b580b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53272/0 (socket says 172.21.15.33:53272) 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b57400640 1 -- 172.21.15.33:0/750471647 learned_addr learned my addr 172.21.15.33:0/750471647 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/750471647 >> v2:172.21.15.33:3300/0 conn(0x7f3b580b40c0 0x7f3b5815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b57e00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 0x7f3b5815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b56a00640 1 -- 172.21.15.33:0/750471647 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776937953 0 0) 0x7f3b580cbfc0 con 0x7f3b5815a5c0 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b56a00640 1 -- 172.21.15.33:0/750471647 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b3c003520 con 0x7f3b5815a5c0 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.097+0000 7f3b4ea00640 1 -- 172.21.15.33:0/750471647 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 msgr2=0x7f3b5815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.098+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 0x7f3b5815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.098+0000 7f3b4ea00640 1 -- 172.21.15.33:0/750471647 >> v1:172.21.15.33:6789/0 conn(0x7f3b5815a5c0 legacy=0x7f3b580b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.098+0000 7f3b4ea00640 1 -- 172.21.15.33:0/750471647 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58070a80 con 0x7f3b580b40c0 2024-09-13T18:59:55.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.098+0000 7f3b57e00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 0x7f3b5815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580b40c0 0x7f3b5815a9a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3b400097a0 tx=0x7f3b4002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dfcde7d710af3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b56a00640 1 -- 172.21.15.33:0/750471647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40032440 con 0x7f3b580b40c0 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b56a00640 1 -- 172.21.15.33:0/750471647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b400325a0 con 0x7f3b580b40c0 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b56a00640 1 -- 172.21.15.33:0/750471647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40032930 con 0x7f3b580b40c0 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 -- 172.21.15.33:0/750471647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580b40c0 msgr2=0x7f3b5815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580b40c0 0x7f3b5815a9a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3b400097a0 tx=0x7f3b4002a180 comp rx=0 tx=0).stop 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 -- 172.21.15.33:0/750471647 shutdown_connections 2024-09-13T18:59:55.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b580cbac0 0x7f3b5815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/750471647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580b40c0 0x7f3b5815a9a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.099+0000 7f3b5cc00640 1 -- 172.21.15.33:0/750471647 >> 172.21.15.33:0/750471647 conn(0x7f3b580ae310 msgr2=0x7f3b580ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.100+0000 7f3b5cc00640 1 -- 172.21.15.33:0/750471647 shutdown_connections 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.100+0000 7f3b5cc00640 1 -- 172.21.15.33:0/750471647 wait complete. 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.101+0000 7f3b5cc00640 1 Processor -- start 2024-09-13T18:59:55.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.101+0000 7f3b5cc00640 1 -- start start 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b580b40c0 0x7f3b581f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5815a5c0 0x7f3b58155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815dde0 con 0x7f3b580cbac0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581f65a0 con 0x7f3b580b40c0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b5cc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581f5d00 con 0x7f3b5815a5c0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.102+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43110/0 (socket says 172.21.15.33:43110) 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 -- 172.21.15.33:0/2305579289 learned_addr learned my addr 172.21.15.33:0/2305579289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b57e00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5815a5c0 0x7f3b58155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b57400640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b580b40c0 0x7f3b581f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 -- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5815a5c0 msgr2=0x7f3b58155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5815a5c0 0x7f3b58155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 -- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b580b40c0 msgr2=0x7f3b581f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b580b40c0 0x7f3b581f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 -- 172.21.15.33:0/2305579289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009a70 con 0x7f3b580cbac0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.103+0000 7f3b4ea00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b40035040 tx=0x7f3b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.104+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4003d8f0 con 0x7f3b580cbac0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.104+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4003da70 con 0x7f3b580cbac0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.104+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4003de20 con 0x7f3b580cbac0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.104+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b40009400 con 0x7f3b580cbac0 2024-09-13T18:59:55.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.104+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581f62c0 con 0x7f3b580cbac0 2024-09-13T18:59:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.105+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58067360 con 0x7f3b580cbac0 2024-09-13T18:59:55.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.106+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b40039040 con 0x7f3b580cbac0 2024-09-13T18:59:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.107+0000 7f3b4fe00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 0x7f3b3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.107+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b400a9da0 con 0x7f3b580cbac0 2024-09-13T18:59:55.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.107+0000 7f3b57400640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 0x7f3b3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.108+0000 7f3b57400640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 0x7f3b3406d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b480011e0 tx=0x7f3b48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.112+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b40075090 con 0x7f3b580cbac0 2024-09-13T18:59:55.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.293+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b580afe10 con 0x7f3b580cbac0 2024-09-13T18:59:55.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.294+0000 7f3b4fe00640 1 -- 172.21.15.33:0/2305579289 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f3b400786b0 con 0x7f3b580cbac0 2024-09-13T18:59:55.297 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:55.298 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":71,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:54.899699+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:55.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 msgr2=0x7f3b3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 0x7f3b3406d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b480011e0 tx=0x7f3b48009040 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 msgr2=0x7f3b5815d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b40035040 tx=0x7f3b400046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 shutdown_connections 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3b3406ac00 0x7f3b3406d0c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b5815a5c0 0x7f3b58155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b580cbac0 0x7f3b5815d8a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 --2- 172.21.15.33:0/2305579289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b580b40c0 0x7f3b581f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 >> 172.21.15.33:0/2305579289 conn(0x7f3b580ae310 msgr2=0x7f3b580cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 shutdown_connections 2024-09-13T18:59:55.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.296+0000 7f3b5cc00640 1 -- 172.21.15.33:0/2305579289 wait complete. 2024-09-13T18:59:55.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:55.449 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-09-13T18:59:55.446+0000 7f0c49600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:59:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.468+0000 7fce1ca00640 1 Processor -- start 2024-09-13T18:59:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.468+0000 7fce1ca00640 1 -- start start 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce1ca00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce180b40c0 0x7fce1815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce1ca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce180cbac0 0x7fce1815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce1ca00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce180cbfc0 con 0x7fce1815a5c0 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce1ca00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce180cce20 con 0x7fce180b40c0 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce1ca00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce180707a0 con 0x7fce180cbac0 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce16a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce180b40c0 0x7fce1815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce16a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce180b40c0 0x7fce1815a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43120/0 (socket says 172.21.15.33:43120) 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.469+0000 7fce16a00640 1 -- 172.21.15.33:0/4030593483 learned_addr learned my addr 172.21.15.33:0/4030593483 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.470+0000 7fce17e00640 1 --2- 172.21.15.33:0/4030593483 >> v2:172.21.15.103:3300/0 conn(0x7fce180cbac0 0x7fce1815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.470+0000 7fce16a00640 1 -- 172.21.15.33:0/4030593483 >> v2:172.21.15.103:3300/0 conn(0x7fce180cbac0 msgr2=0x7fce1815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.470+0000 7fce16a00640 1 --2- 172.21.15.33:0/4030593483 >> v2:172.21.15.103:3300/0 conn(0x7fce180cbac0 0x7fce1815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.470+0000 7fce16a00640 1 -- 172.21.15.33:0/4030593483 >> v1:172.21.15.103:6789/0 conn(0x7fce1815a5c0 legacy=0x7fce180b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.470+0000 7fce16a00640 1 -- 172.21.15.33:0/4030593483 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18070a80 con 0x7fce180b40c0 2024-09-13T18:59:55.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.471+0000 7fce16a00640 1 --2- 172.21.15.33:0/4030593483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce180b40c0 0x7fce1815a9a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fce18073c80 tx=0x7fce0402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb0769b0bb4f11e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.473+0000 7fce16000640 1 -- 172.21.15.33:0/4030593483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04032440 con 0x7fce180b40c0 2024-09-13T18:59:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.473+0000 7fce16000640 1 -- 172.21.15.33:0/4030593483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040325a0 con 0x7fce180b40c0 2024-09-13T18:59:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.473+0000 7fce16000640 1 -- 172.21.15.33:0/4030593483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04032930 con 0x7fce180b40c0 2024-09-13T18:59:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 -- 172.21.15.33:0/4030593483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce180b40c0 msgr2=0x7fce1815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 --2- 172.21.15.33:0/4030593483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce180b40c0 0x7fce1815a9a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fce18073c80 tx=0x7fce0402a200 comp rx=0 tx=0).stop 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 -- 172.21.15.33:0/4030593483 shutdown_connections 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 --2- 172.21.15.33:0/4030593483 >> v2:172.21.15.103:3300/0 conn(0x7fce180cbac0 0x7fce1815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 --2- 172.21.15.33:0/4030593483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce180b40c0 0x7fce1815a9a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 -- 172.21.15.33:0/4030593483 >> 172.21.15.33:0/4030593483 conn(0x7fce180ae310 msgr2=0x7fce180ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 -- 172.21.15.33:0/4030593483 shutdown_connections 2024-09-13T18:59:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.474+0000 7fce1ca00640 1 -- 172.21.15.33:0/4030593483 wait complete. 2024-09-13T18:59:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.476+0000 7fce1ca00640 1 Processor -- start 2024-09-13T18:59:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.476+0000 7fce1ca00640 1 -- start start 2024-09-13T18:59:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce180b40c0 0x7fce181e2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce180cbac0 0x7fce18143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce181e3210 con 0x7fce1815a5c0 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce18155010 con 0x7fce180b40c0 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce1ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce18143d90 con 0x7fce180cbac0 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43128/0 (socket says 172.21.15.33:43128) 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce17e00640 1 -- 172.21.15.33:0/2201893045 learned_addr learned my addr 172.21.15.33:0/2201893045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce16a00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce180cbac0 0x7fce18143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.477+0000 7fce17400640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce180b40c0 0x7fce181e2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 -- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce180cbac0 msgr2=0x7fce18143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce180cbac0 0x7fce18143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 -- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce180b40c0 msgr2=0x7fce181e2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce180b40c0 0x7fce181e2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 -- 172.21.15.33:0/2201893045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040094d0 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce17e00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fce10007de0 tx=0x7fce1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce10014620 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1000ee90 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.478+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce181552b0 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.479+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100149e0 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.479+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce18155870 con 0x7fce1815a5c0 2024-09-13T18:59:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.480+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce18067360 con 0x7fce1815a5c0 2024-09-13T18:59:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.481+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce10014b40 con 0x7fce1815a5c0 2024-09-13T18:59:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.481+0000 7fce0f400640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 0x7fcdf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.481+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce10089d50 con 0x7fce1815a5c0 2024-09-13T18:59:55.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.482+0000 7fce17400640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 0x7fcdf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.482+0000 7fce17400640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 0x7fcdf806d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce08000f60 tx=0x7fce08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.486+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce1008d030 con 0x7fce1815a5c0 2024-09-13T18:59:55.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.666+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce1806ef90 con 0x7fce1815a5c0 2024-09-13T18:59:55.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.668+0000 7fce0f400640 1 -- 172.21.15.33:0/2201893045 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fce10058960 con 0x7fce1815a5c0 2024-09-13T18:59:55.671 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:55.671 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":71,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:54.899699+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 msgr2=0x7fcdf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 0x7fcdf806d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce08000f60 tx=0x7fce08009040 comp rx=0 tx=0).stop 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 msgr2=0x7fce1806bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fce10007de0 tx=0x7fce1000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 shutdown_connections 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcdf806ac00 0x7fcdf806d0c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce1815a5c0 0x7fce1806bf40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce180cbac0 0x7fce18143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 --2- 172.21.15.33:0/2201893045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce180b40c0 0x7fce181e2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 >> 172.21.15.33:0/2201893045 conn(0x7fce180ae310 msgr2=0x7fce1806f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 shutdown_connections 2024-09-13T18:59:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.670+0000 7fce1ca00640 1 -- 172.21.15.33:0/2201893045 wait complete. 2024-09-13T18:59:55.690 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:59:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.845+0000 7f2515e00640 1 Processor -- start 2024-09-13T18:59:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.846+0000 7f2515e00640 1 -- start start 2024-09-13T18:59:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25100b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25100cbf40 0x7f251006b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100b30e0 con 0x7f25100cbb00 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251015a800 con 0x7f25100cbf40 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25100b24d0 con 0x7f251015a420 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25100cbf40 0x7f251006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25100cbf40 0x7f251006b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43140/0 (socket says 172.21.15.33:43140) 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2515400640 1 -- 172.21.15.33:0/3669301166 learned_addr learned my addr 172.21.15.33:0/3669301166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.847+0000 7f2514a00640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25100b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.848+0000 7f2515400640 1 -- 172.21.15.33:0/3669301166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 msgr2=0x7f25100b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.848+0000 7f2515400640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25100b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.848+0000 7f2515400640 1 -- 172.21.15.33:0/3669301166 >> v1:172.21.15.103:6789/0 conn(0x7f25100cbb00 legacy=0x7f25100cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.848+0000 7f2515400640 1 -- 172.21.15.33:0/3669301166 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100b27b0 con 0x7f25100cbf40 2024-09-13T18:59:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f2515400640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbf40 0x7f251006b750 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2508009e50 tx=0x7f250802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78221911acb138ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f250fe00640 1 -- 172.21.15.33:0/3669301166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508031600 con 0x7f25100cbf40 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f250fe00640 1 -- 172.21.15.33:0/3669301166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250802d050 con 0x7f25100cbf40 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f250fe00640 1 -- 172.21.15.33:0/3669301166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508031980 con 0x7f25100cbf40 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f2515e00640 1 -- 172.21.15.33:0/3669301166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbf40 msgr2=0x7f251006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.849+0000 7f2515e00640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbf40 0x7f251006b750 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2508009e50 tx=0x7f250802a710 comp rx=0 tx=0).stop 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 -- 172.21.15.33:0/3669301166 shutdown_connections 2024-09-13T18:59:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbf40 0x7f251006b750 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 --2- 172.21.15.33:0/3669301166 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25100b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 -- 172.21.15.33:0/3669301166 >> 172.21.15.33:0/3669301166 conn(0x7f2510069ed0 msgr2=0x7f251006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 -- 172.21.15.33:0/3669301166 shutdown_connections 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.850+0000 7f2515e00640 1 -- 172.21.15.33:0/3669301166 wait complete. 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.851+0000 7f2515e00640 1 Processor -- start 2024-09-13T18:59:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.851+0000 7f2515e00640 1 -- start start 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 0x7f25101f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25101f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251014d010 con 0x7f25100cbb00 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251014f6d0 con 0x7f25100cbf40 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2515e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251014f990 con 0x7f251015a420 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2514a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.852+0000 7f2514a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43154/0 (socket says 172.21.15.33:43154) 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 -- 172.21.15.33:0/3219561472 learned_addr learned my addr 172.21.15.33:0/3219561472 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:55.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2507e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 0x7f25101f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2515400640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25101f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 -- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 msgr2=0x7f25101f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25101f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 -- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 msgr2=0x7f25101f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 0x7f25101f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 -- 172.21.15.33:0/3219561472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508009b30 con 0x7f25100cbb00 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2507e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 0x7f25101f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f2514a00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f250000e870 tx=0x7f250000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.853+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000094f0 con 0x7f25100cbb00 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.854+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251014fc70 con 0x7f25100cbb00 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.854+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2510150230 con 0x7f25100cbb00 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.854+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250000c940 con 0x7f25100cbb00 2024-09-13T18:59:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.854+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250000ccb0 con 0x7f25100cbb00 2024-09-13T18:59:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.855+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e8005250 con 0x7f25100cbb00 2024-09-13T18:59:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.856+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2500013470 con 0x7f25100cbb00 2024-09-13T18:59:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.856+0000 7f250d600640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 0x7f24ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.857+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2500089650 con 0x7f25100cbb00 2024-09-13T18:59:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.857+0000 7f2507e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 0x7f24ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:55.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.858+0000 7f2507e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 0x7f24ec06d0f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:55.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:55.861+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25000548c0 con 0x7f25100cbb00 2024-09-13T18:59:56.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.078+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f24e80055a0 con 0x7f25100cbb00 2024-09-13T18:59:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.906+0000 7f250d600640 1 -- 172.21.15.33:0/3219561472 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2500057ee0 con 0x7f25100cbb00 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 msgr2=0x7f24ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 0x7f24ec06d0f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8009040 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 msgr2=0x7f251014ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f250000e870 tx=0x7f250000ed30 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 shutdown_connections 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f24ec06ac30 0x7f24ec06d0f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f251015a420 0x7f25101f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25100cbf40 0x7f25101f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 --2- 172.21.15.33:0/3219561472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25100cbb00 0x7f251014ee30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 >> 172.21.15.33:0/3219561472 conn(0x7f2510069ed0 msgr2=0x7f2510158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 shutdown_connections 2024-09-13T18:59:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:56.909+0000 7f2515e00640 1 -- 172.21.15.33:0/3219561472 wait complete. 2024-09-13T18:59:56.931 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:59:56.931 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:59:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.091+0000 7f7642400640 1 Processor -- start 2024-09-13T18:59:57.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.091+0000 7f7642400640 1 -- start start 2024-09-13T18:59:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f7642400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f763c1461c0 0x7f763c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f7642400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c06c5b0 0x7f763c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f7642400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0b2890 con 0x7f763c0b2fe0 2024-09-13T18:59:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f7642400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c06ca40 con 0x7f763c1461c0 2024-09-13T18:59:57.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f7642400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b3450 con 0x7f763c06c5b0 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f763aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f763c0b2fe0 0x7f763c06bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53278/0 (socket says 172.21.15.33:53278) 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.092+0000 7f763aa00640 1 -- 172.21.15.33:0/4141306758 learned_addr learned my addr 172.21.15.33:0/4141306758 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763b400640 1 --2- 172.21.15.33:0/4141306758 >> v2:172.21.15.103:3300/0 conn(0x7f763c1461c0 0x7f763c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763be00640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c06c5b0 0x7f763c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763a000640 1 -- 172.21.15.33:0/4141306758 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508547998 0 0) 0x7f763c0b2890 con 0x7f763c0b2fe0 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763a000640 1 -- 172.21.15.33:0/4141306758 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7620003520 con 0x7f763c0b2fe0 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763b400640 1 -- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c06c5b0 msgr2=0x7f763c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763b400640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c06c5b0 0x7f763c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763b400640 1 -- 172.21.15.33:0/4141306758 >> v1:172.21.15.33:6789/0 conn(0x7f763c0b2fe0 legacy=0x7f763c06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.093+0000 7f763b400640 1 -- 172.21.15.33:0/4141306758 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0b1880 con 0x7f763c1461c0 2024-09-13T18:59:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.094+0000 7f763b400640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c1461c0 0x7f763c0b2aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f762c0097d0 tx=0x7f762c02a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab3647204418ac0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f763a000640 1 -- 172.21.15.33:0/4141306758 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c02ae30 con 0x7f763c1461c0 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f763a000640 1 -- 172.21.15.33:0/4141306758 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c032440 con 0x7f763c1461c0 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f763a000640 1 -- 172.21.15.33:0/4141306758 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0327d0 con 0x7f763c1461c0 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 -- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c1461c0 msgr2=0x7f763c0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c1461c0 0x7f763c0b2aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f762c0097d0 tx=0x7f762c02a120 comp rx=0 tx=0).stop 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 -- 172.21.15.33:0/4141306758 shutdown_connections 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c06c5b0 0x7f763c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 --2- 172.21.15.33:0/4141306758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c1461c0 0x7f763c0b2aa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.095+0000 7f7642400640 1 -- 172.21.15.33:0/4141306758 >> 172.21.15.33:0/4141306758 conn(0x7f763c0b0580 msgr2=0x7f763c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.096+0000 7f7642400640 1 -- 172.21.15.33:0/4141306758 shutdown_connections 2024-09-13T18:59:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.096+0000 7f7642400640 1 -- 172.21.15.33:0/4141306758 wait complete. 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.097+0000 7f7642400640 1 Processor -- start 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.097+0000 7f7642400640 1 -- start start 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c0b2fe0 0x7f763c1606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 0x7f763c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c1f65c0 con 0x7f763c06c5b0 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c160260 con 0x7f763c0b2fe0 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f7642400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15f650 con 0x7f763c1461c0 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f763b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f763b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43160/0 (socket says 172.21.15.33:43160) 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f763b400640 1 -- 172.21.15.33:0/305406369 learned_addr learned my addr 172.21.15.33:0/305406369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.098+0000 7f763aa00640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c0b2fe0 0x7f763c1606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763be00640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 0x7f763c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 -- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 msgr2=0x7f763c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 0x7f763c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 -- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c0b2fe0 msgr2=0x7f763c1606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c0b2fe0 0x7f763c1606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 -- 172.21.15.33:0/305406369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c009400 con 0x7f763c06c5b0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763be00640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 0x7f763c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f763b400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f762c035040 tx=0x7f762c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c03d8f0 con 0x7f763c06c5b0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c03da90 con 0x7f763c06c5b0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c03de40 con 0x7f763c06c5b0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.099+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c15f930 con 0x7f763c06c5b0 2024-09-13T18:59:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.100+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c15fef0 con 0x7f763c06c5b0 2024-09-13T18:59:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.100+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c1465a0 con 0x7f763c06c5b0 2024-09-13T18:59:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.101+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f762c039040 con 0x7f763c06c5b0 2024-09-13T18:59:57.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.102+0000 7f7633400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 0x7f761c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.102+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f762c0a9b50 con 0x7f763c06c5b0 2024-09-13T18:59:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.103+0000 7f763aa00640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 0x7f761c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:57.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.103+0000 7f763aa00640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 0x7f761c06d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f763c13e880 tx=0x7f7628007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:57.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.106+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f762c074e60 con 0x7f763c06c5b0 2024-09-13T18:59:57.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.324+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f763c06ce40 con 0x7f763c06c5b0 2024-09-13T18:59:57.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.912+0000 7f7633400640 1 -- 172.21.15.33:0/305406369 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f762c078480 con 0x7f763c06c5b0 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 msgr2=0x7f761c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 0x7f761c06d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f763c13e880 tx=0x7f7628007d30 comp rx=0 tx=0).stop 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 msgr2=0x7f763c15f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f762c035040 tx=0x7f762c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 shutdown_connections 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f761c06ac00 0x7f761c06d0c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f763c1461c0 0x7f763c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f763c0b2fe0 0x7f763c1606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 --2- 172.21.15.33:0/305406369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f763c06c5b0 0x7f763c15f070 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.914+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 >> 172.21.15.33:0/305406369 conn(0x7f763c0b0580 msgr2=0x7f763c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.915+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 shutdown_connections 2024-09-13T18:59:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:57.915+0000 7f7642400640 1 -- 172.21.15.33:0/305406369 wait complete. 2024-09-13T18:59:57.935 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:59:57.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:59:58.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.088+0000 7f481ee00640 1 Processor -- start 2024-09-13T18:59:58.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.088+0000 7f481ee00640 1 -- start start 2024-09-13T18:59:58.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481ee00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f481815a5c0 0x7f48180b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481ee00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48180cbfc0 con 0x7f481815b9b0 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481ee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48180707a0 con 0x7f48180cbac0 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481ee00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48180cce20 con 0x7f481815a5c0 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481da00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f481815a5c0 0x7f48180b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481da00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f481815a5c0 0x7f48180b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43174/0 (socket says 172.21.15.33:43174) 2024-09-13T18:59:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.089+0000 7f481da00640 1 -- 172.21.15.33:0/3613159193 learned_addr learned my addr 172.21.15.33:0/3613159193 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.090+0000 7f481da00640 1 -- 172.21.15.33:0/3613159193 >> v1:172.21.15.103:6789/0 conn(0x7f48180cbac0 legacy=0x7f481806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.090+0000 7f481da00640 1 -- 172.21.15.33:0/3613159193 >> v1:172.21.15.33:6789/0 conn(0x7f481815b9b0 legacy=0x7f481806fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.090+0000 7f4817e00640 1 -- 172.21.15.33:0/3613159193 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580881861 0 0) 0x7f48180cbfc0 con 0x7f481815b9b0 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.090+0000 7f481da00640 1 -- 172.21.15.33:0/3613159193 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818070a80 con 0x7f481815a5c0 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.091+0000 7f481da00640 1 --2- 172.21.15.33:0/3613159193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815a5c0 0x7f48180b39b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4804009870 tx=0x7f480402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789f1b20c8e17e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.091+0000 7f4817e00640 1 -- 172.21.15.33:0/3613159193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804032440 con 0x7f481815a5c0 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.091+0000 7f4817e00640 1 -- 172.21.15.33:0/3613159193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48040325a0 con 0x7f481815a5c0 2024-09-13T18:59:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.091+0000 7f4817e00640 1 -- 172.21.15.33:0/3613159193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804032930 con 0x7f481815a5c0 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 -- 172.21.15.33:0/3613159193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815a5c0 msgr2=0x7f48180b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 --2- 172.21.15.33:0/3613159193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815a5c0 0x7f48180b39b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4804009870 tx=0x7f480402a270 comp rx=0 tx=0).stop 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 -- 172.21.15.33:0/3613159193 shutdown_connections 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 --2- 172.21.15.33:0/3613159193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815a5c0 0x7f48180b39b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 -- 172.21.15.33:0/3613159193 >> 172.21.15.33:0/3613159193 conn(0x7f48180ae310 msgr2=0x7f48180ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 -- 172.21.15.33:0/3613159193 shutdown_connections 2024-09-13T18:59:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.092+0000 7f481ee00640 1 -- 172.21.15.33:0/3613159193 wait complete. 2024-09-13T18:59:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.094+0000 7f481ee00640 1 Processor -- start 2024-09-13T18:59:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.094+0000 7f481ee00640 1 -- start start 2024-09-13T18:59:58.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48180cbac0 0x7f48181f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f481815a5c0 0x7f4818153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818154cf0 con 0x7f481815b9b0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818150a60 con 0x7f48180cbac0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4818150d40 con 0x7f481815a5c0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43176/0 (socket says 172.21.15.33:43176) 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 -- 172.21.15.33:0/2461638940 learned_addr learned my addr 172.21.15.33:0/2461638940 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481da00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48180cbac0 0x7f48181f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481d000640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f481815a5c0 0x7f4818153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 -- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f481815a5c0 msgr2=0x7f4818153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f481815a5c0 0x7f4818153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 -- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48180cbac0 msgr2=0x7f48181f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48180cbac0 0x7f48181f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.095+0000 7f481e400640 1 -- 172.21.15.33:0/2461638940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040094d0 con 0x7f481815b9b0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f481e400640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f481000c780 tx=0x7f481000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810003da0 con 0x7f481815b9b0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000ce30 con 0x7f481815b9b0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810005290 con 0x7f481815b9b0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4818151020 con 0x7f481815b9b0 2024-09-13T18:59:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.096+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4818156440 con 0x7f481815b9b0 2024-09-13T18:59:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.097+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4818067360 con 0x7f481815b9b0 2024-09-13T18:59:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.098+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48100053f0 con 0x7f481815b9b0 2024-09-13T18:59:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.099+0000 7f4815600640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 0x7f47f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.099+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4810088a90 con 0x7f481815b9b0 2024-09-13T18:59:58.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.100+0000 7f481da00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 0x7f47f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.100+0000 7f481da00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 0x7f47f806d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4804034000 tx=0x7f480402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.103+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4810053d10 con 0x7f481815b9b0 2024-09-13T18:59:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.318+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48180afe10 con 0x7f481815b9b0 2024-09-13T18:59:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.318+0000 7f4815600640 1 -- 172.21.15.33:0/2461638940 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f4810017070 con 0x7f481815b9b0 2024-09-13T18:59:58.322 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:58.322 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:59:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.320+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 msgr2=0x7f47f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 0x7f47f806d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4804034000 tx=0x7f480402e000 comp rx=0 tx=0).stop 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 msgr2=0x7f48181545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f481000c780 tx=0x7f481000cc40 comp rx=0 tx=0).stop 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 shutdown_connections 2024-09-13T18:59:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47f806ac00 0x7f47f806d0c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481815b9b0 0x7f48181545f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f481815a5c0 0x7f4818153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 --2- 172.21.15.33:0/2461638940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48180cbac0 0x7f48181f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 >> 172.21.15.33:0/2461638940 conn(0x7f48180ae310 msgr2=0x7f48180af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 shutdown_connections 2024-09-13T18:59:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.321+0000 7f481ee00640 1 -- 172.21.15.33:0/2461638940 wait complete. 2024-09-13T18:59:58.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:59:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.493+0000 7f0654c00640 1 Processor -- start 2024-09-13T18:59:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.493+0000 7f0654c00640 1 -- start start 2024-09-13T18:59:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0654c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0654c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0654c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065006bea0 con 0x7f065015a520 2024-09-13T18:59:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0654c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065006c180 con 0x7f06500cde50 2024-09-13T18:59:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0654c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065006c460 con 0x7f06500b1b00 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f064e800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0647e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0647e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:35406/0 (socket says 172.21.15.33:35406) 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f0647e00640 1 -- 172.21.15.33:0/2220791317 learned_addr learned my addr 172.21.15.33:0/2220791317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.495+0000 7f064e800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54294/0 (socket says 172.21.15.33:54294) 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.496+0000 7f0647e00640 1 -- 172.21.15.33:0/2220791317 >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 msgr2=0x7f065015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.496+0000 7f0647e00640 1 --2- 172.21.15.33:0/2220791317 >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.496+0000 7f0647e00640 1 -- 172.21.15.33:0/2220791317 >> v1:172.21.15.103:6789/0 conn(0x7f065015a520 legacy=0x7f065006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.496+0000 7f0647e00640 1 -- 172.21.15.33:0/2220791317 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065006c740 con 0x7f06500b1b00 2024-09-13T18:59:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.496+0000 7f064e800640 1 --2- 172.21.15.33:0/2220791317 >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.497+0000 7f0647e00640 1 --2- 172.21.15.33:0/2220791317 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06380098a0 tx=0x7f063802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcafbe4679528e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.497+0000 7f064d400640 1 -- 172.21.15.33:0/2220791317 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638032440 con 0x7f06500b1b00 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.497+0000 7f064d400640 1 -- 172.21.15.33:0/2220791317 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380325a0 con 0x7f06500b1b00 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.497+0000 7f064d400640 1 -- 172.21.15.33:0/2220791317 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638032930 con 0x7f06500b1b00 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 -- 172.21.15.33:0/2220791317 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 msgr2=0x7f06500cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 --2- 172.21.15.33:0/2220791317 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06380098a0 tx=0x7f063802a290 comp rx=0 tx=0).stop 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 -- 172.21.15.33:0/2220791317 shutdown_connections 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 --2- 172.21.15.33:0/2220791317 >> v2:172.21.15.103:3300/0 conn(0x7f06500cde50 0x7f065015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 --2- 172.21.15.33:0/2220791317 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f06500cd910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 -- 172.21.15.33:0/2220791317 >> 172.21.15.33:0/2220791317 conn(0x7f06500b0510 msgr2=0x7f06500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 -- 172.21.15.33:0/2220791317 shutdown_connections 2024-09-13T18:59:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.498+0000 7f0654c00640 1 -- 172.21.15.33:0/2220791317 wait complete. 2024-09-13T18:59:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.499+0000 7f0654c00640 1 Processor -- start 2024-09-13T18:59:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 -- start start 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f065015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065015a520 0x7f06500ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065015c260 con 0x7f06500cde50 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065015c540 con 0x7f065015a520 2024-09-13T18:59:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.500+0000 7f0654c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065015c820 con 0x7f06500b1b00 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43186/0 (socket says 172.21.15.33:43186) 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 -- 172.21.15.33:0/4223205587 learned_addr learned my addr 172.21.15.33:0/4223205587 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f064e800640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065015a520 0x7f06500ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f064de00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f065015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 -- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 msgr2=0x7f065015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f065015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 -- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065015a520 msgr2=0x7f06500ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065015a520 0x7f06500ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 -- 172.21.15.33:0/4223205587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648009a70 con 0x7f06500cde50 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.501+0000 7f0647e00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f06380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.502+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638032440 con 0x7f06500cde50 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.502+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638030980 con 0x7f06500cde50 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.502+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638030d10 con 0x7f06500cde50 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.502+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06380094d0 con 0x7f06500cde50 2024-09-13T18:59:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.502+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065015cde0 con 0x7f06500cde50 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.503+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06500cd910 con 0x7f06500cde50 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.504+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0638039040 con 0x7f06500cde50 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.504+0000 7f0646000640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 0x7f062c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.505+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06380a9c00 con 0x7f06500cde50 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.505+0000 7f064de00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 0x7f062c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.506+0000 7f064de00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 0x7f062c06d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f60 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.509+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0638074cb0 con 0x7f06500cde50 2024-09-13T18:59:58.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.688+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06501521e0 con 0x7f06500cde50 2024-09-13T18:59:58.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.689+0000 7f0646000640 1 -- 172.21.15.33:0/4223205587 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f06380782d0 con 0x7f06500cde50 2024-09-13T18:59:58.692 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:58.693 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 msgr2=0x7f062c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 0x7f062c06d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f60 tx=0x7f0640009040 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 msgr2=0x7f0650151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f06380046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 shutdown_connections 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f062c06ac00 0x7f062c06d0c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065015a520 0x7f06500ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06500cde50 0x7f0650151ca0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 --2- 172.21.15.33:0/4223205587 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06500b1b00 0x7f065015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 >> 172.21.15.33:0/4223205587 conn(0x7f06500b0510 msgr2=0x7f06500cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 shutdown_connections 2024-09-13T18:59:58.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.691+0000 7f0654c00640 1 -- 172.21.15.33:0/4223205587 wait complete. 2024-09-13T18:59:58.713 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:59:58.714 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.865+0000 7fc90e400640 1 Processor -- start 2024-09-13T18:59:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.865+0000 7fc90e400640 1 -- start start 2024-09-13T18:59:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.866+0000 7fc90e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 0x7fc90806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc90e400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 0x7fc9080cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc90e400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806bc00 con 0x7fc9080cde50 2024-09-13T18:59:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc90e400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90806bea0 con 0x7fc9080b1b00 2024-09-13T18:59:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc90e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90806c180 con 0x7fc90815a520 2024-09-13T18:59:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc8fea00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 0x7fc9080cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc907400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 0x7fc90806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc8fea00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 0x7fc9080cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54314/0 (socket says 172.21.15.33:54314) 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc8fea00640 1 -- 172.21.15.33:0/1411264541 learned_addr learned my addr 172.21.15.33:0/1411264541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.867+0000 7fc907e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc9080cde50 0x7fc9080b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:38640/0 (socket says 172.21.15.33:38640) 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.868+0000 7fc907400640 1 -- 172.21.15.33:0/1411264541 >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 msgr2=0x7fc9080cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.868+0000 7fc907400640 1 --2- 172.21.15.33:0/1411264541 >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 0x7fc9080cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.868+0000 7fc907400640 1 -- 172.21.15.33:0/1411264541 >> v1:172.21.15.103:6789/0 conn(0x7fc9080cde50 legacy=0x7fc9080b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.868+0000 7fc906a00640 1 -- 172.21.15.33:0/1411264541 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884050029 0 0) 0x7fc90806bc00 con 0x7fc9080cde50 2024-09-13T18:59:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.868+0000 7fc907400640 1 -- 172.21.15.33:0/1411264541 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90806c460 con 0x7fc90815a520 2024-09-13T18:59:58.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.869+0000 7fc907400640 1 --2- 172.21.15.33:0/1411264541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 0x7fc90806b6c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800dbf0 tx=0x7fc8f802e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ec24e817281b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.869+0000 7fc906a00640 1 -- 172.21.15.33:0/1411264541 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800b650 con 0x7fc90815a520 2024-09-13T18:59:58.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.869+0000 7fc906a00640 1 -- 172.21.15.33:0/1411264541 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f8031050 con 0x7fc90815a520 2024-09-13T18:59:58.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.869+0000 7fc906a00640 1 -- 172.21.15.33:0/1411264541 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800b9d0 con 0x7fc90815a520 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 -- 172.21.15.33:0/1411264541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 msgr2=0x7fc90806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 --2- 172.21.15.33:0/1411264541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 0x7fc90806b6c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800dbf0 tx=0x7fc8f802e4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 -- 172.21.15.33:0/1411264541 shutdown_connections 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 --2- 172.21.15.33:0/1411264541 >> v2:172.21.15.103:3300/0 conn(0x7fc9080b1b00 0x7fc9080cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 --2- 172.21.15.33:0/1411264541 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc90815a520 0x7fc90806b6c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 -- 172.21.15.33:0/1411264541 >> 172.21.15.33:0/1411264541 conn(0x7fc9080b0510 msgr2=0x7fc9080b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 -- 172.21.15.33:0/1411264541 shutdown_connections 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.870+0000 7fc90e400640 1 -- 172.21.15.33:0/1411264541 wait complete. 2024-09-13T18:59:58.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.871+0000 7fc90e400640 1 Processor -- start 2024-09-13T18:59:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 -- start start 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9080b1b00 0x7fc908153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc9080cde50 0x7fc908151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90814f510 con 0x7fc90815a520 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081e3240 con 0x7fc9080b1b00 2024-09-13T18:59:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.872+0000 7fc90e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081e2350 con 0x7fc9080cde50 2024-09-13T18:59:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43192/0 (socket says 172.21.15.33:43192) 2024-09-13T18:59:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 -- 172.21.15.33:0/3811385036 learned_addr learned my addr 172.21.15.33:0/3811385036 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9080b1b00 0x7fc908153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc8fea00640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc9080cde50 0x7fc908151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 -- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc9080cde50 msgr2=0x7fc908151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc9080cde50 0x7fc908151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 -- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9080b1b00 msgr2=0x7fc908153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9080b1b00 0x7fc908153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.873+0000 7fc907e00640 1 -- 172.21.15.33:0/3811385036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f800d8a0 con 0x7fc90815a520 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc907e00640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c7e0 tx=0x7fc90000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000a640 con 0x7fc90815a520 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000a7c0 con 0x7fc90815a520 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9081e2630 con 0x7fc90815a520 2024-09-13T18:59:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000ab70 con 0x7fc90815a520 2024-09-13T18:59:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.874+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9081e2bf0 con 0x7fc90815a520 2024-09-13T18:59:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.875+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9080cd910 con 0x7fc90815a520 2024-09-13T18:59:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.876+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc90000acd0 con 0x7fc90815a520 2024-09-13T18:59:58.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.877+0000 7fc8ffe00640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 0x7fc8e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:58.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.877+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc900088840 con 0x7fc90815a520 2024-09-13T18:59:58.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.878+0000 7fc907400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 0x7fc8e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.879+0000 7fc907400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 0x7fc8e406d0f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8037000 tx=0x7fc8f800d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:58.882+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc900053a30 con 0x7fc90815a520 2024-09-13T18:59:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.061+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9080cc6f0 con 0x7fc8e406ac30 2024-09-13T18:59:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.069+0000 7fc8ffe00640 1 -- 172.21.15.33:0/3811385036 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274811 (secure 0 0 0) 0x7fc9080cc6f0 con 0x7fc8e406ac30 2024-09-13T18:59:59.075 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 msgr2=0x7fc8e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 0x7fc8e406d0f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8037000 tx=0x7fc8f800d000 comp rx=0 tx=0).stop 2024-09-13T18:59:59.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 msgr2=0x7fc9081515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c7e0 tx=0x7fc90000cca0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 shutdown_connections 2024-09-13T18:59:59.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc8e406ac30 0x7fc8e406d0f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc90815a520 0x7fc9081515a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc9080cde50 0x7fc908151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 --2- 172.21.15.33:0/3811385036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9080b1b00 0x7fc908153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 >> 172.21.15.33:0/3811385036 conn(0x7fc9080b0510 msgr2=0x7fc9080cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 shutdown_connections 2024-09-13T18:59:59.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.073+0000 7fc90e400640 1 -- 172.21.15.33:0/3811385036 wait complete. 2024-09-13T18:59:59.093 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T18:59:57.132795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":232008,"kb_used_data":7600,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754742712,"statfs":{"total":773094113280,"available":772856537088,"internally_reserved":0,"allocated":7782400,"data_stored":3925738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000694"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:54.459536+0000","last_change":"2024-09-13T18:59:54.459536+0000","last_active":"2024-09-13T18:59:54.459536+0000","last_peered":"2024-09-13T18:59:54.459536+0000","last_clean":"2024-09-13T18:59:54.459536+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:54.459536+0000","last_undegraded":"2024-09-13T18:59:54.459536+0000","last_fullsized":"2024-09-13T18:59:54.459536+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:59:53.448259+0000","last_change":"2024-09-13T18:59:53.448259+0000","last_active":"2024-09-13T18:59:53.448259+0000","last_peered":"2024-09-13T18:59:53.448259+0000","last_clean":"2024-09-13T18:59:53.448259+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:59:53.448259+0000","last_undegraded":"2024-09-13T18:59:53.448259+0000","last_fullsized":"2024-09-13T18:59:53.448259+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T18:59:49.797273+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:49.797273+0000","last_peered":"2024-09-13T18:59:49.797273+0000","last_clean":"2024-09-13T18:59:49.797273+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:49.797273+0000","last_undegraded":"2024-09-13T18:59:49.797273+0000","last_fullsized":"2024-09-13T18:59:49.797273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1421312,"data_stored":934775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.627}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.80100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":344407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.84899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.877}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.504}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":344407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.878},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.95199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":1.077}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":344407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":339280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.432},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.502}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":344407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.751}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1421312,"data_stored":934775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.435},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:59.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:59:59.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.285+0000 7f9b6ec00640 1 Processor -- start 2024-09-13T18:59:59.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.286+0000 7f9b6ec00640 1 -- start start 2024-09-13T18:59:59.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6ec00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b68159480 0x7f9b680ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6ec00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68071560 0x7f9b680b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6ec00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b680cd850 con 0x7f9b6806f4b0 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6ec00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b680cd570 con 0x7f9b68159480 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6ec00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680b1740 con 0x7f9b68071560 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6d800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b68159480 0x7f9b680ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6d800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b68159480 0x7f9b680ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43198/0 (socket says 172.21.15.33:43198) 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6d800640 1 -- 172.21.15.33:0/1057567287 learned_addr learned my addr 172.21.15.33:0/1057567287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.287+0000 7f9b6e200640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68071560 0x7f9b680b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.288+0000 7f9b6d800640 1 -- 172.21.15.33:0/1057567287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68071560 msgr2=0x7f9b680b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:59.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.288+0000 7f9b6d800640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68071560 0x7f9b680b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.288+0000 7f9b6d800640 1 -- 172.21.15.33:0/1057567287 >> v1:172.21.15.103:6789/0 conn(0x7f9b6806f4b0 legacy=0x7f9b68070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.288+0000 7f9b6d800640 1 -- 172.21.15.33:0/1057567287 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680b1a20 con 0x7f9b68159480 2024-09-13T18:59:59.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.289+0000 7f9b6d800640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b68159480 0x7f9b680ccf90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009870 tx=0x7f9b5c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17d041ca7417f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.289+0000 7f9b67e00640 1 -- 172.21.15.33:0/1057567287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c032440 con 0x7f9b68159480 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.289+0000 7f9b67e00640 1 -- 172.21.15.33:0/1057567287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c0325a0 con 0x7f9b68159480 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.289+0000 7f9b67e00640 1 -- 172.21.15.33:0/1057567287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c032930 con 0x7f9b68159480 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 -- 172.21.15.33:0/1057567287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b68159480 msgr2=0x7f9b680ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b68159480 0x7f9b680ccf90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009870 tx=0x7f9b5c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 -- 172.21.15.33:0/1057567287 shutdown_connections 2024-09-13T18:59:59.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68071560 0x7f9b680b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/1057567287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b68159480 0x7f9b680ccf90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 -- 172.21.15.33:0/1057567287 >> 172.21.15.33:0/1057567287 conn(0x7f9b680ae310 msgr2=0x7f9b680ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:59.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 -- 172.21.15.33:0/1057567287 shutdown_connections 2024-09-13T18:59:59.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.290+0000 7f9b6ec00640 1 -- 172.21.15.33:0/1057567287 wait complete. 2024-09-13T18:59:59.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.291+0000 7f9b6ec00640 1 Processor -- start 2024-09-13T18:59:59.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.292+0000 7f9b6ec00640 1 -- start start 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b68071560 0x7f9b681656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68159480 0x7f9b680aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68166da0 con 0x7f9b6806f4b0 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68166120 con 0x7f9b68071560 2024-09-13T18:59:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ec00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68166400 con 0x7f9b68159480 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43214/0 (socket says 172.21.15.33:43214) 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 -- 172.21.15.33:0/124742323 learned_addr learned my addr 172.21.15.33:0/124742323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6e200640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68159480 0x7f9b680aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6ce00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b68071560 0x7f9b681656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 -- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68159480 msgr2=0x7f9b680aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68159480 0x7f9b680aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 -- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b68071560 msgr2=0x7f9b681656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b68071560 0x7f9b681656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.293+0000 7f9b6d800640 1 -- 172.21.15.33:0/124742323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0094d0 con 0x7f9b6806f4b0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b6d800640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c000c00 tx=0x7f9b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c032440 con 0x7f9b6806f4b0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c030b80 con 0x7f9b6806f4b0 2024-09-13T18:59:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c03d440 con 0x7f9b6806f4b0 2024-09-13T18:59:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b681666e0 con 0x7f9b6806f4b0 2024-09-13T18:59:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.294+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6814fa30 con 0x7f9b6806f4b0 2024-09-13T18:59:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.295+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b68067360 con 0x7f9b6806f4b0 2024-09-13T18:59:59.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.296+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b5c039040 con 0x7f9b6806f4b0 2024-09-13T18:59:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.297+0000 7f9b65600640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 0x7f9b4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.297+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b5c0a9ed0 con 0x7f9b6806f4b0 2024-09-13T18:59:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.297+0000 7f9b6ce00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 0x7f9b4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.298+0000 7f9b6ce00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 0x7f9b4806d0c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b68163980 tx=0x7f9b54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.301+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9b5c0750a0 con 0x7f9b6806f4b0 2024-09-13T18:59:59.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.478+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b680ce280 con 0x7f9b4806ac00 2024-09-13T18:59:59.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.486+0000 7f9b65600640 1 -- 172.21.15.33:0/124742323 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289483 (secure 0 0 0) 0x7f9b54001c70 con 0x7f9b4806ac00 2024-09-13T18:59:59.492 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T18:59:59.494 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T18:59:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.490+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 msgr2=0x7f9b4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.490+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 0x7f9b4806d0c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b68163980 tx=0x7f9b54009040 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.490+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 msgr2=0x7f9b6814af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.490+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c000c00 tx=0x7f9b5c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 shutdown_connections 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b4806ac00 0x7f9b4806d0c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b68159480 0x7f9b680aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b68071560 0x7f9b681656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 --2- 172.21.15.33:0/124742323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b6806f4b0 0x7f9b6814af30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 >> 172.21.15.33:0/124742323 conn(0x7f9b680ae310 msgr2=0x7f9b6806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 shutdown_connections 2024-09-13T18:59:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.491+0000 7f9b6ec00640 1 -- 172.21.15.33:0/124742323 wait complete. 2024-09-13T18:59:59.510 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T18:59:59.133249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232436,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754742284,"statfs":{"total":773094113280,"available":772856098816,"internally_reserved":0,"allocated":8265728,"data_stored":4142052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.671761"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912972+0000","last_change":"2024-09-13T18:59:54.930915+0000","last_active":"2024-09-13T18:59:55.912972+0000","last_peered":"2024-09-13T18:59:55.912972+0000","last_clean":"2024-09-13T18:59:55.912972+0000","last_became_active":"2024-09-13T18:59:54.930611+0000","last_became_peered":"2024-09-13T18:59:54.930611+0000","last_unstale":"2024-09-13T18:59:55.912972+0000","last_undegraded":"2024-09-13T18:59:55.912972+0000","last_fullsized":"2024-09-13T18:59:55.912972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:09.725548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983611+0000","last_change":"2024-09-13T18:59:54.929938+0000","last_active":"2024-09-13T18:59:55.983611+0000","last_peered":"2024-09-13T18:59:55.983611+0000","last_clean":"2024-09-13T18:59:55.983611+0000","last_became_active":"2024-09-13T18:59:54.929408+0000","last_became_peered":"2024-09-13T18:59:54.929408+0000","last_unstale":"2024-09-13T18:59:55.983611+0000","last_undegraded":"2024-09-13T18:59:55.983611+0000","last_fullsized":"2024-09-13T18:59:55.983611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:41.535652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983495+0000","last_change":"2024-09-13T18:59:54.917028+0000","last_active":"2024-09-13T18:59:55.983495+0000","last_peered":"2024-09-13T18:59:55.983495+0000","last_clean":"2024-09-13T18:59:55.983495+0000","last_became_active":"2024-09-13T18:59:54.916784+0000","last_became_peered":"2024-09-13T18:59:54.916784+0000","last_unstale":"2024-09-13T18:59:55.983495+0000","last_undegraded":"2024-09-13T18:59:55.983495+0000","last_fullsized":"2024-09-13T18:59:55.983495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:55.817261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983943+0000","last_change":"2024-09-13T18:59:54.934030+0000","last_active":"2024-09-13T18:59:55.983943+0000","last_peered":"2024-09-13T18:59:55.983943+0000","last_clean":"2024-09-13T18:59:55.983943+0000","last_became_active":"2024-09-13T18:59:54.933804+0000","last_became_peered":"2024-09-13T18:59:54.933804+0000","last_unstale":"2024-09-13T18:59:55.983943+0000","last_undegraded":"2024-09-13T18:59:55.983943+0000","last_fullsized":"2024-09-13T18:59:55.983943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:22.600238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906204+0000","last_change":"2024-09-13T18:59:54.934211+0000","last_active":"2024-09-13T18:59:55.906204+0000","last_peered":"2024-09-13T18:59:55.906204+0000","last_clean":"2024-09-13T18:59:55.906204+0000","last_became_active":"2024-09-13T18:59:54.932569+0000","last_became_peered":"2024-09-13T18:59:54.932569+0000","last_unstale":"2024-09-13T18:59:55.906204+0000","last_undegraded":"2024-09-13T18:59:55.906204+0000","last_fullsized":"2024-09-13T18:59:55.906204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:05.602745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983170+0000","last_change":"2024-09-13T18:59:54.926043+0000","last_active":"2024-09-13T18:59:55.983170+0000","last_peered":"2024-09-13T18:59:55.983170+0000","last_clean":"2024-09-13T18:59:55.983170+0000","last_became_active":"2024-09-13T18:59:54.924850+0000","last_became_peered":"2024-09-13T18:59:54.924850+0000","last_unstale":"2024-09-13T18:59:55.983170+0000","last_undegraded":"2024-09-13T18:59:55.983170+0000","last_fullsized":"2024-09-13T18:59:55.983170+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:25.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911268+0000","last_change":"2024-09-13T18:59:54.923563+0000","last_active":"2024-09-13T18:59:55.911268+0000","last_peered":"2024-09-13T18:59:55.911268+0000","last_clean":"2024-09-13T18:59:55.911268+0000","last_became_active":"2024-09-13T18:59:54.923230+0000","last_became_peered":"2024-09-13T18:59:54.923230+0000","last_unstale":"2024-09-13T18:59:55.911268+0000","last_undegraded":"2024-09-13T18:59:55.911268+0000","last_fullsized":"2024-09-13T18:59:55.911268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:49.770176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983207+0000","last_change":"2024-09-13T18:59:54.927796+0000","last_active":"2024-09-13T18:59:55.983207+0000","last_peered":"2024-09-13T18:59:55.983207+0000","last_clean":"2024-09-13T18:59:55.983207+0000","last_became_active":"2024-09-13T18:59:54.927206+0000","last_became_peered":"2024-09-13T18:59:54.927206+0000","last_unstale":"2024-09-13T18:59:55.983207+0000","last_undegraded":"2024-09-13T18:59:55.983207+0000","last_fullsized":"2024-09-13T18:59:55.983207+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:49.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906741+0000","last_change":"2024-09-13T18:59:54.930310+0000","last_active":"2024-09-13T18:59:55.906741+0000","last_peered":"2024-09-13T18:59:55.906741+0000","last_clean":"2024-09-13T18:59:55.906741+0000","last_became_active":"2024-09-13T18:59:54.929669+0000","last_became_peered":"2024-09-13T18:59:54.929669+0000","last_unstale":"2024-09-13T18:59:55.906741+0000","last_undegraded":"2024-09-13T18:59:55.906741+0000","last_fullsized":"2024-09-13T18:59:55.906741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:31.960236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912343+0000","last_change":"2024-09-13T18:59:54.929476+0000","last_active":"2024-09-13T18:59:55.912343+0000","last_peered":"2024-09-13T18:59:55.912343+0000","last_clean":"2024-09-13T18:59:55.912343+0000","last_became_active":"2024-09-13T18:59:54.929237+0000","last_became_peered":"2024-09-13T18:59:54.929237+0000","last_unstale":"2024-09-13T18:59:55.912343+0000","last_undegraded":"2024-09-13T18:59:55.912343+0000","last_fullsized":"2024-09-13T18:59:55.912343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:04.202976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912435+0000","last_change":"2024-09-13T18:59:54.919832+0000","last_active":"2024-09-13T18:59:55.912435+0000","last_peered":"2024-09-13T18:59:55.912435+0000","last_clean":"2024-09-13T18:59:55.912435+0000","last_became_active":"2024-09-13T18:59:54.919540+0000","last_became_peered":"2024-09-13T18:59:54.919540+0000","last_unstale":"2024-09-13T18:59:55.912435+0000","last_undegraded":"2024-09-13T18:59:55.912435+0000","last_fullsized":"2024-09-13T18:59:55.912435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.634829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984037+0000","last_change":"2024-09-13T18:59:54.930864+0000","last_active":"2024-09-13T18:59:55.984037+0000","last_peered":"2024-09-13T18:59:55.984037+0000","last_clean":"2024-09-13T18:59:55.984037+0000","last_became_active":"2024-09-13T18:59:54.930484+0000","last_became_peered":"2024-09-13T18:59:54.930484+0000","last_unstale":"2024-09-13T18:59:55.984037+0000","last_undegraded":"2024-09-13T18:59:55.984037+0000","last_fullsized":"2024-09-13T18:59:55.984037+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:41.535652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983581+0000","last_change":"2024-09-13T18:59:54.938006+0000","last_active":"2024-09-13T18:59:55.983581+0000","last_peered":"2024-09-13T18:59:55.983581+0000","last_clean":"2024-09-13T18:59:55.983581+0000","last_became_active":"2024-09-13T18:59:54.937727+0000","last_became_peered":"2024-09-13T18:59:54.937727+0000","last_unstale":"2024-09-13T18:59:55.983581+0000","last_undegraded":"2024-09-13T18:59:55.983581+0000","last_fullsized":"2024-09-13T18:59:55.983581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:31.874158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906360+0000","last_change":"2024-09-13T18:59:54.928014+0000","last_active":"2024-09-13T18:59:55.906360+0000","last_peered":"2024-09-13T18:59:55.906360+0000","last_clean":"2024-09-13T18:59:55.906360+0000","last_became_active":"2024-09-13T18:59:54.927166+0000","last_became_peered":"2024-09-13T18:59:54.927166+0000","last_unstale":"2024-09-13T18:59:55.906360+0000","last_undegraded":"2024-09-13T18:59:55.906360+0000","last_fullsized":"2024-09-13T18:59:55.906360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:07.612501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983086+0000","last_change":"2024-09-13T18:59:54.927227+0000","last_active":"2024-09-13T18:59:55.983086+0000","last_peered":"2024-09-13T18:59:55.983086+0000","last_clean":"2024-09-13T18:59:55.983086+0000","last_became_active":"2024-09-13T18:59:54.926018+0000","last_became_peered":"2024-09-13T18:59:54.926018+0000","last_unstale":"2024-09-13T18:59:55.983086+0000","last_undegraded":"2024-09-13T18:59:55.983086+0000","last_fullsized":"2024-09-13T18:59:55.983086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:55.810310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911231+0000","last_change":"2024-09-13T18:59:54.924954+0000","last_active":"2024-09-13T18:59:55.911231+0000","last_peered":"2024-09-13T18:59:55.911231+0000","last_clean":"2024-09-13T18:59:55.911231+0000","last_became_active":"2024-09-13T18:59:54.923221+0000","last_became_peered":"2024-09-13T18:59:54.923221+0000","last_unstale":"2024-09-13T18:59:55.911231+0000","last_undegraded":"2024-09-13T18:59:55.911231+0000","last_fullsized":"2024-09-13T18:59:55.911231+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:02.923141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906745+0000","last_change":"2024-09-13T18:59:54.930139+0000","last_active":"2024-09-13T18:59:55.906745+0000","last_peered":"2024-09-13T18:59:55.906745+0000","last_clean":"2024-09-13T18:59:55.906745+0000","last_became_active":"2024-09-13T18:59:54.929348+0000","last_became_peered":"2024-09-13T18:59:54.929348+0000","last_unstale":"2024-09-13T18:59:55.906745+0000","last_undegraded":"2024-09-13T18:59:55.906745+0000","last_fullsized":"2024-09-13T18:59:55.906745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:01.184041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984087+0000","last_change":"2024-09-13T18:59:54.932570+0000","last_active":"2024-09-13T18:59:55.984087+0000","last_peered":"2024-09-13T18:59:55.984087+0000","last_clean":"2024-09-13T18:59:55.984087+0000","last_became_active":"2024-09-13T18:59:54.932268+0000","last_became_peered":"2024-09-13T18:59:54.932268+0000","last_unstale":"2024-09-13T18:59:55.984087+0000","last_undegraded":"2024-09-13T18:59:55.984087+0000","last_fullsized":"2024-09-13T18:59:55.984087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:44.025619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983556+0000","last_change":"2024-09-13T18:59:54.932249+0000","last_active":"2024-09-13T18:59:55.983556+0000","last_peered":"2024-09-13T18:59:55.983556+0000","last_clean":"2024-09-13T18:59:55.983556+0000","last_became_active":"2024-09-13T18:59:54.931582+0000","last_became_peered":"2024-09-13T18:59:54.931582+0000","last_unstale":"2024-09-13T18:59:55.983556+0000","last_undegraded":"2024-09-13T18:59:55.983556+0000","last_fullsized":"2024-09-13T18:59:55.983556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:06.253446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983847+0000","last_change":"2024-09-13T18:59:54.924421+0000","last_active":"2024-09-13T18:59:55.983847+0000","last_peered":"2024-09-13T18:59:55.983847+0000","last_clean":"2024-09-13T18:59:55.983847+0000","last_became_active":"2024-09-13T18:59:54.924157+0000","last_became_peered":"2024-09-13T18:59:54.924157+0000","last_unstale":"2024-09-13T18:59:55.983847+0000","last_undegraded":"2024-09-13T18:59:55.983847+0000","last_fullsized":"2024-09-13T18:59:55.983847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:26.574408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911489+0000","last_change":"2024-09-13T18:59:54.919342+0000","last_active":"2024-09-13T18:59:55.911489+0000","last_peered":"2024-09-13T18:59:55.911489+0000","last_clean":"2024-09-13T18:59:55.911489+0000","last_became_active":"2024-09-13T18:59:54.918485+0000","last_became_peered":"2024-09-13T18:59:54.918485+0000","last_unstale":"2024-09-13T18:59:55.911489+0000","last_undegraded":"2024-09-13T18:59:55.911489+0000","last_fullsized":"2024-09-13T18:59:55.911489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.635386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911798+0000","last_change":"2024-09-13T18:59:54.917515+0000","last_active":"2024-09-13T18:59:55.911798+0000","last_peered":"2024-09-13T18:59:55.911798+0000","last_clean":"2024-09-13T18:59:55.911798+0000","last_became_active":"2024-09-13T18:59:54.917273+0000","last_became_peered":"2024-09-13T18:59:54.917273+0000","last_unstale":"2024-09-13T18:59:55.911798+0000","last_undegraded":"2024-09-13T18:59:55.911798+0000","last_fullsized":"2024-09-13T18:59:55.911798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:26.650806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912345+0000","last_change":"2024-09-13T18:59:54.916211+0000","last_active":"2024-09-13T18:59:55.912345+0000","last_peered":"2024-09-13T18:59:55.912345+0000","last_clean":"2024-09-13T18:59:55.912345+0000","last_became_active":"2024-09-13T18:59:54.915487+0000","last_became_peered":"2024-09-13T18:59:54.915487+0000","last_unstale":"2024-09-13T18:59:55.912345+0000","last_undegraded":"2024-09-13T18:59:55.912345+0000","last_fullsized":"2024-09-13T18:59:55.912345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:18.240746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912039+0000","last_change":"2024-09-13T18:59:54.923134+0000","last_active":"2024-09-13T18:59:55.912039+0000","last_peered":"2024-09-13T18:59:55.912039+0000","last_clean":"2024-09-13T18:59:55.912039+0000","last_became_active":"2024-09-13T18:59:54.922854+0000","last_became_peered":"2024-09-13T18:59:54.922854+0000","last_unstale":"2024-09-13T18:59:55.912039+0000","last_undegraded":"2024-09-13T18:59:55.912039+0000","last_fullsized":"2024-09-13T18:59:55.912039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:55.810310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912612+0000","last_change":"2024-09-13T18:59:54.921709+0000","last_active":"2024-09-13T18:59:55.912612+0000","last_peered":"2024-09-13T18:59:55.912612+0000","last_clean":"2024-09-13T18:59:55.912612+0000","last_became_active":"2024-09-13T18:59:54.919916+0000","last_became_peered":"2024-09-13T18:59:54.919916+0000","last_unstale":"2024-09-13T18:59:55.912612+0000","last_undegraded":"2024-09-13T18:59:55.912612+0000","last_fullsized":"2024-09-13T18:59:55.912612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:42.424666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912482+0000","last_change":"2024-09-13T18:59:54.930017+0000","last_active":"2024-09-13T18:59:55.912482+0000","last_peered":"2024-09-13T18:59:55.912482+0000","last_clean":"2024-09-13T18:59:55.912482+0000","last_became_active":"2024-09-13T18:59:54.929741+0000","last_became_peered":"2024-09-13T18:59:54.929741+0000","last_unstale":"2024-09-13T18:59:55.912482+0000","last_undegraded":"2024-09-13T18:59:55.912482+0000","last_fullsized":"2024-09-13T18:59:55.912482+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:26.650806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983593+0000","last_change":"2024-09-13T18:59:54.919335+0000","last_active":"2024-09-13T18:59:55.983593+0000","last_peered":"2024-09-13T18:59:55.983593+0000","last_clean":"2024-09-13T18:59:55.983593+0000","last_became_active":"2024-09-13T18:59:54.918241+0000","last_became_peered":"2024-09-13T18:59:54.918241+0000","last_unstale":"2024-09-13T18:59:55.983593+0000","last_undegraded":"2024-09-13T18:59:55.983593+0000","last_fullsized":"2024-09-13T18:59:55.983593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:30.632988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911869+0000","last_change":"2024-09-13T18:59:54.930324+0000","last_active":"2024-09-13T18:59:55.911869+0000","last_peered":"2024-09-13T18:59:55.911869+0000","last_clean":"2024-09-13T18:59:55.911869+0000","last_became_active":"2024-09-13T18:59:54.930062+0000","last_became_peered":"2024-09-13T18:59:54.930062+0000","last_unstale":"2024-09-13T18:59:55.911869+0000","last_undegraded":"2024-09-13T18:59:55.911869+0000","last_fullsized":"2024-09-13T18:59:55.911869+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:42.425642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983647+0000","last_change":"2024-09-13T18:59:54.917671+0000","last_active":"2024-09-13T18:59:55.983647+0000","last_peered":"2024-09-13T18:59:55.983647+0000","last_clean":"2024-09-13T18:59:55.983647+0000","last_became_active":"2024-09-13T18:59:54.917414+0000","last_became_peered":"2024-09-13T18:59:54.917414+0000","last_unstale":"2024-09-13T18:59:55.983647+0000","last_undegraded":"2024-09-13T18:59:55.983647+0000","last_fullsized":"2024-09-13T18:59:55.983647+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:17.666956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912418+0000","last_change":"2024-09-13T18:59:54.929981+0000","last_active":"2024-09-13T18:59:55.912418+0000","last_peered":"2024-09-13T18:59:55.912418+0000","last_clean":"2024-09-13T18:59:55.912418+0000","last_became_active":"2024-09-13T18:59:54.929684+0000","last_became_peered":"2024-09-13T18:59:54.929684+0000","last_unstale":"2024-09-13T18:59:55.912418+0000","last_undegraded":"2024-09-13T18:59:55.912418+0000","last_fullsized":"2024-09-13T18:59:55.912418+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:04.202976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911707+0000","last_change":"2024-09-13T18:59:54.925708+0000","last_active":"2024-09-13T18:59:55.911707+0000","last_peered":"2024-09-13T18:59:55.911707+0000","last_clean":"2024-09-13T18:59:55.911707+0000","last_became_active":"2024-09-13T18:59:54.925348+0000","last_became_peered":"2024-09-13T18:59:54.925348+0000","last_unstale":"2024-09-13T18:59:55.911707+0000","last_undegraded":"2024-09-13T18:59:55.911707+0000","last_fullsized":"2024-09-13T18:59:55.911707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:27.779538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983189+0000","last_change":"2024-09-13T18:59:54.932858+0000","last_active":"2024-09-13T18:59:55.983189+0000","last_peered":"2024-09-13T18:59:55.983189+0000","last_clean":"2024-09-13T18:59:55.983189+0000","last_became_active":"2024-09-13T18:59:54.932620+0000","last_became_peered":"2024-09-13T18:59:54.932620+0000","last_unstale":"2024-09-13T18:59:55.983189+0000","last_undegraded":"2024-09-13T18:59:55.983189+0000","last_fullsized":"2024-09-13T18:59:55.983189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:32.310927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.913227+0000","last_change":"2024-09-13T18:59:54.932067+0000","last_active":"2024-09-13T18:59:55.913227+0000","last_peered":"2024-09-13T18:59:55.913227+0000","last_clean":"2024-09-13T18:59:55.913227+0000","last_became_active":"2024-09-13T18:59:54.931713+0000","last_became_peered":"2024-09-13T18:59:54.931713+0000","last_unstale":"2024-09-13T18:59:55.913227+0000","last_undegraded":"2024-09-13T18:59:55.913227+0000","last_fullsized":"2024-09-13T18:59:55.913227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:31.874158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.913170+0000","last_change":"2024-09-13T18:59:54.488658+0000","last_active":"2024-09-13T18:59:55.913170+0000","last_peered":"2024-09-13T18:59:55.913170+0000","last_clean":"2024-09-13T18:59:55.913170+0000","last_became_active":"2024-09-13T18:59:54.487202+0000","last_became_peered":"2024-09-13T18:59:54.487202+0000","last_unstale":"2024-09-13T18:59:55.913170+0000","last_undegraded":"2024-09-13T18:59:55.913170+0000","last_fullsized":"2024-09-13T18:59:55.913170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:56.663487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906802+0000","last_change":"2024-09-13T18:59:54.930339+0000","last_active":"2024-09-13T18:59:55.906802+0000","last_peered":"2024-09-13T18:59:55.906802+0000","last_clean":"2024-09-13T18:59:55.906802+0000","last_became_active":"2024-09-13T18:59:54.930059+0000","last_became_peered":"2024-09-13T18:59:54.930059+0000","last_unstale":"2024-09-13T18:59:55.906802+0000","last_undegraded":"2024-09-13T18:59:55.906802+0000","last_fullsized":"2024-09-13T18:59:55.906802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:13.420178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983881+0000","last_change":"2024-09-13T18:59:54.479249+0000","last_active":"2024-09-13T18:59:55.983881+0000","last_peered":"2024-09-13T18:59:55.983881+0000","last_clean":"2024-09-13T18:59:55.983881+0000","last_became_active":"2024-09-13T18:59:54.478648+0000","last_became_peered":"2024-09-13T18:59:54.478648+0000","last_unstale":"2024-09-13T18:59:55.983881+0000","last_undegraded":"2024-09-13T18:59:55.983881+0000","last_fullsized":"2024-09-13T18:59:55.983881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:16.697357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983331+0000","last_change":"2024-09-13T18:59:54.933573+0000","last_active":"2024-09-13T18:59:55.983331+0000","last_peered":"2024-09-13T18:59:55.983331+0000","last_clean":"2024-09-13T18:59:55.983331+0000","last_became_active":"2024-09-13T18:59:54.933034+0000","last_became_peered":"2024-09-13T18:59:54.933034+0000","last_unstale":"2024-09-13T18:59:55.983331+0000","last_undegraded":"2024-09-13T18:59:55.983331+0000","last_fullsized":"2024-09-13T18:59:55.983331+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:35.521511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912169+0000","last_change":"2024-09-13T18:59:54.486066+0000","last_active":"2024-09-13T18:59:55.912169+0000","last_peered":"2024-09-13T18:59:55.912169+0000","last_clean":"2024-09-13T18:59:55.912169+0000","last_became_active":"2024-09-13T18:59:54.485363+0000","last_became_peered":"2024-09-13T18:59:54.485363+0000","last_unstale":"2024-09-13T18:59:55.912169+0000","last_undegraded":"2024-09-13T18:59:55.912169+0000","last_fullsized":"2024-09-13T18:59:55.912169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:05.242168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912842+0000","last_change":"2024-09-13T18:59:54.917595+0000","last_active":"2024-09-13T18:59:55.912842+0000","last_peered":"2024-09-13T18:59:55.912842+0000","last_clean":"2024-09-13T18:59:55.912842+0000","last_became_active":"2024-09-13T18:59:54.917229+0000","last_became_peered":"2024-09-13T18:59:54.917229+0000","last_unstale":"2024-09-13T18:59:55.912842+0000","last_undegraded":"2024-09-13T18:59:55.912842+0000","last_fullsized":"2024-09-13T18:59:55.912842+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:08.734214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983529+0000","last_change":"2024-09-13T18:59:54.481618+0000","last_active":"2024-09-13T18:59:55.983529+0000","last_peered":"2024-09-13T18:59:55.983529+0000","last_clean":"2024-09-13T18:59:55.983529+0000","last_became_active":"2024-09-13T18:59:54.481333+0000","last_became_peered":"2024-09-13T18:59:54.481333+0000","last_unstale":"2024-09-13T18:59:55.983529+0000","last_undegraded":"2024-09-13T18:59:55.983529+0000","last_fullsized":"2024-09-13T18:59:55.983529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:18.517726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912461+0000","last_change":"2024-09-13T18:59:54.921929+0000","last_active":"2024-09-13T18:59:55.912461+0000","last_peered":"2024-09-13T18:59:55.912461+0000","last_clean":"2024-09-13T18:59:55.912461+0000","last_became_active":"2024-09-13T18:59:54.921615+0000","last_became_peered":"2024-09-13T18:59:54.921615+0000","last_unstale":"2024-09-13T18:59:55.912461+0000","last_undegraded":"2024-09-13T18:59:55.912461+0000","last_fullsized":"2024-09-13T18:59:55.912461+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:42.424666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983730+0000","last_change":"2024-09-13T18:59:54.491235+0000","last_active":"2024-09-13T18:59:55.983730+0000","last_peered":"2024-09-13T18:59:55.983730+0000","last_clean":"2024-09-13T18:59:55.983730+0000","last_became_active":"2024-09-13T18:59:54.490931+0000","last_became_peered":"2024-09-13T18:59:54.490931+0000","last_unstale":"2024-09-13T18:59:55.983730+0000","last_undegraded":"2024-09-13T18:59:55.983730+0000","last_fullsized":"2024-09-13T18:59:55.983730+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:07.722937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911516+0000","last_change":"2024-09-13T18:59:54.916929+0000","last_active":"2024-09-13T18:59:55.911516+0000","last_peered":"2024-09-13T18:59:55.911516+0000","last_clean":"2024-09-13T18:59:55.911516+0000","last_became_active":"2024-09-13T18:59:54.916441+0000","last_became_peered":"2024-09-13T18:59:54.916441+0000","last_unstale":"2024-09-13T18:59:55.911516+0000","last_undegraded":"2024-09-13T18:59:55.911516+0000","last_fullsized":"2024-09-13T18:59:55.911516+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:17.708635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983378+0000","last_change":"2024-09-13T18:59:54.484521+0000","last_active":"2024-09-13T18:59:55.983378+0000","last_peered":"2024-09-13T18:59:55.983378+0000","last_clean":"2024-09-13T18:59:55.983378+0000","last_became_active":"2024-09-13T18:59:54.483999+0000","last_became_peered":"2024-09-13T18:59:54.483999+0000","last_unstale":"2024-09-13T18:59:55.983378+0000","last_undegraded":"2024-09-13T18:59:55.983378+0000","last_fullsized":"2024-09-13T18:59:55.983378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:04.591467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906068+0000","last_change":"2024-09-13T18:59:54.933592+0000","last_active":"2024-09-13T18:59:55.906068+0000","last_peered":"2024-09-13T18:59:55.906068+0000","last_clean":"2024-09-13T18:59:55.906068+0000","last_became_active":"2024-09-13T18:59:54.931212+0000","last_became_peered":"2024-09-13T18:59:54.931212+0000","last_unstale":"2024-09-13T18:59:55.906068+0000","last_undegraded":"2024-09-13T18:59:55.906068+0000","last_fullsized":"2024-09-13T18:59:55.906068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:19.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983313+0000","last_change":"2024-09-13T18:59:54.487179+0000","last_active":"2024-09-13T18:59:55.983313+0000","last_peered":"2024-09-13T18:59:55.983313+0000","last_clean":"2024-09-13T18:59:55.983313+0000","last_became_active":"2024-09-13T18:59:54.486891+0000","last_became_peered":"2024-09-13T18:59:54.486891+0000","last_unstale":"2024-09-13T18:59:55.983313+0000","last_undegraded":"2024-09-13T18:59:55.983313+0000","last_fullsized":"2024-09-13T18:59:55.983313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:06.601223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984368+0000","last_change":"2024-09-13T18:59:54.929414+0000","last_active":"2024-09-13T18:59:55.984368+0000","last_peered":"2024-09-13T18:59:55.984368+0000","last_clean":"2024-09-13T18:59:55.984368+0000","last_became_active":"2024-09-13T18:59:54.929166+0000","last_became_peered":"2024-09-13T18:59:54.929166+0000","last_unstale":"2024-09-13T18:59:55.984368+0000","last_undegraded":"2024-09-13T18:59:55.984368+0000","last_fullsized":"2024-09-13T18:59:55.984368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.634829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906128+0000","last_change":"2024-09-13T18:59:54.491461+0000","last_active":"2024-09-13T18:59:55.906128+0000","last_peered":"2024-09-13T18:59:55.906128+0000","last_clean":"2024-09-13T18:59:55.906128+0000","last_became_active":"2024-09-13T18:59:54.484865+0000","last_became_peered":"2024-09-13T18:59:54.484865+0000","last_unstale":"2024-09-13T18:59:55.906128+0000","last_undegraded":"2024-09-13T18:59:55.906128+0000","last_fullsized":"2024-09-13T18:59:55.906128+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:41.554844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912573+0000","last_change":"2024-09-13T18:59:54.922912+0000","last_active":"2024-09-13T18:59:55.912573+0000","last_peered":"2024-09-13T18:59:55.912573+0000","last_clean":"2024-09-13T18:59:55.912573+0000","last_became_active":"2024-09-13T18:59:54.922585+0000","last_became_peered":"2024-09-13T18:59:54.922585+0000","last_unstale":"2024-09-13T18:59:55.912573+0000","last_undegraded":"2024-09-13T18:59:55.912573+0000","last_fullsized":"2024-09-13T18:59:55.912573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:19.168132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912723+0000","last_change":"2024-09-13T18:59:54.488072+0000","last_active":"2024-09-13T18:59:55.912723+0000","last_peered":"2024-09-13T18:59:55.912723+0000","last_clean":"2024-09-13T18:59:55.912723+0000","last_became_active":"2024-09-13T18:59:54.487832+0000","last_became_peered":"2024-09-13T18:59:54.487832+0000","last_unstale":"2024-09-13T18:59:55.912723+0000","last_undegraded":"2024-09-13T18:59:55.912723+0000","last_fullsized":"2024-09-13T18:59:55.912723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:16.893623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.913071+0000","last_change":"2024-09-13T18:59:54.938310+0000","last_active":"2024-09-13T18:59:55.913071+0000","last_peered":"2024-09-13T18:59:55.913071+0000","last_clean":"2024-09-13T18:59:55.913071+0000","last_became_active":"2024-09-13T18:59:54.937881+0000","last_became_peered":"2024-09-13T18:59:54.937881+0000","last_unstale":"2024-09-13T18:59:55.913071+0000","last_undegraded":"2024-09-13T18:59:55.913071+0000","last_fullsized":"2024-09-13T18:59:55.913071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:26.574408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983639+0000","last_change":"2024-09-13T18:59:54.487873+0000","last_active":"2024-09-13T18:59:55.983639+0000","last_peered":"2024-09-13T18:59:55.983639+0000","last_clean":"2024-09-13T18:59:55.983639+0000","last_became_active":"2024-09-13T18:59:54.487327+0000","last_became_peered":"2024-09-13T18:59:54.487327+0000","last_unstale":"2024-09-13T18:59:55.983639+0000","last_undegraded":"2024-09-13T18:59:55.983639+0000","last_fullsized":"2024-09-13T18:59:55.983639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:38.573003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983497+0000","last_change":"2024-09-13T18:59:54.928838+0000","last_active":"2024-09-13T18:59:55.983497+0000","last_peered":"2024-09-13T18:59:55.983497+0000","last_clean":"2024-09-13T18:59:55.983497+0000","last_became_active":"2024-09-13T18:59:54.928464+0000","last_became_peered":"2024-09-13T18:59:54.928464+0000","last_unstale":"2024-09-13T18:59:55.983497+0000","last_undegraded":"2024-09-13T18:59:55.983497+0000","last_fullsized":"2024-09-13T18:59:55.983497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.673852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983915+0000","last_change":"2024-09-13T18:59:54.492617+0000","last_active":"2024-09-13T18:59:55.983915+0000","last_peered":"2024-09-13T18:59:55.983915+0000","last_clean":"2024-09-13T18:59:55.983915+0000","last_became_active":"2024-09-13T18:59:54.492315+0000","last_became_peered":"2024-09-13T18:59:54.492315+0000","last_unstale":"2024-09-13T18:59:55.983915+0000","last_undegraded":"2024-09-13T18:59:55.983915+0000","last_fullsized":"2024-09-13T18:59:55.983915+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:04.677443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906388+0000","last_change":"2024-09-13T18:59:54.927162+0000","last_active":"2024-09-13T18:59:55.906388+0000","last_peered":"2024-09-13T18:59:55.906388+0000","last_clean":"2024-09-13T18:59:55.906388+0000","last_became_active":"2024-09-13T18:59:54.925255+0000","last_became_peered":"2024-09-13T18:59:54.925255+0000","last_unstale":"2024-09-13T18:59:55.906388+0000","last_undegraded":"2024-09-13T18:59:55.906388+0000","last_fullsized":"2024-09-13T18:59:55.906388+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:39.584281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984205+0000","last_change":"2024-09-13T18:59:54.488108+0000","last_active":"2024-09-13T18:59:55.984205+0000","last_peered":"2024-09-13T18:59:55.984205+0000","last_clean":"2024-09-13T18:59:55.984205+0000","last_became_active":"2024-09-13T18:59:54.486990+0000","last_became_peered":"2024-09-13T18:59:54.486990+0000","last_unstale":"2024-09-13T18:59:55.984205+0000","last_undegraded":"2024-09-13T18:59:55.984205+0000","last_fullsized":"2024-09-13T18:59:55.984205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:30.948958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912129+0000","last_change":"2024-09-13T18:59:54.922445+0000","last_active":"2024-09-13T18:59:55.912129+0000","last_peered":"2024-09-13T18:59:55.912129+0000","last_clean":"2024-09-13T18:59:55.912129+0000","last_became_active":"2024-09-13T18:59:54.922051+0000","last_became_peered":"2024-09-13T18:59:54.922051+0000","last_unstale":"2024-09-13T18:59:55.912129+0000","last_undegraded":"2024-09-13T18:59:55.912129+0000","last_fullsized":"2024-09-13T18:59:55.912129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:12.840919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984137+0000","last_change":"2024-09-13T18:59:54.488862+0000","last_active":"2024-09-13T18:59:55.984137+0000","last_peered":"2024-09-13T18:59:55.984137+0000","last_clean":"2024-09-13T18:59:55.984137+0000","last_became_active":"2024-09-13T18:59:54.488557+0000","last_became_peered":"2024-09-13T18:59:54.488557+0000","last_unstale":"2024-09-13T18:59:55.984137+0000","last_undegraded":"2024-09-13T18:59:55.984137+0000","last_fullsized":"2024-09-13T18:59:55.984137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:00.172763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912743+0000","last_change":"2024-09-13T18:59:54.920001+0000","last_active":"2024-09-13T18:59:55.912743+0000","last_peered":"2024-09-13T18:59:55.912743+0000","last_clean":"2024-09-13T18:59:55.912743+0000","last_became_active":"2024-09-13T18:59:54.919723+0000","last_became_peered":"2024-09-13T18:59:54.919723+0000","last_unstale":"2024-09-13T18:59:55.912743+0000","last_undegraded":"2024-09-13T18:59:55.912743+0000","last_fullsized":"2024-09-13T18:59:55.912743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:17.708635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983596+0000","last_change":"2024-09-13T18:59:54.480876+0000","last_active":"2024-09-13T18:59:55.983596+0000","last_peered":"2024-09-13T18:59:55.983596+0000","last_clean":"2024-09-13T18:59:55.983596+0000","last_became_active":"2024-09-13T18:59:54.480405+0000","last_became_peered":"2024-09-13T18:59:54.480405+0000","last_unstale":"2024-09-13T18:59:55.983596+0000","last_undegraded":"2024-09-13T18:59:55.983596+0000","last_fullsized":"2024-09-13T18:59:55.983596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:12.408901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983108+0000","last_change":"2024-09-13T18:59:54.932175+0000","last_active":"2024-09-13T18:59:55.983108+0000","last_peered":"2024-09-13T18:59:55.983108+0000","last_clean":"2024-09-13T18:59:55.983108+0000","last_became_active":"2024-09-13T18:59:54.931933+0000","last_became_peered":"2024-09-13T18:59:54.931933+0000","last_unstale":"2024-09-13T18:59:55.983108+0000","last_undegraded":"2024-09-13T18:59:55.983108+0000","last_fullsized":"2024-09-13T18:59:55.983108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:45.659843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911364+0000","last_change":"2024-09-13T18:59:54.485402+0000","last_active":"2024-09-13T18:59:55.911364+0000","last_peered":"2024-09-13T18:59:55.911364+0000","last_clean":"2024-09-13T18:59:55.911364+0000","last_became_active":"2024-09-13T18:59:54.485118+0000","last_became_peered":"2024-09-13T18:59:54.485118+0000","last_unstale":"2024-09-13T18:59:55.911364+0000","last_undegraded":"2024-09-13T18:59:55.911364+0000","last_fullsized":"2024-09-13T18:59:55.911364+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:53.932770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906220+0000","last_change":"2024-09-13T18:59:54.924875+0000","last_active":"2024-09-13T18:59:55.906220+0000","last_peered":"2024-09-13T18:59:55.906220+0000","last_clean":"2024-09-13T18:59:55.906220+0000","last_became_active":"2024-09-13T18:59:54.923425+0000","last_became_peered":"2024-09-13T18:59:54.923425+0000","last_unstale":"2024-09-13T18:59:55.906220+0000","last_undegraded":"2024-09-13T18:59:55.906220+0000","last_fullsized":"2024-09-13T18:59:55.906220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:30.795312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911266+0000","last_change":"2024-09-13T18:59:54.489804+0000","last_active":"2024-09-13T18:59:55.911266+0000","last_peered":"2024-09-13T18:59:55.911266+0000","last_clean":"2024-09-13T18:59:55.911266+0000","last_became_active":"2024-09-13T18:59:54.489335+0000","last_became_peered":"2024-09-13T18:59:54.489335+0000","last_unstale":"2024-09-13T18:59:55.911266+0000","last_undegraded":"2024-09-13T18:59:55.911266+0000","last_fullsized":"2024-09-13T18:59:55.911266+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:39.662574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912606+0000","last_change":"2024-09-13T18:59:54.915445+0000","last_active":"2024-09-13T18:59:55.912606+0000","last_peered":"2024-09-13T18:59:55.912606+0000","last_clean":"2024-09-13T18:59:55.912606+0000","last_became_active":"2024-09-13T18:59:54.915116+0000","last_became_peered":"2024-09-13T18:59:54.915116+0000","last_unstale":"2024-09-13T18:59:55.912606+0000","last_undegraded":"2024-09-13T18:59:55.912606+0000","last_fullsized":"2024-09-13T18:59:55.912606+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:49.150126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983599+0000","last_change":"2024-09-13T18:59:54.488663+0000","last_active":"2024-09-13T18:59:55.983599+0000","last_peered":"2024-09-13T18:59:55.983599+0000","last_clean":"2024-09-13T18:59:55.983599+0000","last_became_active":"2024-09-13T18:59:54.488420+0000","last_became_peered":"2024-09-13T18:59:54.488420+0000","last_unstale":"2024-09-13T18:59:55.983599+0000","last_undegraded":"2024-09-13T18:59:55.983599+0000","last_fullsized":"2024-09-13T18:59:55.983599+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:06.601223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.913079+0000","last_change":"2024-09-13T18:59:54.922219+0000","last_active":"2024-09-13T18:59:55.913079+0000","last_peered":"2024-09-13T18:59:55.913079+0000","last_clean":"2024-09-13T18:59:55.913079+0000","last_became_active":"2024-09-13T18:59:54.921961+0000","last_became_peered":"2024-09-13T18:59:54.921961+0000","last_unstale":"2024-09-13T18:59:55.913079+0000","last_undegraded":"2024-09-13T18:59:55.913079+0000","last_fullsized":"2024-09-13T18:59:55.913079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:25.119320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912718+0000","last_change":"2024-09-13T18:59:54.489598+0000","last_active":"2024-09-13T18:59:55.912718+0000","last_peered":"2024-09-13T18:59:55.912718+0000","last_clean":"2024-09-13T18:59:55.912718+0000","last_became_active":"2024-09-13T18:59:54.486929+0000","last_became_peered":"2024-09-13T18:59:54.486929+0000","last_unstale":"2024-09-13T18:59:55.912718+0000","last_undegraded":"2024-09-13T18:59:55.912718+0000","last_fullsized":"2024-09-13T18:59:55.912718+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:31.299649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984127+0000","last_change":"2024-09-13T18:59:54.929056+0000","last_active":"2024-09-13T18:59:55.984127+0000","last_peered":"2024-09-13T18:59:55.984127+0000","last_clean":"2024-09-13T18:59:55.984127+0000","last_became_active":"2024-09-13T18:59:54.928820+0000","last_became_peered":"2024-09-13T18:59:54.928820+0000","last_unstale":"2024-09-13T18:59:55.984127+0000","last_undegraded":"2024-09-13T18:59:55.984127+0000","last_fullsized":"2024-09-13T18:59:55.984127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:49.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983386+0000","last_change":"2024-09-13T18:59:54.488257+0000","last_active":"2024-09-13T18:59:55.983386+0000","last_peered":"2024-09-13T18:59:55.983386+0000","last_clean":"2024-09-13T18:59:55.983386+0000","last_became_active":"2024-09-13T18:59:54.486715+0000","last_became_peered":"2024-09-13T18:59:54.486715+0000","last_unstale":"2024-09-13T18:59:55.983386+0000","last_undegraded":"2024-09-13T18:59:55.983386+0000","last_fullsized":"2024-09-13T18:59:55.983386+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:07.774808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906501+0000","last_change":"2024-09-13T18:59:54.924055+0000","last_active":"2024-09-13T18:59:55.906501+0000","last_peered":"2024-09-13T18:59:55.906501+0000","last_clean":"2024-09-13T18:59:55.906501+0000","last_became_active":"2024-09-13T18:59:54.923787+0000","last_became_peered":"2024-09-13T18:59:54.923787+0000","last_unstale":"2024-09-13T18:59:55.906501+0000","last_undegraded":"2024-09-13T18:59:55.906501+0000","last_fullsized":"2024-09-13T18:59:55.906501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:07.929026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912508+0000","last_change":"2024-09-13T18:59:54.492772+0000","last_active":"2024-09-13T18:59:55.912508+0000","last_peered":"2024-09-13T18:59:55.912508+0000","last_clean":"2024-09-13T18:59:55.912508+0000","last_became_active":"2024-09-13T18:59:54.491884+0000","last_became_peered":"2024-09-13T18:59:54.491884+0000","last_unstale":"2024-09-13T18:59:55.912508+0000","last_undegraded":"2024-09-13T18:59:55.912508+0000","last_fullsized":"2024-09-13T18:59:55.912508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:37.615670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983817+0000","last_change":"2024-09-13T18:59:54.917661+0000","last_active":"2024-09-13T18:59:55.983817+0000","last_peered":"2024-09-13T18:59:55.983817+0000","last_clean":"2024-09-13T18:59:55.983817+0000","last_became_active":"2024-09-13T18:59:54.917367+0000","last_became_peered":"2024-09-13T18:59:54.917367+0000","last_unstale":"2024-09-13T18:59:55.983817+0000","last_undegraded":"2024-09-13T18:59:55.983817+0000","last_fullsized":"2024-09-13T18:59:55.983817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:39.984672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983529+0000","last_change":"2024-09-13T18:59:54.483760+0000","last_active":"2024-09-13T18:59:55.983529+0000","last_peered":"2024-09-13T18:59:55.983529+0000","last_clean":"2024-09-13T18:59:55.983529+0000","last_became_active":"2024-09-13T18:59:54.483130+0000","last_became_peered":"2024-09-13T18:59:54.483130+0000","last_unstale":"2024-09-13T18:59:55.983529+0000","last_undegraded":"2024-09-13T18:59:55.983529+0000","last_fullsized":"2024-09-13T18:59:55.983529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:29.784034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983304+0000","last_change":"2024-09-13T18:59:54.926683+0000","last_active":"2024-09-13T18:59:55.983304+0000","last_peered":"2024-09-13T18:59:55.983304+0000","last_clean":"2024-09-13T18:59:55.983304+0000","last_became_active":"2024-09-13T18:59:54.926424+0000","last_became_peered":"2024-09-13T18:59:54.926424+0000","last_unstale":"2024-09-13T18:59:55.983304+0000","last_undegraded":"2024-09-13T18:59:55.983304+0000","last_fullsized":"2024-09-13T18:59:55.983304+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:27.791647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912228+0000","last_change":"2024-09-13T18:59:54.488115+0000","last_active":"2024-09-13T18:59:55.912228+0000","last_peered":"2024-09-13T18:59:55.912228+0000","last_clean":"2024-09-13T18:59:55.912228+0000","last_became_active":"2024-09-13T18:59:54.487847+0000","last_became_peered":"2024-09-13T18:59:54.487847+0000","last_unstale":"2024-09-13T18:59:55.912228+0000","last_undegraded":"2024-09-13T18:59:55.912228+0000","last_fullsized":"2024-09-13T18:59:55.912228+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:34.510234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983736+0000","last_change":"2024-09-13T18:59:54.933277+0000","last_active":"2024-09-13T18:59:55.983736+0000","last_peered":"2024-09-13T18:59:55.983736+0000","last_clean":"2024-09-13T18:59:55.983736+0000","last_became_active":"2024-09-13T18:59:54.931633+0000","last_became_peered":"2024-09-13T18:59:54.931633+0000","last_unstale":"2024-09-13T18:59:55.983736+0000","last_undegraded":"2024-09-13T18:59:55.983736+0000","last_fullsized":"2024-09-13T18:59:55.983736+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:50.019752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983011+0000","last_change":"2024-09-13T18:59:54.479017+0000","last_active":"2024-09-13T18:59:55.983011+0000","last_peered":"2024-09-13T18:59:55.983011+0000","last_clean":"2024-09-13T18:59:55.983011+0000","last_became_active":"2024-09-13T18:59:54.478781+0000","last_became_peered":"2024-09-13T18:59:54.478781+0000","last_unstale":"2024-09-13T18:59:55.983011+0000","last_undegraded":"2024-09-13T18:59:55.983011+0000","last_fullsized":"2024-09-13T18:59:55.983011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:25.639528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983787+0000","last_change":"2024-09-13T18:59:54.926283+0000","last_active":"2024-09-13T18:59:55.983787+0000","last_peered":"2024-09-13T18:59:55.983787+0000","last_clean":"2024-09-13T18:59:55.983787+0000","last_became_active":"2024-09-13T18:59:54.926012+0000","last_became_peered":"2024-09-13T18:59:54.926012+0000","last_unstale":"2024-09-13T18:59:55.983787+0000","last_undegraded":"2024-09-13T18:59:55.983787+0000","last_fullsized":"2024-09-13T18:59:55.983787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:12.840919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983656+0000","last_change":"2024-09-13T18:59:54.492304+0000","last_active":"2024-09-13T18:59:55.983656+0000","last_peered":"2024-09-13T18:59:55.983656+0000","last_clean":"2024-09-13T18:59:55.983656+0000","last_became_active":"2024-09-13T18:59:54.492116+0000","last_became_peered":"2024-09-13T18:59:54.492116+0000","last_unstale":"2024-09-13T18:59:55.983656+0000","last_undegraded":"2024-09-13T18:59:55.983656+0000","last_fullsized":"2024-09-13T18:59:55.983656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:00.172763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912977+0000","last_change":"2024-09-13T18:59:54.927737+0000","last_active":"2024-09-13T18:59:55.912977+0000","last_peered":"2024-09-13T18:59:55.912977+0000","last_clean":"2024-09-13T18:59:55.912977+0000","last_became_active":"2024-09-13T18:59:54.927220+0000","last_became_peered":"2024-09-13T18:59:54.927220+0000","last_unstale":"2024-09-13T18:59:55.912977+0000","last_undegraded":"2024-09-13T18:59:55.912977+0000","last_fullsized":"2024-09-13T18:59:55.912977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:49.150126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912824+0000","last_change":"2024-09-13T18:59:54.485971+0000","last_active":"2024-09-13T18:59:55.912824+0000","last_peered":"2024-09-13T18:59:55.912824+0000","last_clean":"2024-09-13T18:59:55.912824+0000","last_became_active":"2024-09-13T18:59:54.485732+0000","last_became_peered":"2024-09-13T18:59:54.485732+0000","last_unstale":"2024-09-13T18:59:55.912824+0000","last_undegraded":"2024-09-13T18:59:55.912824+0000","last_fullsized":"2024-09-13T18:59:55.912824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:16.893623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912423+0000","last_change":"2024-09-13T18:59:54.936114+0000","last_active":"2024-09-13T18:59:55.912423+0000","last_peered":"2024-09-13T18:59:55.912423+0000","last_clean":"2024-09-13T18:59:55.912423+0000","last_became_active":"2024-09-13T18:59:54.935851+0000","last_became_peered":"2024-09-13T18:59:54.935851+0000","last_unstale":"2024-09-13T18:59:55.912423+0000","last_undegraded":"2024-09-13T18:59:55.912423+0000","last_fullsized":"2024-09-13T18:59:55.912423+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:50.019752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906587+0000","last_change":"2024-09-13T18:59:54.489242+0000","last_active":"2024-09-13T18:59:55.906587+0000","last_peered":"2024-09-13T18:59:55.906587+0000","last_clean":"2024-09-13T18:59:55.906587+0000","last_became_active":"2024-09-13T18:59:54.487354+0000","last_became_peered":"2024-09-13T18:59:54.487354+0000","last_unstale":"2024-09-13T18:59:55.906587+0000","last_undegraded":"2024-09-13T18:59:55.906587+0000","last_fullsized":"2024-09-13T18:59:55.906587+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:55.510178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.912941+0000","last_change":"2024-09-13T18:59:54.916895+0000","last_active":"2024-09-13T18:59:55.912941+0000","last_peered":"2024-09-13T18:59:55.912941+0000","last_clean":"2024-09-13T18:59:55.912941+0000","last_became_active":"2024-09-13T18:59:54.916559+0000","last_became_peered":"2024-09-13T18:59:54.916559+0000","last_unstale":"2024-09-13T18:59:55.912941+0000","last_undegraded":"2024-09-13T18:59:55.912941+0000","last_fullsized":"2024-09-13T18:59:55.912941+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:45.659843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983920+0000","last_change":"2024-09-13T18:59:54.487901+0000","last_active":"2024-09-13T18:59:55.983920+0000","last_peered":"2024-09-13T18:59:55.983920+0000","last_clean":"2024-09-13T18:59:55.983920+0000","last_became_active":"2024-09-13T18:59:54.487560+0000","last_became_peered":"2024-09-13T18:59:54.487560+0000","last_unstale":"2024-09-13T18:59:55.983920+0000","last_undegraded":"2024-09-13T18:59:55.983920+0000","last_fullsized":"2024-09-13T18:59:55.983920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:03.191698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906469+0000","last_change":"2024-09-13T18:59:54.924865+0000","last_active":"2024-09-13T18:59:55.906469+0000","last_peered":"2024-09-13T18:59:55.906469+0000","last_clean":"2024-09-13T18:59:55.906469+0000","last_became_active":"2024-09-13T18:59:54.923408+0000","last_became_peered":"2024-09-13T18:59:54.923408+0000","last_unstale":"2024-09-13T18:59:55.906469+0000","last_undegraded":"2024-09-13T18:59:55.906469+0000","last_fullsized":"2024-09-13T18:59:55.906469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:42.027105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.906320+0000","last_change":"2024-09-13T18:59:54.491207+0000","last_active":"2024-09-13T18:59:55.906320+0000","last_peered":"2024-09-13T18:59:55.906320+0000","last_clean":"2024-09-13T18:59:55.906320+0000","last_became_active":"2024-09-13T18:59:54.490923+0000","last_became_peered":"2024-09-13T18:59:54.490923+0000","last_unstale":"2024-09-13T18:59:55.906320+0000","last_undegraded":"2024-09-13T18:59:55.906320+0000","last_fullsized":"2024-09-13T18:59:55.906320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:50.958292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983190+0000","last_change":"2024-09-13T18:59:54.931191+0000","last_active":"2024-09-13T18:59:55.983190+0000","last_peered":"2024-09-13T18:59:55.983190+0000","last_clean":"2024-09-13T18:59:55.983190+0000","last_became_active":"2024-09-13T18:59:54.930921+0000","last_became_peered":"2024-09-13T18:59:54.930921+0000","last_unstale":"2024-09-13T18:59:55.983190+0000","last_undegraded":"2024-09-13T18:59:55.983190+0000","last_fullsized":"2024-09-13T18:59:55.983190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:54.944048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.984784+0000","last_change":"2024-09-13T18:59:54.486186+0000","last_active":"2024-09-13T18:59:55.984784+0000","last_peered":"2024-09-13T18:59:55.984784+0000","last_clean":"2024-09-13T18:59:55.984784+0000","last_became_active":"2024-09-13T18:59:54.485918+0000","last_became_peered":"2024-09-13T18:59:54.485918+0000","last_unstale":"2024-09-13T18:59:55.984784+0000","last_undegraded":"2024-09-13T18:59:55.984784+0000","last_fullsized":"2024-09-13T18:59:55.984784+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:41.015828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983010+0000","last_change":"2024-09-13T18:59:54.923880+0000","last_active":"2024-09-13T18:59:55.983010+0000","last_peered":"2024-09-13T18:59:55.983010+0000","last_clean":"2024-09-13T18:59:55.983010+0000","last_became_active":"2024-09-13T18:59:54.923620+0000","last_became_peered":"2024-09-13T18:59:54.923620+0000","last_unstale":"2024-09-13T18:59:55.983010+0000","last_undegraded":"2024-09-13T18:59:55.983010+0000","last_fullsized":"2024-09-13T18:59:55.983010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:34.430638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.911913+0000","last_change":"2024-09-13T18:59:54.489464+0000","last_active":"2024-09-13T18:59:55.911913+0000","last_peered":"2024-09-13T18:59:55.911913+0000","last_clean":"2024-09-13T18:59:55.911913+0000","last_became_active":"2024-09-13T18:59:54.489140+0000","last_became_peered":"2024-09-13T18:59:54.489140+0000","last_unstale":"2024-09-13T18:59:55.911913+0000","last_undegraded":"2024-09-13T18:59:55.911913+0000","last_fullsized":"2024-09-13T18:59:55.911913+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.212357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983003+0000","last_change":"2024-09-13T18:59:54.935431+0000","last_active":"2024-09-13T18:59:55.983003+0000","last_peered":"2024-09-13T18:59:55.983003+0000","last_clean":"2024-09-13T18:59:55.983003+0000","last_became_active":"2024-09-13T18:59:54.934245+0000","last_became_peered":"2024-09-13T18:59:54.934245+0000","last_unstale":"2024-09-13T18:59:55.983003+0000","last_undegraded":"2024-09-13T18:59:55.983003+0000","last_fullsized":"2024-09-13T18:59:55.983003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:17.904901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983325+0000","last_change":"2024-09-13T18:59:54.479505+0000","last_active":"2024-09-13T18:59:55.983325+0000","last_peered":"2024-09-13T18:59:55.983325+0000","last_clean":"2024-09-13T18:59:55.983325+0000","last_became_active":"2024-09-13T18:59:54.479028+0000","last_became_peered":"2024-09-13T18:59:54.479028+0000","last_unstale":"2024-09-13T18:59:55.983325+0000","last_undegraded":"2024-09-13T18:59:55.983325+0000","last_fullsized":"2024-09-13T18:59:55.983325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:56.658864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983539+0000","last_change":"2024-09-13T18:59:54.926637+0000","last_active":"2024-09-13T18:59:55.983539+0000","last_peered":"2024-09-13T18:59:55.983539+0000","last_clean":"2024-09-13T18:59:55.983539+0000","last_became_active":"2024-09-13T18:59:54.926278+0000","last_became_peered":"2024-09-13T18:59:54.926278+0000","last_unstale":"2024-09-13T18:59:55.983539+0000","last_undegraded":"2024-09-13T18:59:55.983539+0000","last_fullsized":"2024-09-13T18:59:55.983539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:54.459536+0000","last_clean_scrub_stamp":"2024-09-13T18:59:54.459536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:50.787503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:59:55.983260+0000","last_change":"2024-09-13T18:59:54.481727+0000","last_active":"2024-09-13T18:59:55.983260+0000","last_peered":"2024-09-13T18:59:55.983260+0000","last_clean":"2024-09-13T18:59:55.983260+0000","last_became_active":"2024-09-13T18:59:54.481282+0000","last_became_peered":"2024-09-13T18:59:54.481282+0000","last_unstale":"2024-09-13T18:59:55.983260+0000","last_undegraded":"2024-09-13T18:59:55.983260+0000","last_fullsized":"2024-09-13T18:59:55.983260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:59:53.448259+0000","last_clean_scrub_stamp":"2024-09-13T18:59:53.448259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:23.661688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:59:54.906772+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T18:59:54.906772+0000","last_peered":"2024-09-13T18:59:54.906772+0000","last_clean":"2024-09-13T18:59:54.906772+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T18:59:54.906772+0000","last_undegraded":"2024-09-13T18:59:54.906772+0000","last_fullsized":"2024-09-13T18:59:54.906772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1478656,"data_stored":960558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76300000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.42599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.48999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.51800000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.69699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.755}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.877},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45100000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":369666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.84599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.627,"15min":0.628},"min":{"1min":0.45600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.81599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.745}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.84199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.83899999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91400000000000003,"5min":1.105,"15min":1.105},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.86799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0489999999999999,"5min":1.492,"15min":1.492},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.89200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.752},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.79800000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88600000000000001,"5min":1.204,"15min":1.204},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86499999999999999,"5min":1.25,"15min":1.25},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83199999999999996,"5min":1.337,"15min":1.337},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94499999999999995,"5min":1.391,"15min":1.391},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71399999999999997,"5min":1.373,"15min":1.373},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76800000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.80900000000000005,"15min":0.82999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.792,"15min":1.792},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":1.49,"15min":1.49},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.375},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":1.294,"15min":1.294},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.752,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.496},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.474,"15min":1.474},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90200000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.117,"15min":1.117},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.022,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":369686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44600000000000001,"15min":0.45600000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.54700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60999999999999999,"5min":3.339,"15min":3.339},"last":0.376},{"interface":"front","average":{"1min":0.433,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64600000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":1.095,"15min":1.095},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.60299999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.89900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.86099999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.624},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":3.383,"15min":3.383},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91700000000000004,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97999999999999998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0129999999999999,"5min":1.198,"15min":1.198},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.89800000000000002,"15min":0.93300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90400000000000003,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96199999999999997,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92300000000000004,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":371138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.372},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.495}]},{"osd":1,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58799999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.436},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":0.998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95899999999999996,"5min":1.079,"15min":1.079},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93100000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0169999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.171,"15min":1.171},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":897024,"data_stored":371754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58299999999999996,"5min":1.486,"15min":1.486},"last":0.309},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71399999999999997,"5min":1.27,"15min":1.27},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.379},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68500000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.61499999999999999,"5min":1.228,"15min":1.228},"last":0.433}]},{"osd":4,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81999999999999995,"15min":0.84199999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98999999999999999,"5min":1.611,"15min":1.611},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0229999999999999,"5min":1.236,"15min":1.236},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.99399999999999999,"5min":1.137,"15min":1.137},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.056,"5min":1.284,"15min":1.284},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98099999999999998,"5min":1.214,"15min":1.214},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0069999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.67300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1470464,"data_stored":959942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56299999999999994,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.379,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59899999999999998,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.623,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.97299999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.99099999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.754},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95499999999999996,"5min":1.23,"15min":1.23},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.004},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0069999999999999,"5min":1.246,"15min":1.246},"last":0.624},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0229999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.56699999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0269999999999999,"5min":1.339,"15min":1.339},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:59:59.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:59:59.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:59:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.709+0000 7f4826600640 1 Processor -- start 2024-09-13T18:59:59.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.709+0000 7f4826600640 1 -- start start 2024-09-13T18:59:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4820154ad0 0x7f48200cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f482006f830 0x7f482006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48200ce2c0 0x7f48200cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482006b5b0 con 0x7f4820154ad0 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482006b7c0 con 0x7f48200ce2c0 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.710+0000 7f4826600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482006baa0 con 0x7f482006f830 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4820154ad0 0x7f48200cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4820154ad0 0x7f48200cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43230/0 (socket says 172.21.15.33:43230) 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 -- 172.21.15.33:0/3613842124 learned_addr learned my addr 172.21.15.33:0/3613842124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f4817e00640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f482006f830 0x7f482006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481fe00640 1 --2- 172.21.15.33:0/3613842124 >> v2:172.21.15.103:3300/0 conn(0x7f48200ce2c0 0x7f48200cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 -- 172.21.15.33:0/3613842124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f482006f830 msgr2=0x7f482006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f482006f830 0x7f482006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 -- 172.21.15.33:0/3613842124 >> v2:172.21.15.103:3300/0 conn(0x7f48200ce2c0 msgr2=0x7f48200cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 --2- 172.21.15.33:0/3613842124 >> v2:172.21.15.103:3300/0 conn(0x7f48200ce2c0 0x7f48200cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.711+0000 7f481f400640 1 -- 172.21.15.33:0/3613842124 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482006bd80 con 0x7f4820154ad0 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.712+0000 7f481f400640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4820154ad0 0x7f48200cdd80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f482015ab20 tx=0x7f481002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b24575b71377da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f481ea00640 1 -- 172.21.15.33:0/3613842124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481002ae90 con 0x7f4820154ad0 2024-09-13T18:59:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f481ea00640 1 -- 172.21.15.33:0/3613842124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810032440 con 0x7f4820154ad0 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f481ea00640 1 -- 172.21.15.33:0/3613842124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48100327d0 con 0x7f4820154ad0 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 -- 172.21.15.33:0/3613842124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4820154ad0 msgr2=0x7f48200cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4820154ad0 0x7f48200cdd80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f482015ab20 tx=0x7f481002a140 comp rx=0 tx=0).stop 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 -- 172.21.15.33:0/3613842124 shutdown_connections 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f482006f830 0x7f482006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 --2- 172.21.15.33:0/3613842124 >> v2:172.21.15.103:3300/0 conn(0x7f48200ce2c0 0x7f48200cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 --2- 172.21.15.33:0/3613842124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4820154ad0 0x7f48200cdd80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 -- 172.21.15.33:0/3613842124 >> 172.21.15.33:0/3613842124 conn(0x7f48200b0580 msgr2=0x7f48200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 -- 172.21.15.33:0/3613842124 shutdown_connections 2024-09-13T18:59:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.713+0000 7f4826600640 1 -- 172.21.15.33:0/3613842124 wait complete. 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.715+0000 7f4826600640 1 Processor -- start 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.715+0000 7f4826600640 1 -- start start 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820154ad0 0x7f48200b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48200b30f0 0x7f48200c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4820139a90 con 0x7f48200c89b0 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482013ecf0 con 0x7f4820154ad0 2024-09-13T18:59:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4826600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4820138e80 con 0x7f48200b30f0 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f481fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f481f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820154ad0 0x7f48200b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f481fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43246/0 (socket says 172.21.15.33:43246) 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f481fe00640 1 -- 172.21.15.33:0/3102216084 learned_addr learned my addr 172.21.15.33:0/3102216084 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.716+0000 7f4817e00640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48200b30f0 0x7f48200c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 -- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48200b30f0 msgr2=0x7f48200c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48200b30f0 0x7f48200c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 -- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820154ad0 msgr2=0x7f48200b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820154ad0 0x7f48200b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 -- 172.21.15.33:0/3102216084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100094d0 con 0x7f48200c89b0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f481fe00640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4818007e40 tx=0x7f481800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818014620 con 0x7f48200c89b0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481800ee90 con 0x7f48200c89b0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180149e0 con 0x7f48200c89b0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4820139160 con 0x7f48200c89b0 2024-09-13T18:59:59.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.717+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4820139720 con 0x7f48200c89b0 2024-09-13T18:59:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.719+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820139c40 con 0x7f48200c89b0 2024-09-13T18:59:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.719+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4818014b40 con 0x7f48200c89b0 2024-09-13T18:59:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.720+0000 7f4817400640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 0x7f47fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:59:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.720+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4818089af0 con 0x7f48200c89b0 2024-09-13T18:59:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.721+0000 7f481f400640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 0x7f47fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:59:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.721+0000 7f481f400640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 0x7f47fc06d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4810034000 tx=0x7f481002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:59:59.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.724+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4820139c40 con 0x7f48200c89b0 2024-09-13T18:59:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.974+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4820139c40 con 0x7f48200c89b0 2024-09-13T18:59:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.978+0000 7f4817400640 1 -- 172.21.15.33:0/3102216084 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4820139c40 con 0x7f48200c89b0 2024-09-13T18:59:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 msgr2=0x7f47fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 0x7f47fc06d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4810034000 tx=0x7f481002e000 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 msgr2=0x7f48201f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4818007e40 tx=0x7f481800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 shutdown_connections 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f47fc06ac00 0x7f47fc06d0c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48200c89b0 0x7f48201f55b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48200b30f0 0x7f48200c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 --2- 172.21.15.33:0/3102216084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820154ad0 0x7f48200b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:59:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 >> 172.21.15.33:0/3102216084 conn(0x7f48200b0580 msgr2=0x7f482015b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:59:59.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 shutdown_connections 2024-09-13T18:59:59.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T18:59:59.980+0000 7f4826600640 1 -- 172.21.15.33:0/3102216084 wait complete. 2024-09-13T18:59:59.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.151+0000 7fbdef200640 1 Processor -- start 2024-09-13T19:00:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.152+0000 7fbdef200640 1 -- start start 2024-09-13T19:00:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdef200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdf00b40c0 0x7fbdf015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdef200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbdf00cbac0 0x7fbdf015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdef200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00cbfc0 con 0x7fbdf015a5c0 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdef200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00cce20 con 0x7fbdf00cbac0 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdef200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00707a0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdee800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbdf00cbac0 0x7fbdf015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdee800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbdf00cbac0 0x7fbdf015aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43258/0 (socket says 172.21.15.33:43258) 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbdee800640 1 -- 172.21.15.33:0/1821330007 learned_addr learned my addr 172.21.15.33:0/1821330007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.153+0000 7fbde5400640 1 --2- 172.21.15.33:0/1821330007 >> v2:172.21.15.103:3300/0 conn(0x7fbdf00b40c0 0x7fbdf015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.154+0000 7fbdee800640 1 -- 172.21.15.33:0/1821330007 >> v2:172.21.15.103:3300/0 conn(0x7fbdf00b40c0 msgr2=0x7fbdf015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.154+0000 7fbdee800640 1 --2- 172.21.15.33:0/1821330007 >> v2:172.21.15.103:3300/0 conn(0x7fbdf00b40c0 0x7fbdf015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.154+0000 7fbdee800640 1 -- 172.21.15.33:0/1821330007 >> v1:172.21.15.103:6789/0 conn(0x7fbdf015a5c0 legacy=0x7fbdf00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.154+0000 7fbdee800640 1 -- 172.21.15.33:0/1821330007 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0070a80 con 0x7fbdf00cbac0 2024-09-13T19:00:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbdee800640 1 --2- 172.21.15.33:0/1821330007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00cbac0 0x7fbdf015aee0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0061c10 tx=0x7fbde802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a86c21fc0669c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbded400640 1 -- 172.21.15.33:0/1821330007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031600 con 0x7fbdf00cbac0 2024-09-13T19:00:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbded400640 1 -- 172.21.15.33:0/1821330007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde802d050 con 0x7fbdf00cbac0 2024-09-13T19:00:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbded400640 1 -- 172.21.15.33:0/1821330007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031980 con 0x7fbdf00cbac0 2024-09-13T19:00:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbdef200640 1 -- 172.21.15.33:0/1821330007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00cbac0 msgr2=0x7fbdf015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.155+0000 7fbdef200640 1 --2- 172.21.15.33:0/1821330007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00cbac0 0x7fbdf015aee0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0061c10 tx=0x7fbde802a6a0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 -- 172.21.15.33:0/1821330007 shutdown_connections 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 --2- 172.21.15.33:0/1821330007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00cbac0 0x7fbdf015aee0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 --2- 172.21.15.33:0/1821330007 >> v2:172.21.15.103:3300/0 conn(0x7fbdf00b40c0 0x7fbdf015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 -- 172.21.15.33:0/1821330007 >> 172.21.15.33:0/1821330007 conn(0x7fbdf00ae310 msgr2=0x7fbdf00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 -- 172.21.15.33:0/1821330007 shutdown_connections 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.156+0000 7fbdef200640 1 -- 172.21.15.33:0/1821330007 wait complete. 2024-09-13T19:00:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.157+0000 7fbdef200640 1 Processor -- start 2024-09-13T19:00:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.157+0000 7fbdef200640 1 -- start start 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbdf00cbac0 0x7fbdf01518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf015a5c0 0x7fbdf015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf013de80 con 0x7fbdf00b40c0 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf015d7a0 con 0x7fbdf015a5c0 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.158+0000 7fbdef200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0154200 con 0x7fbdf00cbac0 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43260/0 (socket says 172.21.15.33:43260) 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 -- 172.21.15.33:0/3255383714 learned_addr learned my addr 172.21.15.33:0/3255383714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbde5400640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbdf00cbac0 0x7fbdf01518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdee800640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf015a5c0 0x7fbdf015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 -- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbdf00cbac0 msgr2=0x7fbdf01518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbdf00cbac0 0x7fbdf01518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 -- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf015a5c0 msgr2=0x7fbdf015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf015a5c0 0x7fbdf015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 -- 172.21.15.33:0/3255383714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8009b30 con 0x7fbdf00b40c0 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.159+0000 7fbdede00640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c400 tx=0x7fbde000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.160+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00052d0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.160+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0005430 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.160+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0003830 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.160+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf01544e0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.160+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0154aa0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.161+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0067360 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.162+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbde0003990 con 0x7fbdf00b40c0 2024-09-13T19:00:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.163+0000 7fbde6a00640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 0x7fbdcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.163+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbde0088830 con 0x7fbdf00b40c0 2024-09-13T19:00:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.163+0000 7fbde5400640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 0x7fbdcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.164+0000 7fbde5400640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 0x7fbdcc06d0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00cdea0 tx=0x7fbdd8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.167+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbde0053ab0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.381+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdf0071580 con 0x7fbdf00b40c0 2024-09-13T19:00:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.381+0000 7fbde6a00640 1 -- 172.21.15.33:0/3255383714 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fbde00570d0 con 0x7fbdf00b40c0 2024-09-13T19:00:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T19:00:00.385 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 msgr2=0x7fbdcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 0x7fbdcc06d0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00cdea0 tx=0x7fbdd8009190 comp rx=0 tx=0).stop 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 msgr2=0x7fbdf014cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c400 tx=0x7fbde000c8c0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 shutdown_connections 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbdcc06ac00 0x7fbdcc06d0c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf015a5c0 0x7fbdf015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbdf00cbac0 0x7fbdf01518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.383+0000 7fbdef200640 1 --2- 172.21.15.33:0/3255383714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdf00b40c0 0x7fbdf014cc80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.384+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 >> 172.21.15.33:0/3255383714 conn(0x7fbdf00ae310 msgr2=0x7fbdf0157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.384+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 shutdown_connections 2024-09-13T19:00:00.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.384+0000 7fbdef200640 1 -- 172.21.15.33:0/3255383714 wait complete. 2024-09-13T19:00:00.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:59:54.900020+0000', 'modified': '2024-09-13T18:59:57.906170+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6294': {'gid': 6294, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6833/1636530679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 1636530679}, {'type': 'v1', 'addr': '172.21.15.33:6833', 'nonce': 1636530679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T19:00:00.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T19:00:00.806 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T19:00:00.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.963+0000 7f8fdee00640 1 Processor -- start 2024-09-13T19:00:00.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.963+0000 7f8fdee00640 1 -- start start 2024-09-13T19:00:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.964+0000 7f8fdee00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fd8151590 0x7f8fd806b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.964+0000 7f8fdee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.964+0000 7f8fdee00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80b2270 con 0x7f8fd80cba50 2024-09-13T19:00:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.964+0000 7f8fdee00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80b2550 con 0x7f8fd8151590 2024-09-13T19:00:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.964+0000 7f8fdee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80b2830 con 0x7f8fd80b1b30 2024-09-13T19:00:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fd8151590 0x7f8fd806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:35468/0 (socket says 172.21.15.33:35468) 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fcf400640 1 -- 172.21.15.33:0/1366989010 learned_addr learned my addr 172.21.15.33:0/1366989010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fd8151590 0x7f8fd806b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:54386/0 (socket says 172.21.15.33:54386) 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 msgr2=0x7f8fd80cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1366989010 >> v1:172.21.15.103:6789/0 conn(0x7f8fd80cba50 legacy=0x7f8fd80b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1366989010 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80b2b10 con 0x7f8fd8151590 2024-09-13T19:00:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.965+0000 7f8fcf400640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.966+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd8151590 0x7f8fd806b370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009d90 tx=0x7f8fc802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f746c926b368ea0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.966+0000 7f8fd7400640 1 -- 172.21.15.33:0/1366989010 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8007740 con 0x7f8fd8151590 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fd7400640 1 -- 172.21.15.33:0/1366989010 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc802d050 con 0x7f8fd8151590 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fd7400640 1 -- 172.21.15.33:0/1366989010 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8007ac0 con 0x7f8fd8151590 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 -- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd8151590 msgr2=0x7f8fd806b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd8151590 0x7f8fd806b370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009d90 tx=0x7f8fc802a660 comp rx=0 tx=0).stop 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 -- 172.21.15.33:0/1366989010 shutdown_connections 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80b1b30 0x7f8fd80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 --2- 172.21.15.33:0/1366989010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd8151590 0x7f8fd806b370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 -- 172.21.15.33:0/1366989010 >> 172.21.15.33:0/1366989010 conn(0x7f8fd80b0510 msgr2=0x7f8fd80b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 -- 172.21.15.33:0/1366989010 shutdown_connections 2024-09-13T19:00:00.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.967+0000 7f8fdee00640 1 -- 172.21.15.33:0/1366989010 wait complete. 2024-09-13T19:00:00.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.969+0000 7f8fdee00640 1 Processor -- start 2024-09-13T19:00:00.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.969+0000 7f8fdee00640 1 -- start start 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd80b1b30 0x7f8fd81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80cba50 0x7f8fd80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81e5780 con 0x7f8fd8151590 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81e5a60 con 0x7f8fd80b1b30 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81e5d40 con 0x7f8fd80cba50 2024-09-13T19:00:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43262/0 (socket says 172.21.15.33:43262) 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.970+0000 7f8fdce00640 1 -- 172.21.15.33:0/153123182 learned_addr learned my addr 172.21.15.33:0/153123182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fcf400640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80cba50 0x7f8fd80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd80b1b30 0x7f8fd81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 -- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80cba50 msgr2=0x7f8fd80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80cba50 0x7f8fd80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 -- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd80b1b30 msgr2=0x7f8fd81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd80b1b30 0x7f8fd81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 -- 172.21.15.33:0/153123182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00094d0 con 0x7f8fd8151590 2024-09-13T19:00:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdce00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001eb0 tx=0x7f8fd000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fd4c00640 1 -- 172.21.15.33:0/153123182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00052d0 con 0x7f8fd8151590 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fd4c00640 1 -- 172.21.15.33:0/153123182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0005430 con 0x7f8fd8151590 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fd4c00640 1 -- 172.21.15.33:0/153123182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003810 con 0x7f8fd8151590 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.971+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc8009a70 con 0x7f8fd8151590 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.972+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd81e6300 con 0x7f8fd8151590 2024-09-13T19:00:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.973+0000 7f8fd4c00640 1 -- 172.21.15.33:0/153123182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd0003970 con 0x7f8fd8151590 2024-09-13T19:00:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.975+0000 7f8fd4c00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 0x7f8fb406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.975+0000 7f8fd4c00640 1 -- 172.21.15.33:0/153123182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd0088960 con 0x7f8fd8151590 2024-09-13T19:00:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.975+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 0x7f8fb406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.976+0000 7f8fe1c08740 1 Processor -- start 2024-09-13T19:00:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.976+0000 7f8fe1c08740 1 -- start start 2024-09-13T19:00:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.976+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 0x7f8fb406d0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc8033040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 0x55c5b90cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b900bab0 con 0x55c5b909e170 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b9009240 con 0x55c5b90e6690 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5b9004b30 con 0x55c5b90a2da0 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 0x55c5b90cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43266/0 (socket says 172.21.15.33:43266) 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fcf400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 0x55c5b90cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:35480/0 (socket says 172.21.15.33:35480) 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1927445636 learned_addr learned my addr 172.21.15.33:0/1927445636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 -- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 msgr2=0x55c5b90cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 0x55c5b90cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 -- 172.21.15.33:0/1927445636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 msgr2=0x55c5b90a2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fdce00640 1 -- 172.21.15.33:0/1927445636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5b8fcfbd0 con 0x55c5b90e6690 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.977+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fdce00640 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cc7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0086df0 tx=0x7f8fd0057e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334de3522fd763a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fccc00640 1 -- 172.21.15.33:0/1927445636 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd006f170 con 0x55c5b90e6690 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fccc00640 1 -- 172.21.15.33:0/1927445636 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd005fb50 con 0x55c5b90e6690 2024-09-13T19:00:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fccc00640 1 -- 172.21.15.33:0/1927445636 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0053e70 con 0x55c5b90e6690 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 msgr2=0x55c5b90cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.978+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cc7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0086df0 tx=0x7f8fd0057e60 comp rx=0 tx=0).stop 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1927445636 shutdown_connections 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cc7f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90a2da0 0x55c5b90cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1927445636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b909e170 0x55c5b90a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1927445636 >> 172.21.15.33:0/1927445636 conn(0x55c5b909ee00 msgr2=0x55c5b90e72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1927445636 shutdown_connections 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1927445636 wait complete. 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.979+0000 7f8fe1c08740 1 -- start start 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.980+0000 7f8fe1c08740 1 Processor -- start 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.980+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90d0370 0x55c5b90c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b8fa6260 con 0x55c5b90a2da0 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b8fa5f00 con 0x55c5b90e6690 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5b8d6bf20 con 0x55c5b90d0370 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fe1c08740 10 client.0 _ll_register_callbacks cb 0x55c5b8ffe1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fcf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43276/0 (socket says 172.21.15.33:43276) 2024-09-13T19:00:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fdce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90d0370 0x55c5b90c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 -- 172.21.15.33:0/578873119 learned_addr learned my addr 172.21.15.33:0/578873119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 -- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90d0370 msgr2=0x55c5b90c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90d0370 0x55c5b90c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 -- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 msgr2=0x55c5b90cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.981+0000 7f8fd7e00640 1 -- 172.21.15.33:0/578873119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd81e6300 con 0x55c5b90a2da0 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8007e40 tx=0x7f8fc8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86acacfbca7108e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fc5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:00:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc803cba0 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc803cd00 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5b902ecd0 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc8052460 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fe1c08740 10 client.6414 fetch_fsmap learned FSMap version 39 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.982+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55c5b90031b0 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5b902ecd0 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8fc8038040 con 0x55c5b90a2da0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 10 client.6414 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 10 client.6414 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 20 client.6414 populate_metadata read hostname 'smithi033' 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b909d5b0 0x55c5b90caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 4 client.6414 mds_command: new command op to 6294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 --> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5b8cf83c0 con 0x55c5b909d5b0 2024-09-13T19:00:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fcf400640 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b909d5b0 0x55c5b90caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fcf400640 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b909d5b0 0x55c5b90caed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329c364590edf7cd server_cookie=36d13dfb6b3458ba in_seq=0 out_seq=0 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.983+0000 7f8fc5600640 10 client.6414 ms_handle_connect on v2:172.21.15.33:6832/1636530679 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fc5600640 1 -- 172.21.15.33:0/578873119 <== mds.0 v2:172.21.15.33:6832/1636530679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c5b8cf83c0 con 0x55c5b909d5b0 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fc5600640 10 client.6414 handle_command_reply: tid=0 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fe1c08740 1 client.6414 shutdown 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 msgr2=0x55c5b90d4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8007e40 tx=0x7f8fc8004ab0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.984+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 shutdown_connections 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b909d5b0 0x55c5b90caed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90d0370 0x55c5b90c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90e6690 0x55c5b90cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/578873119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90d4ff0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fc5600640 0 client.6414 ms_handle_reset on v2:172.21.15.33:6832/1636530679 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 >> 172.21.15.33:0/578873119 conn(0x55c5b909e170 msgr2=0x55c5b90e58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 shutdown_connections 2024-09-13T19:00:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 1 -- 172.21.15.33:0/578873119 wait complete. 2024-09-13T19:00:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:00.985+0000 7f8fe1c08740 20 client.6414 trim_cache size 0 max 16384 2024-09-13T19:00:01.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.000+0000 7f8fe1c08740 1 Processor -- start 2024-09-13T19:00:01.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.000+0000 7f8fe1c08740 1 -- start start 2024-09-13T19:00:01.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b914fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b90c9610 con 0x55c5b90a2da0 2024-09-13T19:00:01.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b90c1fc0 con 0x55c5b90d0370 2024-09-13T19:00:01.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.001+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5b8f8b850 con 0x55c5b90e6690 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43292/0 (socket says 172.21.15.33:43292) 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1796227244 learned_addr learned my addr 172.21.15.33:0/1796227244 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fcf400640 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b914fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fdce00640 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 msgr2=0x55c5b90e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 msgr2=0x55c5b914fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b914fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 -- 172.21.15.33:0/1796227244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5b90d68b0 con 0x55c5b90a2da0 2024-09-13T19:00:01.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.002+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80077d0 tx=0x7f8fc804a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f09bad8137844e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:01.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fcd600640 1 -- 172.21.15.33:0/1796227244 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc802ae60 con 0x55c5b90a2da0 2024-09-13T19:00:01.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fcd600640 1 -- 172.21.15.33:0/1796227244 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8052750 con 0x55c5b90a2da0 2024-09-13T19:00:01.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fcd600640 1 -- 172.21.15.33:0/1796227244 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8052bd0 con 0x55c5b90a2da0 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1796227244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 msgr2=0x55c5b90cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80077d0 tx=0x7f8fc804a000 comp rx=0 tx=0).stop 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1796227244 shutdown_connections 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b914fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/1796227244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cf1d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1796227244 >> 172.21.15.33:0/1796227244 conn(0x55c5b909e170 msgr2=0x55c5b90fb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1796227244 shutdown_connections 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.003+0000 7f8fe1c08740 1 -- 172.21.15.33:0/1796227244 wait complete. 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.004+0000 7f8fe1c08740 1 -- start start 2024-09-13T19:00:01.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.004+0000 7f8fe1c08740 1 Processor -- start 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b90cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b91399a0 con 0x55c5b90a2da0 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b90c4d70 con 0x55c5b90d0370 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5b90cddd0 con 0x55c5b90e6690 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fe1c08740 10 client.0 _ll_register_callbacks cb 0x55c5b90a3f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fd7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43300/0 (socket says 172.21.15.33:43300) 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.005+0000 7f8fd7e00640 1 -- 172.21.15.33:0/4089849613 learned_addr learned my addr 172.21.15.33:0/4089849613 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 -- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 msgr2=0x55c5b90c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 -- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 msgr2=0x55c5b90cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b90cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 -- 172.21.15.33:0/4089849613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5b90031b0 con 0x55c5b90a2da0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fd7e00640 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c090 tx=0x7f8fc8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8aacc8a880d6e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fc5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8069030 con 0x55c5b90a2da0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc806a070 con 0x55c5b90a2da0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fd005fb50 con 0x55c5b90a2da0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.006+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc8052cd0 con 0x55c5b90a2da0 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 10 client.6420 fetch_fsmap learned FSMap version 39 2024-09-13T19:00:01.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55c5b9038170 con 0x55c5b90a2da0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd005fb50 con 0x55c5b90a2da0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8fc8038040 con 0x55c5b90a2da0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 10 client.6420 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 10 client.6420 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 20 client.6420 populate_metadata read hostname 'smithi033' 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b9139e10 0x55c5b913a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 4 client.6420 mds_command: new command op to 6294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 --> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c5b8d096c0 con 0x55c5b9139e10 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.007+0000 7f8fcf400640 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b9139e10 0x55c5b913a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fc5600640 10 client.6420 ms_handle_connect on v2:172.21.15.33:6832/1636530679 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fcf400640 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b9139e10 0x55c5b913a210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56fe51c4495c9022 server_cookie=b5ee48ad86149275 in_seq=0 out_seq=0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fc5600640 1 -- 172.21.15.33:0/4089849613 <== mds.0 v2:172.21.15.33:6832/1636530679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c5b8d096c0 con 0x55c5b9139e10 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fc5600640 10 client.6420 handle_command_reply: tid=0 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 client.6420 shutdown 2024-09-13T19:00:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 msgr2=0x55c5b90cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c090 tx=0x7f8fc8030000 comp rx=0 tx=0).stop 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 shutdown_connections 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:6832/1636530679,v1:172.21.15.33:6833/1636530679] conn(0x55c5b9139e10 0x55c5b913a210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55c5b90e6690 0x55c5b90c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5b90d0370 0x55c5b90cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 --2- 172.21.15.33:0/4089849613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c5b90a2da0 0x55c5b90cd860 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fc5600640 0 client.6420 ms_handle_reset on v2:172.21.15.33:6832/1636530679 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 >> 172.21.15.33:0/4089849613 conn(0x55c5b909e170 msgr2=0x55c5b9098300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.008+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 shutdown_connections 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fe1c08740 1 -- 172.21.15.33:0/4089849613 wait complete. 2024-09-13T19:00:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fe1c08740 20 client.6420 trim_cache size 0 max 16384 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 6294, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 6.1071394359999998, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 39, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 72, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 72, 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.240747463 2024-09-13T19:00:01.016 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:00:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 msgr2=0x7f8fb406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 0x7f8fb406d0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc8033040 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 msgr2=0x7f8fd81e3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001eb0 tx=0x7f8fd000c890 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 shutdown_connections 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fb406ac30 0x7f8fb406d0f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fd8151590 0x7f8fd81e3ee0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fd80cba50 0x7f8fd80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 --2- 172.21.15.33:0/153123182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fd80b1b30 0x7f8fd81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 >> 172.21.15.33:0/153123182 conn(0x7f8fd80b0510 msgr2=0x7f8fd814dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 shutdown_connections 2024-09-13T19:00:01.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.009+0000 7f8fdee00640 1 -- 172.21.15.33:0/153123182 wait complete. 2024-09-13T19:00:01.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:00:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.181+0000 7faf0ca00640 1 Processor -- start 2024-09-13T19:00:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.181+0000 7faf0ca00640 1 -- start start 2024-09-13T19:00:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf0ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf080b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf0ca00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf0815cf10 0x7faf080d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf0ca00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080b55d0 con 0x7faf080d1030 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf0ca00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0815d7e0 con 0x7faf0815cf10 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf0ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080b58b0 con 0x7faf080d0710 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf05400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf0815cf10 0x7faf080d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf06800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faf080d1030 0x7faf0806b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53292/0 (socket says 172.21.15.33:53292) 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.182+0000 7faf06800640 1 -- 172.21.15.33:0/1698934495 learned_addr learned my addr 172.21.15.33:0/1698934495 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05e00640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf080b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05400640 1 -- 172.21.15.33:0/1698934495 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 msgr2=0x7faf080b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05400640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf080b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05400640 1 -- 172.21.15.33:0/1698934495 >> v1:172.21.15.33:6789/0 conn(0x7faf080d1030 legacy=0x7faf0806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05400640 1 -- 172.21.15.33:0/1698934495 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0815d400 con 0x7faf0815cf10 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf05e00640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf080b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.183+0000 7faf04a00640 1 -- 172.21.15.33:0/1698934495 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993664745 0 0) 0x7faf080b55d0 con 0x7faf080d1030 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.184+0000 7faf05400640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf0815cf10 0x7faf080d0af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faae697db669cbb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.184+0000 7faf04a00640 1 -- 172.21.15.33:0/1698934495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4032440 con 0x7faf0815cf10 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.184+0000 7faf04a00640 1 -- 172.21.15.33:0/1698934495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef40325a0 con 0x7faf0815cf10 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.184+0000 7faf04a00640 1 -- 172.21.15.33:0/1698934495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4032930 con 0x7faf0815cf10 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 -- 172.21.15.33:0/1698934495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf0815cf10 msgr2=0x7faf080d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf0815cf10 0x7faf080d0af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402a210 comp rx=0 tx=0).stop 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 -- 172.21.15.33:0/1698934495 shutdown_connections 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf0815cf10 0x7faf080d0af0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 --2- 172.21.15.33:0/1698934495 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf080b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 -- 172.21.15.33:0/1698934495 >> 172.21.15.33:0/1698934495 conn(0x7faf08071d70 msgr2=0x7faf08099a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:01.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 -- 172.21.15.33:0/1698934495 shutdown_connections 2024-09-13T19:00:01.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.185+0000 7faf0ca00640 1 -- 172.21.15.33:0/1698934495 wait complete. 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.186+0000 7faf0ca00640 1 Processor -- start 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.186+0000 7faf0ca00640 1 -- start start 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf08153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 0x7faf08156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0809cff0 con 0x7faf080d1030 2024-09-13T19:00:01.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081560a0 con 0x7faf0815cf10 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.187+0000 7faf0ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf081532b0 con 0x7faf080d0710 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43314/0 (socket says 172.21.15.33:43314) 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 -- 172.21.15.33:0/367375455 learned_addr learned my addr 172.21.15.33:0/367375455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 -- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 msgr2=0x7faf08153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf06800640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 0x7faf08156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05e00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf08153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf08153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 -- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 msgr2=0x7faf08156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 0x7faf08156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 -- 172.21.15.33:0/367375455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009400 con 0x7faf080d1030 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05e00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf08153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf06800640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 0x7faf08156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.188+0000 7faf05400640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.189+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4032440 con 0x7faf080d1030 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.189+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4030b80 con 0x7faf080d1030 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.189+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4006e10 con 0x7faf080d1030 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.189+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0809ca30 con 0x7faf080d1030 2024-09-13T19:00:01.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.189+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08156a70 con 0x7faf080d1030 2024-09-13T19:00:01.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.190+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf08155e40 con 0x7faf080d1030 2024-09-13T19:00:01.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.191+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faef4039040 con 0x7faf080d1030 2024-09-13T19:00:01.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.192+0000 7faefe000640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 0x7faee806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:01.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.192+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef40a9c10 con 0x7faf080d1030 2024-09-13T19:00:01.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.192+0000 7faf05e00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 0x7faee806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:01.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.193+0000 7faf05e00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 0x7faee806d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf081f59b0 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:01.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.197+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faef4074e70 con 0x7faf080d1030 2024-09-13T19:00:01.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.411+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf080b4da0 con 0x7faf080d1030 2024-09-13T19:00:01.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.411+0000 7faefe000640 1 -- 172.21.15.33:0/367375455 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7faef404c070 con 0x7faf080d1030 2024-09-13T19:00:01.415 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 msgr2=0x7faee806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 0x7faee806d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf081f59b0 tx=0x7faef8008040 comp rx=0 tx=0).stop 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 msgr2=0x7faf08152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef40046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 shutdown_connections 2024-09-13T19:00:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faee806ac00 0x7faee806d0c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf0815cf10 0x7faf08156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf080d1030 0x7faf08152d70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 --2- 172.21.15.33:0/367375455 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf080d0710 0x7faf08153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.413+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 >> 172.21.15.33:0/367375455 conn(0x7faf08071d70 msgr2=0x7faf0815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.414+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 shutdown_connections 2024-09-13T19:00:01.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:01.414+0000 7faf0ca00640 1 -- 172.21.15.33:0/367375455 wait complete. 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:00:01.433 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:01.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.434 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:01.470 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42530sec preferred_lft 42530sec 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:01.471 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T19:00:01.472 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:01.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.473 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:00:01.563 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T19:00:01.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.567 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:00:01.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T19:00:01.604 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T19:00:01.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.749 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T19:00:01.785 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T19:00:01.785 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T19:00:01.785 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:01.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.785 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T19:00:01.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:01.881 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:01.916 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:01.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:01.917 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:01.992 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:00:01.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:01.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:02.121 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:02.121 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:02.121 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:02.136 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:02.136 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:02.136 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:02.136 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:02.136 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:00:02.158 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:00:02.160 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T19:00:02.160 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:00:02.160 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:00:02.160 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:00:02.160 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:00:02.163 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:00:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.163 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:02.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:00:02.263 INFO:teuthology.orchestra.run.smithi033.stdout:client6432 2024-09-13T19:00:02.263 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:02.263 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:02.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:00:02.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.536+0000 7f7f1ca00640 1 Processor -- start 2024-09-13T19:00:02.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.536+0000 7f7f1ca00640 1 -- start start 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f1ca00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f1815a520 0x7f7f1806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f1ca00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1806bc00 con 0x7f7f180ce020 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f1ca00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1806bea0 con 0x7f7f180b1b00 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f1ca00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1806c180 con 0x7f7f1815a520 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f16800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7f180ce020 0x7f7f1815a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53308/0 (socket says 172.21.15.33:53308) 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f16800640 1 -- 172.21.15.33:0/235089857 learned_addr learned my addr 172.21.15.33:0/235089857 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:02.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f15e00640 1 --2- 172.21.15.33:0/235089857 >> v2:172.21.15.103:3300/0 conn(0x7f7f1815a520 0x7f7f1806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:02.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.538+0000 7f7f15400640 1 -- 172.21.15.33:0/235089857 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145351211 0 0) 0x7f7f1806bc00 con 0x7f7f180ce020 2024-09-13T19:00:02.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.539+0000 7f7f15400640 1 -- 172.21.15.33:0/235089857 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7efc003520 con 0x7f7f180ce020 2024-09-13T19:00:02.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.539+0000 7f7f15e00640 1 -- 172.21.15.33:0/235089857 >> v1:172.21.15.103:6789/0 conn(0x7f7f180b1b00 legacy=0x7f7f180cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.539+0000 7f7f15e00640 1 -- 172.21.15.33:0/235089857 >> v1:172.21.15.33:6789/0 conn(0x7f7f180ce020 legacy=0x7f7f1815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.539+0000 7f7f15e00640 1 -- 172.21.15.33:0/235089857 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1806c460 con 0x7f7f1815a520 2024-09-13T19:00:02.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.540+0000 7f7f15e00640 1 --2- 172.21.15.33:0/235089857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f1806b6c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097a0 tx=0x7f7f0802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f59edac849e3a58a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:02.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.540+0000 7f7f15400640 1 -- 172.21.15.33:0/235089857 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08032440 con 0x7f7f1815a520 2024-09-13T19:00:02.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.540+0000 7f7f15400640 1 -- 172.21.15.33:0/235089857 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f080325a0 con 0x7f7f1815a520 2024-09-13T19:00:02.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.540+0000 7f7f15400640 1 -- 172.21.15.33:0/235089857 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08032930 con 0x7f7f1815a520 2024-09-13T19:00:02.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 -- 172.21.15.33:0/235089857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 msgr2=0x7f7f1806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/235089857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f1806b6c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f080097a0 tx=0x7f7f0802a230 comp rx=0 tx=0).stop 2024-09-13T19:00:02.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 -- 172.21.15.33:0/235089857 shutdown_connections 2024-09-13T19:00:02.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/235089857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f1806b6c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 -- 172.21.15.33:0/235089857 >> 172.21.15.33:0/235089857 conn(0x7f7f180b0510 msgr2=0x7f7f180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:02.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 -- 172.21.15.33:0/235089857 shutdown_connections 2024-09-13T19:00:02.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.541+0000 7f7f1ca00640 1 -- 172.21.15.33:0/235089857 wait complete. 2024-09-13T19:00:02.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.542+0000 7f7f1ca00640 1 Processor -- start 2024-09-13T19:00:02.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 -- start start 2024-09-13T19:00:02.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f180ce020 0x7f7f180ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f181f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180aae80 con 0x7f7f180b1b00 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f181f1240 con 0x7f7f1815a520 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.543+0000 7f7f1ca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180ab090 con 0x7f7f180ce020 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43326/0 (socket says 172.21.15.33:43326) 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 -- 172.21.15.33:0/3999917603 learned_addr learned my addr 172.21.15.33:0/3999917603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f16800640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f181f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f0fe00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f180ce020 0x7f7f180ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 -- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f180ce020 msgr2=0x7f7f180ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f180ce020 0x7f7f180ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 -- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 msgr2=0x7f7f181f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f181f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f15e00640 1 -- 172.21.15.33:0/3999917603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009400 con 0x7f7f180b1b00 2024-09-13T19:00:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.544+0000 7f7f16800640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f181f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f15e00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7f08035040 tx=0x7f7f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08006e10 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08032e90 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08030be0 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f180ab370 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.545+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180ab930 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.546+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1815de80 con 0x7f7f180b1b00 2024-09-13T19:00:02.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.547+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f08039040 con 0x7f7f180b1b00 2024-09-13T19:00:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.548+0000 7f7f0e000640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 0x7f7ef406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.548+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f080a9e20 con 0x7f7f180b1b00 2024-09-13T19:00:02.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.548+0000 7f7f0fe00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 0x7f7ef406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:02.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.549+0000 7f7f0fe00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 0x7f7ef406d0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7f180ad3c0 tx=0x7f7f00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.556+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7f08075090 con 0x7f7f180b1b00 2024-09-13T19:00:02.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.772+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f181572c0 con 0x7f7f180b1b00 2024-09-13T19:00:02.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.773+0000 7f7f0e000640 1 -- 172.21.15.33:0/3999917603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f080786b0 con 0x7f7f180b1b00 2024-09-13T19:00:02.776 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 msgr2=0x7f7ef406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 0x7f7ef406d0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7f180ad3c0 tx=0x7f7f00009040 comp rx=0 tx=0).stop 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 msgr2=0x7f7f18156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7f08035040 tx=0x7f7f080046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 shutdown_connections 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ef406ac00 0x7f7ef406d0c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f1815a520 0x7f7f181f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7f180ce020 0x7f7f180ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 --2- 172.21.15.33:0/3999917603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f180b1b00 0x7f7f18156d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:02.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.775+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 >> 172.21.15.33:0/3999917603 conn(0x7f7f180b0510 msgr2=0x7f7f180afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:02.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.776+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 shutdown_connections 2024-09-13T19:00:02.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:02.776+0000 7f7f1ca00640 1 -- 172.21.15.33:0/3999917603 wait complete. 2024-09-13T19:00:02.794 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:00:02.795 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:02.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.795 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T19:00:02.836 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.837 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:02.838 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42546sec preferred_lft 42546sec 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:00:02.839 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.840 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T19:00:02.840 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.840 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:02.840 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T19:00:02.840 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:02.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.841 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:00:02.940 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T19:00:02.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.942 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T19:00:02.980 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T19:00:02.980 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:00:02.980 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T19:00:02.980 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T19:00:02.980 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:00:02.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T19:00:02.981 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T19:00:03.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:03.127 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:00:03.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T19:00:03.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T19:00:03.163 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:03.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:03.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T19:00:03.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:03.260 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:03.294 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:03.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:03.295 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:03.369 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:00:03.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:03.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:03.498 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:03.498 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:03.498 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:03.514 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:03.514 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:03.514 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:03.514 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:03.535 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:03.535 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:03.535 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:03.536 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:03.536 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:03.536 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:00:03.536 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:00:03.536 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:00:03.537 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T19:00:03.537 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:00:03.537 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:00:03.537 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:00:03.537 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:00:03.539 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:00:03.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:03.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:03.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:03.595 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:00:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:client6441 2024-09-13T19:00:03.637 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:03.637 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:03.710 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:03.710 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:03.786 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:03.786 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:03.861 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:04.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.016+0000 7fac3ae00640 1 Processor -- start 2024-09-13T19:00:04.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.016+0000 7fac3ae00640 1 -- start start 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.017+0000 7fac3ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac340b1b00 0x7fac340cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.017+0000 7fac3ae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3406bea0 con 0x7fac340cde50 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.017+0000 7fac3ae00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3406c180 con 0x7fac3415a520 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.017+0000 7fac3ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3406c460 con 0x7fac340b1b00 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac33400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac340b1b00 0x7fac340cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac38e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fac340cde50 0x7fac3415a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49724/0 (socket says 172.21.15.33:49724) 2024-09-13T19:00:04.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac38e00640 1 -- 172.21.15.33:0/3829000167 learned_addr learned my addr 172.21.15.33:0/3829000167 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:04.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac33400640 1 -- 172.21.15.33:0/3829000167 >> v1:172.21.15.103:6789/0 conn(0x7fac3415a520 legacy=0x7fac3406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac33400640 1 -- 172.21.15.33:0/3829000167 >> v1:172.21.15.33:6789/0 conn(0x7fac340cde50 legacy=0x7fac3415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac33400640 1 -- 172.21.15.33:0/3829000167 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3406c740 con 0x7fac340b1b00 2024-09-13T19:00:04.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.018+0000 7fac32a00640 1 -- 172.21.15.33:0/3829000167 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204261872 0 0) 0x7fac3406bea0 con 0x7fac340cde50 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.019+0000 7fac33400640 1 --2- 172.21.15.33:0/3829000167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac340b1b00 0x7fac340cd910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac200097a0 tx=0x7fac2002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db285065facee0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.019+0000 7fac32a00640 1 -- 172.21.15.33:0/3829000167 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20032440 con 0x7fac340b1b00 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.019+0000 7fac32a00640 1 -- 172.21.15.33:0/3829000167 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac200325a0 con 0x7fac340b1b00 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.019+0000 7fac32a00640 1 -- 172.21.15.33:0/3829000167 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20032930 con 0x7fac340b1b00 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 -- 172.21.15.33:0/3829000167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac340b1b00 msgr2=0x7fac340cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 --2- 172.21.15.33:0/3829000167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac340b1b00 0x7fac340cd910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac200097a0 tx=0x7fac2002a230 comp rx=0 tx=0).stop 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 -- 172.21.15.33:0/3829000167 shutdown_connections 2024-09-13T19:00:04.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 --2- 172.21.15.33:0/3829000167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac340b1b00 0x7fac340cd910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 -- 172.21.15.33:0/3829000167 >> 172.21.15.33:0/3829000167 conn(0x7fac340b0510 msgr2=0x7fac340b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 -- 172.21.15.33:0/3829000167 shutdown_connections 2024-09-13T19:00:04.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.020+0000 7fac3ae00640 1 -- 172.21.15.33:0/3829000167 wait complete. 2024-09-13T19:00:04.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.022+0000 7fac3ae00640 1 Processor -- start 2024-09-13T19:00:04.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.022+0000 7fac3ae00640 1 -- start start 2024-09-13T19:00:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 0x7fac340ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 0x7fac340c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3414cde0 con 0x7fac340cde50 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ca170 con 0x7fac3415a520 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac3ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340c9560 con 0x7fac340b1b00 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59702/0 (socket says 172.21.15.33:59702) 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 -- 172.21.15.33:0/1822031959 learned_addr learned my addr 172.21.15.33:0/1822031959 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 0x7fac340ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac38e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 0x7fac340c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 -- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 msgr2=0x7fac340ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 0x7fac340ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 -- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 msgr2=0x7fac340c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 0x7fac340c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.023+0000 7fac33400640 1 -- 172.21.15.33:0/1822031959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009400 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac33e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 0x7fac340ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac38e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 0x7fac340c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac33400640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fac20000c00 tx=0x7fac200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20030b80 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20030ce0 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2003d680 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac340c9840 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.024+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340c9e00 con 0x7fac340cde50 2024-09-13T19:00:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.025+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac340ca300 con 0x7fac340cde50 2024-09-13T19:00:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.026+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac20039040 con 0x7fac340cde50 2024-09-13T19:00:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.027+0000 7fac2be00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 0x7fac1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.027+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac200a9df0 con 0x7fac340cde50 2024-09-13T19:00:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.028+0000 7fac33e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 0x7fac1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.028+0000 7fac33e00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 0x7fac1406d0c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac24000f60 tx=0x7fac24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.031+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac20075070 con 0x7fac340cde50 2024-09-13T19:00:04.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.210+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac340cd910 con 0x7fac340cde50 2024-09-13T19:00:04.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.211+0000 7fac2be00640 1 -- 172.21.15.33:0/1822031959 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7fac20041090 con 0x7fac340cde50 2024-09-13T19:00:04.215 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:04.215 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.213+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 msgr2=0x7fac1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.213+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 0x7fac1406d0c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac24000f60 tx=0x7fac24009040 comp rx=0 tx=0).stop 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.213+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 msgr2=0x7fac3414c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.213+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fac20000c00 tx=0x7fac200046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.213+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 shutdown_connections 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac1406ac00 0x7fac1406d0c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac3415a520 0x7fac340c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac340cde50 0x7fac3414c8a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 --2- 172.21.15.33:0/1822031959 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac340b1b00 0x7fac340ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 >> 172.21.15.33:0/1822031959 conn(0x7fac340b0510 msgr2=0x7fac3406a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 shutdown_connections 2024-09-13T19:00:04.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.214+0000 7fac3ae00640 1 -- 172.21.15.33:0/1822031959 wait complete. 2024-09-13T19:00:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:52.781766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:53.886144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:04.234 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:04.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.388+0000 7fe52d600640 1 Processor -- start 2024-09-13T19:00:04.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.388+0000 7fe52d600640 1 -- start start 2024-09-13T19:00:04.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.389+0000 7fe52d600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 0x7fe52806bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.389+0000 7fe52d600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe52806c3e0 0x7fe528070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.389+0000 7fe52d600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5280b2890 con 0x7fe5281461c0 2024-09-13T19:00:04.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.389+0000 7fe52d600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5280b1880 con 0x7fe52806c3e0 2024-09-13T19:00:04.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.389+0000 7fe52d600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b1ad0 con 0x7fe5280b31b0 2024-09-13T19:00:04.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 0x7fe52806bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe527400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe52806c3e0 0x7fe528070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526a00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5281461c0 0x7fe5280b2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:51014/0 (socket says 172.21.15.33:51014) 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526a00640 1 -- 172.21.15.33:0/2276757843 learned_addr learned my addr 172.21.15.33:0/2276757843 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe525600640 1 -- 172.21.15.33:0/2276757843 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238760915 0 0) 0x7fe5280b2890 con 0x7fe5281461c0 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe525600640 1 -- 172.21.15.33:0/2276757843 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe50c003520 con 0x7fe5281461c0 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526000640 1 -- 172.21.15.33:0/2276757843 >> v2:172.21.15.33:3300/0 conn(0x7fe52806c3e0 msgr2=0x7fe528070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526000640 1 --2- 172.21.15.33:0/2276757843 >> v2:172.21.15.33:3300/0 conn(0x7fe52806c3e0 0x7fe528070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526000640 1 -- 172.21.15.33:0/2276757843 >> v1:172.21.15.103:6789/0 conn(0x7fe5281461c0 legacy=0x7fe5280b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.390+0000 7fe526000640 1 -- 172.21.15.33:0/2276757843 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280b1db0 con 0x7fe5280b31b0 2024-09-13T19:00:04.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.391+0000 7fe526000640 1 --2- 172.21.15.33:0/2276757843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 0x7fe52806bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097a0 tx=0x7fe51402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e94f923328d41d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.391+0000 7fe525600640 1 -- 172.21.15.33:0/2276757843 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51402ae40 con 0x7fe5280b31b0 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.391+0000 7fe525600640 1 -- 172.21.15.33:0/2276757843 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514032440 con 0x7fe5280b31b0 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.391+0000 7fe525600640 1 -- 172.21.15.33:0/2276757843 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140327d0 con 0x7fe5280b31b0 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 -- 172.21.15.33:0/2276757843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 msgr2=0x7fe52806bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 --2- 172.21.15.33:0/2276757843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 0x7fe52806bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097a0 tx=0x7fe51402a0f0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 -- 172.21.15.33:0/2276757843 shutdown_connections 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 --2- 172.21.15.33:0/2276757843 >> v2:172.21.15.33:3300/0 conn(0x7fe52806c3e0 0x7fe528070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 --2- 172.21.15.33:0/2276757843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5280b31b0 0x7fe52806bea0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 -- 172.21.15.33:0/2276757843 >> 172.21.15.33:0/2276757843 conn(0x7fe5280b0580 msgr2=0x7fe5280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 -- 172.21.15.33:0/2276757843 shutdown_connections 2024-09-13T19:00:04.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.392+0000 7fe52d600640 1 -- 172.21.15.33:0/2276757843 wait complete. 2024-09-13T19:00:04.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.394+0000 7fe52d600640 1 Processor -- start 2024-09-13T19:00:04.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.394+0000 7fe52d600640 1 -- start start 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 0x7fe528154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5280b31b0 0x7fe5281f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281f3040 con 0x7fe5281461c0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528133c60 con 0x7fe5280b31b0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe52d600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe528155650 con 0x7fe52806c3e0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe526a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 0x7fe528154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe526000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5280b31b0 0x7fe5281f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59726/0 (socket says 172.21.15.33:59726) 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 -- 172.21.15.33:0/4217723715 learned_addr learned my addr 172.21.15.33:0/4217723715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 -- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 msgr2=0x7fe528154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 0x7fe528154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 -- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5280b31b0 msgr2=0x7fe5281f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5280b31b0 0x7fe5281f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe527400640 1 -- 172.21.15.33:0/4217723715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe514009400 con 0x7fe5281461c0 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.395+0000 7fe526a00640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 0x7fe528154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe527400640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe52000efc0 tx=0x7fe52000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520009ba0 con 0x7fe5281461c0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000f040 con 0x7fe5281461c0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5200146c0 con 0x7fe5281461c0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528155930 con 0x7fe5281461c0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.396+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe528155ef0 con 0x7fe5281461c0 2024-09-13T19:00:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.397+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5280b00b0 con 0x7fe5281461c0 2024-09-13T19:00:04.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.398+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe520014820 con 0x7fe5281461c0 2024-09-13T19:00:04.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.399+0000 7fe51ea00640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 0x7fe50806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.399+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe520089d80 con 0x7fe5281461c0 2024-09-13T19:00:04.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.400+0000 7fe526a00640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 0x7fe50806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.400+0000 7fe526a00640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 0x7fe50806d0c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe5180011e0 tx=0x7fe518007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.403+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe520054f70 con 0x7fe5281461c0 2024-09-13T19:00:04.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.579+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe52806bea0 con 0x7fe5281461c0 2024-09-13T19:00:04.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.580+0000 7fe51ea00640 1 -- 172.21.15.33:0/4217723715 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5200180a0 con 0x7fe5281461c0 2024-09-13T19:00:04.583 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 msgr2=0x7fe50806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 0x7fe50806d0c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe5180011e0 tx=0x7fe518007d30 comp rx=0 tx=0).stop 2024-09-13T19:00:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 msgr2=0x7fe528133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe52000efc0 tx=0x7fe52000c490 comp rx=0 tx=0).stop 2024-09-13T19:00:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 shutdown_connections 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe50806ac00 0x7fe50806d0c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5281461c0 0x7fe528133720 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5280b31b0 0x7fe5281f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 --2- 172.21.15.33:0/4217723715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe52806c3e0 0x7fe528154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 >> 172.21.15.33:0/4217723715 conn(0x7fe5280b0580 msgr2=0x7fe5280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 shutdown_connections 2024-09-13T19:00:04.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.582+0000 7fe52d600640 1 -- 172.21.15.33:0/4217723715 wait complete. 2024-09-13T19:00:04.601 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.756+0000 7f3440000640 1 Processor -- start 2024-09-13T19:00:04.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.756+0000 7f3440000640 1 -- start start 2024-09-13T19:00:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.757+0000 7f3440000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3438156f60 0x7f343815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.757+0000 7f3440000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34380cafa0 0x7f3438070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.757+0000 7f3440000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343806f5f0 con 0x7f34380714c0 2024-09-13T19:00:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.757+0000 7f3440000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343815aa30 con 0x7f34380cafa0 2024-09-13T19:00:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.757+0000 7f3440000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438071930 con 0x7f3438156f60 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343cc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34380cafa0 0x7f3438070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343e000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f34380714c0 0x7f343815d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49728/0 (socket says 172.21.15.33:49728) 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343e000640 1 -- 172.21.15.33:0/4244012472 learned_addr learned my addr 172.21.15.33:0/4244012472 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343d600640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3438156f60 0x7f343815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f3437e00640 1 -- 172.21.15.33:0/4244012472 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235918942 0 0) 0x7f343806f5f0 con 0x7f34380714c0 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f3437e00640 1 -- 172.21.15.33:0/4244012472 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3420005730 con 0x7f34380714c0 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343cc00640 1 -- 172.21.15.33:0/4244012472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3438156f60 msgr2=0x7f343815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343cc00640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3438156f60 0x7f343815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343cc00640 1 -- 172.21.15.33:0/4244012472 >> v1:172.21.15.33:6789/0 conn(0x7f34380714c0 legacy=0x7f343815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.758+0000 7f343cc00640 1 -- 172.21.15.33:0/4244012472 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438070450 con 0x7f34380cafa0 2024-09-13T19:00:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.759+0000 7f343cc00640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34380cafa0 0x7f3438070f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34240097a0 tx=0x7f342402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2157c0960aeb12dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.759+0000 7f3437e00640 1 -- 172.21.15.33:0/4244012472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424032440 con 0x7f34380cafa0 2024-09-13T19:00:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.759+0000 7f3437e00640 1 -- 172.21.15.33:0/4244012472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240325a0 con 0x7f34380cafa0 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.759+0000 7f3437e00640 1 -- 172.21.15.33:0/4244012472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424032910 con 0x7f34380cafa0 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 -- 172.21.15.33:0/4244012472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34380cafa0 msgr2=0x7f3438070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34380cafa0 0x7f3438070f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f34240097a0 tx=0x7f342402a180 comp rx=0 tx=0).stop 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 -- 172.21.15.33:0/4244012472 shutdown_connections 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34380cafa0 0x7f3438070f80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 --2- 172.21.15.33:0/4244012472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3438156f60 0x7f343815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 -- 172.21.15.33:0/4244012472 >> 172.21.15.33:0/4244012472 conn(0x7f34380b0580 msgr2=0x7f34380b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 -- 172.21.15.33:0/4244012472 shutdown_connections 2024-09-13T19:00:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.760+0000 7f3440000640 1 -- 172.21.15.33:0/4244012472 wait complete. 2024-09-13T19:00:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.762+0000 7f3440000640 1 Processor -- start 2024-09-13T19:00:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.762+0000 7f3440000640 1 -- start start 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34380714c0 0x7f34380ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34380cafa0 0x7f343815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381f3360 con 0x7f3438156f60 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381f3d00 con 0x7f34380714c0 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f3440000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34381f3080 con 0x7f34380cafa0 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59756/0 (socket says 172.21.15.33:59756) 2024-09-13T19:00:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 -- 172.21.15.33:0/34493277 learned_addr learned my addr 172.21.15.33:0/34493277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343cc00640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34380cafa0 0x7f343815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343d600640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34380714c0 0x7f34380ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 -- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34380cafa0 msgr2=0x7f343815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34380cafa0 0x7f343815d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 -- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34380714c0 msgr2=0x7f34380ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34380714c0 0x7f34380ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.763+0000 7f343e000640 1 -- 172.21.15.33:0/34493277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424009400 con 0x7f3438156f60 2024-09-13T19:00:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f343e000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f343000cb40 tx=0x7f343000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000aca0 con 0x7f3438156f60 2024-09-13T19:00:04.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000ae00 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430012620 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34381f36b0 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.764+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34381f22f0 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.765+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34381f3510 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.766+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3430007070 con 0x7f3438156f60 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.767+0000 7f3435600640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 0x7f341806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.767+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34300892c0 con 0x7f3438156f60 2024-09-13T19:00:04.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.767+0000 7f343d600640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 0x7f341806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:04.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.768+0000 7f343d600640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 0x7f341806d0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f34380ce1e0 tx=0x7f342c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:04.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.771+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f34381f3510 con 0x7f3438156f60 2024-09-13T19:00:04.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.949+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34381f3eb0 con 0x7f3438156f60 2024-09-13T19:00:04.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.950+0000 7f3435600640 1 -- 172.21.15.33:0/34493277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34381f3eb0 con 0x7f3438156f60 2024-09-13T19:00:04.953 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 msgr2=0x7f341806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 0x7f341806d0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f34380ce1e0 tx=0x7f342c009190 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 msgr2=0x7f343815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f343000cb40 tx=0x7f343000a060 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 shutdown_connections 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f341806ac00 0x7f341806d0c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3438156f60 0x7f343815d670 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34380cafa0 0x7f343815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 --2- 172.21.15.33:0/34493277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34380714c0 0x7f34380ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 >> 172.21.15.33:0/34493277 conn(0x7f34380b0580 msgr2=0x7f343815a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:04.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 shutdown_connections 2024-09-13T19:00:04.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:04.952+0000 7f3440000640 1 -- 172.21.15.33:0/34493277 wait complete. 2024-09-13T19:00:04.973 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:05.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.128+0000 7f0396e00640 1 Processor -- start 2024-09-13T19:00:05.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.128+0000 7f0396e00640 1 -- start start 2024-09-13T19:00:05.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0396e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03900afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0396e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900b3f20 con 0x7f039015c330 2024-09-13T19:00:05.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0396e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03901602b0 con 0x7f0390071cc0 2024-09-13T19:00:05.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0396e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0390160590 con 0x7f039015c710 2024-09-13T19:00:05.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0395a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f039015c330 0x7f03900715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49736/0 (socket says 172.21.15.33:49736) 2024-09-13T19:00:05.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0395a00640 1 -- 172.21.15.33:0/2605905536 learned_addr learned my addr 172.21.15.33:0/2605905536 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674875708 0 0) 0x7f03900b3f20 con 0x7f039015c330 2024-09-13T19:00:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0378003520 con 0x7f039015c330 2024-09-13T19:00:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.130+0000 7f0396400640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03900afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696386073 0 0) 0x7f0378003520 con 0x7f039015c330 2024-09-13T19:00:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 msgr2=0x7f03900afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03900afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 >> v1:172.21.15.103:6789/0 conn(0x7f0390071cc0 legacy=0x7f039006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390160870 con 0x7f039015c330 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f0384001670 con 0x7f039015c330 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 >> v1:172.21.15.33:6789/0 conn(0x7f039015c330 legacy=0x7f03900715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0378003f20 0x7f03780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f0378005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390160590 con 0x7f0378004d00 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037800bb10 con 0x7f0378003f20 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037800bcd0 con 0x7f039015c710 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f0396400640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f0378005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f0395a00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.131+0000 7f0395000640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0378003f20 0x7f03780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.132+0000 7f0396400640 1 -- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 msgr2=0x7f03780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.132+0000 7f0396400640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f039015c710 0x7f03780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.132+0000 7f0396400640 1 -- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0378003f20 msgr2=0x7f03780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.132+0000 7f0396400640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0378003f20 0x7f03780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.132+0000 7f0396400640 1 -- 172.21.15.33:0/2605905536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378003520 con 0x7f0378004d00 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f0396400640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f0378005180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0388009fc0 tx=0x7f03780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcab705ec43692f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388031640 con 0x7f0378004d00 2024-09-13T19:00:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038802d070 con 0x7f0378004d00 2024-09-13T19:00:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f038fe00640 1 -- 172.21.15.33:0/2605905536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03880319e0 con 0x7f0378004d00 2024-09-13T19:00:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f0396e00640 1 -- 172.21.15.33:0/2605905536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 msgr2=0x7f0378005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f0396e00640 1 --2- 172.21.15.33:0/2605905536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f0378005180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0388009fc0 tx=0x7f03780057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f0396400640 1 -- 172.21.15.33:0/2605905536 reap_dead start 2024-09-13T19:00:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.133+0000 7f0396e00640 1 -- 172.21.15.33:0/2605905536 shutdown_connections 2024-09-13T19:00:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.134+0000 7f0396e00640 1 -- 172.21.15.33:0/2605905536 >> 172.21.15.33:0/2605905536 conn(0x7f039006d6c0 msgr2=0x7f039006daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.134+0000 7f0396e00640 1 -- 172.21.15.33:0/2605905536 shutdown_connections 2024-09-13T19:00:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.134+0000 7f0396e00640 1 -- 172.21.15.33:0/2605905536 wait complete. 2024-09-13T19:00:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.135+0000 7f0396e00640 1 Processor -- start 2024-09-13T19:00:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.135+0000 7f0396e00640 1 -- start start 2024-09-13T19:00:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 0x7f039015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 0x7f03900cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900cbd10 con 0x7f0378004d00 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039015d3d0 con 0x7f03900cb350 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0396e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039015ed40 con 0x7f0390154480 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.136+0000 7f0395a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 -- 172.21.15.33:0/3924402283 learned_addr learned my addr 172.21.15.33:0/3924402283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0396400640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 0x7f03900cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395000640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 0x7f039015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 -- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 msgr2=0x7f039015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 0x7f039015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 -- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 msgr2=0x7f03900cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 0x7f03900cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 -- 172.21.15.33:0/3924402283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039015cd80 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0396400640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 0x7f03900cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395000640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 0x7f039015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f0395a00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f03840072c0 tx=0x7f0384007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.137+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400f960 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.138+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038400fac0 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.138+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400fe70 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.138+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039015d060 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.138+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0390157bf0 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.139+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390067360 con 0x7f0378004d00 2024-09-13T19:00:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.140+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f038401d460 con 0x7f0378004d00 2024-09-13T19:00:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.141+0000 7f038d600640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 0x7f037006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.141+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03840895c0 con 0x7f0378004d00 2024-09-13T19:00:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.141+0000 7f0395000640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 0x7f037006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.142+0000 7f0395000640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 0x7f037006d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f039015fac0 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.146+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0384054790 con 0x7f0378004d00 2024-09-13T19:00:05.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.327+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03900b37f0 con 0x7f0378004d00 2024-09-13T19:00:05.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.327+0000 7f038d600640 1 -- 172.21.15.33:0/3924402283 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0384057db0 con 0x7f0378004d00 2024-09-13T19:00:05.331 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 msgr2=0x7f037006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 0x7f037006d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f039015fac0 tx=0x7f037c009040 comp rx=0 tx=0).stop 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 msgr2=0x7f039015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f03840072c0 tx=0x7f0384007780 comp rx=0 tx=0).stop 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 shutdown_connections 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f037006ac00 0x7f037006d0c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03900cb350 0x7f03900cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0390154480 0x7f039015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 --2- 172.21.15.33:0/3924402283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0378004d00 0x7f039015d860 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.329+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 >> 172.21.15.33:0/3924402283 conn(0x7f039006d6c0 msgr2=0x7f039006daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.330+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 shutdown_connections 2024-09-13T19:00:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.330+0000 7f0396e00640 1 -- 172.21.15.33:0/3924402283 wait complete. 2024-09-13T19:00:05.348 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:00:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.501+0000 7fb4b1c00640 1 Processor -- start 2024-09-13T19:00:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.501+0000 7fb4b1c00640 1 -- start start 2024-09-13T19:00:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4b1c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4ac0b3080 0x7fb4ac0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4b1c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0b3a00 con 0x7fb4ac159610 2024-09-13T19:00:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4b1c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac070710 con 0x7fb4ac0cd080 2024-09-13T19:00:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4b1c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac1599f0 con 0x7fb4ac0b3080 2024-09-13T19:00:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4aaa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb4ac159610 0x7fb4ac070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49750/0 (socket says 172.21.15.33:49750) 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4aaa00640 1 -- 172.21.15.33:0/2678346305 learned_addr learned my addr 172.21.15.33:0/2678346305 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.502+0000 7fb4a2000640 1 --2- 172.21.15.33:0/2678346305 >> v2:172.21.15.33:3300/0 conn(0x7fb4ac0b3080 0x7fb4ac0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.503+0000 7fb4aa000640 1 -- 172.21.15.33:0/2678346305 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511496181 0 0) 0x7fb4ac0b3a00 con 0x7fb4ac159610 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.503+0000 7fb4aa000640 1 -- 172.21.15.33:0/2678346305 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb490005730 con 0x7fb4ac159610 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.503+0000 7fb4a2000640 1 -- 172.21.15.33:0/2678346305 >> v1:172.21.15.103:6789/0 conn(0x7fb4ac0cd080 legacy=0x7fb4ac0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.503+0000 7fb4a2000640 1 -- 172.21.15.33:0/2678346305 >> v1:172.21.15.33:6789/0 conn(0x7fb4ac159610 legacy=0x7fb4ac070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.503+0000 7fb4a2000640 1 -- 172.21.15.33:0/2678346305 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0709e0 con 0x7fb4ac0b3080 2024-09-13T19:00:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.504+0000 7fb4a2000640 1 --2- 172.21.15.33:0/2678346305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0b3080 0x7fb4ac0b34c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb4940097a0 tx=0x7fb49402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535b42c5cbb1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.504+0000 7fb4aa000640 1 -- 172.21.15.33:0/2678346305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494032440 con 0x7fb4ac0b3080 2024-09-13T19:00:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.504+0000 7fb4aa000640 1 -- 172.21.15.33:0/2678346305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4940325a0 con 0x7fb4ac0b3080 2024-09-13T19:00:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.504+0000 7fb4aa000640 1 -- 172.21.15.33:0/2678346305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494032930 con 0x7fb4ac0b3080 2024-09-13T19:00:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 -- 172.21.15.33:0/2678346305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0b3080 msgr2=0x7fb4ac0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/2678346305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0b3080 0x7fb4ac0b34c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb4940097a0 tx=0x7fb49402a230 comp rx=0 tx=0).stop 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 -- 172.21.15.33:0/2678346305 shutdown_connections 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/2678346305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0b3080 0x7fb4ac0b34c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 -- 172.21.15.33:0/2678346305 >> 172.21.15.33:0/2678346305 conn(0x7fb4ac0b0510 msgr2=0x7fb4ac0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 -- 172.21.15.33:0/2678346305 shutdown_connections 2024-09-13T19:00:05.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.505+0000 7fb4b1c00640 1 -- 172.21.15.33:0/2678346305 wait complete. 2024-09-13T19:00:05.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.507+0000 7fb4b1c00640 1 Processor -- start 2024-09-13T19:00:05.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.507+0000 7fb4b1c00640 1 -- start start 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb4ac0b3080 0x7fb4ac0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 0x7fb4ac14b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1f2420 con 0x7fb4ac0cd080 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15a9c0 con 0x7fb4ac159610 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4b1c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac159b60 con 0x7fb4ac0b3080 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59792/0 (socket says 172.21.15.33:59792) 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 -- 172.21.15.33:0/1014870211 learned_addr learned my addr 172.21.15.33:0/1014870211 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4aaa00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb4ac0b3080 0x7fb4ac0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4ab400640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 0x7fb4ac14b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 -- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb4ac0b3080 msgr2=0x7fb4ac0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb4ac0b3080 0x7fb4ac0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 -- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 msgr2=0x7fb4ac14b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 0x7fb4ac14b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.508+0000 7fb4a2000640 1 -- 172.21.15.33:0/1014870211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009400 con 0x7fb4ac0cd080 2024-09-13T19:00:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4ab400640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 0x7fb4ac14b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4a2000640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb494035040 tx=0x7fb4940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494006e10 con 0x7fb4ac0cd080 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494032e90 con 0x7fb4ac0cd080 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494030be0 con 0x7fb4ac0cd080 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac159e40 con 0x7fb4ac0cd080 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.509+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac15a400 con 0x7fb4ac0cd080 2024-09-13T19:00:05.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.510+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac1f2590 con 0x7fb4ac0cd080 2024-09-13T19:00:05.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.511+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb494039040 con 0x7fb4ac0cd080 2024-09-13T19:00:05.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.512+0000 7fb4a3400640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 0x7fb48806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.513+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4940a9d20 con 0x7fb4ac0cd080 2024-09-13T19:00:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.513+0000 7fb4aaa00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 0x7fb48806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:05.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.514+0000 7fb4aaa00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 0x7fb48806d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0011e0 tx=0x7fb49c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:05.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.517+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb4ac1f2590 con 0x7fb4ac0cd080 2024-09-13T19:00:05.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.710+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4ac1f2560 con 0x7fb4ac0cd080 2024-09-13T19:00:05.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.710+0000 7fb4a3400640 1 -- 172.21.15.33:0/1014870211 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb494075020 con 0x7fb4ac0cd080 2024-09-13T19:00:05.714 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:00:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 msgr2=0x7fb48806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 0x7fb48806d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0011e0 tx=0x7fb49c007d30 comp rx=0 tx=0).stop 2024-09-13T19:00:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 msgr2=0x7fb4ac14b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb494035040 tx=0x7fb4940046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 shutdown_connections 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb48806ac00 0x7fb48806d0c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4ac159610 0x7fb4ac14b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4ac0cd080 0x7fb4ac14b210 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 --2- 172.21.15.33:0/1014870211 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb4ac0b3080 0x7fb4ac0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 >> 172.21.15.33:0/1014870211 conn(0x7fb4ac0b0510 msgr2=0x7fb4ac06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 shutdown_connections 2024-09-13T19:00:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:05.713+0000 7fb4b1c00640 1 -- 172.21.15.33:0/1014870211 wait complete. 2024-09-13T19:00:05.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T19:00:05.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:05.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:05.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:00:05.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:05.800 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T19:00:05.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:05.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T19:00:05.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:05.877 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 134217728 ./subdir) 2024-09-13T19:00:05.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:00:06.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.148+0000 7f8c59400640 1 Processor -- start 2024-09-13T19:00:06.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.148+0000 7f8c59400640 1 -- start start 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.149+0000 7f8c59400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8c54153b20 0x7f8c540b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c59400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c54153f00 con 0x7f8c54159a80 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c59400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540b1a40 con 0x7f8c5406f660 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c59400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540ce600 con 0x7f8c54153b20 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c52800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8c54153b20 0x7f8c540b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c4be00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8c54159a80 0x7f8c540b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49752/0 (socket says 172.21.15.33:49752) 2024-09-13T19:00:06.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c4be00640 1 -- 172.21.15.33:0/437187361 learned_addr learned my addr 172.21.15.33:0/437187361 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:06.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c52800640 1 -- 172.21.15.33:0/437187361 >> v1:172.21.15.103:6789/0 conn(0x7f8c5406f660 legacy=0x7f8c5406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c52800640 1 -- 172.21.15.33:0/437187361 >> v1:172.21.15.33:6789/0 conn(0x7f8c54159a80 legacy=0x7f8c540b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.150+0000 7f8c52800640 1 -- 172.21.15.33:0/437187361 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5415a1f0 con 0x7f8c54153b20 2024-09-13T19:00:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.151+0000 7f8c52800640 1 --2- 172.21.15.33:0/437187361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c54153b20 0x7f8c540b3990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8c440097a0 tx=0x7f8c4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6662fce14005ed4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c51e00640 1 -- 172.21.15.33:0/437187361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032440 con 0x7f8c54153b20 2024-09-13T19:00:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c51e00640 1 -- 172.21.15.33:0/437187361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c440325a0 con 0x7f8c54153b20 2024-09-13T19:00:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c51e00640 1 -- 172.21.15.33:0/437187361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032930 con 0x7f8c54153b20 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 -- 172.21.15.33:0/437187361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c54153b20 msgr2=0x7f8c540b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 --2- 172.21.15.33:0/437187361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c54153b20 0x7f8c540b3990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8c440097a0 tx=0x7f8c4402a230 comp rx=0 tx=0).stop 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 -- 172.21.15.33:0/437187361 shutdown_connections 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 --2- 172.21.15.33:0/437187361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c54153b20 0x7f8c540b3990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 -- 172.21.15.33:0/437187361 >> 172.21.15.33:0/437187361 conn(0x7f8c540b0510 msgr2=0x7f8c540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 -- 172.21.15.33:0/437187361 shutdown_connections 2024-09-13T19:00:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.152+0000 7f8c59400640 1 -- 172.21.15.33:0/437187361 wait complete. 2024-09-13T19:00:06.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.154+0000 7f8c59400640 1 Processor -- start 2024-09-13T19:00:06.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.154+0000 7f8c59400640 1 -- start start 2024-09-13T19:00:06.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:06.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 0x7f8c5415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 0x7f8c54158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c541540b0 con 0x7f8c5406f660 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54146ce0 con 0x7f8c54153b20 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c59400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54154300 con 0x7f8c54159a80 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59812/0 (socket says 172.21.15.33:59812) 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 -- 172.21.15.33:0/2552643929 learned_addr learned my addr 172.21.15.33:0/2552643929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c4be00640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 0x7f8c5415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c53200640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 0x7f8c54158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 -- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 msgr2=0x7f8c54158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 0x7f8c54158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 -- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 msgr2=0x7f8c5415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 0x7f8c5415c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c52800640 1 -- 172.21.15.33:0/2552643929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009400 con 0x7f8c5406f660 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c4be00640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 0x7f8c5415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.155+0000 7f8c53200640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 0x7f8c54158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c52800640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098c0 tx=0x7f8c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44030b80 con 0x7f8c5406f660 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44030d00 con 0x7f8c5406f660 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4403c640 con 0x7f8c5406f660 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c541545e0 con 0x7f8c5406f660 2024-09-13T19:00:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.156+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c54154ba0 con 0x7f8c5406f660 2024-09-13T19:00:06.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.157+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c540b3990 con 0x7f8c5406f660 2024-09-13T19:00:06.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.158+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c4403c7a0 con 0x7f8c5406f660 2024-09-13T19:00:06.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.159+0000 7f8c4aa00640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 0x7f8c3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:06.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.160+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c440aa270 con 0x7f8c5406f660 2024-09-13T19:00:06.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.160+0000 7f8c4be00640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 0x7f8c3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.161+0000 7f8c4be00640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 0x7f8c3006d0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c540a8510 tx=0x7f8c3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.164+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8c440753b0 con 0x7f8c5406f660 2024-09-13T19:00:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.379+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8c540cb010 con 0x7f8c5406f660 2024-09-13T19:00:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.379+0000 7f8c4aa00640 1 -- 172.21.15.33:0/2552643929 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8c44006e10 con 0x7f8c5406f660 2024-09-13T19:00:06.383 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:00:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 msgr2=0x7f8c3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 0x7f8c3006d0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c540a8510 tx=0x7f8c3c009040 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 msgr2=0x7f8c541467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098c0 tx=0x7f8c440046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 shutdown_connections 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c3006ac00 0x7f8c3006d0c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8c54159a80 0x7f8c54158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c54153b20 0x7f8c5415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 --2- 172.21.15.33:0/2552643929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c5406f660 0x7f8c541467a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 >> 172.21.15.33:0/2552643929 conn(0x7f8c540b0510 msgr2=0x7f8c5406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 shutdown_connections 2024-09-13T19:00:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:06.382+0000 7f8c59400640 1 -- 172.21.15.33:0/2552643929 wait complete. 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /subdir 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:00:06.401 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:06.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.402 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T19:00:06.442 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:00:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:00:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:00:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T19:00:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T19:00:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T19:00:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:06.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.445 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:00:06.539 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T19:00:06.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.542 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T19:00:06.579 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T19:00:06.579 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:00:06.579 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T19:00:06.579 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T19:00:06.579 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:00:06.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T19:00:06.580 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T19:00:06.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.725 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:00:06.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T19:00:06.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T19:00:06.760 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:06.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T19:00:06.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:06.856 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:06.891 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:06.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:06.891 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:06.967 INFO:tasks.cephfs.kernel_mount:mounting using device: :/subdir 2024-09-13T19:00:06.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:06.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/subdir /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:07.094 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:07.094 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:07.094 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:07.109 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:07.110 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:07.110 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:07.110 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:07.110 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:07.132 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:07.132 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/subdir 2024-09-13T19:00:07.133 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:00:07.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T19:00:07.135 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:00:07.135 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:00:07.135 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:00:07.135 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:00:07.138 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:00:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:07.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:07.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:07.196 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:00:07.243 INFO:teuthology.orchestra.run.smithi103.stdout:client6489 2024-09-13T19:00:07.243 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:07.243 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:07.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:07.322 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-13T19:00:07.403 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-13T19:00:07.404 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/subdir 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:07.405 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', '172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/subdir 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-13T19:00:07.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:07.405 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 268435456 ./subdir) 2024-09-13T19:00:07.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:07.451 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-13T19:00:07.487 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-13T19:00:07.487 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/subdir 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:07.488 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', '172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/subdir 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-13T19:00:07.488 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T19:00:07.488 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:07.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:07.679 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T19:00:07.679 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:07.679 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:07.718 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:07.718 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:07.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.989+0000 7f7be2a00640 1 Processor -- start 2024-09-13T19:00:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.989+0000 7f7be2a00640 1 -- start start 2024-09-13T19:00:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7be2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bdc15a520 0x7f7bdc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7be2a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7bdc0ce020 0x7f7bdc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7be2a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc06bc00 con 0x7f7bdc0b1b00 2024-09-13T19:00:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7be2a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc06bea0 con 0x7f7bdc15a520 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7be2a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc06c180 con 0x7f7bdc0ce020 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7bdbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7bdc15a520 0x7f7bdc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7bdb400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7bdc0b1b00 0x7f7bdc0cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49762/0 (socket says 172.21.15.33:49762) 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.990+0000 7f7bdb400640 1 -- 172.21.15.33:0/374008140 learned_addr learned my addr 172.21.15.33:0/374008140 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7be0a00640 1 --2- 172.21.15.33:0/374008140 >> v2:172.21.15.103:3300/0 conn(0x7f7bdc0ce020 0x7f7bdc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7bdbe00640 1 -- 172.21.15.33:0/374008140 >> v2:172.21.15.103:3300/0 conn(0x7f7bdc0ce020 msgr2=0x7f7bdc15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/374008140 >> v2:172.21.15.103:3300/0 conn(0x7f7bdc0ce020 0x7f7bdc15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7bdbe00640 1 -- 172.21.15.33:0/374008140 >> v1:172.21.15.33:6789/0 conn(0x7f7bdc0b1b00 legacy=0x7f7bdc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7bdbe00640 1 -- 172.21.15.33:0/374008140 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc06c460 con 0x7f7bdc15a520 2024-09-13T19:00:07.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.991+0000 7f7bdaa00640 1 -- 172.21.15.33:0/374008140 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492871159 0 0) 0x7f7bdc06bc00 con 0x7f7bdc0b1b00 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.992+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/374008140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc15a520 0x7f7bdc06b6c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0b1f70 tx=0x7f7bcc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f303339fe25b97a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.992+0000 7f7bdaa00640 1 -- 172.21.15.33:0/374008140 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc032440 con 0x7f7bdc15a520 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.992+0000 7f7bdaa00640 1 -- 172.21.15.33:0/374008140 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0325a0 con 0x7f7bdc15a520 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.992+0000 7f7bdaa00640 1 -- 172.21.15.33:0/374008140 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc032930 con 0x7f7bdc15a520 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 -- 172.21.15.33:0/374008140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc15a520 msgr2=0x7f7bdc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 --2- 172.21.15.33:0/374008140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc15a520 0x7f7bdc06b6c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0b1f70 tx=0x7f7bcc02a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 -- 172.21.15.33:0/374008140 shutdown_connections 2024-09-13T19:00:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 --2- 172.21.15.33:0/374008140 >> v2:172.21.15.103:3300/0 conn(0x7f7bdc0ce020 0x7f7bdc15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 --2- 172.21.15.33:0/374008140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc15a520 0x7f7bdc06b6c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 -- 172.21.15.33:0/374008140 >> 172.21.15.33:0/374008140 conn(0x7f7bdc0b0510 msgr2=0x7f7bdc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 -- 172.21.15.33:0/374008140 shutdown_connections 2024-09-13T19:00:07.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.993+0000 7f7be2a00640 1 -- 172.21.15.33:0/374008140 wait complete. 2024-09-13T19:00:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.995+0000 7f7be2a00640 1 Processor -- start 2024-09-13T19:00:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.995+0000 7f7be2a00640 1 -- start start 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0ce020 0x7f7bdc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7bdc15a520 0x7f7bdc1f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc06fba0 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc06fe70 con 0x7f7bdc0ce020 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be2a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc070150 con 0x7f7bdc15a520 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59818/0 (socket says 172.21.15.33:59818) 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 -- 172.21.15.33:0/1276964995 learned_addr learned my addr 172.21.15.33:0/1276964995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7be0a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7bdc15a520 0x7f7bdc1f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdb400640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0ce020 0x7f7bdc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 -- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7bdc15a520 msgr2=0x7f7bdc1f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7bdc15a520 0x7f7bdc1f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 -- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0ce020 msgr2=0x7f7bdc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0ce020 0x7f7bdc06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.996+0000 7f7bdbe00640 1 -- 172.21.15.33:0/1276964995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc009400 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000c00 tx=0x7f7bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc030b80 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc032e90 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc006e10 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc070430 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.997+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc0709f0 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.998+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc15a900 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:07.999+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bcc039040 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.000+0000 7f7bd3e00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 0x7f7bbc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.000+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bcc0a9c40 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.001+0000 7f7bdb400640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 0x7f7bbc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.001+0000 7f7bdb400640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 0x7f7bbc06d0f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc14f3f0 tx=0x7f7bc8007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.005+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7bcc074ec0 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.183+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bdc073630 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.185+0000 7f7bd3e00640 1 -- 172.21.15.33:0/1276964995 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f7bcc0784e0 con 0x7f7bdc0b1b00 2024-09-13T19:00:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:08.188 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 msgr2=0x7f7bbc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 0x7f7bbc06d0f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc14f3f0 tx=0x7f7bc8007d50 comp rx=0 tx=0).stop 2024-09-13T19:00:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 msgr2=0x7f7bdc14b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000c00 tx=0x7f7bcc0046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 shutdown_connections 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bbc06ac30 0x7f7bbc06d0f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7bdc15a520 0x7f7bdc1f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bdc0ce020 0x7f7bdc06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1276964995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc0b1b00 0x7f7bdc14b8f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 >> 172.21.15.33:0/1276964995 conn(0x7f7bdc0b0510 msgr2=0x7f7bdc0cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 shutdown_connections 2024-09-13T19:00:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.187+0000 7f7be2a00640 1 -- 172.21.15.33:0/1276964995 wait complete. 2024-09-13T19:00:08.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:52.781766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:53.886144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:08.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:08.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.362+0000 7f53b1a00640 1 Processor -- start 2024-09-13T19:00:08.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.362+0000 7f53b1a00640 1 -- start start 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.363+0000 7f53b1a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53ac071690 0x7f53ac15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.363+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac0cafa0 0x7f53ac0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.363+0000 7f53b1a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac06f5f0 con 0x7f53ac156f60 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.363+0000 7f53b1a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac15aa30 con 0x7f53ac071690 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.363+0000 7f53b1a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac070450 con 0x7f53ac0cafa0 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53ac071690 0x7f53ac15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53ab400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac0cafa0 0x7f53ac0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aaa00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f53ac156f60 0x7f53ac070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:51060/0 (socket says 172.21.15.33:51060) 2024-09-13T19:00:08.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aaa00640 1 -- 172.21.15.33:0/1365052177 learned_addr learned my addr 172.21.15.33:0/1365052177 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:08.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 --2- 172.21.15.33:0/1365052177 >> v2:172.21.15.33:3300/0 conn(0x7f53ac071690 0x7f53ac15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59826/0 (socket says 172.21.15.33:59826) 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 -- 172.21.15.33:0/1365052177 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac0cafa0 msgr2=0x7f53ac0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 --2- 172.21.15.33:0/1365052177 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac0cafa0 0x7f53ac0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 -- 172.21.15.33:0/1365052177 >> v1:172.21.15.103:6789/0 conn(0x7f53ac156f60 legacy=0x7f53ac070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53a9600640 1 -- 172.21.15.33:0/1365052177 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984260982 0 0) 0x7f53ac06f5f0 con 0x7f53ac156f60 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.364+0000 7f53aa000640 1 -- 172.21.15.33:0/1365052177 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac06f840 con 0x7f53ac071690 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.365+0000 7f53aa000640 1 --2- 172.21.15.33:0/1365052177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac071690 0x7f53ac15a4f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ee45334c4b72c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53a9600640 1 -- 172.21.15.33:0/1365052177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398032440 con 0x7f53ac071690 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53a9600640 1 -- 172.21.15.33:0/1365052177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980325a0 con 0x7f53ac071690 2024-09-13T19:00:08.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53a9600640 1 -- 172.21.15.33:0/1365052177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398032930 con 0x7f53ac071690 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 -- 172.21.15.33:0/1365052177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac071690 msgr2=0x7f53ac15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 --2- 172.21.15.33:0/1365052177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac071690 0x7f53ac15a4f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802a180 comp rx=0 tx=0).stop 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 -- 172.21.15.33:0/1365052177 shutdown_connections 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 --2- 172.21.15.33:0/1365052177 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac0cafa0 0x7f53ac0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 --2- 172.21.15.33:0/1365052177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac071690 0x7f53ac15a4f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 -- 172.21.15.33:0/1365052177 >> 172.21.15.33:0/1365052177 conn(0x7f53ac0b0580 msgr2=0x7f53ac0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 -- 172.21.15.33:0/1365052177 shutdown_connections 2024-09-13T19:00:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.366+0000 7f53b1a00640 1 -- 172.21.15.33:0/1365052177 wait complete. 2024-09-13T19:00:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.368+0000 7f53b1a00640 1 Processor -- start 2024-09-13T19:00:08.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.368+0000 7f53b1a00640 1 -- start start 2024-09-13T19:00:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac071690 0x7f53ac1e5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53ac156f60 0x7f53ac154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0a8570 con 0x7f53ac0cafa0 2024-09-13T19:00:08.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac13f340 con 0x7f53ac156f60 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53b1a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac154840 con 0x7f53ac071690 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53aa000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53aa000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59834/0 (socket says 172.21.15.33:59834) 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53aa000640 1 -- 172.21.15.33:0/3706297512 learned_addr learned my addr 172.21.15.33:0/3706297512 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53aaa00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac071690 0x7f53ac1e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.369+0000 7f53ab400640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53ac156f60 0x7f53ac154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 -- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac071690 msgr2=0x7f53ac1e5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac071690 0x7f53ac1e5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 -- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53ac156f60 msgr2=0x7f53ac154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53ac156f60 0x7f53ac154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 -- 172.21.15.33:0/3706297512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398009400 con 0x7f53ac0cafa0 2024-09-13T19:00:08.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53aa000640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f53980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398032440 con 0x7f53ac0cafa0 2024-09-13T19:00:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398004230 con 0x7f53ac0cafa0 2024-09-13T19:00:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398006e10 con 0x7f53ac0cafa0 2024-09-13T19:00:08.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac13ed10 con 0x7f53ac0cafa0 2024-09-13T19:00:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.370+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac13efd0 con 0x7f53ac0cafa0 2024-09-13T19:00:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.371+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac0708c0 con 0x7f53ac0cafa0 2024-09-13T19:00:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.372+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5398039050 con 0x7f53ac0cafa0 2024-09-13T19:00:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.373+0000 7f53a2a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 0x7f538c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.373+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53980a9c50 con 0x7f53ac0cafa0 2024-09-13T19:00:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.373+0000 7f53aaa00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 0x7f538c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.374+0000 7f53aaa00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 0x7f538c06d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f539c000f60 tx=0x7f539c007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.377+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53ac0708c0 con 0x7f53ac0cafa0 2024-09-13T19:00:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.555+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53ac0708c0 con 0x7f53ac0cafa0 2024-09-13T19:00:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.556+0000 7f53a2a00640 1 -- 172.21.15.33:0/3706297512 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53ac0708c0 con 0x7f53ac0cafa0 2024-09-13T19:00:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 msgr2=0x7f538c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 0x7f538c06d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f539c000f60 tx=0x7f539c007e40 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 msgr2=0x7f53ac153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f53980046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 shutdown_connections 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f538c06ac00 0x7f538c06d0c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53ac156f60 0x7f53ac154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0cafa0 0x7f53ac153dc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 --2- 172.21.15.33:0/3706297512 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53ac071690 0x7f53ac1e5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 >> 172.21.15.33:0/3706297512 conn(0x7f53ac0b0580 msgr2=0x7f53ac06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 shutdown_connections 2024-09-13T19:00:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.558+0000 7f53b1a00640 1 -- 172.21.15.33:0/3706297512 wait complete. 2024-09-13T19:00:08.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:08.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.731+0000 7f302d000640 1 Processor -- start 2024-09-13T19:00:08.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.731+0000 7f302d000640 1 -- start start 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f302d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 0x7f302815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f302d000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302806f5f0 con 0x7f3028156f60 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f302d000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3028070450 con 0x7f30280cafa0 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f302d000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302815aa30 con 0x7f3028071690 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f3025e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3028156f60 0x7f3028070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49770/0 (socket says 172.21.15.33:49770) 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f3025e00640 1 -- 172.21.15.33:0/402974017 learned_addr learned my addr 172.21.15.33:0/402974017 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:08.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f301d400640 1 --2- 172.21.15.33:0/402974017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 0x7f302815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927127180 0 0) 0x7f302806f5f0 con 0x7f3028156f60 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.733+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300c005730 con 0x7f3028156f60 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.734+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282200357 0 0) 0x7f3028070450 con 0x7f30280cafa0 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.734+0000 7f301d400640 1 -- 172.21.15.33:0/402974017 >> v1:172.21.15.103:6789/0 conn(0x7f30280cafa0 legacy=0x7f30280cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.734+0000 7f301d400640 1 -- 172.21.15.33:0/402974017 >> v1:172.21.15.33:6789/0 conn(0x7f3028156f60 legacy=0x7f3028070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.734+0000 7f301d400640 1 -- 172.21.15.33:0/402974017 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302806f840 con 0x7f3028071690 2024-09-13T19:00:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f301d400640 1 --2- 172.21.15.33:0/402974017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 0x7f302815a4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30100097d0 tx=0x7f301002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=223823961e70b1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010032440 con 0x7f3028071690 2024-09-13T19:00:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30100325a0 con 0x7f3028071690 2024-09-13T19:00:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f3025400640 1 -- 172.21.15.33:0/402974017 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010032930 con 0x7f3028071690 2024-09-13T19:00:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f302d000640 1 -- 172.21.15.33:0/402974017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 msgr2=0x7f302815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f302d000640 1 --2- 172.21.15.33:0/402974017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 0x7f302815a4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30100097d0 tx=0x7f301002a210 comp rx=0 tx=0).stop 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f302d000640 1 -- 172.21.15.33:0/402974017 shutdown_connections 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.735+0000 7f302d000640 1 --2- 172.21.15.33:0/402974017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3028071690 0x7f302815a4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.736+0000 7f302d000640 1 -- 172.21.15.33:0/402974017 >> 172.21.15.33:0/402974017 conn(0x7f30280b0580 msgr2=0x7f30280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.736+0000 7f302d000640 1 -- 172.21.15.33:0/402974017 shutdown_connections 2024-09-13T19:00:08.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.736+0000 7f302d000640 1 -- 172.21.15.33:0/402974017 wait complete. 2024-09-13T19:00:08.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.737+0000 7f302d000640 1 Processor -- start 2024-09-13T19:00:08.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.737+0000 7f302d000640 1 -- start start 2024-09-13T19:00:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 0x7f30280af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30280cafa0 0x7f30281ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028157550 con 0x7f3028156f60 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30281efbf0 con 0x7f3028071690 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.738+0000 7f302d000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302815df10 con 0x7f30280cafa0 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59840/0 (socket says 172.21.15.33:59840) 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 -- 172.21.15.33:0/262290073 learned_addr learned my addr 172.21.15.33:0/262290073 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3025e00640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 0x7f30280af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f301d400640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30280cafa0 0x7f30281ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 -- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30280cafa0 msgr2=0x7f30281ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30280cafa0 0x7f30281ef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 -- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 msgr2=0x7f30280af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 0x7f30280af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 -- 172.21.15.33:0/262290073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010009400 con 0x7f3028156f60 2024-09-13T19:00:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3025e00640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 0x7f30280af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.739+0000 7f3026800640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f302000c7c0 tx=0x7f302000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.740+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020003da0 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.740+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020005070 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.740+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020005420 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.740+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30281f58b0 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.740+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30281f5b50 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.741+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028157340 con 0x7f3028156f60 2024-09-13T19:00:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.742+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3020005580 con 0x7f3028156f60 2024-09-13T19:00:08.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.743+0000 7f301ea00640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 0x7f300406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:08.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.743+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3020088b70 con 0x7f3028156f60 2024-09-13T19:00:08.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.743+0000 7f3025e00640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 0x7f300406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:08.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.743+0000 7f3025e00640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 0x7f300406d0c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3018007fd0 tx=0x7f3018009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:08.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.747+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3020053de0 con 0x7f3028156f60 2024-09-13T19:00:08.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.925+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30280aeb90 con 0x7f3028156f60 2024-09-13T19:00:08.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.926+0000 7f301ea00640 1 -- 172.21.15.33:0/262290073 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3020017020 con 0x7f3028156f60 2024-09-13T19:00:08.929 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:08.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 msgr2=0x7f300406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 0x7f300406d0c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3018007fd0 tx=0x7f3018009040 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 msgr2=0x7f30281ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f302000c7c0 tx=0x7f302000cc80 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 shutdown_connections 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f300406ac00 0x7f300406d0c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3028156f60 0x7f30281ef6b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30280cafa0 0x7f30281ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 --2- 172.21.15.33:0/262290073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3028071690 0x7f30280af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 >> 172.21.15.33:0/262290073 conn(0x7f30280b0580 msgr2=0x7f302806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 shutdown_connections 2024-09-13T19:00:08.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:08.928+0000 7f302d000640 1 -- 172.21.15.33:0/262290073 wait complete. 2024-09-13T19:00:08.947 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:09.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.101+0000 7f968c000640 1 Processor -- start 2024-09-13T19:00:09.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.102+0000 7f968c000640 1 -- start start 2024-09-13T19:00:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968c000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9684154ad0 0x7f96840cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968c000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96840ce2c0 0x7f96840cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968c000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968406b7c0 con 0x7f968406f830 2024-09-13T19:00:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968c000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968406b5b0 con 0x7f96840ce2c0 2024-09-13T19:00:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968c000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968406baa0 con 0x7f9684154ad0 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96840ce2c0 0x7f96840cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96840ce2c0 0x7f96840cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59842/0 (socket says 172.21.15.33:59842) 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f968a000640 1 -- 172.21.15.33:0/2880533041 learned_addr learned my addr 172.21.15.33:0/2880533041 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.103+0000 7f9689600640 1 --2- 172.21.15.33:0/2880533041 >> v2:172.21.15.103:3300/0 conn(0x7f9684154ad0 0x7f96840cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.104+0000 7f968a000640 1 -- 172.21.15.33:0/2880533041 >> v2:172.21.15.103:3300/0 conn(0x7f9684154ad0 msgr2=0x7f96840cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.104+0000 7f968a000640 1 --2- 172.21.15.33:0/2880533041 >> v2:172.21.15.103:3300/0 conn(0x7f9684154ad0 0x7f96840cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.104+0000 7f968a000640 1 -- 172.21.15.33:0/2880533041 >> v1:172.21.15.103:6789/0 conn(0x7f968406f830 legacy=0x7f968406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.104+0000 7f968a000640 1 -- 172.21.15.33:0/2880533041 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968406bd80 con 0x7f96840ce2c0 2024-09-13T19:00:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.105+0000 7f968a000640 1 --2- 172.21.15.33:0/2880533041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840ce2c0 0x7f96840cbac0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f96840b1340 tx=0x7f967c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e59bb5630cfd87a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.105+0000 7f9683e00640 1 -- 172.21.15.33:0/2880533041 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c031600 con 0x7f96840ce2c0 2024-09-13T19:00:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.105+0000 7f9683e00640 1 -- 172.21.15.33:0/2880533041 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c02d050 con 0x7f96840ce2c0 2024-09-13T19:00:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.105+0000 7f9683e00640 1 -- 172.21.15.33:0/2880533041 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c031980 con 0x7f96840ce2c0 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.105+0000 7f968c000640 1 -- 172.21.15.33:0/2880533041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840ce2c0 msgr2=0x7f96840cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 --2- 172.21.15.33:0/2880533041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840ce2c0 0x7f96840cbac0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f96840b1340 tx=0x7f967c02a6a0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 -- 172.21.15.33:0/2880533041 shutdown_connections 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 --2- 172.21.15.33:0/2880533041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840ce2c0 0x7f96840cbac0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 --2- 172.21.15.33:0/2880533041 >> v2:172.21.15.103:3300/0 conn(0x7f9684154ad0 0x7f96840cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 -- 172.21.15.33:0/2880533041 >> 172.21.15.33:0/2880533041 conn(0x7f96840b0580 msgr2=0x7f96840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 -- 172.21.15.33:0/2880533041 shutdown_connections 2024-09-13T19:00:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.106+0000 7f968c000640 1 -- 172.21.15.33:0/2880533041 wait complete. 2024-09-13T19:00:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.107+0000 7f968c000640 1 Processor -- start 2024-09-13T19:00:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.107+0000 7f968c000640 1 -- start start 2024-09-13T19:00:09.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 0x7f9684146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f968415b5a0 0x7f968415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968414f500 con 0x7f968414eb40 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968415ba40 con 0x7f9684154ad0 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.108+0000 7f968c000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968415bd20 con 0x7f968415b5a0 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59846/0 (socket says 172.21.15.33:59846) 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 -- 172.21.15.33:0/3207054833 learned_addr learned my addr 172.21.15.33:0/3207054833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f9689600640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 0x7f9684146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f9688c00640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f968415b5a0 0x7f968415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 -- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f968415b5a0 msgr2=0x7f968415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f968415b5a0 0x7f968415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 -- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 msgr2=0x7f9684146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 0x7f9684146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 -- 172.21.15.33:0/3207054833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009b30 con 0x7f968414eb40 2024-09-13T19:00:09.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f9689600640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 0x7f9684146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:09.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.109+0000 7f968a000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f967c034040 tx=0x7f967c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.110+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c03d860 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.110+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c03d9c0 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.110+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c03dd70 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.110+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968415c000 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.110+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968415c5c0 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.111+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840cdd80 con 0x7f968414eb40 2024-09-13T19:00:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.112+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f967c03b400 con 0x7f968414eb40 2024-09-13T19:00:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.113+0000 7f9681600640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 0x7f966406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.113+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f967c0aa2a0 con 0x7f968414eb40 2024-09-13T19:00:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.113+0000 7f9689600640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 0x7f966406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.114+0000 7f9689600640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 0x7f966406d0c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9678009af0 tx=0x7f9678008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.117+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f967c0753e0 con 0x7f968414eb40 2024-09-13T19:00:09.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.294+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96840afc70 con 0x7f968414eb40 2024-09-13T19:00:09.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.295+0000 7f9681600640 1 -- 172.21.15.33:0/3207054833 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f967c009510 con 0x7f968414eb40 2024-09-13T19:00:09.298 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.296+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 msgr2=0x7f966406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.296+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 0x7f966406d0c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9678009af0 tx=0x7f9678008040 comp rx=0 tx=0).stop 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.296+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 msgr2=0x7f968414efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.296+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f967c034040 tx=0x7f967c004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 shutdown_connections 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f966406ac00 0x7f966406d0c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968414eb40 0x7f968414efc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f968415b5a0 0x7f968415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 --2- 172.21.15.33:0/3207054833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9684154ad0 0x7f9684146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 >> 172.21.15.33:0/3207054833 conn(0x7f96840b0580 msgr2=0x7f968415e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 shutdown_connections 2024-09-13T19:00:09.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.297+0000 7f968c000640 1 -- 172.21.15.33:0/3207054833 wait complete. 2024-09-13T19:00:09.316 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:00:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.469+0000 7f4b20400640 1 Processor -- start 2024-09-13T19:00:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.469+0000 7f4b20400640 1 -- start start 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b20400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b180b1b30 0x7f4b180cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b20400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1806ba80 con 0x7f4b180cba50 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b20400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180b2270 con 0x7f4b18151590 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b20400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180b2550 con 0x7f4b180b1b30 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1d000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b180b1b30 0x7f4b180cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1e400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4b180cba50 0x7f4b180cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49772/0 (socket says 172.21.15.33:49772) 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1e400640 1 -- 172.21.15.33:0/2714011571 learned_addr learned my addr 172.21.15.33:0/2714011571 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1d000640 1 -- 172.21.15.33:0/2714011571 >> v1:172.21.15.103:6789/0 conn(0x7f4b18151590 legacy=0x7f4b1806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1d000640 1 -- 172.21.15.33:0/2714011571 >> v1:172.21.15.33:6789/0 conn(0x7f4b180cba50 legacy=0x7f4b180cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.471+0000 7f4b1d000640 1 -- 172.21.15.33:0/2714011571 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180b2830 con 0x7f4b180b1b30 2024-09-13T19:00:09.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.472+0000 7f4b1d000640 1 --2- 172.21.15.33:0/2714011571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b180cdda0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097a0 tx=0x7f4b0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a647da395572f73a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b17e00640 1 -- 172.21.15.33:0/2714011571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04032440 con 0x7f4b180b1b30 2024-09-13T19:00:09.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b17e00640 1 -- 172.21.15.33:0/2714011571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040325a0 con 0x7f4b180b1b30 2024-09-13T19:00:09.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b17e00640 1 -- 172.21.15.33:0/2714011571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04032930 con 0x7f4b180b1b30 2024-09-13T19:00:09.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 -- 172.21.15.33:0/2714011571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 msgr2=0x7f4b180cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 --2- 172.21.15.33:0/2714011571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b180cdda0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097a0 tx=0x7f4b0402a230 comp rx=0 tx=0).stop 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 -- 172.21.15.33:0/2714011571 shutdown_connections 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 --2- 172.21.15.33:0/2714011571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b180cdda0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 -- 172.21.15.33:0/2714011571 >> 172.21.15.33:0/2714011571 conn(0x7f4b180b0510 msgr2=0x7f4b180b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 -- 172.21.15.33:0/2714011571 shutdown_connections 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.473+0000 7f4b20400640 1 -- 172.21.15.33:0/2714011571 wait complete. 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.475+0000 7f4b20400640 1 Processor -- start 2024-09-13T19:00:09.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.475+0000 7f4b20400640 1 -- start start 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b180cba50 0x7f4b18146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b18151590 0x7f4b18146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181e5140 con 0x7f4b180b1b30 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181e5420 con 0x7f4b180cba50 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b20400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181e5700 con 0x7f4b18151590 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b1da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b1da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59862/0 (socket says 172.21.15.33:59862) 2024-09-13T19:00:09.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b1da00640 1 -- 172.21.15.33:0/27641058 learned_addr learned my addr 172.21.15.33:0/27641058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.476+0000 7f4b1d000640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b180cba50 0x7f4b18146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 -- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b18151590 msgr2=0x7f4b18146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b18151590 0x7f4b18146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 -- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b180cba50 msgr2=0x7f4b18146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b180cba50 0x7f4b18146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 -- 172.21.15.33:0/27641058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009400 con 0x7f4b180b1b30 2024-09-13T19:00:09.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b1da00640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c400 tx=0x7f4b0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0052d0 con 0x7f4b180b1b30 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c005430 con 0x7f4b180b1b30 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003830 con 0x7f4b180b1b30 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b181e59e0 con 0x7f4b180b1b30 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.477+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1815ec60 con 0x7f4b180b1b30 2024-09-13T19:00:09.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.478+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b181e5f00 con 0x7f4b180b1b30 2024-09-13T19:00:09.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.479+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b0c003990 con 0x7f4b180b1b30 2024-09-13T19:00:09.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.480+0000 7f4b15600640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 0x7f4af806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:09.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.480+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b0c088970 con 0x7f4b180b1b30 2024-09-13T19:00:09.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.481+0000 7f4b1d000640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 0x7f4af806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:09.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.481+0000 7f4b1d000640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 0x7f4af806d0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b04034000 tx=0x7f4b0402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:09.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.484+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b0c053ab0 con 0x7f4b180b1b30 2024-09-13T19:00:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.674+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b1815edf0 con 0x7f4b180b1b30 2024-09-13T19:00:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.675+0000 7f4b15600640 1 -- 172.21.15.33:0/27641058 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4b0c017080 con 0x7f4b180b1b30 2024-09-13T19:00:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 msgr2=0x7f4af806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 0x7f4af806d0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b04034000 tx=0x7f4b0402e000 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 msgr2=0x7f4b1815e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c400 tx=0x7f4b0c00c8c0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 shutdown_connections 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4af806ac00 0x7f4af806d0c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b18151590 0x7f4b18146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b180cba50 0x7f4b18146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 --2- 172.21.15.33:0/27641058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b180b1b30 0x7f4b1815e720 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 >> 172.21.15.33:0/27641058 conn(0x7f4b180b0510 msgr2=0x7f4b1814e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 shutdown_connections 2024-09-13T19:00:09.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:09.677+0000 7f4b20400640 1 -- 172.21.15.33:0/27641058 wait complete. 2024-09-13T19:00:09.696 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T19:00:09.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:09.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:09.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:00:09.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:09.758 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T19:00:09.795 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:09.795 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:09.835 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:09.835 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:09.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.067+0000 7f4da3600640 1 Processor -- start 2024-09-13T19:00:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.067+0000 7f4da3600640 1 -- start start 2024-09-13T19:00:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.068+0000 7f4da3600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.068+0000 7f4da3600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 0x7f4d9c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.068+0000 7f4da3600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9c06bc00 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.068+0000 7f4da3600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c06bea0 con 0x7f4d9c0ce020 2024-09-13T19:00:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.068+0000 7f4da3600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c06c180 con 0x7f4d9c15a520 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da1600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 0x7f4d9c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:52778/0 (socket says 172.21.15.33:52778) 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da1600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 0x7f4d9c15a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:39708/0 (socket says 172.21.15.33:39708) 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 -- 172.21.15.33:0/4124265415 learned_addr learned my addr 172.21.15.33:0/4124265415 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 -- 172.21.15.33:0/4124265415 >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 msgr2=0x7f4d9c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 --2- 172.21.15.33:0/4124265415 >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 0x7f4d9c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 -- 172.21.15.33:0/4124265415 >> v1:172.21.15.103:6789/0 conn(0x7f4d9c0b1b00 legacy=0x7f4d9c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.069+0000 7f4da0c00640 1 -- 172.21.15.33:0/4124265415 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c06c460 con 0x7f4d9c15a520 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.070+0000 7f4da0c00640 1 --2- 172.21.15.33:0/4124265415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009870 tx=0x7f4d9002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb3a5f88fdee0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4d9b400640 1 -- 172.21.15.33:0/4124265415 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90032440 con 0x7f4d9c15a520 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4d9b400640 1 -- 172.21.15.33:0/4124265415 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d900325a0 con 0x7f4d9c15a520 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4d9b400640 1 -- 172.21.15.33:0/4124265415 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90032930 con 0x7f4d9c15a520 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 -- 172.21.15.33:0/4124265415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 msgr2=0x7f4d9c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 --2- 172.21.15.33:0/4124265415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009870 tx=0x7f4d9002a250 comp rx=0 tx=0).stop 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 -- 172.21.15.33:0/4124265415 shutdown_connections 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 --2- 172.21.15.33:0/4124265415 >> v2:172.21.15.103:3300/0 conn(0x7f4d9c0ce020 0x7f4d9c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 --2- 172.21.15.33:0/4124265415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c15a520 0x7f4d9c06b6c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 -- 172.21.15.33:0/4124265415 >> 172.21.15.33:0/4124265415 conn(0x7f4d9c0b0510 msgr2=0x7f4d9c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 -- 172.21.15.33:0/4124265415 shutdown_connections 2024-09-13T19:00:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.071+0000 7f4da3600640 1 -- 172.21.15.33:0/4124265415 wait complete. 2024-09-13T19:00:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.073+0000 7f4da3600640 1 Processor -- start 2024-09-13T19:00:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.073+0000 7f4da3600640 1 -- start start 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 0x7f4d9c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d9c15a520 0x7f4d9c0c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0cb0d0 con 0x7f4d9c0ce020 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0c3cc0 con 0x7f4d9c15a520 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da3600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c06f870 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4d9be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 0x7f4d9c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da0c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da0c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:52782/0 (socket says 172.21.15.33:52782) 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da0c00640 1 -- 172.21.15.33:0/3022043966 learned_addr learned my addr 172.21.15.33:0/3022043966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.074+0000 7f4da1600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d9c15a520 0x7f4d9c0c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 -- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d9c15a520 msgr2=0x7f4d9c0c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d9c15a520 0x7f4d9c0c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 -- 172.21.15.33:0/3022043966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 msgr2=0x7f4d9c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 0x7f4d9c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 -- 172.21.15.33:0/3022043966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900094d0 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4d9be00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 0x7f4d9c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da0c00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d9002a290 tx=0x7f4d900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90032440 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d90030ba0 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c070eb0 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.075+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9003d440 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.076+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c071470 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.077+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c15a900 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.077+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d90039040 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.078+0000 7f4d98c00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 0x7f4d7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.078+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d900a9e00 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.079+0000 7f4d9be00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 0x7f4d7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.079+0000 7f4d9be00640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 0x7f4d7c06d0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0b1950 tx=0x7f4d88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.084+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d90074f70 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.266+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d9c06f640 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.267+0000 7f4d98c00640 1 -- 172.21.15.33:0/3022043966 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f4d90078590 con 0x7f4d9c0b1b00 2024-09-13T19:00:10.271 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:10.271 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.269+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 msgr2=0x7f4d7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.269+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 0x7f4d7c06d0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0b1950 tx=0x7f4d88009040 comp rx=0 tx=0).stop 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.269+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 msgr2=0x7f4d9c1f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.269+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d9002a290 tx=0x7f4d900046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 shutdown_connections 2024-09-13T19:00:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4d7c06ac00 0x7f4d7c06d0c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d9c15a520 0x7f4d9c0c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d9c0ce020 0x7f4d9c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 --2- 172.21.15.33:0/3022043966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4d9c0b1b00 0x7f4d9c1f2c50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 >> 172.21.15.33:0/3022043966 conn(0x7f4d9c0b0510 msgr2=0x7f4d9c157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 shutdown_connections 2024-09-13T19:00:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.270+0000 7f4da3600640 1 -- 172.21.15.33:0/3022043966 wait complete. 2024-09-13T19:00:10.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:52.781766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:53.886144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:10.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.445+0000 7fe3c9400640 1 Processor -- start 2024-09-13T19:00:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.445+0000 7fe3c9400640 1 -- start start 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.446+0000 7fe3c9400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.446+0000 7fe3c9400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe3c40ce2c0 0x7fe3c40cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.446+0000 7fe3c9400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c406b7c0 con 0x7fe3c406f830 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.446+0000 7fe3c9400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c406b5b0 con 0x7fe3c40ce2c0 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.446+0000 7fe3c9400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c406baa0 con 0x7fe3c4154ad0 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c3200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe3c40ce2c0 0x7fe3c40cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3bbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe3c406f830 0x7fe3c406fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49784/0 (socket says 172.21.15.33:49784) 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3bbe00640 1 -- 172.21.15.33:0/888214134 learned_addr learned my addr 172.21.15.33:0/888214134 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c2800640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c3200640 1 -- 172.21.15.33:0/888214134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 msgr2=0x7fe3c40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c3200640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c40cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c3200640 1 -- 172.21.15.33:0/888214134 >> v1:172.21.15.33:6789/0 conn(0x7fe3c406f830 legacy=0x7fe3c406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c3200640 1 -- 172.21.15.33:0/888214134 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c406bd80 con 0x7fe3c40ce2c0 2024-09-13T19:00:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.447+0000 7fe3c1e00640 1 -- 172.21.15.33:0/888214134 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337614892 0 0) 0x7fe3c406b7c0 con 0x7fe3c406f830 2024-09-13T19:00:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.448+0000 7fe3c3200640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c40ce2c0 0x7fe3c40cbac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009dc0 tx=0x7fe3bc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107d697671387252 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c1e00640 1 -- 172.21.15.33:0/888214134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc007740 con 0x7fe3c40ce2c0 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c1e00640 1 -- 172.21.15.33:0/888214134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc02d050 con 0x7fe3c40ce2c0 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c1e00640 1 -- 172.21.15.33:0/888214134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc007ac0 con 0x7fe3c40ce2c0 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 -- 172.21.15.33:0/888214134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c40ce2c0 msgr2=0x7fe3c40cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c40ce2c0 0x7fe3c40cbac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009dc0 tx=0x7fe3bc02a5f0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 -- 172.21.15.33:0/888214134 shutdown_connections 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c40ce2c0 0x7fe3c40cbac0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 --2- 172.21.15.33:0/888214134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c40cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 -- 172.21.15.33:0/888214134 >> 172.21.15.33:0/888214134 conn(0x7fe3c40b0580 msgr2=0x7fe3c40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 -- 172.21.15.33:0/888214134 shutdown_connections 2024-09-13T19:00:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.449+0000 7fe3c9400640 1 -- 172.21.15.33:0/888214134 wait complete. 2024-09-13T19:00:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.451+0000 7fe3c9400640 1 Processor -- start 2024-09-13T19:00:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.451+0000 7fe3c9400640 1 -- start start 2024-09-13T19:00:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c4146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3c41f2b60 0x7fe3c40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4147230 con 0x7fe3c41f26e0 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4147730 con 0x7fe3c41f2b60 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c9400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c41f5a80 con 0x7fe3c4154ad0 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59904/0 (socket says 172.21.15.33:59904) 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3bbe00640 1 -- 172.21.15.33:0/3361182535 learned_addr learned my addr 172.21.15.33:0/3361182535 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c2800640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c4146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.452+0000 7fe3c3200640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3c41f2b60 0x7fe3c40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 -- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 msgr2=0x7fe3c4146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c4146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 -- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3c41f2b60 msgr2=0x7fe3c40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3c41f2b60 0x7fe3c40b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 -- 172.21.15.33:0/3361182535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009a70 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c470 tx=0x7fe3ac00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0074e0 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac007640 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4150160 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac004a20 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.453+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4150720 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.454+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c40cb0d0 con 0x7fe3c41f26e0 2024-09-13T19:00:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.455+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3ac004b80 con 0x7fe3c41f26e0 2024-09-13T19:00:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.456+0000 7fe3baa00640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 0x7fe3a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.456+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3ac0884e0 con 0x7fe3c41f26e0 2024-09-13T19:00:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.457+0000 7fe3c2800640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 0x7fe3a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.457+0000 7fe3c2800640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 0x7fe3a006d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4154100 tx=0x7fe3b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.461+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3ac053760 con 0x7fe3c41f26e0 2024-09-13T19:00:10.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.642+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3c415a9b0 con 0x7fe3c41f26e0 2024-09-13T19:00:10.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.643+0000 7fe3baa00640 1 -- 172.21.15.33:0/3361182535 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3ac0180a0 con 0x7fe3c41f26e0 2024-09-13T19:00:10.646 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:10.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.644+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 msgr2=0x7fe3a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.644+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 0x7fe3a006d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4154100 tx=0x7fe3b4009190 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.644+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 msgr2=0x7fe3c40b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.644+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c470 tx=0x7fe3ac00c930 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 shutdown_connections 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe3a006ac00 0x7fe3a006d0c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3c41f2b60 0x7fe3c40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c41f26e0 0x7fe3c40b2f70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 --2- 172.21.15.33:0/3361182535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3c4154ad0 0x7fe3c4146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 >> 172.21.15.33:0/3361182535 conn(0x7fe3c40b0580 msgr2=0x7fe3c40ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 shutdown_connections 2024-09-13T19:00:10.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.645+0000 7fe3c9400640 1 -- 172.21.15.33:0/3361182535 wait complete. 2024-09-13T19:00:10.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.819+0000 7f2913400640 1 Processor -- start 2024-09-13T19:00:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.819+0000 7f2913400640 1 -- start start 2024-09-13T19:00:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.820+0000 7f2913400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f290c154ad0 0x7f290c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.820+0000 7f2913400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f290c0ce2c0 0x7f290c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.820+0000 7f2913400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c06b7c0 con 0x7f290c06f830 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.820+0000 7f2913400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c06b5b0 con 0x7f290c154ad0 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.820+0000 7f2913400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c06baa0 con 0x7f290c0ce2c0 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f290c154ad0 0x7f290c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f290c154ad0 0x7f290c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59906/0 (socket says 172.21.15.33:59906) 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 -- 172.21.15.33:0/128518255 learned_addr learned my addr 172.21.15.33:0/128518255 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2911400640 1 --2- 172.21.15.33:0/128518255 >> v2:172.21.15.103:3300/0 conn(0x7f290c0ce2c0 0x7f290c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 -- 172.21.15.33:0/128518255 >> v2:172.21.15.103:3300/0 conn(0x7f290c0ce2c0 msgr2=0x7f290c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 --2- 172.21.15.33:0/128518255 >> v2:172.21.15.103:3300/0 conn(0x7f290c0ce2c0 0x7f290c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 -- 172.21.15.33:0/128518255 >> v1:172.21.15.33:6789/0 conn(0x7f290c06f830 legacy=0x7f290c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.821+0000 7f2910a00640 1 -- 172.21.15.33:0/128518255 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c06bd80 con 0x7f290c154ad0 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.822+0000 7f2910a00640 1 --2- 172.21.15.33:0/128518255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c154ad0 0x7f290c0cdd80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f290c0ce780 tx=0x7f290002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c3ce3905365c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.822+0000 7f290b400640 1 -- 172.21.15.33:0/128518255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900032440 con 0x7f290c154ad0 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.822+0000 7f290b400640 1 -- 172.21.15.33:0/128518255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000325a0 con 0x7f290c154ad0 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.822+0000 7f290b400640 1 -- 172.21.15.33:0/128518255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900032930 con 0x7f290c154ad0 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 -- 172.21.15.33:0/128518255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c154ad0 msgr2=0x7f290c0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 --2- 172.21.15.33:0/128518255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c154ad0 0x7f290c0cdd80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f290c0ce780 tx=0x7f290002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 -- 172.21.15.33:0/128518255 shutdown_connections 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 --2- 172.21.15.33:0/128518255 >> v2:172.21.15.103:3300/0 conn(0x7f290c0ce2c0 0x7f290c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 --2- 172.21.15.33:0/128518255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c154ad0 0x7f290c0cdd80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 -- 172.21.15.33:0/128518255 >> 172.21.15.33:0/128518255 conn(0x7f290c0b0580 msgr2=0x7f290c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 -- 172.21.15.33:0/128518255 shutdown_connections 2024-09-13T19:00:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.823+0000 7f2913400640 1 -- 172.21.15.33:0/128518255 wait complete. 2024-09-13T19:00:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.825+0000 7f2913400640 1 Processor -- start 2024-09-13T19:00:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.825+0000 7f2913400640 1 -- start start 2024-09-13T19:00:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 0x7f290c1f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 0x7f290c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c14aa20 con 0x7f290c1f5ea0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c156f00 con 0x7f290c156910 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2913400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c1571e0 con 0x7f290c154ad0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59918/0 (socket says 172.21.15.33:59918) 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 -- 172.21.15.33:0/2026336603 learned_addr learned my addr 172.21.15.33:0/2026336603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2911400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 0x7f290c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2910a00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 0x7f290c1f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 -- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 msgr2=0x7f290c1f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 0x7f290c1f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 -- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 msgr2=0x7f290c14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 0x7f290c14f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f290be00640 1 -- 172.21.15.33:0/2026336603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000094d0 con 0x7f290c1f5ea0 2024-09-13T19:00:10.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2911400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 0x7f290c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.826+0000 7f2910a00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 0x7f290c1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f290be00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c450 tx=0x7f28f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80052d0 con 0x7f290c1f5ea0 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8005430 con 0x7f290c1f5ea0 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8012870 con 0x7f290c1f5ea0 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c1574c0 con 0x7f290c1f5ea0 2024-09-13T19:00:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.827+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c157a80 con 0x7f290c1f5ea0 2024-09-13T19:00:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.828+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c0b0960 con 0x7f290c1f5ea0 2024-09-13T19:00:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.829+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28f80129d0 con 0x7f290c1f5ea0 2024-09-13T19:00:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.830+0000 7f2908c00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 0x7f28ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.830+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f8088ed0 con 0x7f290c1f5ea0 2024-09-13T19:00:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.830+0000 7f2910a00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 0x7f28ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.831+0000 7f2910a00640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 0x7f28ec06d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2900034000 tx=0x7f290002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:10.834+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28f80540a0 con 0x7f290c1f5ea0 2024-09-13T19:00:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.017+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f290c1f6d90 con 0x7f290c1f5ea0 2024-09-13T19:00:11.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.017+0000 7f2908c00640 1 -- 172.21.15.33:0/2026336603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28f80576c0 con 0x7f290c1f5ea0 2024-09-13T19:00:11.021 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:11.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 msgr2=0x7f28ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 0x7f28ec06d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2900034000 tx=0x7f290002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:11.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 msgr2=0x7f290c1563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c450 tx=0x7f28f800c910 comp rx=0 tx=0).stop 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 shutdown_connections 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f28ec06ac00 0x7f28ec06d0c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f290c156910 0x7f290c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.019+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f290c1f5ea0 0x7f290c1563d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.020+0000 7f2913400640 1 --2- 172.21.15.33:0/2026336603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f290c154ad0 0x7f290c1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.020+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 >> 172.21.15.33:0/2026336603 conn(0x7f290c0b0580 msgr2=0x7f290c15ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.020+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 shutdown_connections 2024-09-13T19:00:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.020+0000 7f2913400640 1 -- 172.21.15.33:0/2026336603 wait complete. 2024-09-13T19:00:11.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.194+0000 7faf39800640 1 Processor -- start 2024-09-13T19:00:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.194+0000 7faf39800640 1 -- start start 2024-09-13T19:00:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf39800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf340cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf39800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340ce490 con 0x7faf3406f830 2024-09-13T19:00:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf39800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3406b7c0 con 0x7faf34154ad0 2024-09-13T19:00:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf39800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cc4b0 con 0x7faf340cbac0 2024-09-13T19:00:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf2a000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faf3406f830 0x7faf3406fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49796/0 (socket says 172.21.15.33:49796) 2024-09-13T19:00:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.195+0000 7faf2a000640 1 -- 172.21.15.33:0/4133738583 learned_addr learned my addr 172.21.15.33:0/4133738583 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:11.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf33400640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf340cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410593304 0 0) 0x7faf340ce490 con 0x7faf3406f830 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf18003520 con 0x7faf3406f830 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868161228 0 0) 0x7faf3406b7c0 con 0x7faf34154ad0 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf340ce490 con 0x7faf34154ad0 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1132593466 0 0) 0x7faf18003520 con 0x7faf3406f830 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 msgr2=0x7faf340cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf340cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 >> v1:172.21.15.103:6789/0 conn(0x7faf34154ad0 legacy=0x7faf340cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3406baa0 con 0x7faf3406f830 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7faf1c0015f0 con 0x7faf3406f830 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 >> v1:172.21.15.33:6789/0 conn(0x7faf3406f830 legacy=0x7faf3406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf18003b30 0x7faf18003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cc4b0 con 0x7faf18004d00 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1800bb10 con 0x7faf18003b30 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.196+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1800bca0 con 0x7faf340cbac0 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf32a00640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf18003b30 0x7faf18003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf2a000640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 -- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 msgr2=0x7faf180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf340cbac0 0x7faf180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 -- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf18003b30 msgr2=0x7faf18003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf18003b30 0x7faf18003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf33400640 1 -- 172.21.15.33:0/4133738583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18003520 con 0x7faf18004d00 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.197+0000 7faf32a00640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf18003b30 0x7faf18003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.198+0000 7faf33400640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf18005180 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e170 tx=0x7faf180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c450c1da128df0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.198+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0305f0 con 0x7faf18004d00 2024-09-13T19:00:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.198+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00f040 con 0x7faf18004d00 2024-09-13T19:00:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf32000640 1 -- 172.21.15.33:0/4133738583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c030990 con 0x7faf18004d00 2024-09-13T19:00:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 -- 172.21.15.33:0/4133738583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 msgr2=0x7faf18005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 --2- 172.21.15.33:0/4133738583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf18005180 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00e170 tx=0x7faf180057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf33400640 1 -- 172.21.15.33:0/4133738583 reap_dead start 2024-09-13T19:00:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 -- 172.21.15.33:0/4133738583 shutdown_connections 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 -- 172.21.15.33:0/4133738583 >> 172.21.15.33:0/4133738583 conn(0x7faf340b0580 msgr2=0x7faf340b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 -- 172.21.15.33:0/4133738583 shutdown_connections 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.199+0000 7faf39800640 1 -- 172.21.15.33:0/4133738583 wait complete. 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.201+0000 7faf39800640 1 Processor -- start 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.201+0000 7faf39800640 1 -- start start 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 0x7faf3415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf3413d950 0x7faf3413ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3413eec0 con 0x7faf18004d00 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3415ea20 con 0x7faf3413d950 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf39800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34141d90 con 0x7faf3415e060 2024-09-13T19:00:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf32a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf2a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 0x7faf3415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf32a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59942/0 (socket says 172.21.15.33:59942) 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf32a00640 1 -- 172.21.15.33:0/3888000328 learned_addr learned my addr 172.21.15.33:0/3888000328 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf2a000640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 0x7faf3415e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:52832/0 (socket says 172.21.15.33:52832) 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.202+0000 7faf33400640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf3413d950 0x7faf3413ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 -- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 msgr2=0x7faf3415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 0x7faf3415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 -- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf3413d950 msgr2=0x7faf3413ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf3413d950 0x7faf3413ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 -- 172.21.15.33:0/3888000328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3413e800 con 0x7faf18004d00 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf32a00640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faf240079a0 tx=0x7faf2400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240052e0 con 0x7faf18004d00 2024-09-13T19:00:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24005440 con 0x7faf18004d00 2024-09-13T19:00:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400da10 con 0x7faf18004d00 2024-09-13T19:00:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3413f0d0 con 0x7faf18004d00 2024-09-13T19:00:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.203+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3413f690 con 0x7faf18004d00 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.205+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34071750 con 0x7faf18004d00 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.205+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf2400db70 con 0x7faf18004d00 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.206+0000 7faf2b400640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 0x7faf1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.206+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf240894b0 con 0x7faf18004d00 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.207+0000 7faf2a000640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 0x7faf1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.208+0000 7faf2a000640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 0x7faf1006d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf340705a0 tx=0x7faf1c001020 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.211+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf34071750 con 0x7faf18004d00 2024-09-13T19:00:11.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.392+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf34071750 con 0x7faf18004d00 2024-09-13T19:00:11.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.393+0000 7faf2b400640 1 -- 172.21.15.33:0/3888000328 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf34071750 con 0x7faf18004d00 2024-09-13T19:00:11.396 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 msgr2=0x7faf1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 0x7faf1006d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf340705a0 tx=0x7faf1c001020 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 msgr2=0x7faf34141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faf240079a0 tx=0x7faf2400ff70 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 shutdown_connections 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7faf1006ac30 0x7faf1006d0f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf3413d950 0x7faf3413ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faf3415e060 0x7faf3415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 --2- 172.21.15.33:0/3888000328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf18004d00 0x7faf34141850 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 >> 172.21.15.33:0/3888000328 conn(0x7faf340b0580 msgr2=0x7faf3415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:11.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 shutdown_connections 2024-09-13T19:00:11.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.395+0000 7faf39800640 1 -- 172.21.15.33:0/3888000328 wait complete. 2024-09-13T19:00:11.414 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:00:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.568+0000 7f2d6ee00640 1 Processor -- start 2024-09-13T19:00:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.568+0000 7f2d6ee00640 1 -- start start 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.569+0000 7f2d6ee00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d68151590 0x7f2d6806b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.569+0000 7f2d6ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d680cba50 0x7f2d680cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d6ee00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680cc3a0 con 0x7f2d680b1b30 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d6ee00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d680ce4b0 con 0x7f2d68151590 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d6ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680b2270 con 0x7f2d680cba50 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d68151590 0x7f2d6806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d68151590 0x7f2d6806b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59952/0 (socket says 172.21.15.33:59952) 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 -- 172.21.15.33:0/3017786530 learned_addr learned my addr 172.21.15.33:0/3017786530 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d5fe00640 1 --1- 172.21.15.33:0/3017786530 >> v1:172.21.15.33:6789/0 conn(0x7f2d680b1b30 0x7f2d680cdda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49802/0 (socket says 172.21.15.33:49802) 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d6ce00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d680cba50 0x7f2d680cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 -- 172.21.15.33:0/3017786530 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d680cba50 msgr2=0x7f2d680cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d680cba50 0x7f2d680cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 -- 172.21.15.33:0/3017786530 >> v1:172.21.15.33:6789/0 conn(0x7f2d680b1b30 legacy=0x7f2d680cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67e00640 1 -- 172.21.15.33:0/3017786530 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680b2550 con 0x7f2d68151590 2024-09-13T19:00:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.570+0000 7f2d67400640 1 -- 172.21.15.33:0/3017786530 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259793183 0 0) 0x7f2d680cc3a0 con 0x7f2d680b1b30 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.571+0000 7f2d67e00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d68151590 0x7f2d6806b370 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009870 tx=0x7f2d5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5991bdff78909ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d67400640 1 -- 172.21.15.33:0/3017786530 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58032440 con 0x7f2d68151590 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d67400640 1 -- 172.21.15.33:0/3017786530 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580325a0 con 0x7f2d68151590 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d67400640 1 -- 172.21.15.33:0/3017786530 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58032930 con 0x7f2d68151590 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3017786530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d68151590 msgr2=0x7f2d6806b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d68151590 0x7f2d6806b370 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009870 tx=0x7f2d5802a270 comp rx=0 tx=0).stop 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3017786530 shutdown_connections 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d680cba50 0x7f2d680cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3017786530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d68151590 0x7f2d6806b370 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3017786530 >> 172.21.15.33:0/3017786530 conn(0x7f2d680b0510 msgr2=0x7f2d680b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3017786530 shutdown_connections 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.572+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3017786530 wait complete. 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.574+0000 7f2d6ee00640 1 Processor -- start 2024-09-13T19:00:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.574+0000 7f2d6ee00640 1 -- start start 2024-09-13T19:00:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 0x7f2d6814cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d68151590 0x7f2d6814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681f4540 con 0x7f2d680b1b30 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68151d50 con 0x7f2d680cba50 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d6ee00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68152030 con 0x7f2d68151590 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d67e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d67e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59958/0 (socket says 172.21.15.33:59958) 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.575+0000 7f2d67e00640 1 -- 172.21.15.33:0/3828639880 learned_addr learned my addr 172.21.15.33:0/3828639880 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 -- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d68151590 msgr2=0x7f2d6814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d68151590 0x7f2d6814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d5fe00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 0x7f2d6814cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 -- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 msgr2=0x7f2d6814cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 0x7f2d6814cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 -- 172.21.15.33:0/3828639880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580094d0 con 0x7f2d680b1b30 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d5fe00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 0x7f2d6814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d67e00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58032440 con 0x7f2d680b1b30 2024-09-13T19:00:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58030900 con 0x7f2d680b1b30 2024-09-13T19:00:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58030cb0 con 0x7f2d680b1b30 2024-09-13T19:00:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68152310 con 0x7f2d680b1b30 2024-09-13T19:00:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.576+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68152b10 con 0x7f2d680b1b30 2024-09-13T19:00:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.578+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68152ca0 con 0x7f2d680b1b30 2024-09-13T19:00:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.579+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d58039040 con 0x7f2d680b1b30 2024-09-13T19:00:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.579+0000 7f2d64c00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 0x7f2d4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.580+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d580a9c70 con 0x7f2d680b1b30 2024-09-13T19:00:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.580+0000 7f2d5fe00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 0x7f2d4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.581+0000 7f2d5fe00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 0x7f2d4406d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b1930 tx=0x7f2d50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.584+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d58074e40 con 0x7f2d680b1b30 2024-09-13T19:00:11.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.777+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d6806ccf0 con 0x7f2d680b1b30 2024-09-13T19:00:11.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.778+0000 7f2d64c00640 1 -- 172.21.15.33:0/3828639880 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2d5803d440 con 0x7f2d680b1b30 2024-09-13T19:00:11.782 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 msgr2=0x7f2d4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 0x7f2d4406d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b1930 tx=0x7f2d50009040 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 msgr2=0x7f2d680aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d580046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 shutdown_connections 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2d4406ac00 0x7f2d4406d0c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d68151590 0x7f2d6814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d680cba50 0x7f2d6814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 --2- 172.21.15.33:0/3828639880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d680b1b30 0x7f2d680aefc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 >> 172.21.15.33:0/3828639880 conn(0x7f2d680b0510 msgr2=0x7f2d6814d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 shutdown_connections 2024-09-13T19:00:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:11.780+0000 7f2d6ee00640 1 -- 172.21.15.33:0/3828639880 wait complete. 2024-09-13T19:00:11.800 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T19:00:11.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:11.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:11.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:00:11.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:11.869 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T19:00:11.906 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:11.906 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:11.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:11.943 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:11.943 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:11.984 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:11.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:12.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:00:12.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:00:12.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.138+0000 7f659c800640 1 Processor -- start 2024-09-13T19:00:12.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.138+0000 7f659c800640 1 -- start start 2024-09-13T19:00:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659c800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f65940b3990 0x7f6594159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659c800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f659406f660 0x7f659406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659c800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6594159fc0 con 0x7f6594153b20 2024-09-13T19:00:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659c800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940b3df0 con 0x7f659406f660 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659c800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940ce600 con 0x7f65940b3990 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f6599e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6594153b20 0x7f65940b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49816/0 (socket says 172.21.15.33:49816) 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f6599e00640 1 -- 172.21.15.33:0/2535254973 learned_addr learned my addr 172.21.15.33:0/2535254973 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.139+0000 7f659a800640 1 --2- 172.21.15.33:0/2535254973 >> v2:172.21.15.33:3300/0 conn(0x7f659406f660 0x7f659406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.140+0000 7f6599400640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f65940b3990 0x7f6594159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.140+0000 7f659a800640 1 -- 172.21.15.33:0/2535254973 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f65940b3990 msgr2=0x7f6594159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.140+0000 7f659a800640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f65940b3990 0x7f6594159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.140+0000 7f659a800640 1 -- 172.21.15.33:0/2535254973 >> v1:172.21.15.33:6789/0 conn(0x7f6594153b20 legacy=0x7f65940b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.140+0000 7f659a800640 1 -- 172.21.15.33:0/2535254973 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594153f00 con 0x7f659406f660 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.141+0000 7f659a800640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659406f660 0x7f659406faf0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d90 tx=0x7f659002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725cca478a56ccb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.141+0000 7f6598a00640 1 -- 172.21.15.33:0/2535254973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590007740 con 0x7f659406f660 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.141+0000 7f6598a00640 1 -- 172.21.15.33:0/2535254973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659002d050 con 0x7f659406f660 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.141+0000 7f6598a00640 1 -- 172.21.15.33:0/2535254973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590007ac0 con 0x7f659406f660 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 -- 172.21.15.33:0/2535254973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659406f660 msgr2=0x7f659406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659406f660 0x7f659406faf0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d90 tx=0x7f659002a660 comp rx=0 tx=0).stop 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 -- 172.21.15.33:0/2535254973 shutdown_connections 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f65940b3990 0x7f6594159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 --2- 172.21.15.33:0/2535254973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659406f660 0x7f659406faf0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 -- 172.21.15.33:0/2535254973 >> 172.21.15.33:0/2535254973 conn(0x7f65940b0510 msgr2=0x7f65940b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 -- 172.21.15.33:0/2535254973 shutdown_connections 2024-09-13T19:00:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.142+0000 7f659c800640 1 -- 172.21.15.33:0/2535254973 wait complete. 2024-09-13T19:00:12.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.143+0000 7f659c800640 1 Processor -- start 2024-09-13T19:00:12.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 -- start start 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 0x7f659415c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6594153b20 0x7f659415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941557f0 con 0x7f65940b3990 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6594156050 con 0x7f659406f660 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.144+0000 7f659c800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594155a90 con 0x7f6594153b20 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59974/0 (socket says 172.21.15.33:59974) 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 -- 172.21.15.33:0/352556785 learned_addr learned my addr 172.21.15.33:0/352556785 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599e00640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 0x7f659415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f659a800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6594153b20 0x7f659415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 -- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6594153b20 msgr2=0x7f659415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6594153b20 0x7f659415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 -- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 msgr2=0x7f659415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 0x7f659415c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599400640 1 -- 172.21.15.33:0/352556785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590009a70 con 0x7f65940b3990 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.145+0000 7f6599e00640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 0x7f659415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f6599400640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f658400e840 tx=0x7f658400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840094f0 con 0x7f65940b3990 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658400c940 con 0x7f65940b3990 2024-09-13T19:00:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400ccd0 con 0x7f65940b3990 2024-09-13T19:00:12.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6594155d70 con 0x7f65940b3990 2024-09-13T19:00:12.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.146+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659415aea0 con 0x7f65940b3990 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.147+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659415a7b0 con 0x7f65940b3990 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.148+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6584013470 con 0x7f65940b3990 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.149+0000 7f658e000640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.149+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65840892f0 con 0x7f65940b3990 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.149+0000 7f6599e00640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.150+0000 7f6599e00640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 0x7f657806d0c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6588005880 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.153+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6584054610 con 0x7f65940b3990 2024-09-13T19:00:12.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.366+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6594159da0 con 0x7f65940b3990 2024-09-13T19:00:12.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.367+0000 7f658e000640 1 -- 172.21.15.33:0/352556785 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f6584057c30 con 0x7f65940b3990 2024-09-13T19:00:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:12.371 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T19:00:12.371 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 msgr2=0x7f657806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 0x7f657806d0c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6588005880 tx=0x7f6588009040 comp rx=0 tx=0).stop 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 msgr2=0x7f65941552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f658400e840 tx=0x7f658400ed00 comp rx=0 tx=0).stop 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 shutdown_connections 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6594153b20 0x7f659415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65940b3990 0x7f65941552b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 --2- 172.21.15.33:0/352556785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659406f660 0x7f659415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 >> 172.21.15.33:0/352556785 conn(0x7f65940b0510 msgr2=0x7f659415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:12.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 shutdown_connections 2024-09-13T19:00:12.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.369+0000 7f659c800640 1 -- 172.21.15.33:0/352556785 wait complete. 2024-09-13T19:00:12.389 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.580+0000 7f71cd200640 1 Processor -- start 2024-09-13T19:00:12.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.581+0000 7f71cd200640 1 -- start start 2024-09-13T19:00:12.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71cd200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 0x7f71c815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71cd200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80cbfc0 con 0x7f71c815a5c0 2024-09-13T19:00:12.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71cd200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80707a0 con 0x7f71c80cbac0 2024-09-13T19:00:12.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71cd200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80cce20 con 0x7f71c80b40c0 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71c7400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f71c815a5c0 0x7f71c80b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49818/0 (socket says 172.21.15.33:49818) 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71c7400640 1 -- 172.21.15.33:0/2605925887 learned_addr learned my addr 172.21.15.33:0/2605925887 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.582+0000 7f71bea00640 1 --2- 172.21.15.33:0/2605925887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 0x7f71c815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990566290 0 0) 0x7f71c80cbfc0 con 0x7f71c815a5c0 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003520 con 0x7f71c815a5c0 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020771869 0 0) 0x7f71c80707a0 con 0x7f71c80cbac0 2024-09-13T19:00:12.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c80cbfc0 con 0x7f71c80cbac0 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71bea00640 1 -- 172.21.15.33:0/2605925887 >> v1:172.21.15.103:6789/0 conn(0x7f71c80cbac0 legacy=0x7f71c815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71bea00640 1 -- 172.21.15.33:0/2605925887 >> v1:172.21.15.33:6789/0 conn(0x7f71c815a5c0 legacy=0x7f71c80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.583+0000 7f71bea00640 1 -- 172.21.15.33:0/2605925887 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8070a80 con 0x7f71c80b40c0 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.584+0000 7f71bea00640 1 --2- 172.21.15.33:0/2605925887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 0x7f71c815a9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009800 tx=0x7f71b002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=315dafe236163343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.584+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0032440 con 0x7f71c80b40c0 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.584+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00325a0 con 0x7f71c80b40c0 2024-09-13T19:00:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.584+0000 7f71c6a00640 1 -- 172.21.15.33:0/2605925887 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0032930 con 0x7f71c80b40c0 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 -- 172.21.15.33:0/2605925887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 msgr2=0x7f71c815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 --2- 172.21.15.33:0/2605925887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 0x7f71c815a9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009800 tx=0x7f71b002a250 comp rx=0 tx=0).stop 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 -- 172.21.15.33:0/2605925887 shutdown_connections 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 --2- 172.21.15.33:0/2605925887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c80b40c0 0x7f71c815a9a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 -- 172.21.15.33:0/2605925887 >> 172.21.15.33:0/2605925887 conn(0x7f71c80ae310 msgr2=0x7f71c80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 -- 172.21.15.33:0/2605925887 shutdown_connections 2024-09-13T19:00:12.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.585+0000 7f71cd200640 1 -- 172.21.15.33:0/2605925887 wait complete. 2024-09-13T19:00:12.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.586+0000 7f71cd200640 1 Processor -- start 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.587+0000 7f71cd200640 1 -- start start 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.587+0000 7f71cd200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.587+0000 7f71cd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71c80cbac0 0x7f71c81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71cd200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c815a5c0 0x7f71c8155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71cd200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8152f90 con 0x7f71c80b40c0 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71cd200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81519b0 con 0x7f71c80cbac0 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71cd200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8151c90 con 0x7f71c815a5c0 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59990/0 (socket says 172.21.15.33:59990) 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 -- 172.21.15.33:0/1899531418 learned_addr learned my addr 172.21.15.33:0/1899531418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:12.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71bea00640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71c80cbac0 0x7f71c81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7e00640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c815a5c0 0x7f71c8155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 -- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c815a5c0 msgr2=0x7f71c8155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c815a5c0 0x7f71c8155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 -- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71c80cbac0 msgr2=0x7f71c81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71c80cbac0 0x7f71c81511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.588+0000 7f71c7400640 1 -- 172.21.15.33:0/1899531418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009400 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71c7400640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c500 tx=0x7f71b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8005ce0 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b8005e40 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b80072f0 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8151f70 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.589+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c8152530 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.590+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c8067360 con 0x7f71c80b40c0 2024-09-13T19:00:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.591+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71b8007450 con 0x7f71c80b40c0 2024-09-13T19:00:12.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.592+0000 7f71bfe00640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 0x7f71a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.592+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71b8088920 con 0x7f71c80b40c0 2024-09-13T19:00:12.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.593+0000 7f71bea00640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 0x7f71a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.593+0000 7f71bea00640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 0x7f71a406d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71b0034000 tx=0x7f71b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.597+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f71b8053ba0 con 0x7f71c80b40c0 2024-09-13T19:00:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.778+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71c80afe10 con 0x7f71c80b40c0 2024-09-13T19:00:12.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.780+0000 7f71bfe00640 1 -- 172.21.15.33:0/1899531418 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f71b8017020 con 0x7f71c80b40c0 2024-09-13T19:00:12.783 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:12.783 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:12.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 msgr2=0x7f71a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 0x7f71a406d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71b0034000 tx=0x7f71b002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:12.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 msgr2=0x7f71c8152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c500 tx=0x7f71b800c9c0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 shutdown_connections 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f71a406ac00 0x7f71a406d0c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f71c815a5c0 0x7f71c8155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71c80cbac0 0x7f71c81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 --2- 172.21.15.33:0/1899531418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71c80b40c0 0x7f71c8152a50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 >> 172.21.15.33:0/1899531418 conn(0x7f71c80ae310 msgr2=0x7f71c806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 shutdown_connections 2024-09-13T19:00:12.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.782+0000 7f71cd200640 1 -- 172.21.15.33:0/1899531418 wait complete. 2024-09-13T19:00:12.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:59:52.781766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:59:53.886144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:12.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.958+0000 7fac5c200640 1 Processor -- start 2024-09-13T19:00:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.958+0000 7fac5c200640 1 -- start start 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac5c200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac54156f60 0x7fac5415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac5c200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac540cafa0 0x7fac54070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac5c200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5406f5f0 con 0x7fac540714c0 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac5c200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5415aa30 con 0x7fac54156f60 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac5c200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac54071930 con 0x7fac540cafa0 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac59800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac54156f60 0x7fac5415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac59800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac54156f60 0x7fac5415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36486/0 (socket says 172.21.15.33:36486) 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.959+0000 7fac59800640 1 -- 172.21.15.33:0/2906179510 learned_addr learned my addr 172.21.15.33:0/2906179510 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.960+0000 7fac58e00640 1 --2- 172.21.15.33:0/2906179510 >> v2:172.21.15.103:3300/0 conn(0x7fac540cafa0 0x7fac54070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.960+0000 7fac59800640 1 -- 172.21.15.33:0/2906179510 >> v2:172.21.15.103:3300/0 conn(0x7fac540cafa0 msgr2=0x7fac54070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.960+0000 7fac59800640 1 --2- 172.21.15.33:0/2906179510 >> v2:172.21.15.103:3300/0 conn(0x7fac540cafa0 0x7fac54070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.960+0000 7fac59800640 1 -- 172.21.15.33:0/2906179510 >> v1:172.21.15.103:6789/0 conn(0x7fac540714c0 legacy=0x7fac5415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.960+0000 7fac59800640 1 -- 172.21.15.33:0/2906179510 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac54070450 con 0x7fac54156f60 2024-09-13T19:00:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac59800640 1 --2- 172.21.15.33:0/2906179510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac5415a4f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fac540b12e0 tx=0x7fac4802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572e5be9ec70afaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac53e00640 1 -- 172.21.15.33:0/2906179510 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48032440 con 0x7fac54156f60 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac53e00640 1 -- 172.21.15.33:0/2906179510 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480325a0 con 0x7fac54156f60 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac53e00640 1 -- 172.21.15.33:0/2906179510 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48032930 con 0x7fac54156f60 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac5c200640 1 -- 172.21.15.33:0/2906179510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 msgr2=0x7fac5415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.961+0000 7fac5c200640 1 --2- 172.21.15.33:0/2906179510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac5415a4f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fac540b12e0 tx=0x7fac4802a230 comp rx=0 tx=0).stop 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 -- 172.21.15.33:0/2906179510 shutdown_connections 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 --2- 172.21.15.33:0/2906179510 >> v2:172.21.15.103:3300/0 conn(0x7fac540cafa0 0x7fac54070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 --2- 172.21.15.33:0/2906179510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac5415a4f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 -- 172.21.15.33:0/2906179510 >> 172.21.15.33:0/2906179510 conn(0x7fac540b0580 msgr2=0x7fac540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 -- 172.21.15.33:0/2906179510 shutdown_connections 2024-09-13T19:00:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.962+0000 7fac5c200640 1 -- 172.21.15.33:0/2906179510 wait complete. 2024-09-13T19:00:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.963+0000 7fac5c200640 1 Processor -- start 2024-09-13T19:00:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.964+0000 7fac5c200640 1 -- start start 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac540714c0 0x7fac5415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac540cafa0 0x7fac54150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541530c0 con 0x7fac54156f60 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac54163c00 con 0x7fac540cafa0 2024-09-13T19:00:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5c200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415b000 con 0x7fac540714c0 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36498/0 (socket says 172.21.15.33:36498) 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 -- 172.21.15.33:0/4268623046 learned_addr learned my addr 172.21.15.33:0/4268623046 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac58e00640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac540cafa0 0x7fac54150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac59800640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac540714c0 0x7fac5415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 -- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac540714c0 msgr2=0x7fac5415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac540714c0 0x7fac5415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 -- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac540cafa0 msgr2=0x7fac54150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac540cafa0 0x7fac54150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.965+0000 7fac5a200640 1 -- 172.21.15.33:0/4268623046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480094d0 con 0x7fac54156f60 2024-09-13T19:00:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac5a200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c780 tx=0x7fac4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c004b60 con 0x7fac54156f60 2024-09-13T19:00:12.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00ce90 con 0x7fac54156f60 2024-09-13T19:00:12.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00a850 con 0x7fac54156f60 2024-09-13T19:00:12.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5415b2e0 con 0x7fac54156f60 2024-09-13T19:00:12.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.966+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5415b8a0 con 0x7fac54156f60 2024-09-13T19:00:12.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.967+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5415bac0 con 0x7fac54156f60 2024-09-13T19:00:12.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.968+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac4c00a9b0 con 0x7fac54156f60 2024-09-13T19:00:12.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.969+0000 7fac51600640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 0x7fac3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:12.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.969+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac4c089490 con 0x7fac54156f60 2024-09-13T19:00:12.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.970+0000 7fac59800640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 0x7fac3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.970+0000 7fac59800640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 0x7fac3406d0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac48034000 tx=0x7fac4802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:12.974+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac4c054680 con 0x7fac54156f60 2024-09-13T19:00:13.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.155+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac54071190 con 0x7fac54156f60 2024-09-13T19:00:13.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.156+0000 7fac51600640 1 -- 172.21.15.33:0/4268623046 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac4c057ca0 con 0x7fac54156f60 2024-09-13T19:00:13.159 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 msgr2=0x7fac3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 0x7fac3406d0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac48034000 tx=0x7fac4802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 msgr2=0x7fac54164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c780 tx=0x7fac4c00cc40 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 shutdown_connections 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fac3406ac00 0x7fac3406d0c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac54156f60 0x7fac54164210 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac540cafa0 0x7fac54150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 --2- 172.21.15.33:0/4268623046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fac540714c0 0x7fac5415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 >> 172.21.15.33:0/4268623046 conn(0x7fac540b0580 msgr2=0x7fac540b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.158+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 shutdown_connections 2024-09-13T19:00:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.159+0000 7fac5c200640 1 -- 172.21.15.33:0/4268623046 wait complete. 2024-09-13T19:00:13.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.332+0000 7ff85e000640 1 Processor -- start 2024-09-13T19:00:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.332+0000 7ff85e000640 1 -- start start 2024-09-13T19:00:13.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff85e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff85e000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff85806f830 0x7ff85806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff85e000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85806b7c0 con 0x7ff8580ce2c0 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff85e000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85806b5b0 con 0x7ff85806f830 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff85e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85806baa0 con 0x7ff858154ad0 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff857e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff8580ce2c0 0x7ff8580cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44498/0 (socket says 172.21.15.33:44498) 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff857e00640 1 -- 172.21.15.33:0/3758103603 learned_addr learned my addr 172.21.15.33:0/3758103603 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff84ea00640 1 --2- 172.21.15.33:0/3758103603 >> v2:172.21.15.103:3300/0 conn(0x7ff85806f830 0x7ff85806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.333+0000 7ff857400640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff856a00640 1 -- 172.21.15.33:0/3758103603 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255222722 0 0) 0x7ff85806b7c0 con 0x7ff8580ce2c0 2024-09-13T19:00:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff856a00640 1 -- 172.21.15.33:0/3758103603 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c003520 con 0x7ff8580ce2c0 2024-09-13T19:00:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff84ea00640 1 -- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 msgr2=0x7ff8580cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff84ea00640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff84ea00640 1 -- 172.21.15.33:0/3758103603 >> v1:172.21.15.33:6789/0 conn(0x7ff8580ce2c0 legacy=0x7ff8580cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.334+0000 7ff84ea00640 1 -- 172.21.15.33:0/3758103603 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85806bd80 con 0x7ff85806f830 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.335+0000 7ff84ea00640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff85806f830 0x7ff85806fee0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8400097d0 tx=0x7ff84002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf8320a915a15132 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.335+0000 7ff856a00640 1 -- 172.21.15.33:0/3758103603 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84002ae40 con 0x7ff85806f830 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.335+0000 7ff856a00640 1 -- 172.21.15.33:0/3758103603 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840032440 con 0x7ff85806f830 2024-09-13T19:00:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.335+0000 7ff856a00640 1 -- 172.21.15.33:0/3758103603 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400327d0 con 0x7ff85806f830 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 -- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff85806f830 msgr2=0x7ff85806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff85806f830 0x7ff85806fee0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8400097d0 tx=0x7ff84002a130 comp rx=0 tx=0).stop 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 -- 172.21.15.33:0/3758103603 shutdown_connections 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff85806f830 0x7ff85806fee0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 --2- 172.21.15.33:0/3758103603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 -- 172.21.15.33:0/3758103603 >> 172.21.15.33:0/3758103603 conn(0x7ff8580b0580 msgr2=0x7ff8580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 -- 172.21.15.33:0/3758103603 shutdown_connections 2024-09-13T19:00:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.336+0000 7ff85e000640 1 -- 172.21.15.33:0/3758103603 wait complete. 2024-09-13T19:00:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.338+0000 7ff85e000640 1 Processor -- start 2024-09-13T19:00:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.338+0000 7ff85e000640 1 -- start start 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.338+0000 7ff85e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff85e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8580b3540 0x7ff8581402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff85e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff85e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858149bc0 con 0x7ff858149090 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff85e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b1b20 con 0x7ff8580b3540 2024-09-13T19:00:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff85e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581498e0 con 0x7ff858154ad0 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36504/0 (socket says 172.21.15.33:36504) 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 -- 172.21.15.33:0/3216700700 learned_addr learned my addr 172.21.15.33:0/3216700700 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857400640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff84ea00640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8580b3540 0x7ff8581402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 -- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 msgr2=0x7ff8580b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 -- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8580b3540 msgr2=0x7ff8581402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8580b3540 0x7ff8581402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857e00640 1 -- 172.21.15.33:0/3216700700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009400 con 0x7ff858149090 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.339+0000 7ff857400640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff857e00640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff85000cbb0 tx=0x7ff85000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000ad40 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850012400 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8580b1dc0 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000aea0 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.340+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff858140830 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.341+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858152bf0 con 0x7ff858149090 2024-09-13T19:00:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.342+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff850007070 con 0x7ff858149090 2024-09-13T19:00:13.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.343+0000 7ff84fe00640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 0x7ff83406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.343+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff850089270 con 0x7ff858149090 2024-09-13T19:00:13.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.343+0000 7ff857400640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 0x7ff83406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.344+0000 7ff857400640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 0x7ff83406d0f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff848009af0 tx=0x7ff848008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.347+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff850054460 con 0x7ff858149090 2024-09-13T19:00:13.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.551+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8580b1980 con 0x7ff858149090 2024-09-13T19:00:13.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.552+0000 7ff84fe00640 1 -- 172.21.15.33:0/3216700700 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8580b1980 con 0x7ff858149090 2024-09-13T19:00:13.555 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 msgr2=0x7ff83406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 0x7ff83406d0f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff848009af0 tx=0x7ff848008040 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 msgr2=0x7ff8581595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff85000cbb0 tx=0x7ff85000a430 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 shutdown_connections 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff83406ac30 0x7ff83406d0f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff858149090 0x7ff8581595f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8580b3540 0x7ff8581402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 --2- 172.21.15.33:0/3216700700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff858154ad0 0x7ff8580b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 >> 172.21.15.33:0/3216700700 conn(0x7ff8580b0580 msgr2=0x7ff858149db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 shutdown_connections 2024-09-13T19:00:13.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.554+0000 7ff85e000640 1 -- 172.21.15.33:0/3216700700 wait complete. 2024-09-13T19:00:13.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.727+0000 7fa08ae00640 1 Processor -- start 2024-09-13T19:00:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.727+0000 7fa08ae00640 1 -- start start 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.728+0000 7fa08ae00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa084071690 0x7fa08415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.728+0000 7fa08ae00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08406f5f0 con 0x7fa0840cafa0 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.728+0000 7fa08ae00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa084070450 con 0x7fa084156f60 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.728+0000 7fa08ae00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08415aa30 con 0x7fa084071690 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa088e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa0840cafa0 0x7fa0840cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44510/0 (socket says 172.21.15.33:44510) 2024-09-13T19:00:13.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa088e00640 1 -- 172.21.15.33:0/1117033028 learned_addr learned my addr 172.21.15.33:0/1117033028 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:13.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> v2:172.21.15.103:3300/0 conn(0x7fa084071690 0x7fa08415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837583918 0 0) 0x7fa08406f5f0 con 0x7fa0840cafa0 2024-09-13T19:00:13.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa068003520 con 0x7fa0840cafa0 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018605989 0 0) 0x7fa068003520 con 0x7fa0840cafa0 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 >> v2:172.21.15.103:3300/0 conn(0x7fa084071690 msgr2=0x7fa08415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 --2- 172.21.15.33:0/1117033028 >> v2:172.21.15.103:3300/0 conn(0x7fa084071690 0x7fa08415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 >> v1:172.21.15.103:6789/0 conn(0x7fa084156f60 legacy=0x7fa084070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08406f840 con 0x7fa0840cafa0 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fa07c0019f0 con 0x7fa0840cafa0 2024-09-13T19:00:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> v2:172.21.15.103:3300/0 conn(0x7fa084071690 0x7fa08415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.729+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 >> v1:172.21.15.33:6789/0 conn(0x7fa0840cafa0 legacy=0x7fa0840cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa068003970 0x7fa068003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 0x7fa068004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa068005180 0x7fa06800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415aa30 con 0x7fa0680047c0 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06800c020 con 0x7fa068003970 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06800c1e0 con 0x7fa068005180 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 0x7fa068004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083e00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa068003970 0x7fa068003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa088e00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa068005180 0x7fa06800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 -- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa068005180 msgr2=0x7fa06800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa068005180 0x7fa06800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 -- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa068003970 msgr2=0x7fa068003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa068003970 0x7fa068003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083400640 1 -- 172.21.15.33:0/1117033028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068003520 con 0x7fa0680047c0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa083e00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa068003970 0x7fa068003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.730+0000 7fa088e00640 1 -- 172.21.15.33:0/1117033028 reap_dead start 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.731+0000 7fa083400640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 0x7fa068004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa070009c90 tx=0x7fa0680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced5726903423200 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.731+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070031400 con 0x7fa0680047c0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07002d050 con 0x7fa0680047c0 2024-09-13T19:00:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa082a00640 1 -- 172.21.15.33:0/1117033028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070031760 con 0x7fa0680047c0 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 -- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 msgr2=0x7fa068004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 0x7fa068004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa070009c90 tx=0x7fa0680057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 -- 172.21.15.33:0/1117033028 shutdown_connections 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 --2- 172.21.15.33:0/1117033028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0680047c0 0x7fa068004c40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 -- 172.21.15.33:0/1117033028 >> 172.21.15.33:0/1117033028 conn(0x7fa0840b0580 msgr2=0x7fa0840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 -- 172.21.15.33:0/1117033028 shutdown_connections 2024-09-13T19:00:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.732+0000 7fa08ae00640 1 -- 172.21.15.33:0/1117033028 wait complete. 2024-09-13T19:00:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.734+0000 7fa08ae00640 1 Processor -- start 2024-09-13T19:00:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.734+0000 7fa08ae00640 1 -- start start 2024-09-13T19:00:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0680047c0 0x7fa08415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa08415c500 0x7fa084140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415df80 con 0x7fa08413d680 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084140fd0 con 0x7fa0680047c0 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa08ae00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415c9a0 con 0x7fa08415c500 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36516/0 (socket says 172.21.15.33:36516) 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 -- 172.21.15.33:0/3105173454 learned_addr learned my addr 172.21.15.33:0/3105173454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa083e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0680047c0 0x7fa08415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa083400640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa08415c500 0x7fa084140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 -- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa08415c500 msgr2=0x7fa084140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa08415c500 0x7fa084140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 -- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0680047c0 msgr2=0x7fa08415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0680047c0 0x7fa08415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.735+0000 7fa088e00640 1 -- 172.21.15.33:0/3105173454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08415cc80 con 0x7fa08413d680 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa088e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa0840cb3a0 tx=0x7fa07c007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00ea40 con 0x7fa08413d680 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00eba0 con 0x7fa08413d680 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08415cf60 con 0x7fa08413d680 2024-09-13T19:00:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c013420 con 0x7fa08413d680 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.736+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08415d520 con 0x7fa08413d680 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.737+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa084157340 con 0x7fa08413d680 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.738+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa07c013580 con 0x7fa08413d680 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.739+0000 7fa07be00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 0x7fa06406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.739+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa07c089720 con 0x7fa08413d680 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.739+0000 7fa083e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 0x7fa06406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.740+0000 7fa083e00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 0x7fa06406d0c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa074009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.743+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa07c0547d0 con 0x7fa08413d680 2024-09-13T19:00:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.923+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa084157340 con 0x7fa08413d680 2024-09-13T19:00:13.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.923+0000 7fa07be00640 1 -- 172.21.15.33:0/3105173454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa07c057df0 con 0x7fa08413d680 2024-09-13T19:00:13.926 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 msgr2=0x7fa06406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 0x7fa06406d0c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa074009040 comp rx=0 tx=0).stop 2024-09-13T19:00:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 msgr2=0x7fa0840af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa0840cb3a0 tx=0x7fa07c007af0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 shutdown_connections 2024-09-13T19:00:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa06406ac00 0x7fa06406d0c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08413d680 0x7fa0840af120 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa08415c500 0x7fa084140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 --2- 172.21.15.33:0/3105173454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0680047c0 0x7fa08415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 >> 172.21.15.33:0/3105173454 conn(0x7fa0840b0580 msgr2=0x7fa0840ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.925+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 shutdown_connections 2024-09-13T19:00:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:13.926+0000 7fa08ae00640 1 -- 172.21.15.33:0/3105173454 wait complete. 2024-09-13T19:00:13.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.100+0000 7fc402e00640 1 Processor -- start 2024-09-13T19:00:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.100+0000 7fc402e00640 1 -- start start 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.101+0000 7fc402e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc3fc159a80 0x7fc3fc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.101+0000 7fc402e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc153f00 con 0x7fc3fc153b20 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.101+0000 7fc402e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0b1a40 con 0x7fc3fc0b3990 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc402e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0ce600 con 0x7fc3fc159a80 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc3fbe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc3fc153b20 0x7fc3fc0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44512/0 (socket says 172.21.15.33:44512) 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc3fbe00640 1 -- 172.21.15.33:0/3064835314 learned_addr learned my addr 172.21.15.33:0/3064835314 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc400e00640 1 --2- 172.21.15.33:0/3064835314 >> v2:172.21.15.103:3300/0 conn(0x7fc3fc159a80 0x7fc3fc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865075587 0 0) 0x7fc3fc153f00 con 0x7fc3fc153b20 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.102+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e0003520 con 0x7fc3fc153b20 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.103+0000 7fc400e00640 1 -- 172.21.15.33:0/3064835314 >> v1:172.21.15.103:6789/0 conn(0x7fc3fc0b3990 legacy=0x7fc3fc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.103+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490177739 0 0) 0x7fc3e0003520 con 0x7fc3fc153b20 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.103+0000 7fc400e00640 1 -- 172.21.15.33:0/3064835314 >> v1:172.21.15.33:6789/0 conn(0x7fc3fc153b20 legacy=0x7fc3fc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.103+0000 7fc400e00640 1 -- 172.21.15.33:0/3064835314 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc15a1f0 con 0x7fc3fc159a80 2024-09-13T19:00:14.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc400e00640 1 --2- 172.21.15.33:0/3064835314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc159a80 0x7fc3fc06d060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009d90 tx=0x7fc3f402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ef0bb2e0175876 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec001670 con 0x7fc3fc159a80 2024-09-13T19:00:14.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f402d050 con 0x7fc3fc159a80 2024-09-13T19:00:14.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc3faa00640 1 -- 172.21.15.33:0/3064835314 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4007760 con 0x7fc3fc159a80 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc402e00640 1 -- 172.21.15.33:0/3064835314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc159a80 msgr2=0x7fc3fc06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.104+0000 7fc402e00640 1 --2- 172.21.15.33:0/3064835314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc159a80 0x7fc3fc06d060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009d90 tx=0x7fc3f402a680 comp rx=0 tx=0).stop 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.105+0000 7fc402e00640 1 -- 172.21.15.33:0/3064835314 shutdown_connections 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.105+0000 7fc402e00640 1 --2- 172.21.15.33:0/3064835314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc159a80 0x7fc3fc06d060 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.105+0000 7fc402e00640 1 -- 172.21.15.33:0/3064835314 >> 172.21.15.33:0/3064835314 conn(0x7fc3fc0b0510 msgr2=0x7fc3fc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.105+0000 7fc402e00640 1 -- 172.21.15.33:0/3064835314 shutdown_connections 2024-09-13T19:00:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.105+0000 7fc402e00640 1 -- 172.21.15.33:0/3064835314 wait complete. 2024-09-13T19:00:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.106+0000 7fc402e00640 1 Processor -- start 2024-09-13T19:00:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.106+0000 7fc402e00640 1 -- start start 2024-09-13T19:00:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc0b3990 0x7fc3fc1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3fc153b20 0x7fc3fc147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1552a0 con 0x7fc3fc159a80 2024-09-13T19:00:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc147680 con 0x7fc3fc0b3990 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc402e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc154690 con 0x7fc3fc153b20 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.107+0000 7fc400e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36518/0 (socket says 172.21.15.33:36518) 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 -- 172.21.15.33:0/4004720392 learned_addr learned my addr 172.21.15.33:0/4004720392 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc3fbe00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc0b3990 0x7fc3fc1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc3fb400640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3fc153b20 0x7fc3fc147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 -- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3fc153b20 msgr2=0x7fc3fc147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3fc153b20 0x7fc3fc147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 -- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc0b3990 msgr2=0x7fc3fc1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc0b3990 0x7fc3fc1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 -- 172.21.15.33:0/4004720392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4009a70 con 0x7fc3fc159a80 2024-09-13T19:00:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.108+0000 7fc400e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009d90 tx=0x7fc3f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.109+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f403c8f0 con 0x7fc3fc159a80 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.109+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f403ca50 con 0x7fc3fc159a80 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.109+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f403cdc0 con 0x7fc3fc159a80 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.109+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc154970 con 0x7fc3fc159a80 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.109+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc154f30 con 0x7fc3fc159a80 2024-09-13T19:00:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.110+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc153080 con 0x7fc3fc159a80 2024-09-13T19:00:14.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.111+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3f4031400 con 0x7fc3fc159a80 2024-09-13T19:00:14.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.111+0000 7fc3f3e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 0x7fc3dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.111+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3f40aace0 con 0x7fc3fc159a80 2024-09-13T19:00:14.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.112+0000 7fc3fbe00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 0x7fc3dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.113+0000 7fc3fbe00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 0x7fc3dc06d0c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f60 tx=0x7fc3ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.116+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc3f4075da0 con 0x7fc3fc159a80 2024-09-13T19:00:14.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.329+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3fc1553e0 con 0x7fc3fc159a80 2024-09-13T19:00:14.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.330+0000 7fc3f3e00640 1 -- 172.21.15.33:0/4004720392 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fc3f40793c0 con 0x7fc3fc159a80 2024-09-13T19:00:14.333 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:14.333 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T19:00:14.334 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T19:00:14.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 msgr2=0x7fc3dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 0x7fc3dc06d0c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f60 tx=0x7fc3ec009040 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 msgr2=0x7fc3fc1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009d90 tx=0x7fc3f4004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 shutdown_connections 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc3dc06ac00 0x7fc3dc06d0c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc159a80 0x7fc3fc1589c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc3fc153b20 0x7fc3fc147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 --2- 172.21.15.33:0/4004720392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3fc0b3990 0x7fc3fc1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 >> 172.21.15.33:0/4004720392 conn(0x7fc3fc0b0510 msgr2=0x7fc3fc0cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 shutdown_connections 2024-09-13T19:00:14.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.332+0000 7fc402e00640 1 -- 172.21.15.33:0/4004720392 wait complete. 2024-09-13T19:00:14.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:14.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.504+0000 7f2b08c00640 1 Processor -- start 2024-09-13T19:00:14.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.505+0000 7f2b08c00640 1 -- start start 2024-09-13T19:00:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b0415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2b08c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040cbfc0 con 0x7f2b040b40c0 2024-09-13T19:00:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2b08c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040707a0 con 0x7f2b0415a5c0 2024-09-13T19:00:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2b08c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040cce20 con 0x7f2b040cbac0 2024-09-13T19:00:14.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2afaa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b040b40c0 0x7f2b0415a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44514/0 (socket says 172.21.15.33:44514) 2024-09-13T19:00:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2afaa00640 1 -- 172.21.15.33:0/1304239719 learned_addr learned my addr 172.21.15.33:0/1304239719 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.506+0000 7f2b03e00640 1 --2- 172.21.15.33:0/1304239719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b0415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237961162 0 0) 0x7f2b040cbfc0 con 0x7f2b040b40c0 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae8003520 con 0x7f2b040b40c0 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727106145 0 0) 0x7f2b040707a0 con 0x7f2b0415a5c0 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b040cbfc0 con 0x7f2b0415a5c0 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b03e00640 1 -- 172.21.15.33:0/1304239719 >> v1:172.21.15.103:6789/0 conn(0x7f2b0415a5c0 legacy=0x7f2b040b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b03e00640 1 -- 172.21.15.33:0/1304239719 >> v1:172.21.15.33:6789/0 conn(0x7f2b040b40c0 legacy=0x7f2b0415a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.507+0000 7f2b03e00640 1 -- 172.21.15.33:0/1304239719 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04070a80 con 0x7f2b040cbac0 2024-09-13T19:00:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.508+0000 7f2b03e00640 1 --2- 172.21.15.33:0/1304239719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b0415b0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009dc0 tx=0x7f2afc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b386c44b5b6a25aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.508+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc007740 con 0x7f2b040cbac0 2024-09-13T19:00:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.508+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc02d050 con 0x7f2b040cbac0 2024-09-13T19:00:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.508+0000 7f2b02a00640 1 -- 172.21.15.33:0/1304239719 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc007ac0 con 0x7f2b040cbac0 2024-09-13T19:00:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 -- 172.21.15.33:0/1304239719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 msgr2=0x7f2b0415b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 --2- 172.21.15.33:0/1304239719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b0415b0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009dc0 tx=0x7f2afc02a6d0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 -- 172.21.15.33:0/1304239719 shutdown_connections 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 --2- 172.21.15.33:0/1304239719 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b0415b0b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 -- 172.21.15.33:0/1304239719 >> 172.21.15.33:0/1304239719 conn(0x7f2b040ae310 msgr2=0x7f2b040ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 -- 172.21.15.33:0/1304239719 shutdown_connections 2024-09-13T19:00:14.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.509+0000 7f2b08c00640 1 -- 172.21.15.33:0/1304239719 wait complete. 2024-09-13T19:00:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.511+0000 7f2b08c00640 1 Processor -- start 2024-09-13T19:00:14.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.511+0000 7f2b08c00640 1 -- start start 2024-09-13T19:00:14.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b04153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b0415a5c0 0x7f2b04153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415a9a0 con 0x7f2b040b40c0 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415abf0 con 0x7f2b0415a5c0 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b08c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415aed0 con 0x7f2b040cbac0 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b03400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b03400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36530/0 (socket says 172.21.15.33:36530) 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b03400640 1 -- 172.21.15.33:0/3341726260 learned_addr learned my addr 172.21.15.33:0/3341726260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2afaa00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b04153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.512+0000 7f2b03e00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b0415a5c0 0x7f2b04153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 -- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 msgr2=0x7f2b04153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b04153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 -- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b0415a5c0 msgr2=0x7f2b04153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b0415a5c0 0x7f2b04153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 -- 172.21.15.33:0/3341726260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009a70 con 0x7f2b040b40c0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b03400640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c430 tx=0x7f2af400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40052d0 con 0x7f2b040b40c0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4005450 con 0x7f2b040b40c0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4003830 con 0x7f2b040b40c0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0415b1b0 con 0x7f2b040b40c0 2024-09-13T19:00:14.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.513+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b04142320 con 0x7f2b040b40c0 2024-09-13T19:00:14.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.515+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04067360 con 0x7f2b040b40c0 2024-09-13T19:00:14.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.515+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2af4003990 con 0x7f2b040b40c0 2024-09-13T19:00:14.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.516+0000 7f2afbe00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 0x7f2ae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.516+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2af40889a0 con 0x7f2b040b40c0 2024-09-13T19:00:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.517+0000 7f2afaa00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 0x7f2ae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.517+0000 7f2afaa00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 0x7f2ae006d0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2b040b0270 tx=0x7f2aec007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.520+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2af4053b90 con 0x7f2b040b40c0 2024-09-13T19:00:14.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.699+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b040b3ee0 con 0x7f2b040b40c0 2024-09-13T19:00:14.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.701+0000 7f2afbe00640 1 -- 172.21.15.33:0/3341726260 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f2af4017090 con 0x7f2b040b40c0 2024-09-13T19:00:14.705 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:14.705 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 msgr2=0x7f2ae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 0x7f2ae006d0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2b040b0270 tx=0x7f2aec007d30 comp rx=0 tx=0).stop 2024-09-13T19:00:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 msgr2=0x7f2b04141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c430 tx=0x7f2af400c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 shutdown_connections 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2ae006ac00 0x7f2ae006d0c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b0415a5c0 0x7f2b04153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b040cbac0 0x7f2b04153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 --2- 172.21.15.33:0/3341726260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b040b40c0 0x7f2b04141de0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.703+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 >> 172.21.15.33:0/3341726260 conn(0x7f2b040ae310 msgr2=0x7f2b0406b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:14.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.704+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 shutdown_connections 2024-09-13T19:00:14.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.704+0000 7f2b08c00640 1 -- 172.21.15.33:0/3341726260 wait complete. 2024-09-13T19:00:14.723 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T19:00:14.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:14.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.876+0000 7f3d4da00640 1 Processor -- start 2024-09-13T19:00:14.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.877+0000 7f3d4da00640 1 -- start start 2024-09-13T19:00:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 0x7f3d480b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d4da00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480cbfc0 con 0x7f3d480cbac0 2024-09-13T19:00:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d4da00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480707a0 con 0x7f3d4815b9b0 2024-09-13T19:00:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d4da00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480cce20 con 0x7f3d4815a5c0 2024-09-13T19:00:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d3f400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3d480cbac0 0x7f3d4806f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44528/0 (socket says 172.21.15.33:44528) 2024-09-13T19:00:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d3f400640 1 -- 172.21.15.33:0/659857932 learned_addr learned my addr 172.21.15.33:0/659857932 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.878+0000 7f3d47e00640 1 --2- 172.21.15.33:0/659857932 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 0x7f3d480b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155341186 0 0) 0x7f3d480cbfc0 con 0x7f3d480cbac0 2024-09-13T19:00:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d2c003520 con 0x7f3d480cbac0 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080893115 0 0) 0x7f3d480707a0 con 0x7f3d4815b9b0 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47e00640 1 -- 172.21.15.33:0/659857932 >> v1:172.21.15.103:6789/0 conn(0x7f3d4815b9b0 legacy=0x7f3d4806fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47e00640 1 -- 172.21.15.33:0/659857932 >> v1:172.21.15.33:6789/0 conn(0x7f3d480cbac0 legacy=0x7f3d4806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.879+0000 7f3d47e00640 1 -- 172.21.15.33:0/659857932 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48070a80 con 0x7f3d4815a5c0 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.880+0000 7f3d47e00640 1 --2- 172.21.15.33:0/659857932 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 0x7f3d480b39b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097d0 tx=0x7f3d3802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e254091b6cf72d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.880+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38032440 con 0x7f3d4815a5c0 2024-09-13T19:00:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.880+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d380325a0 con 0x7f3d4815a5c0 2024-09-13T19:00:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.880+0000 7f3d47400640 1 -- 172.21.15.33:0/659857932 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38032930 con 0x7f3d4815a5c0 2024-09-13T19:00:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 -- 172.21.15.33:0/659857932 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 msgr2=0x7f3d480b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 --2- 172.21.15.33:0/659857932 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 0x7f3d480b39b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097d0 tx=0x7f3d3802a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 -- 172.21.15.33:0/659857932 shutdown_connections 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 --2- 172.21.15.33:0/659857932 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815a5c0 0x7f3d480b39b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 -- 172.21.15.33:0/659857932 >> 172.21.15.33:0/659857932 conn(0x7f3d480ae310 msgr2=0x7f3d480ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 -- 172.21.15.33:0/659857932 shutdown_connections 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.881+0000 7f3d4da00640 1 -- 172.21.15.33:0/659857932 wait complete. 2024-09-13T19:00:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.882+0000 7f3d4da00640 1 Processor -- start 2024-09-13T19:00:14.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.883+0000 7f3d4da00640 1 -- start start 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.883+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 0x7f3d48152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.883+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.883+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815b9b0 0x7f3d48149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.883+0000 7f3d4da00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815cbd0 con 0x7f3d4815a5c0 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d4da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d481f2d70 con 0x7f3d480cbac0 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d4da00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d481f2460 con 0x7f3d4815b9b0 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36544/0 (socket says 172.21.15.33:36544) 2024-09-13T19:00:14.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 -- 172.21.15.33:0/3245621811 learned_addr learned my addr 172.21.15.33:0/3245621811 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d47e00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 0x7f3d48152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d4d000640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815b9b0 0x7f3d48149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 -- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815b9b0 msgr2=0x7f3d48149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815b9b0 0x7f3d48149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 -- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 msgr2=0x7f3d48152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 0x7f3d48152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d3f400640 1 -- 172.21.15.33:0/3245621811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38009400 con 0x7f3d4815a5c0 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.884+0000 7f3d47e00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 0x7f3d48152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d3f400640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c430 tx=0x7f3d3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30005ce0 con 0x7f3d4815a5c0 2024-09-13T19:00:14.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30005e40 con 0x7f3d4815a5c0 2024-09-13T19:00:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4815c8f0 con 0x7f3d4815a5c0 2024-09-13T19:00:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30007310 con 0x7f3d4815a5c0 2024-09-13T19:00:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.885+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d481f2990 con 0x7f3d4815a5c0 2024-09-13T19:00:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.886+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d48067360 con 0x7f3d4815a5c0 2024-09-13T19:00:14.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.887+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3d30007470 con 0x7f3d4815a5c0 2024-09-13T19:00:14.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.888+0000 7f3d44c00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 0x7f3d2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:14.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.888+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d30088a00 con 0x7f3d4815a5c0 2024-09-13T19:00:14.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.889+0000 7f3d47e00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 0x7f3d2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:14.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.889+0000 7f3d47e00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 0x7f3d2406d0c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d38034000 tx=0x7f3d3802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:14.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:14.893+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3d30053bd0 con 0x7f3d4815a5c0 2024-09-13T19:00:15.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.112+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d481f2eb0 con 0x7f3d4815a5c0 2024-09-13T19:00:15.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.113+0000 7f3d44c00640 1 -- 172.21.15.33:0/3245621811 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f3d481f2eb0 con 0x7f3d4815a5c0 2024-09-13T19:00:15.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:15.116 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T19:00:15.116 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T19:00:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 msgr2=0x7f3d2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 0x7f3d2406d0c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d38034000 tx=0x7f3d3802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 msgr2=0x7f3d4815c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c430 tx=0x7f3d3000c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 shutdown_connections 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3d2406ac00 0x7f3d2406d0c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3d4815b9b0 0x7f3d48149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d4815a5c0 0x7f3d4815c0a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 --2- 172.21.15.33:0/3245621811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d480cbac0 0x7f3d48152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 >> 172.21.15.33:0/3245621811 conn(0x7f3d480ae310 msgr2=0x7f3d480af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 shutdown_connections 2024-09-13T19:00:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.115+0000 7f3d4da00640 1 -- 172.21.15.33:0/3245621811 wait complete. 2024-09-13T19:00:15.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.287+0000 7fee8f400640 1 Processor -- start 2024-09-13T19:00:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.287+0000 7fee8f400640 1 -- start start 2024-09-13T19:00:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.288+0000 7fee8f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee88070c20 0x7fee8806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.288+0000 7fee8f400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee8815d9a0 0x7fee880b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.288+0000 7fee8f400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8815cd50 con 0x7fee8815c970 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.288+0000 7fee8f400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8806d170 con 0x7fee88070c20 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.288+0000 7fee8f400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8806d450 con 0x7fee8815d9a0 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee88070c20 0x7fee8806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee88070c20 0x7fee8806cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36556/0 (socket says 172.21.15.33:36556) 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 -- 172.21.15.33:0/2035780047 learned_addr learned my addr 172.21.15.33:0/2035780047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee8ca00640 1 --1- 172.21.15.33:0/2035780047 >> v1:172.21.15.33:6789/0 conn(0x7fee8815c970 0x7fee88070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44536/0 (socket says 172.21.15.33:44536) 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee8d400640 1 --2- 172.21.15.33:0/2035780047 >> v2:172.21.15.103:3300/0 conn(0x7fee8815d9a0 0x7fee880b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 -- 172.21.15.33:0/2035780047 >> v2:172.21.15.103:3300/0 conn(0x7fee8815d9a0 msgr2=0x7fee880b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 --2- 172.21.15.33:0/2035780047 >> v2:172.21.15.103:3300/0 conn(0x7fee8815d9a0 0x7fee880b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 -- 172.21.15.33:0/2035780047 >> v1:172.21.15.33:6789/0 conn(0x7fee8815c970 legacy=0x7fee88070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87e00640 1 -- 172.21.15.33:0/2035780047 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880b1d80 con 0x7fee88070c20 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.289+0000 7fee87400640 1 -- 172.21.15.33:0/2035780047 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729380234 0 0) 0x7fee8815cd50 con 0x7fee8815c970 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.290+0000 7fee87e00640 1 --2- 172.21.15.33:0/2035780047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee88070c20 0x7fee8806cab0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fee8806b580 tx=0x7fee7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726addb242582ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.290+0000 7fee87400640 1 -- 172.21.15.33:0/2035780047 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032440 con 0x7fee88070c20 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee87400640 1 -- 172.21.15.33:0/2035780047 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740325a0 con 0x7fee88070c20 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee87400640 1 -- 172.21.15.33:0/2035780047 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032930 con 0x7fee88070c20 2024-09-13T19:00:15.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 -- 172.21.15.33:0/2035780047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee88070c20 msgr2=0x7fee8806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 --2- 172.21.15.33:0/2035780047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee88070c20 0x7fee8806cab0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fee8806b580 tx=0x7fee7402a270 comp rx=0 tx=0).stop 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 -- 172.21.15.33:0/2035780047 shutdown_connections 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 --2- 172.21.15.33:0/2035780047 >> v2:172.21.15.103:3300/0 conn(0x7fee8815d9a0 0x7fee880b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 --2- 172.21.15.33:0/2035780047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee88070c20 0x7fee8806cab0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 -- 172.21.15.33:0/2035780047 >> 172.21.15.33:0/2035780047 conn(0x7fee880b09e0 msgr2=0x7fee880b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 -- 172.21.15.33:0/2035780047 shutdown_connections 2024-09-13T19:00:15.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.291+0000 7fee8f400640 1 -- 172.21.15.33:0/2035780047 wait complete. 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.293+0000 7fee8f400640 1 Processor -- start 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.293+0000 7fee8f400640 1 -- start start 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee88070c20 0x7fee8814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee8815d9a0 0x7fee88154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee880aee00 con 0x7fee8815c970 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88156400 con 0x7fee8815d9a0 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8f400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee88155e40 con 0x7fee88070c20 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36566/0 (socket says 172.21.15.33:36566) 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee87e00640 1 -- 172.21.15.33:0/3813075553 learned_addr learned my addr 172.21.15.33:0/3813075553 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8d400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee8815d9a0 0x7fee88154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.294+0000 7fee8ca00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee88070c20 0x7fee8814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 -- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee88070c20 msgr2=0x7fee8814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee88070c20 0x7fee8814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 -- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee8815d9a0 msgr2=0x7fee88154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee8815d9a0 0x7fee88154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 -- 172.21.15.33:0/3813075553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740094d0 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee87e00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fee7402a2b0 tx=0x7fee740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032440 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74030980 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee88156120 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74030d10 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.295+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee880af310 con 0x7fee8815c970 2024-09-13T19:00:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.296+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee880b2860 con 0x7fee8815c970 2024-09-13T19:00:15.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.297+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee74039040 con 0x7fee8815c970 2024-09-13T19:00:15.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.298+0000 7fee84c00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 0x7fee6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.298+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee740a9c50 con 0x7fee8815c970 2024-09-13T19:00:15.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.299+0000 7fee8ca00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 0x7fee6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.299+0000 7fee8ca00640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 0x7fee6806d0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee7c000f60 tx=0x7fee7c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.303+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fee74074e40 con 0x7fee8815c970 2024-09-13T19:00:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.516+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee8806d720 con 0x7fee8815c970 2024-09-13T19:00:15.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.517+0000 7fee84c00640 1 -- 172.21.15.33:0/3813075553 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fee74041090 con 0x7fee8815c970 2024-09-13T19:00:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:15.521 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:59:54.900020+0000","modified":"2024-09-13T18:59:57.906170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/1636530679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1636530679},{"type":"v1","addr":"172.21.15.33:6833","nonce":1636530679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T19:00:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 msgr2=0x7fee6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 0x7fee6806d0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee7c000f60 tx=0x7fee7c007d50 comp rx=0 tx=0).stop 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 msgr2=0x7fee881553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fee7402a2b0 tx=0x7fee740046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 shutdown_connections 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac30 0x7fee6806d0f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee8815d9a0 0x7fee88154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee8815c970 0x7fee881553f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 --2- 172.21.15.33:0/3813075553 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee88070c20 0x7fee8814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 >> 172.21.15.33:0/3813075553 conn(0x7fee880b09e0 msgr2=0x7fee88159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 shutdown_connections 2024-09-13T19:00:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.519+0000 7fee8f400640 1 -- 172.21.15.33:0/3813075553 wait complete. 2024-09-13T19:00:15.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:15.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.691+0000 7fbfccc00640 1 Processor -- start 2024-09-13T19:00:15.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.691+0000 7fbfccc00640 1 -- start start 2024-09-13T19:00:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfccc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbfc8160370 0x7fbfc80b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfccc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b2e90 0x7fbfc80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfccc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc813fbc0 con 0x7fbfc80b3a40 2024-09-13T19:00:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfccc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc806cca0 con 0x7fbfc8160370 2024-09-13T19:00:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfccc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc815ce80 con 0x7fbfc80b2e90 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfc5400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbfc8160370 0x7fbfc80b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfc5400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbfc8160370 0x7fbfc80b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36570/0 (socket says 172.21.15.33:36570) 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.692+0000 7fbfc5400640 1 -- 172.21.15.33:0/3628059058 learned_addr learned my addr 172.21.15.33:0/3628059058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.693+0000 7fbfc6800640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b2e90 0x7fbfc80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.693+0000 7fbfc5400640 1 -- 172.21.15.33:0/3628059058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b2e90 msgr2=0x7fbfc80ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.693+0000 7fbfc5400640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b2e90 0x7fbfc80ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.693+0000 7fbfc5400640 1 -- 172.21.15.33:0/3628059058 >> v1:172.21.15.103:6789/0 conn(0x7fbfc80b3a40 legacy=0x7fbfc81428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.693+0000 7fbfc5400640 1 -- 172.21.15.33:0/3628059058 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8160910 con 0x7fbfc8160370 2024-09-13T19:00:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.694+0000 7fbfc5400640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc80b2950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009870 tx=0x7fbfb402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981784317f73f25c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.694+0000 7fbfc4a00640 1 -- 172.21.15.33:0/3628059058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4032440 con 0x7fbfc8160370 2024-09-13T19:00:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.694+0000 7fbfc4a00640 1 -- 172.21.15.33:0/3628059058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40325a0 con 0x7fbfc8160370 2024-09-13T19:00:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.694+0000 7fbfc4a00640 1 -- 172.21.15.33:0/3628059058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4032930 con 0x7fbfc8160370 2024-09-13T19:00:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 -- 172.21.15.33:0/3628059058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 msgr2=0x7fbfc80b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc80b2950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009870 tx=0x7fbfb402a1c0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 -- 172.21.15.33:0/3628059058 shutdown_connections 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b2e90 0x7fbfc80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 --2- 172.21.15.33:0/3628059058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc80b2950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 -- 172.21.15.33:0/3628059058 >> 172.21.15.33:0/3628059058 conn(0x7fbfc80b0510 msgr2=0x7fbfc80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 -- 172.21.15.33:0/3628059058 shutdown_connections 2024-09-13T19:00:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.695+0000 7fbfccc00640 1 -- 172.21.15.33:0/3628059058 wait complete. 2024-09-13T19:00:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.697+0000 7fbfccc00640 1 Processor -- start 2024-09-13T19:00:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.697+0000 7fbfccc00640 1 -- start start 2024-09-13T19:00:15.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 0x7fbfc8142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b3a40 0x7fbfc8144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8142dd0 con 0x7fbfc8160370 2024-09-13T19:00:15.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8143290 con 0x7fbfc80b2e90 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfccc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8141650 con 0x7fbfc80b3a40 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36574/0 (socket says 172.21.15.33:36574) 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 -- 172.21.15.33:0/2519989366 learned_addr learned my addr 172.21.15.33:0/2519989366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc5400640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b3a40 0x7fbfc8144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc5e00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 0x7fbfc8142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 -- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b3a40 msgr2=0x7fbfc8144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b3a40 0x7fbfc8144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 -- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 msgr2=0x7fbfc8142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 0x7fbfc8142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc6800640 1 -- 172.21.15.33:0/2519989366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40094d0 con 0x7fbfc8160370 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.698+0000 7fbfc5e00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 0x7fbfc8142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfc6800640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0007e60 tx=0x7fbfc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0014620 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0014780 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc8140890 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0014b30 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.699+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc8140e50 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.700+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80ad140 con 0x7fbfc8160370 2024-09-13T19:00:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.701+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfc0014c90 con 0x7fbfc8160370 2024-09-13T19:00:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.702+0000 7fbfbe000640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.702+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfc0089c90 con 0x7fbfc8160370 2024-09-13T19:00:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.702+0000 7fbfc5e00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:15.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.703+0000 7fbfc5e00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 0x7fbfa806d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbfc813f7b0 tx=0x7fbfb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.706+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbfc0054e60 con 0x7fbfc8160370 2024-09-13T19:00:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.887+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc80ce4d0 con 0x7fbfc8160370 2024-09-13T19:00:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.888+0000 7fbfbe000640 1 -- 172.21.15.33:0/2519989366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16568 (secure 0 0 0) 0x7fbfc0058480 con 0x7fbfc8160370 2024-09-13T19:00:15.891 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:15.892 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T18:59:55.902004+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:59:52.781766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:59:53.886144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 msgr2=0x7fbfa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 0x7fbfa806d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbfc813f7b0 tx=0x7fbfb8009040 comp rx=0 tx=0).stop 2024-09-13T19:00:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 msgr2=0x7fbfc8145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0007e60 tx=0x7fbfc000e4b0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 shutdown_connections 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfc8160370 0x7fbfc8145420 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbfc80b3a40 0x7fbfc8144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 --2- 172.21.15.33:0/2519989366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc80b2e90 0x7fbfc8142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 >> 172.21.15.33:0/2519989366 conn(0x7fbfc80b0510 msgr2=0x7fbfc80aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 shutdown_connections 2024-09-13T19:00:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:15.890+0000 7fbfccc00640 1 -- 172.21.15.33:0/2519989366 wait complete. 2024-09-13T19:00:15.909 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T19:00:16.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.061+0000 7f06f8e00640 1 Processor -- start 2024-09-13T19:00:16.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.061+0000 7f06f8e00640 1 -- start start 2024-09-13T19:00:16.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.062+0000 7f06f8e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06f4159610 0x7f06f4070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f8e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40709e0 con 0x7f06f40b3790 2024-09-13T19:00:16.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f8e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f4070cc0 con 0x7f06f4070540 2024-09-13T19:00:16.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f8e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f41599f0 con 0x7f06f4159610 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06f4159610 0x7f06f4070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06f4159610 0x7f06f4070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36590/0 (socket says 172.21.15.33:36590) 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 -- 172.21.15.33:0/2659896451 learned_addr learned my addr 172.21.15.33:0/2659896451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f2800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06f40b3790 0x7f06f40cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44546/0 (socket says 172.21.15.33:44546) 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 -- 172.21.15.33:0/2659896451 >> v1:172.21.15.103:6789/0 conn(0x7f06f4070540 legacy=0x7f06f40b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 -- 172.21.15.33:0/2659896451 >> v1:172.21.15.33:6789/0 conn(0x7f06f40b3790 legacy=0x7f06f40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.063+0000 7f06f1e00640 1 -- 172.21.15.33:0/2659896451 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4070fa0 con 0x7f06f4159610 2024-09-13T19:00:16.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.064+0000 7f06f1e00640 1 --2- 172.21.15.33:0/2659896451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4159610 0x7f06f4070000 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa773f4d4bdf6f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f1400640 1 -- 172.21.15.33:0/2659896451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032440 con 0x7f06f4159610 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f1400640 1 -- 172.21.15.33:0/2659896451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e40325a0 con 0x7f06f4159610 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f1400640 1 -- 172.21.15.33:0/2659896451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032930 con 0x7f06f4159610 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 -- 172.21.15.33:0/2659896451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4159610 msgr2=0x7f06f4070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2659896451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4159610 0x7f06f4070000 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a2a0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 -- 172.21.15.33:0/2659896451 shutdown_connections 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2659896451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4159610 0x7f06f4070000 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 -- 172.21.15.33:0/2659896451 >> 172.21.15.33:0/2659896451 conn(0x7f06f40b0510 msgr2=0x7f06f40b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 -- 172.21.15.33:0/2659896451 shutdown_connections 2024-09-13T19:00:16.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.065+0000 7f06f8e00640 1 -- 172.21.15.33:0/2659896451 wait complete. 2024-09-13T19:00:16.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.067+0000 7f06f8e00640 1 Processor -- start 2024-09-13T19:00:16.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.067+0000 7f06f8e00640 1 -- start start 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06f40b3790 0x7f06f40acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06f4159610 0x7f06f40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f415b020 con 0x7f06f4070540 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f415a570 con 0x7f06f4159610 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f8e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f415c9f0 con 0x7f06f40b3790 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36604/0 (socket says 172.21.15.33:36604) 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f1e00640 1 -- 172.21.15.33:0/2855398377 learned_addr learned my addr 172.21.15.33:0/2855398377 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06e9400640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06f40b3790 0x7f06f40acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.068+0000 7f06f2800640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06f4159610 0x7f06f40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 -- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06f40b3790 msgr2=0x7f06f40acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06f40b3790 0x7f06f40acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 -- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06f4159610 msgr2=0x7f06f40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06f4159610 0x7f06f40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 -- 172.21.15.33:0/2855398377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094d0 con 0x7f06f4070540 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f1e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f06e40097c0 tx=0x7f06e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032440 con 0x7f06f4070540 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4030b80 con 0x7f06f4070540 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f41674d0 con 0x7f06f4070540 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e403d420 con 0x7f06f4070540 2024-09-13T19:00:16.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.069+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f415aa60 con 0x7f06f4070540 2024-09-13T19:00:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.070+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f40ce560 con 0x7f06f4070540 2024-09-13T19:00:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.071+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06e4039040 con 0x7f06f4070540 2024-09-13T19:00:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.072+0000 7f06eaa00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 0x7f06d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.072+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06e40aa070 con 0x7f06f4070540 2024-09-13T19:00:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.073+0000 7f06e9400640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 0x7f06d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.073+0000 7f06e9400640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 0x7f06d006d0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f06dc006fd0 tx=0x7f06dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.077+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06e4075250 con 0x7f06f4070540 2024-09-13T19:00:16.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.292+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f06f4070000 con 0x7f06f4070540 2024-09-13T19:00:16.296 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T19:00:16.293+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T19:00:16.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.301+0000 7f06eaa00640 1 -- 172.21.15.33:0/2855398377 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f06e4078870 con 0x7f06f4070540 2024-09-13T19:00:16.305 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T19:00:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 msgr2=0x7f06d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 0x7f06d006d0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f06dc006fd0 tx=0x7f06dc008040 comp rx=0 tx=0).stop 2024-09-13T19:00:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 msgr2=0x7f06f415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f06e40097c0 tx=0x7f06e40046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 shutdown_connections 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f06d006ac00 0x7f06d006d0c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06f4159610 0x7f06f40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06f40b3790 0x7f06f40acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 --2- 172.21.15.33:0/2855398377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f4070540 0x7f06f415c4b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 >> 172.21.15.33:0/2855398377 conn(0x7f06f40b0510 msgr2=0x7f06f40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 shutdown_connections 2024-09-13T19:00:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.304+0000 7f06f8e00640 1 -- 172.21.15.33:0/2855398377 wait complete. 2024-09-13T19:00:16.313 INFO:tasks.ceph.mds.a.smithi033.stderr: -5143> 2024-09-13T18:59:55.446+0000 7f0c49600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T19:00:16.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T19:00:16.365 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T19:00:16.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.478+0000 7f91b6a00640 1 Processor -- start 2024-09-13T19:00:16.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.478+0000 7f91b6a00640 1 -- start start 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.479+0000 7f91b6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 0x7f91b006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.479+0000 7f91b6a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b006bc00 con 0x7f91b00ce020 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91b6a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b006bea0 con 0x7f91b00b1b00 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91b6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b006c180 con 0x7f91b015a520 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91b4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f91b00ce020 0x7f91b015a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44566/0 (socket says 172.21.15.33:44566) 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91b4a00640 1 -- 172.21.15.33:0/2934251106 learned_addr learned my addr 172.21.15.33:0/2934251106 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:16.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91afe00640 1 --2- 172.21.15.33:0/2934251106 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 0x7f91b006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947601712 0 0) 0x7f91b006bc00 con 0x7f91b00ce020 2024-09-13T19:00:16.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9194003520 con 0x7f91b00ce020 2024-09-13T19:00:16.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957740353 0 0) 0x7f91b006bea0 con 0x7f91b00b1b00 2024-09-13T19:00:16.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b006bc00 con 0x7f91b00b1b00 2024-09-13T19:00:16.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91afe00640 1 -- 172.21.15.33:0/2934251106 >> v1:172.21.15.103:6789/0 conn(0x7f91b00b1b00 legacy=0x7f91b00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91afe00640 1 -- 172.21.15.33:0/2934251106 >> v1:172.21.15.33:6789/0 conn(0x7f91b00ce020 legacy=0x7f91b015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.480+0000 7f91afe00640 1 -- 172.21.15.33:0/2934251106 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b006c460 con 0x7f91b015a520 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91afe00640 1 --2- 172.21.15.33:0/2934251106 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 0x7f91b006b6c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097d0 tx=0x7f91a002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4cce7159d7d935c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0032440 con 0x7f91b015a520 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00325a0 con 0x7f91b015a520 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91af400640 1 -- 172.21.15.33:0/2934251106 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0032930 con 0x7f91b015a520 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91b6a00640 1 -- 172.21.15.33:0/2934251106 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 msgr2=0x7f91b006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91b6a00640 1 --2- 172.21.15.33:0/2934251106 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 0x7f91b006b6c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097d0 tx=0x7f91a002a210 comp rx=0 tx=0).stop 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91b6a00640 1 -- 172.21.15.33:0/2934251106 shutdown_connections 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91b6a00640 1 --2- 172.21.15.33:0/2934251106 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b015a520 0x7f91b006b6c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.482+0000 7f91b6a00640 1 -- 172.21.15.33:0/2934251106 >> 172.21.15.33:0/2934251106 conn(0x7f91b00b0510 msgr2=0x7f91b00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.483+0000 7f91b6a00640 1 -- 172.21.15.33:0/2934251106 shutdown_connections 2024-09-13T19:00:16.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.483+0000 7f91b6a00640 1 -- 172.21.15.33:0/2934251106 wait complete. 2024-09-13T19:00:16.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.484+0000 7f91b6a00640 1 Processor -- start 2024-09-13T19:00:16.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.484+0000 7f91b6a00640 1 -- start start 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b00b1b00 0x7f91b00acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 0x7f91b01502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0150820 con 0x7f91b00ce020 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01f23c0 con 0x7f91b015a520 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91b6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01f26a0 con 0x7f91b00b1b00 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36614/0 (socket says 172.21.15.33:36614) 2024-09-13T19:00:16.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.485+0000 7f91a7400640 1 -- 172.21.15.33:0/1657402300 learned_addr learned my addr 172.21.15.33:0/1657402300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91b4a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 0x7f91b01502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91afe00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b00b1b00 0x7f91b00acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 -- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b00b1b00 msgr2=0x7f91b00acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b00b1b00 0x7f91b00acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 -- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 msgr2=0x7f91b01502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 0x7f91b01502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 -- 172.21.15.33:0/1657402300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009400 con 0x7f91b00ce020 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91b4a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 0x7f91b01502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91a7400640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f919800c450 tx=0x7f919800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.486+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980052d0 con 0x7f91b00ce020 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.487+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198005430 con 0x7f91b00ce020 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.487+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198012870 con 0x7f91b00ce020 2024-09-13T19:00:16.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.487+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b01f2980 con 0x7f91b00ce020 2024-09-13T19:00:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.487+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b01f2f40 con 0x7f91b00ce020 2024-09-13T19:00:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.488+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b006f640 con 0x7f91b00ce020 2024-09-13T19:00:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.489+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91980129d0 con 0x7f91b00ce020 2024-09-13T19:00:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.490+0000 7f91acc00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 0x7f918c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.490+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9198088f60 con 0x7f91b00ce020 2024-09-13T19:00:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.490+0000 7f91afe00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 0x7f918c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:16.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.491+0000 7f91afe00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 0x7f918c06d0c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:16.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.494+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9198054100 con 0x7f91b00ce020 2024-09-13T19:00:16.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:16.710+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f91b00cc0b0 con 0x7f91b00ce020 2024-09-13T19:00:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.305+0000 7f91acc00640 1 -- 172.21.15.33:0/1657402300 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9198057720 con 0x7f91b00ce020 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 msgr2=0x7f918c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 0x7f918c06d0c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 msgr2=0x7f91b014fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f919800c450 tx=0x7f919800c910 comp rx=0 tx=0).stop 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 shutdown_connections 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f918c06ac00 0x7f918c06d0c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91b015a520 0x7f91b01502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91b00ce020 0x7f91b014fda0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 --2- 172.21.15.33:0/1657402300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91b00b1b00 0x7f91b00acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 >> 172.21.15.33:0/1657402300 conn(0x7f91b00b0510 msgr2=0x7f91b00adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.307+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 shutdown_connections 2024-09-13T19:00:17.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.308+0000 7f91b6a00640 1 -- 172.21.15.33:0/1657402300 wait complete. 2024-09-13T19:00:17.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T19:00:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.530+0000 7fdcb8400640 1 Processor -- start 2024-09-13T19:00:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.530+0000 7fdcb8400640 1 -- start start 2024-09-13T19:00:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.531+0000 7fdcb8400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcb01461a0 0x7fdcb00b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.531+0000 7fdcb8400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00b2d60 0x7fdcb00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb8400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00ad200 con 0x7fdcb00acdb0 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb8400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb006b3e0 con 0x7fdcb01461a0 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb8400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b3370 con 0x7fdcb00b2d60 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcb01461a0 0x7fdcb00b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb6400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdcb00acdb0 0x7fdcb0160250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44580/0 (socket says 172.21.15.33:44580) 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb6400640 1 -- 172.21.15.33:0/1092043891 learned_addr learned my addr 172.21.15.33:0/1092043891 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5000640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00b2d60 0x7fdcb00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5a00640 1 -- 172.21.15.33:0/1092043891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00b2d60 msgr2=0x7fdcb00ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00b2d60 0x7fdcb00ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5a00640 1 -- 172.21.15.33:0/1092043891 >> v1:172.21.15.33:6789/0 conn(0x7fdcb00acdb0 legacy=0x7fdcb0160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.532+0000 7fdcb5a00640 1 -- 172.21.15.33:0/1092043891 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00b3650 con 0x7fdcb01461a0 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.533+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb01461a0 0x7fdcb00b2820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097a0 tx=0x7fdca402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578c135c7c674ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcafe00640 1 -- 172.21.15.33:0/1092043891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4032440 con 0x7fdcb01461a0 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcafe00640 1 -- 172.21.15.33:0/1092043891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40325a0 con 0x7fdcb01461a0 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcafe00640 1 -- 172.21.15.33:0/1092043891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4032930 con 0x7fdcb01461a0 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 -- 172.21.15.33:0/1092043891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb01461a0 msgr2=0x7fdcb00b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb01461a0 0x7fdcb00b2820 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097a0 tx=0x7fdca402a180 comp rx=0 tx=0).stop 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 -- 172.21.15.33:0/1092043891 shutdown_connections 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00b2d60 0x7fdcb00ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 --2- 172.21.15.33:0/1092043891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb01461a0 0x7fdcb00b2820 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 -- 172.21.15.33:0/1092043891 >> 172.21.15.33:0/1092043891 conn(0x7fdcb00b0510 msgr2=0x7fdcb00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 -- 172.21.15.33:0/1092043891 shutdown_connections 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.534+0000 7fdcb8400640 1 -- 172.21.15.33:0/1092043891 wait complete. 2024-09-13T19:00:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.536+0000 7fdcb8400640 1 Processor -- start 2024-09-13T19:00:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.536+0000 7fdcb8400640 1 -- start start 2024-09-13T19:00:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 0x7fdcb013a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 0x7fdcb01f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01f5410 con 0x7fdcb00b2d60 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb013a760 con 0x7fdcb01461a0 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb8400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01f4790 con 0x7fdcb00acdb0 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36634/0 (socket says 172.21.15.33:36634) 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb5000640 1 -- 172.21.15.33:0/2860762051 learned_addr learned my addr 172.21.15.33:0/2860762051 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb6400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 0x7fdcb01f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.537+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 0x7fdcb013a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 -- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 msgr2=0x7fdcb013a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 0x7fdcb013a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 -- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 msgr2=0x7fdcb01f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 0x7fdcb01f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 -- 172.21.15.33:0/2860762051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4009400 con 0x7fdcb00b2d60 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 0x7fdcb013a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb6400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 0x7fdcb01f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb5000640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00d800 tx=0x7fdc9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00b6c0 con 0x7fdcb00b2d60 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00b820 con 0x7fdcb00b2d60 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bbb0 con 0x7fdcb00b2d60 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb01f4a70 con 0x7fdcb00b2d60 2024-09-13T19:00:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.538+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb01f5030 con 0x7fdcb00b2d60 2024-09-13T19:00:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.539+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb01f5550 con 0x7fdcb00b2d60 2024-09-13T19:00:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.540+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc9c00bd10 con 0x7fdcb00b2d60 2024-09-13T19:00:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.541+0000 7fdcad600640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 0x7fdc9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.541+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdc9c089940 con 0x7fdcb00b2d60 2024-09-13T19:00:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.541+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 0x7fdc9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.542+0000 7fdcb5a00640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 0x7fdc9006d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdca4034000 tx=0x7fdca402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.545+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdcb01f5550 con 0x7fdcb00b2d60 2024-09-13T19:00:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:17.725+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdcb01f5550 con 0x7fdcb00b2d60 2024-09-13T19:00:18.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.307+0000 7fdcad600640 1 -- 172.21.15.33:0/2860762051 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdcb01f5550 con 0x7fdcb00b2d60 2024-09-13T19:00:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T19:00:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 msgr2=0x7fdc9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 0x7fdc9006d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdca4034000 tx=0x7fdca402e000 comp rx=0 tx=0).stop 2024-09-13T19:00:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 msgr2=0x7fdcb01f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00d800 tx=0x7fdc9c00dcc0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 shutdown_connections 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9006ac00 0x7fdc9006d0c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb01461a0 0x7fdcb01f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcb00b2d60 0x7fdcb01f39e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 --2- 172.21.15.33:0/2860762051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb00acdb0 0x7fdcb013a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 >> 172.21.15.33:0/2860762051 conn(0x7fdcb00b0510 msgr2=0x7fdcb00cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 shutdown_connections 2024-09-13T19:00:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.310+0000 7fdcb8400640 1 -- 172.21.15.33:0/2860762051 wait complete. 2024-09-13T19:00:18.331 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T19:00:18.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.489+0000 7fe9c1c00640 1 Processor -- start 2024-09-13T19:00:18.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.489+0000 7fe9c1c00640 1 -- start start 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9c1c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9bc15b770 0x7fe9bc0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9c1c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 0x7fe9bc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9c1c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9bc151a20 con 0x7fe9bc06cd60 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9c1c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc0cc430 con 0x7fe9bc15b770 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9c1c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc0b1bb0 con 0x7fe9bc0cd870 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9baa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe9bc06cd60 0x7fe9bc0cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44588/0 (socket says 172.21.15.33:44588) 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9baa00640 1 -- 172.21.15.33:0/3428186536 learned_addr learned my addr 172.21.15.33:0/3428186536 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3428186536 >> v2:172.21.15.33:3300/0 conn(0x7fe9bc15b770 0x7fe9bc0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9bb400640 1 --2- 172.21.15.33:0/3428186536 >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 0x7fe9bc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9b2000640 1 -- 172.21.15.33:0/3428186536 >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 msgr2=0x7fe9bc0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9ba000640 1 -- 172.21.15.33:0/3428186536 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262466588 0 0) 0x7fe9bc151a20 con 0x7fe9bc06cd60 2024-09-13T19:00:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3428186536 >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 0x7fe9bc0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9b2000640 1 -- 172.21.15.33:0/3428186536 >> v1:172.21.15.33:6789/0 conn(0x7fe9bc06cd60 legacy=0x7fe9bc0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9b2000640 1 -- 172.21.15.33:0/3428186536 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc0b1e70 con 0x7fe9bc15b770 2024-09-13T19:00:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.491+0000 7fe9bb400640 1 --2- 172.21.15.33:0/3428186536 >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 0x7fe9bc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.492+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3428186536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc15b770 0x7fe9bc0b2950 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc158690 tx=0x7fe9a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850bb869f4c3e0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9ba000640 1 -- 172.21.15.33:0/3428186536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4032440 con 0x7fe9bc15b770 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9ba000640 1 -- 172.21.15.33:0/3428186536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a40325a0 con 0x7fe9bc15b770 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9ba000640 1 -- 172.21.15.33:0/3428186536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4032930 con 0x7fe9bc15b770 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3428186536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc15b770 msgr2=0x7fe9bc0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3428186536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc15b770 0x7fe9bc0b2950 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc158690 tx=0x7fe9a402a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3428186536 shutdown_connections 2024-09-13T19:00:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3428186536 >> v2:172.21.15.103:3300/0 conn(0x7fe9bc0cd870 0x7fe9bc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3428186536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc15b770 0x7fe9bc0b2950 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3428186536 >> 172.21.15.33:0/3428186536 conn(0x7fe9bc0b0510 msgr2=0x7fe9bc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.493+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3428186536 shutdown_connections 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.494+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3428186536 wait complete. 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.495+0000 7fe9c1c00640 1 Processor -- start 2024-09-13T19:00:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.495+0000 7fe9c1c00640 1 -- start start 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9bc06cd60 0x7fe9bc14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9bc15b770 0x7fe9bc153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc1576d0 con 0x7fe9bc0cd870 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc1f3f30 con 0x7fe9bc06cd60 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9c1c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc157990 con 0x7fe9bc15b770 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9b2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9b2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36662/0 (socket says 172.21.15.33:36662) 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.496+0000 7fe9b2000640 1 -- 172.21.15.33:0/3747090626 learned_addr learned my addr 172.21.15.33:0/3747090626 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9baa00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9bc06cd60 0x7fe9bc14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9bb400640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9bc15b770 0x7fe9bc153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 -- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9bc15b770 msgr2=0x7fe9bc153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9bc15b770 0x7fe9bc153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 -- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9bc06cd60 msgr2=0x7fe9bc14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9bc06cd60 0x7fe9bc14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 -- 172.21.15.33:0/3747090626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4009400 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b2000640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000c00 tx=0x7fe9a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4032440 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4030ba0 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4006e10 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.497+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc157c70 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.498+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc158190 con 0x7fe9bc0cd870 2024-09-13T19:00:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.499+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc0cdc80 con 0x7fe9bc0cd870 2024-09-13T19:00:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.499+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe9a4039040 con 0x7fe9bc0cd870 2024-09-13T19:00:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.500+0000 7fe9b3400640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 0x7fe99806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.500+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fe9a40a9d60 con 0x7fe9bc0cd870 2024-09-13T19:00:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.501+0000 7fe9baa00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 0x7fe99806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.502+0000 7fe9baa00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 0x7fe99806d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac000f60 tx=0x7fe9ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:18.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.505+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe9a4075000 con 0x7fe9bc0cd870 2024-09-13T19:00:18.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:18.683+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9bc15a130 con 0x7fe9bc0cd870 2024-09-13T19:00:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.317+0000 7fe9b3400640 1 -- 172.21.15.33:0/3747090626 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe9a4078620 con 0x7fe9bc0cd870 2024-09-13T19:00:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T19:00:19.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 msgr2=0x7fe99806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 0x7fe99806d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac000f60 tx=0x7fe9ac009040 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 msgr2=0x7fe9bc1533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000c00 tx=0x7fe9a40046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 shutdown_connections 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe99806ac00 0x7fe99806d0c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9bc15b770 0x7fe9bc153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9bc0cd870 0x7fe9bc1533e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 --2- 172.21.15.33:0/3747090626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9bc06cd60 0x7fe9bc14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 >> 172.21.15.33:0/3747090626 conn(0x7fe9bc0b0510 msgr2=0x7fe9bc0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 shutdown_connections 2024-09-13T19:00:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.320+0000 7fe9c1c00640 1 -- 172.21.15.33:0/3747090626 wait complete. 2024-09-13T19:00:19.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T19:00:19.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.497+0000 7f0f1c800640 1 Processor -- start 2024-09-13T19:00:19.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.497+0000 7f0f1c800640 1 -- start start 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f1c800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f1c800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1406bea0 con 0x7f0f140b1b00 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f1c800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1406c180 con 0x7f0f1415a520 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f1c800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1406c460 con 0x7f0f1415b910 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f19400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f140b1b00 0x7f0f140cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44602/0 (socket says 172.21.15.33:44602) 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f19400640 1 -- 172.21.15.33:0/763597430 learned_addr learned my addr 172.21.15.33:0/763597430 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:19.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f1a800640 1 --2- 172.21.15.33:0/763597430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597818697 0 0) 0x7f0f1406bea0 con 0x7f0f140b1b00 2024-09-13T19:00:19.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0efc003520 con 0x7f0f140b1b00 2024-09-13T19:00:19.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051785950 0 0) 0x7f0f1406c180 con 0x7f0f1415a520 2024-09-13T19:00:19.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.499+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f1406bea0 con 0x7f0f1415a520 2024-09-13T19:00:19.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.500+0000 7f0f1a800640 1 -- 172.21.15.33:0/763597430 >> v1:172.21.15.103:6789/0 conn(0x7f0f1415a520 legacy=0x7f0f1406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.500+0000 7f0f1a800640 1 -- 172.21.15.33:0/763597430 >> v1:172.21.15.33:6789/0 conn(0x7f0f140b1b00 legacy=0x7f0f140cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.500+0000 7f0f1a800640 1 -- 172.21.15.33:0/763597430 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1406c740 con 0x7f0f1415b910 2024-09-13T19:00:19.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1a800640 1 --2- 172.21.15.33:0/763597430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14165190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009dc0 tx=0x7f0f1002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ea75ec52202c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10007740 con 0x7f0f1415b910 2024-09-13T19:00:19.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1002d050 con 0x7f0f1415b910 2024-09-13T19:00:19.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f18a00640 1 -- 172.21.15.33:0/763597430 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10007ac0 con 0x7f0f1415b910 2024-09-13T19:00:19.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1c800640 1 -- 172.21.15.33:0/763597430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 msgr2=0x7f0f14165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1c800640 1 --2- 172.21.15.33:0/763597430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14165190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009dc0 tx=0x7f0f1002a6d0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1c800640 1 -- 172.21.15.33:0/763597430 shutdown_connections 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1c800640 1 --2- 172.21.15.33:0/763597430 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14165190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.501+0000 7f0f1c800640 1 -- 172.21.15.33:0/763597430 >> 172.21.15.33:0/763597430 conn(0x7f0f140b0510 msgr2=0x7f0f140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.502+0000 7f0f1c800640 1 -- 172.21.15.33:0/763597430 shutdown_connections 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.502+0000 7f0f1c800640 1 -- 172.21.15.33:0/763597430 wait complete. 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.503+0000 7f0f1c800640 1 Processor -- start 2024-09-13T19:00:19.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.503+0000 7f0f1c800640 1 -- start start 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 0x7f0f140a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141f0eb0 con 0x7f0f140b1b00 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141f3850 con 0x7f0f1415a520 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f1c800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141f3b30 con 0x7f0f1415b910 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.504+0000 7f0f19e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36668/0 (socket says 172.21.15.33:36668) 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 -- 172.21.15.33:0/3460108745 learned_addr learned my addr 172.21.15.33:0/3460108745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:19.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19400640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 0x7f0f140a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f1a800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 -- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 msgr2=0x7f0f14156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 -- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 msgr2=0x7f0f140a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 0x7f0f140a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 -- 172.21.15.33:0/3460108745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009a70 con 0x7f0f140b1b00 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19400640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 0x7f0f140a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f19e00640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c490 tx=0x7f0f0800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.505+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080052d0 con 0x7f0f140b1b00 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.506+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08005430 con 0x7f0f140b1b00 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.506+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08012870 con 0x7f0f140b1b00 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.506+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f141f3e10 con 0x7f0f140b1b00 2024-09-13T19:00:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.506+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f141f34e0 con 0x7f0f140b1b00 2024-09-13T19:00:19.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.507+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f140cb0a0 con 0x7f0f140b1b00 2024-09-13T19:00:19.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.508+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f080129d0 con 0x7f0f140b1b00 2024-09-13T19:00:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.508+0000 7f0f0e000640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 0x7f0ef806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.508+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f08088b90 con 0x7f0f140b1b00 2024-09-13T19:00:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.509+0000 7f0f19400640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 0x7f0ef806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.510+0000 7f0f19400640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 0x7f0ef806d0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0f140b18d0 tx=0x7f0f04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.513+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f08054100 con 0x7f0f140b1b00 2024-09-13T19:00:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.692+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f140cd910 con 0x7f0f140b1b00 2024-09-13T19:00:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.698+0000 7f0f0e000640 1 -- 172.21.15.33:0/3460108745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f08057720 con 0x7f0f140b1b00 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.700+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 msgr2=0x7f0ef806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.700+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 0x7f0ef806d0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0f140b18d0 tx=0x7f0f04009040 comp rx=0 tx=0).stop 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.700+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 msgr2=0x7f0f141f0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.700+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c490 tx=0x7f0f0800c950 comp rx=0 tx=0).stop 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 shutdown_connections 2024-09-13T19:00:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0ef806ac00 0x7f0ef806d0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0f1415b910 0x7f0f14156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f1415a520 0x7f0f140a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 --2- 172.21.15.33:0/3460108745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f140b1b00 0x7f0f141f0970 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 >> 172.21.15.33:0/3460108745 conn(0x7f0f140b0510 msgr2=0x7f0f1406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 shutdown_connections 2024-09-13T19:00:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.701+0000 7f0f1c800640 1 -- 172.21.15.33:0/3460108745 wait complete. 2024-09-13T19:00:19.720 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-13T19:00:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.872+0000 7f5c52200640 1 Processor -- start 2024-09-13T19:00:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.872+0000 7f5c52200640 1 -- start start 2024-09-13T19:00:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c52200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5c4c0b3080 0x7f5c4c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c52200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0b3a00 con 0x7f5c4c159610 2024-09-13T19:00:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c52200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c070710 con 0x7f5c4c0cd080 2024-09-13T19:00:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c52200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c1599f0 con 0x7f5c4c0b3080 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c4b400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5c4c159610 0x7f5c4c070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44614/0 (socket says 172.21.15.33:44614) 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c4b400640 1 -- 172.21.15.33:0/4194106410 learned_addr learned my addr 172.21.15.33:0/4194106410 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.874+0000 7f5c42a00640 1 --2- 172.21.15.33:0/4194106410 >> v2:172.21.15.33:3300/0 conn(0x7f5c4c0b3080 0x7f5c4c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.875+0000 7f5c42a00640 1 -- 172.21.15.33:0/4194106410 >> v1:172.21.15.103:6789/0 conn(0x7f5c4c0cd080 legacy=0x7f5c4c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.875+0000 7f5c42a00640 1 -- 172.21.15.33:0/4194106410 >> v1:172.21.15.33:6789/0 conn(0x7f5c4c159610 legacy=0x7f5c4c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.875+0000 7f5c42a00640 1 -- 172.21.15.33:0/4194106410 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0709e0 con 0x7f5c4c0b3080 2024-09-13T19:00:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.875+0000 7f5c4aa00640 1 -- 172.21.15.33:0/4194106410 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071311046 0 0) 0x7f5c4c0b3a00 con 0x7f5c4c159610 2024-09-13T19:00:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c42a00640 1 --2- 172.21.15.33:0/4194106410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c0b34c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c340097a0 tx=0x7f5c3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609d5b7af34dcc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c4aa00640 1 -- 172.21.15.33:0/4194106410 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34032440 con 0x7f5c4c0b3080 2024-09-13T19:00:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c4aa00640 1 -- 172.21.15.33:0/4194106410 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c340325a0 con 0x7f5c4c0b3080 2024-09-13T19:00:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c4aa00640 1 -- 172.21.15.33:0/4194106410 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34032930 con 0x7f5c4c0b3080 2024-09-13T19:00:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c52200640 1 -- 172.21.15.33:0/4194106410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0b3080 msgr2=0x7f5c4c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c52200640 1 --2- 172.21.15.33:0/4194106410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c0b34c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c340097a0 tx=0x7f5c3402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c52200640 1 -- 172.21.15.33:0/4194106410 shutdown_connections 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c52200640 1 --2- 172.21.15.33:0/4194106410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c0b34c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.876+0000 7f5c52200640 1 -- 172.21.15.33:0/4194106410 >> 172.21.15.33:0/4194106410 conn(0x7f5c4c0b0510 msgr2=0x7f5c4c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.877+0000 7f5c52200640 1 -- 172.21.15.33:0/4194106410 shutdown_connections 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.877+0000 7f5c52200640 1 -- 172.21.15.33:0/4194106410 wait complete. 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.878+0000 7f5c52200640 1 Processor -- start 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.878+0000 7f5c52200640 1 -- start start 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c1f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5c4c159610 0x7f5c4c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c1497b0 con 0x7f5c4c0cd080 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0af130 con 0x7f5c4c0b3080 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c52200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0aff90 con 0x7f5c4c159610 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c42a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c42a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36698/0 (socket says 172.21.15.33:36698) 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.879+0000 7f5c42a00640 1 -- 172.21.15.33:0/2584414006 learned_addr learned my addr 172.21.15.33:0/2584414006 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c4b400640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c1f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c4be00640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5c4c159610 0x7f5c4c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 -- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5c4c159610 msgr2=0x7f5c4c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5c4c159610 0x7f5c4c0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 -- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c4c0b3080 msgr2=0x7f5c4c1f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c1f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:19.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 -- 172.21.15.33:0/2584414006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c34009400 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.880+0000 7f5c42a00640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c340097a0 tx=0x7f5c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.881+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34030b80 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.881+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34030ce0 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.881+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3403b640 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.881+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0aee50 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.881+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c149d40 con 0x7f5c4c0cd080 2024-09-13T19:00:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.882+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c06cf80 con 0x7f5c4c0cd080 2024-09-13T19:00:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.883+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c34039040 con 0x7f5c4c0cd080 2024-09-13T19:00:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.883+0000 7f5c43e00640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 0x7f5c2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.884+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c340a9950 con 0x7f5c4c0cd080 2024-09-13T19:00:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.884+0000 7f5c4b400640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 0x7f5c2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.885+0000 7f5c4b400640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 0x7f5c2806d0c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000f60 tx=0x7f5c3c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:19.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:19.888+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5c34074ed0 con 0x7f5c4c0cd080 2024-09-13T19:00:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.133+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) v1 -- 0x7f5c4c0cdfa0 con 0x7f5c4c0cd080 2024-09-13T19:00:20.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.318+0000 7f5c43e00640 1 -- 172.21.15.33:0/2584414006 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v196) v1 ==== 134+0+0 (secure 0 0 0) 0x7f5c340370c0 con 0x7f5c4c0cd080 2024-09-13T19:00:20.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.320+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 msgr2=0x7f5c2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.320+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 0x7f5c2806d0c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000f60 tx=0x7f5c3c007d50 comp rx=0 tx=0).stop 2024-09-13T19:00:20.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.320+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 msgr2=0x7f5c4c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.320+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c340097a0 tx=0x7f5c340046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 shutdown_connections 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5c2806ac00 0x7f5c2806d0c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5c4c159610 0x7f5c4c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c0cd080 0x7f5c4c149270 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 --2- 172.21.15.33:0/2584414006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c4c0b3080 0x7f5c4c1f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 >> 172.21.15.33:0/2584414006 conn(0x7f5c4c0b0510 msgr2=0x7f5c4c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 shutdown_connections 2024-09-13T19:00:20.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.321+0000 7f5c52200640 1 -- 172.21.15.33:0/2584414006 wait complete. 2024-09-13T19:00:20.341 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-13T19:00:20.341 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) That quota changes made from one client are visible to another 2024-09-13T19:00:20.342 INFO:tasks.cephfs_test_runner:test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) 2024-09-13T19:00:20.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:20.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.493+0000 7f1f85c00640 1 Processor -- start 2024-09-13T19:00:20.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.493+0000 7f1f85c00640 1 -- start start 2024-09-13T19:00:20.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f8006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f85c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1f800b1b00 0x7f1f800cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f85c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8006bc00 con 0x7f1f800cde50 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f85c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8006bea0 con 0x7f1f800b1b00 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f85c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006c180 con 0x7f1f8015a520 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f7f400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f800cde50 0x7f1f800b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44618/0 (socket says 172.21.15.33:44618) 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f7f400640 1 -- 172.21.15.33:0/4069169915 learned_addr learned my addr 172.21.15.33:0/4069169915 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f7ea00640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f8006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.495+0000 7f1f76000640 1 --2- 172.21.15.33:0/4069169915 >> v2:172.21.15.103:3300/0 conn(0x7f1f800b1b00 0x7f1f800cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922877309 0 0) 0x7f1f8006bc00 con 0x7f1f800cde50 2024-09-13T19:00:20.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f64003520 con 0x7f1f800cde50 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953908079 0 0) 0x7f1f64003520 con 0x7f1f800cde50 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 msgr2=0x7f1f8006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f8006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 >> v2:172.21.15.103:3300/0 conn(0x7f1f800b1b00 msgr2=0x7f1f800cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 --2- 172.21.15.33:0/4069169915 >> v2:172.21.15.103:3300/0 conn(0x7f1f800b1b00 0x7f1f800cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8006c460 con 0x7f1f800cde50 2024-09-13T19:00:20.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f1f780019f0 con 0x7f1f800cde50 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 >> v1:172.21.15.33:6789/0 conn(0x7f1f800cde50 legacy=0x7f1f800b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f64003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f64003ef0 0x7f1f640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f64004d00 0x7f1f64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006bea0 con 0x7f1f64003ef0 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8006c180 con 0x7f1f64004d00 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6400b980 con 0x7f1f8015a520 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f76000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f64003ef0 0x7f1f640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7ea00640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f64003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.496+0000 7f1f7f400640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f64004d00 0x7f1f64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.497+0000 7f1f76000640 1 -- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 msgr2=0x7f1f64003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.497+0000 7f1f76000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f8015a520 0x7f1f64003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.497+0000 7f1f76000640 1 -- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f64004d00 msgr2=0x7f1f64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.497+0000 7f1f76000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f64004d00 0x7f1f64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.497+0000 7f1f76000640 1 -- 172.21.15.33:0/4069169915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64003520 con 0x7f1f64003ef0 2024-09-13T19:00:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.498+0000 7f1f76000640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f64003ef0 0x7f1f640047c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009a90 tx=0x7f1f640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a2307a01b21eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.498+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68031400 con 0x7f1f64003ef0 2024-09-13T19:00:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.498+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6802d050 con 0x7f1f64003ef0 2024-09-13T19:00:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.498+0000 7f1f7e000640 1 -- 172.21.15.33:0/4069169915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f680317a0 con 0x7f1f64003ef0 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 -- 172.21.15.33:0/4069169915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f64003ef0 msgr2=0x7f1f640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 --2- 172.21.15.33:0/4069169915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f64003ef0 0x7f1f640047c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009a90 tx=0x7f1f640057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f7f400640 1 -- 172.21.15.33:0/4069169915 reap_dead start 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 -- 172.21.15.33:0/4069169915 shutdown_connections 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 -- 172.21.15.33:0/4069169915 >> 172.21.15.33:0/4069169915 conn(0x7f1f800b0510 msgr2=0x7f1f800b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 -- 172.21.15.33:0/4069169915 shutdown_connections 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.499+0000 7f1f85c00640 1 -- 172.21.15.33:0/4069169915 wait complete. 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.500+0000 7f1f85c00640 1 Processor -- start 2024-09-13T19:00:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.501+0000 7f1f85c00640 1 -- start start 2024-09-13T19:00:20.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.501+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f64003ef0 0x7f1f80154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 0x7f1f801e12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f85c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e4a00 con 0x7f1f80155000 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f85c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e4540 con 0x7f1f801e3800 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f85c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e3ca0 con 0x7f1f64003ef0 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36728/0 (socket says 172.21.15.33:36728) 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 -- 172.21.15.33:0/2959774554 learned_addr learned my addr 172.21.15.33:0/2959774554 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f7ea00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f64003ef0 0x7f1f80154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f7f400640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 0x7f1f801e12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 -- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f64003ef0 msgr2=0x7f1f80154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f64003ef0 0x7f1f80154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 -- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 msgr2=0x7f1f801e12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 0x7f1f801e12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f76000640 1 -- 172.21.15.33:0/2959774554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f801e3f80 con 0x7f1f80155000 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.502+0000 7f1f7f400640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 0x7f1f801e12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f76000640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009bb0 tx=0x7f1f68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6803a810 con 0x7f1f80155000 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6803a970 con 0x7f1f80155000 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6803ad20 con 0x7f1f80155000 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f801e4260 con 0x7f1f80155000 2024-09-13T19:00:20.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.503+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f801e1810 con 0x7f1f80155000 2024-09-13T19:00:20.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.504+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f801e4b40 con 0x7f1f80155000 2024-09-13T19:00:20.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.505+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f68038040 con 0x7f1f80155000 2024-09-13T19:00:20.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.506+0000 7f1f77400640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 0x7f1f5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.506+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1f68040030 con 0x7f1f80155000 2024-09-13T19:00:20.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.506+0000 7f1f7ea00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 0x7f1f5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.507+0000 7f1f7ea00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 0x7f1f5c06d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f801e6a30 tx=0x7f1f70009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.511+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f801e4b40 con 0x7f1f80155000 2024-09-13T19:00:20.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.689+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f801e4b40 con 0x7f1f80155000 2024-09-13T19:00:20.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.690+0000 7f1f77400640 1 -- 172.21.15.33:0/2959774554 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+12987 (secure 0 0 0) 0x7f1f801e4b40 con 0x7f1f80155000 2024-09-13T19:00:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":75,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:19.306893+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6833/1636530679":"2024-09-14T19:00:16.294326+0000","172.21.15.33:6832/1636530679":"2024-09-14T19:00:16.294326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 msgr2=0x7f1f5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 0x7f1f5c06d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f801e6a30 tx=0x7f1f70009190 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 msgr2=0x7f1f801e32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009bb0 tx=0x7f1f68004730 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 shutdown_connections 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1f5c06ac00 0x7f1f5c06d0c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f801e3800 0x7f1f801e12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f80155000 0x7f1f801e32c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 --2- 172.21.15.33:0/2959774554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1f64003ef0 0x7f1f80154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 >> 172.21.15.33:0/2959774554 conn(0x7f1f800b0510 msgr2=0x7f1f800af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:20.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 shutdown_connections 2024-09-13T19:00:20.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.692+0000 7f1f85c00640 1 -- 172.21.15.33:0/2959774554 wait complete. 2024-09-13T19:00:20.712 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:20.712 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.867+0000 7f7a2ce00640 1 Processor -- start 2024-09-13T19:00:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.867+0000 7f7a2ce00640 1 -- start start 2024-09-13T19:00:20.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2806f830 0x7f7a2806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a2ce00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a280ce490 con 0x7f7a28070420 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a2ce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2806b7c0 con 0x7f7a28154ad0 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a2ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2806b5b0 con 0x7f7a2806f830 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a26800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7a28070420 0x7f7a280cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44628/0 (socket says 172.21.15.33:44628) 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a26800640 1 -- 172.21.15.33:0/630326924 learned_addr learned my addr 172.21.15.33:0/630326924 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a1d400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2806f830 0x7f7a2806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940139072 0 0) 0x7f7a280ce490 con 0x7f7a28070420 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.869+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a0c003520 con 0x7f7a28070420 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459883081 0 0) 0x7f7a2806b7c0 con 0x7f7a28154ad0 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a280ce490 con 0x7f7a28154ad0 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491919055 0 0) 0x7f7a0c003520 con 0x7f7a28070420 2024-09-13T19:00:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2806f830 msgr2=0x7f7a2806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a2806f830 0x7f7a2806fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 >> v1:172.21.15.103:6789/0 conn(0x7f7a28154ad0 legacy=0x7f7a280cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2806baa0 con 0x7f7a28070420 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f7a200019f0 con 0x7f7a28070420 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 >> v1:172.21.15.33:6789/0 conn(0x7f7a28070420 legacy=0x7f7a280cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a0c003b30 0x7f7a0c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a0c0047c0 0x7f7a0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2806b5b0 con 0x7f7a0c005180 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c00bf70 con 0x7f7a0c0047c0 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c00c100 con 0x7f7a0c003b30 2024-09-13T19:00:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a26800640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a1d400640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a0c0047c0 0x7f7a0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.870+0000 7f7a25e00640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a0c003b30 0x7f7a0c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.871+0000 7f7a26800640 1 -- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a0c003b30 msgr2=0x7f7a0c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.871+0000 7f7a26800640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a0c003b30 0x7f7a0c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.871+0000 7f7a26800640 1 -- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a0c0047c0 msgr2=0x7f7a0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.871+0000 7f7a26800640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a0c0047c0 0x7f7a0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.871+0000 7f7a26800640 1 -- 172.21.15.33:0/630326924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c003520 con 0x7f7a0c005180 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a26800640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a0c00b980 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000a700 tx=0x7f7a0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20341b2d78f88656 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2002b8b0 con 0x7f7a0c005180 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2002ba10 con 0x7f7a0c005180 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a25400640 1 -- 172.21.15.33:0/630326924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2002be20 con 0x7f7a0c005180 2024-09-13T19:00:20.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a2ce00640 1 -- 172.21.15.33:0/630326924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 msgr2=0x7f7a0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/630326924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a0c00b980 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000a700 tx=0x7f7a0c0057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a26800640 1 -- 172.21.15.33:0/630326924 reap_dead start 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a2ce00640 1 -- 172.21.15.33:0/630326924 shutdown_connections 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.872+0000 7f7a2ce00640 1 -- 172.21.15.33:0/630326924 >> 172.21.15.33:0/630326924 conn(0x7f7a280b0580 msgr2=0x7f7a280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.873+0000 7f7a2ce00640 1 -- 172.21.15.33:0/630326924 shutdown_connections 2024-09-13T19:00:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.873+0000 7f7a2ce00640 1 -- 172.21.15.33:0/630326924 wait complete. 2024-09-13T19:00:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.874+0000 7f7a2ce00640 1 Processor -- start 2024-09-13T19:00:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.874+0000 7f7a2ce00640 1 -- start start 2024-09-13T19:00:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 0x7f7a280ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 0x7f7a28070850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2815dcb0 con 0x7f7a0c005180 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280a98b0 con 0x7f7a2813bbf0 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a2ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281f59d0 con 0x7f7a281f54f0 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a25e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.875+0000 7f7a25e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36736/0 (socket says 172.21.15.33:36736) 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 -- 172.21.15.33:0/2069298698 learned_addr learned my addr 172.21.15.33:0/2069298698 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a1d400640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 0x7f7a280ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a26800640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 0x7f7a28070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 -- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 msgr2=0x7f7a280ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 0x7f7a280ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 -- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 msgr2=0x7f7a28070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 0x7f7a28070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 -- 172.21.15.33:0/2069298698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a281f5cb0 con 0x7f7a0c005180 2024-09-13T19:00:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a1d400640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 0x7f7a280ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a26800640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 0x7f7a28070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a25e00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800e780 tx=0x7f7a1800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.876+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180050d0 con 0x7f7a0c005180 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.877+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18005230 con 0x7f7a0c005180 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.877+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800c6c0 con 0x7f7a0c005180 2024-09-13T19:00:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.877+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a281f5f90 con 0x7f7a0c005180 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.877+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2813dc80 con 0x7f7a0c005180 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.878+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a280cb0d0 con 0x7f7a0c005180 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.879+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a1800c820 con 0x7f7a0c005180 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.879+0000 7f7a1ea00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 0x7f7a0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.880+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a180890d0 con 0x7f7a0c005180 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.880+0000 7f7a1d400640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 0x7f7a0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.881+0000 7f7a1d400640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 0x7f7a0406d0c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009bc0 tx=0x7f7a10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:20.884+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7a18054510 con 0x7f7a0c005180 2024-09-13T19:00:21.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.060+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a2806f830 con 0x7f7a0c005180 2024-09-13T19:00:21.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.061+0000 7f7a1ea00640 1 -- 172.21.15.33:0/2069298698 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a18057b30 con 0x7f7a0c005180 2024-09-13T19:00:21.065 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 msgr2=0x7f7a0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 0x7f7a0406d0c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009bc0 tx=0x7f7a10008040 comp rx=0 tx=0).stop 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 msgr2=0x7f7a2815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800e780 tx=0x7f7a1800eb80 comp rx=0 tx=0).stop 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 shutdown_connections 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a0406ac00 0x7f7a0406d0c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a2813bbf0 0x7f7a28070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a281f54f0 0x7f7a280ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 --2- 172.21.15.33:0/2069298698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a0c005180 0x7f7a2815d770 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.063+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 >> 172.21.15.33:0/2069298698 conn(0x7f7a280b0580 msgr2=0x7f7a280ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:21.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.064+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 shutdown_connections 2024-09-13T19:00:21.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.064+0000 7f7a2ce00640 1 -- 172.21.15.33:0/2069298698 wait complete. 2024-09-13T19:00:21.084 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-13T19:00:21.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.236+0000 7f6c57800640 1 Processor -- start 2024-09-13T19:00:21.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.236+0000 7f6c57800640 1 -- start start 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c57800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500b1b30 0x7f6c500cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c57800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c500cba50 0x7f6c500cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c57800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5006ba80 con 0x7f6c50151590 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c57800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500cc400 con 0x7f6c500cba50 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c57800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b2270 con 0x7f6c500b1b30 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c55800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c500cba50 0x7f6c500cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c47e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500b1b30 0x7f6c500cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c55800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c500cba50 0x7f6c500cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:59422/0 (socket says 172.21.15.33:59422) 2024-09-13T19:00:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c55800640 1 -- 172.21.15.33:0/1202732899 learned_addr learned my addr 172.21.15.33:0/1202732899 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.238+0000 7f6c54e00640 1 --1- 172.21.15.33:0/1202732899 >> v1:172.21.15.103:6789/0 conn(0x7f6c50151590 0x7f6c5006b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:43506/0 (socket says 172.21.15.33:43506) 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c4fe00640 1 -- 172.21.15.33:0/1202732899 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724680273 0 0) 0x7f6c5006ba80 con 0x7f6c50151590 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c4fe00640 1 -- 172.21.15.33:0/1202732899 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c34003520 con 0x7f6c50151590 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c55800640 1 -- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500b1b30 msgr2=0x7f6c500cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c55800640 1 --2- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500b1b30 0x7f6c500cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c55800640 1 -- 172.21.15.33:0/1202732899 >> v1:172.21.15.103:6789/0 conn(0x7f6c50151590 legacy=0x7f6c5006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.239+0000 7f6c55800640 1 -- 172.21.15.33:0/1202732899 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500b2550 con 0x7f6c500cba50 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.240+0000 7f6c55800640 1 --2- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500cba50 0x7f6c500cbec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009e50 tx=0x7f6c4802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5340c49035501f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.240+0000 7f6c4fe00640 1 -- 172.21.15.33:0/1202732899 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48031600 con 0x7f6c500cba50 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.240+0000 7f6c4fe00640 1 -- 172.21.15.33:0/1202732899 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4802d050 con 0x7f6c500cba50 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.240+0000 7f6c4fe00640 1 -- 172.21.15.33:0/1202732899 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48031980 con 0x7f6c500cba50 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 -- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500cba50 msgr2=0x7f6c500cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 --2- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500cba50 0x7f6c500cbec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009e50 tx=0x7f6c4802a710 comp rx=0 tx=0).stop 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 -- 172.21.15.33:0/1202732899 shutdown_connections 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 --2- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500cba50 0x7f6c500cbec0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 --2- 172.21.15.33:0/1202732899 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500b1b30 0x7f6c500cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 -- 172.21.15.33:0/1202732899 >> 172.21.15.33:0/1202732899 conn(0x7f6c500b0510 msgr2=0x7f6c500b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 -- 172.21.15.33:0/1202732899 shutdown_connections 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.241+0000 7f6c57800640 1 -- 172.21.15.33:0/1202732899 wait complete. 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.243+0000 7f6c57800640 1 Processor -- start 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.243+0000 7f6c57800640 1 -- start start 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500cba50 0x7f6c500af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c50151590 0x7f6c500b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5014d6c0 con 0x7f6c500b1b30 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50155600 con 0x7f6c50151590 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c57800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501558e0 con 0x7f6c500cba50 2024-09-13T19:00:21.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36746/0 (socket says 172.21.15.33:36746) 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 -- 172.21.15.33:0/3191629333 learned_addr learned my addr 172.21.15.33:0/3191629333 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c47e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500cba50 0x7f6c500af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c55800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c50151590 0x7f6c500b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 -- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500cba50 msgr2=0x7f6c500af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500cba50 0x7f6c500af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 -- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c50151590 msgr2=0x7f6c500b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c50151590 0x7f6c500b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.244+0000 7f6c54e00640 1 -- 172.21.15.33:0/3191629333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48009b30 con 0x7f6c500b1b30 2024-09-13T19:00:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c54e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c410 tx=0x7f6c4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400074e0 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40007640 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40004a00 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50155bc0 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.245+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c50156180 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.246+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c500cbec0 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.247+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c40004b60 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.248+0000 7f6c4d600640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 0x7f6c2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.248+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c40088b90 con 0x7f6c500b1b30 2024-09-13T19:00:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.248+0000 7f6c47e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 0x7f6c2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:21.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.249+0000 7f6c47e00640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 0x7f6c2c06d0c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6c500ce060 tx=0x7f6c38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:21.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.252+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6c40054090 con 0x7f6c500b1b30 2024-09-13T19:00:21.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:21.499+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7f6c500adea0 con 0x7f6c500b1b30 2024-09-13T19:00:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.326+0000 7f6c4d600640 1 -- 172.21.15.33:0/3191629333 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v198) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6c400576b0 con 0x7f6c500b1b30 2024-09-13T19:00:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.329+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 msgr2=0x7f6c2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 0x7f6c2c06d0c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6c500ce060 tx=0x7f6c38008040 comp rx=0 tx=0).stop 2024-09-13T19:00:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 msgr2=0x7f6c5014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c410 tx=0x7f6c4000c8d0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 shutdown_connections 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6c2c06ac00 0x7f6c2c06d0c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c50151590 0x7f6c500b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500cba50 0x7f6c500af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 --2- 172.21.15.33:0/3191629333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c500b1b30 0x7f6c5014d180 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 >> 172.21.15.33:0/3191629333 conn(0x7f6c500b0510 msgr2=0x7f6c500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 shutdown_connections 2024-09-13T19:00:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.330+0000 7f6c57800640 1 -- 172.21.15.33:0/3191629333 wait complete. 2024-09-13T19:00:22.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T19:00:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.518+0000 7f0ff3c00640 1 Processor -- start 2024-09-13T19:00:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.518+0000 7f0ff3c00640 1 -- start start 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.519+0000 7f0ff3c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0fec06f830 0x7f0fec06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0ff3c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec0ce490 con 0x7f0fec070420 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0ff3c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec06b7c0 con 0x7f0fec154ad0 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0ff3c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec06b5b0 con 0x7f0fec06f830 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0ff1c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0fec070420 0x7f0fec0cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44642/0 (socket says 172.21.15.33:44642) 2024-09-13T19:00:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0ff1c00640 1 -- 172.21.15.33:0/2888464120 learned_addr learned my addr 172.21.15.33:0/2888464120 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> v2:172.21.15.103:3300/0 conn(0x7f0fec06f830 0x7f0fec06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362092854 0 0) 0x7f0fec0ce490 con 0x7f0fec070420 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd4003520 con 0x7f0fec070420 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.520+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554135770 0 0) 0x7f0fec06b7c0 con 0x7f0fec154ad0 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fec0ce490 con 0x7f0fec154ad0 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003495962 0 0) 0x7f0fd4003520 con 0x7f0fec070420 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 >> v2:172.21.15.103:3300/0 conn(0x7f0fec06f830 msgr2=0x7f0fec06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 --2- 172.21.15.33:0/2888464120 >> v2:172.21.15.103:3300/0 conn(0x7f0fec06f830 0x7f0fec06fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 >> v1:172.21.15.103:6789/0 conn(0x7f0fec154ad0 legacy=0x7f0fec0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06baa0 con 0x7f0fec070420 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f0fe40019f0 con 0x7f0fec070420 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 >> v1:172.21.15.33:6789/0 conn(0x7f0fec070420 legacy=0x7f0fec0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd4003b00 0x7f0fd4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 0x7f0fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd4005180 0x7f0fd400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec06b5b0 con 0x7f0fd40047c0 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40104c0 con 0x7f0fd4003b00 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4010680 con 0x7f0fd4005180 2024-09-13T19:00:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> v2:172.21.15.103:3300/0 conn(0x7f0fec06f830 0x7f0fec06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 0x7f0fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0ff1200640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd4003b00 0x7f0fd4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.521+0000 7f0ff1c00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd4005180 0x7f0fd400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0febe00640 1 -- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd4005180 msgr2=0x7f0fd400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd4005180 0x7f0fd400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0febe00640 1 -- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd4003b00 msgr2=0x7f0fd4003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd4003b00 0x7f0fd4003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0febe00640 1 -- 172.21.15.33:0/2888464120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4003520 con 0x7f0fd40047c0 2024-09-13T19:00:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.522+0000 7f0ff1c00640 1 -- 172.21.15.33:0/2888464120 reap_dead start 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0febe00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 0x7f0fd4004c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009c70 tx=0x7f0fd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d0dc057af8bcd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8004020 con 0x7f0fd40047c0 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd802d050 con 0x7f0fd40047c0 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0feb400640 1 -- 172.21.15.33:0/2888464120 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8004380 con 0x7f0fd40047c0 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 -- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 msgr2=0x7f0fd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 0x7f0fd4004c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009c70 tx=0x7f0fd40057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 -- 172.21.15.33:0/2888464120 shutdown_connections 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/2888464120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd40047c0 0x7f0fd4004c40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 -- 172.21.15.33:0/2888464120 >> 172.21.15.33:0/2888464120 conn(0x7f0fec0b0580 msgr2=0x7f0fec0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 -- 172.21.15.33:0/2888464120 shutdown_connections 2024-09-13T19:00:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.523+0000 7f0ff3c00640 1 -- 172.21.15.33:0/2888464120 wait complete. 2024-09-13T19:00:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.525+0000 7f0ff3c00640 1 Processor -- start 2024-09-13T19:00:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.525+0000 7f0ff3c00640 1 -- start start 2024-09-13T19:00:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd40047c0 0x7f0fec159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec153c70 0x7f0fec1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec158be0 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0a9530 con 0x7f0fec153c70 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff3c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0a9250 con 0x7f0fd40047c0 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0febe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0febe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36764/0 (socket says 172.21.15.33:36764) 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0febe00640 1 -- 172.21.15.33:0/3286041844 learned_addr learned my addr 172.21.15.33:0/3286041844 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff1200640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd40047c0 0x7f0fec159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.526+0000 7f0ff1c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec153c70 0x7f0fec1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 -- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd40047c0 msgr2=0x7f0fec159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd40047c0 0x7f0fec159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 -- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec153c70 msgr2=0x7f0fec1ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec153c70 0x7f0fec1ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 -- 172.21.15.33:0/3286041844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec158e80 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0febe00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0fd802ac30 tx=0x7f0fd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8006880 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd8005e70 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd803d670 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.527+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec159160 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.528+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec1495c0 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.529+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec158a40 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.529+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fd803d7d0 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.530+0000 7f0fe8c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 0x7f0fcc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.530+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0fd80a9e20 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.531+0000 7f0ff1200640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 0x7f0fcc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.532+0000 7f0ff1200640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 0x7f0fcc06d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.535+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0fec158a40 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.713+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0fec158a40 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.717+0000 7f0fe8c00640 1 -- 172.21.15.33:0/3286041844 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0fec158a40 con 0x7f0fec0a8ce0 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 msgr2=0x7f0fcc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 0x7f0fcc06d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0009040 comp rx=0 tx=0).stop 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 msgr2=0x7f0fec159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0fd802ac30 tx=0x7f0fd8004730 comp rx=0 tx=0).stop 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 shutdown_connections 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f0fcc06ac30 0x7f0fcc06d0f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.719+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fec153c70 0x7f0fec1ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.720+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fec0a8ce0 0x7f0fec159680 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.720+0000 7f0ff3c00640 1 --2- 172.21.15.33:0/3286041844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0fd40047c0 0x7f0fec159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.720+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 >> 172.21.15.33:0/3286041844 conn(0x7f0fec0b0580 msgr2=0x7f0fec071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.720+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 shutdown_connections 2024-09-13T19:00:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:22.720+0000 7f0ff3c00640 1 -- 172.21.15.33:0/3286041844 wait complete. 2024-09-13T19:00:22.740 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T19:00:22.740 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:22.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:22.929 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T19:00:22.930 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:22.930 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:22.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:22.965 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:22.965 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:23.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:23.004 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:23.005 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:23.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:23.042 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:23.042 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:23.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:23.081 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T19:00:23.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.236+0000 7f2c67200640 1 Processor -- start 2024-09-13T19:00:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.236+0000 7f2c67200640 1 -- start start 2024-09-13T19:00:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c6815a5c0 0x7f2c680b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c680cbac0 0x7f2c680b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c680afe10 0x7f2c6806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680cce20 con 0x7f2c6815a5c0 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680cbfc0 con 0x7f2c680afe10 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c67200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680707a0 con 0x7f2c680cbac0 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c65e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c6815a5c0 0x7f2c680b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c65e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c6815a5c0 0x7f2c680b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39952/0 (socket says 172.21.15.33:39952) 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c65e00640 1 -- 172.21.15.33:0/429985858 learned_addr learned my addr 172.21.15.33:0/429985858 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c5fe00640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c680cbac0 0x7f2c680b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.237+0000 7f2c66800640 1 --2- 172.21.15.33:0/429985858 >> v2:172.21.15.103:3300/0 conn(0x7f2c680afe10 0x7f2c6806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.238+0000 7f2c65e00640 1 -- 172.21.15.33:0/429985858 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c680cbac0 msgr2=0x7f2c680b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.238+0000 7f2c65e00640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c680cbac0 0x7f2c680b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.238+0000 7f2c65e00640 1 -- 172.21.15.33:0/429985858 >> v2:172.21.15.103:3300/0 conn(0x7f2c680afe10 msgr2=0x7f2c6806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.238+0000 7f2c65e00640 1 --2- 172.21.15.33:0/429985858 >> v2:172.21.15.103:3300/0 conn(0x7f2c680afe10 0x7f2c6806f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.238+0000 7f2c65e00640 1 -- 172.21.15.33:0/429985858 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68070a80 con 0x7f2c6815a5c0 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c65e00640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c6815a5c0 0x7f2c680b39b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c68073c80 tx=0x7f2c5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9754ea3f326c9ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c65400640 1 -- 172.21.15.33:0/429985858 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58032440 con 0x7f2c6815a5c0 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c65400640 1 -- 172.21.15.33:0/429985858 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580325a0 con 0x7f2c6815a5c0 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c65400640 1 -- 172.21.15.33:0/429985858 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58032930 con 0x7f2c6815a5c0 2024-09-13T19:00:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c67200640 1 -- 172.21.15.33:0/429985858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c6815a5c0 msgr2=0x7f2c680b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.239+0000 7f2c67200640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c6815a5c0 0x7f2c680b39b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c68073c80 tx=0x7f2c5802a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 -- 172.21.15.33:0/429985858 shutdown_connections 2024-09-13T19:00:23.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c680cbac0 0x7f2c680b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 --2- 172.21.15.33:0/429985858 >> v2:172.21.15.103:3300/0 conn(0x7f2c680afe10 0x7f2c6806f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 --2- 172.21.15.33:0/429985858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c6815a5c0 0x7f2c680b39b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 -- 172.21.15.33:0/429985858 >> 172.21.15.33:0/429985858 conn(0x7f2c680ae310 msgr2=0x7f2c680ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 -- 172.21.15.33:0/429985858 shutdown_connections 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.240+0000 7f2c67200640 1 -- 172.21.15.33:0/429985858 wait complete. 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.241+0000 7f2c67200640 1 Processor -- start 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.241+0000 7f2c67200640 1 -- start start 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 0x7f2c68150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 0x7f2c6813ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68150d50 con 0x7f2c680afe10 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68151030 con 0x7f2c680cbac0 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c67200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68151310 con 0x7f2c6815a5c0 2024-09-13T19:00:23.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.242+0000 7f2c65e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39962/0 (socket says 172.21.15.33:39962) 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 -- 172.21.15.33:0/2089394026 learned_addr learned my addr 172.21.15.33:0/2089394026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c66800640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 0x7f2c6813ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 -- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 msgr2=0x7f2c6813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c5fe00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 0x7f2c68150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 0x7f2c6813ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 -- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 msgr2=0x7f2c68150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 0x7f2c68150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 -- 172.21.15.33:0/2089394026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580094d0 con 0x7f2c680afe10 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c66800640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 0x7f2c6813ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c5fe00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 0x7f2c68150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.243+0000 7f2c65e00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2c5802a220 tx=0x7f2c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.244+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5803d830 con 0x7f2c680afe10 2024-09-13T19:00:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.244+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5803d990 con 0x7f2c680afe10 2024-09-13T19:00:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.244+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5803dd40 con 0x7f2c680afe10 2024-09-13T19:00:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.244+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c681515f0 con 0x7f2c680afe10 2024-09-13T19:00:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.244+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c68150990 con 0x7f2c680afe10 2024-09-13T19:00:23.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.245+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c68150b20 con 0x7f2c680afe10 2024-09-13T19:00:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.246+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c58039040 con 0x7f2c680afe10 2024-09-13T19:00:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.246+0000 7f2c5e000640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 0x7f2c4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.246+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c580a9a70 con 0x7f2c680afe10 2024-09-13T19:00:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.247+0000 7f2c5fe00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 0x7f2c4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.247+0000 7f2c5fe00640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 0x7f2c4406d0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2c680caa30 tx=0x7f2c50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.251+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2c58074ef0 con 0x7f2c680afe10 2024-09-13T19:00:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.466+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c68067360 con 0x7f2c680afe10 2024-09-13T19:00:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.467+0000 7f2c5e000640 1 -- 172.21.15.33:0/2089394026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f2c58037de0 con 0x7f2c680afe10 2024-09-13T19:00:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2736402754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2736402754},{"type":"v1","addr":"172.21.15.103:6836","nonce":2736402754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/766268308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":766268308},{"type":"v1","addr":"172.21.15.103:6837","nonce":766268308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6121,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4155192944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4155192944},{"type":"v1","addr":"172.21.15.33:6835","nonce":4155192944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6642,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/2862804899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":2862804899},{"type":"v1","addr":"172.21.15.33:6833","nonce":2862804899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2024-09-13T19:00:23.470 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-09-13T19:00:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 msgr2=0x7f2c4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 0x7f2c4406d0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2c680caa30 tx=0x7f2c50008040 comp rx=0 tx=0).stop 2024-09-13T19:00:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 msgr2=0x7f2c68151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2c5802a220 tx=0x7f2c580046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 shutdown_connections 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2c4406ac30 0x7f2c4406d0f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c6815a5c0 0x7f2c6813ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c680cbac0 0x7f2c68150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 --2- 172.21.15.33:0/2089394026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c680afe10 0x7f2c68151df0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 >> 172.21.15.33:0/2089394026 conn(0x7f2c680ae310 msgr2=0x7f2c6806b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 shutdown_connections 2024-09-13T19:00:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.469+0000 7f2c67200640 1 -- 172.21.15.33:0/2089394026 wait complete. 2024-09-13T19:00:23.489 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T19:00:23.489 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T19:00:23.489 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T19:00:23.489 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:23.489 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T19:00:23.489 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T19:00:23.490 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T19:00:23.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:23.490 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T19:00:23.490 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T19:00:23.490 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T19:00:23.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:23.490 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T19:00:23.491 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T19:00:23.491 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T19:00:23.491 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:23.506 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T19:00:23.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T19:00:23.507 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T19:00:23.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T19:00:23.509 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T19:00:23.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T19:00:23.510 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T19:00:23.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T19:00:23.551 INFO:tasks.ceph.mds.b:Started 2024-09-13T19:00:23.551 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:23.553 INFO:tasks.ceph.mds.d:Started 2024-09-13T19:00:23.553 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:23.554 INFO:tasks.ceph.mds.a:Started 2024-09-13T19:00:23.554 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:23.555 INFO:tasks.ceph.mds.c:Started 2024-09-13T19:00:23.556 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:23.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T19:00:23.679 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T19:00:23.679 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T19:00:23.685 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T19:00:23.686 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T19:00:23.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.721+0000 7fcaff200640 1 Processor -- start 2024-09-13T19:00:23.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.722+0000 7fcaff200640 1 -- start start 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaff200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb0015c810 0x7fcb000b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaff200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb000cd3f0 0x7fcb000d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaff200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb000d0260 con 0x7fcb000b4650 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaff200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb000ce160 con 0x7fcb000cd3f0 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaff200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000b4a70 con 0x7fcb0015c810 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaf7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcb000b4650 0x7fcb000ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34068/0 (socket says 172.21.15.33:34068) 2024-09-13T19:00:23.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcaf7e00640 1 -- 172.21.15.33:0/2785981705 learned_addr learned my addr 172.21.15.33:0/2785981705 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:23.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafe800640 1 --2- 172.21.15.33:0/2785981705 >> v2:172.21.15.33:3300/0 conn(0x7fcb000cd3f0 0x7fcb000d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafde00640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb0015c810 0x7fcb000b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafe800640 1 -- 172.21.15.33:0/2785981705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb0015c810 msgr2=0x7fcb000b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:23.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafe800640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb0015c810 0x7fcb000b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafe800640 1 -- 172.21.15.33:0/2785981705 >> v1:172.21.15.33:6789/0 conn(0x7fcb000b4650 legacy=0x7fcb000ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafe800640 1 -- 172.21.15.33:0/2785981705 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb000b1c50 con 0x7fcb000cd3f0 2024-09-13T19:00:23.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.723+0000 7fcafd400640 1 -- 172.21.15.33:0/2785981705 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556310990 0 0) 0x7fcb000d0260 con 0x7fcb000b4650 2024-09-13T19:00:23.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.724+0000 7fcafe800640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb000d09d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd87b308b9db31cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcafd400640 1 -- 172.21.15.33:0/2785981705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8007740 con 0x7fcb000cd3f0 2024-09-13T19:00:23.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcafd400640 1 -- 172.21.15.33:0/2785981705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf802d050 con 0x7fcb000cd3f0 2024-09-13T19:00:23.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcafd400640 1 -- 172.21.15.33:0/2785981705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8007ac0 con 0x7fcb000cd3f0 2024-09-13T19:00:23.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 -- 172.21.15.33:0/2785981705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 msgr2=0x7fcb000d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb000d09d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf802a660 comp rx=0 tx=0).stop 2024-09-13T19:00:23.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 -- 172.21.15.33:0/2785981705 shutdown_connections 2024-09-13T19:00:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb000d09d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/2785981705 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb0015c810 0x7fcb000b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 -- 172.21.15.33:0/2785981705 >> 172.21.15.33:0/2785981705 conn(0x7fcb0006c050 msgr2=0x7fcb0006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 -- 172.21.15.33:0/2785981705 shutdown_connections 2024-09-13T19:00:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.725+0000 7fcaff200640 1 -- 172.21.15.33:0/2785981705 wait complete. 2024-09-13T19:00:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.727+0000 7fcaff200640 1 Processor -- start 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.727+0000 7fcaff200640 1 -- start start 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb000b4650 0x7fcb001f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb0015c810 0x7fcb0015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00147550 con 0x7fcb000cd3f0 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0015aae0 con 0x7fcb0015c810 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaff200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0015adc0 con 0x7fcb000b4650 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaf7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaf7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39992/0 (socket says 172.21.15.33:39992) 2024-09-13T19:00:23.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcaf7e00640 1 -- 172.21.15.33:0/1125999707 learned_addr learned my addr 172.21.15.33:0/1125999707 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcafde00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb000b4650 0x7fcb001f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.728+0000 7fcafe800640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb0015c810 0x7fcb0015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 -- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb000b4650 msgr2=0x7fcb001f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb000b4650 0x7fcb001f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 -- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb0015c810 msgr2=0x7fcb0015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb0015c810 0x7fcb0015d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 -- 172.21.15.33:0/1125999707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8009a70 con 0x7fcb000cd3f0 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf7e00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c4b0 tx=0x7fcae800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80074e0 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8007660 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8004a20 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0015b0a0 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.729+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001f32b0 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.730+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0015ccd0 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.731+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcae8004b80 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.732+0000 7fcaf6000640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 0x7fcadc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.732+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcae8088120 con 0x7fcb000cd3f0 2024-09-13T19:00:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.733+0000 7fcafde00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 0x7fcadc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.733+0000 7fcafde00640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 0x7fcadc06d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009aa0 tx=0x7fcaf0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.736+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcae8053760 con 0x7fcb000cd3f0 2024-09-13T19:00:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:23.928+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcb000b5030 con 0x7fcb000cd3f0 2024-09-13T19:00:24.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.722+0000 7fcaf6000640 1 -- 172.21.15.33:0/1125999707 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcae8056d80 con 0x7fcb000cd3f0 2024-09-13T19:00:24.726 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T19:00:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 msgr2=0x7fcadc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 0x7fcadc06d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009aa0 tx=0x7fcaf0009190 comp rx=0 tx=0).stop 2024-09-13T19:00:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 msgr2=0x7fcb0015cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c4b0 tx=0x7fcae800c970 comp rx=0 tx=0).stop 2024-09-13T19:00:24.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 shutdown_connections 2024-09-13T19:00:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcadc06ac00 0x7fcadc06d0c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb0015c810 0x7fcb0015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb000cd3f0 0x7fcb0015cee0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 --2- 172.21.15.33:0/1125999707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb000b4650 0x7fcb001f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 >> 172.21.15.33:0/1125999707 conn(0x7fcb0006c050 msgr2=0x7fcb000b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 shutdown_connections 2024-09-13T19:00:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.725+0000 7fcaff200640 1 -- 172.21.15.33:0/1125999707 wait complete. 2024-09-13T19:00:24.747 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T19:00:24.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.903+0000 7f6a3ba00640 1 Processor -- start 2024-09-13T19:00:24.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.903+0000 7f6a3ba00640 1 -- start start 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b1e40 0x7f6a34159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6a340b2220 0x7f6a340b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a340b2660 0x7f6a340b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3415a430 con 0x7f6a340b2660 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a341598b0 con 0x7f6a340b2220 2024-09-13T19:00:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34159b90 con 0x7f6a340b1e40 2024-09-13T19:00:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a340b2660 0x7f6a340b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a340b2660 0x7f6a340b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40004/0 (socket says 172.21.15.33:40004) 2024-09-13T19:00:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 -- 172.21.15.33:0/1920209782 learned_addr learned my addr 172.21.15.33:0/1920209782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a33e00640 1 --2- 172.21.15.33:0/1920209782 >> v2:172.21.15.103:3300/0 conn(0x7f6a340b2220 0x7f6a340b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39000640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b1e40 0x7f6a34159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 -- 172.21.15.33:0/1920209782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b1e40 msgr2=0x7f6a34159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b1e40 0x7f6a34159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 -- 172.21.15.33:0/1920209782 >> v2:172.21.15.103:3300/0 conn(0x7f6a340b2220 msgr2=0x7f6a340b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 --2- 172.21.15.33:0/1920209782 >> v2:172.21.15.103:3300/0 conn(0x7f6a340b2220 0x7f6a340b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.905+0000 7f6a39a00640 1 -- 172.21.15.33:0/1920209782 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34159e70 con 0x7f6a340b2660 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.906+0000 7f6a39a00640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b2660 0x7f6a340b3100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b15d0 tx=0x7f6a2c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10a62f0dda45d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a33400640 1 -- 172.21.15.33:0/1920209782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c031600 con 0x7f6a340b2660 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a33400640 1 -- 172.21.15.33:0/1920209782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c02d050 con 0x7f6a340b2660 2024-09-13T19:00:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a33400640 1 -- 172.21.15.33:0/1920209782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c031980 con 0x7f6a340b2660 2024-09-13T19:00:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 -- 172.21.15.33:0/1920209782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b2660 msgr2=0x7f6a340b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b2660 0x7f6a340b3100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b15d0 tx=0x7f6a2c02a610 comp rx=0 tx=0).stop 2024-09-13T19:00:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 -- 172.21.15.33:0/1920209782 shutdown_connections 2024-09-13T19:00:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b2660 0x7f6a340b3100 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/1920209782 >> v2:172.21.15.103:3300/0 conn(0x7f6a340b2220 0x7f6a340b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/1920209782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b1e40 0x7f6a34159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 -- 172.21.15.33:0/1920209782 >> 172.21.15.33:0/1920209782 conn(0x7f6a340b0510 msgr2=0x7f6a340b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 -- 172.21.15.33:0/1920209782 shutdown_connections 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.907+0000 7f6a3ba00640 1 -- 172.21.15.33:0/1920209782 wait complete. 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.909+0000 7f6a3ba00640 1 Processor -- start 2024-09-13T19:00:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.909+0000 7f6a3ba00640 1 -- start start 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a340b2220 0x7f6a341e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 0x7f6a340acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341e7cd0 con 0x7f6a340b1e40 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341e70c0 con 0x7f6a340b2220 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a3ba00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341e73a0 con 0x7f6a340b2660 2024-09-13T19:00:24.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a39000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a39000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40016/0 (socket says 172.21.15.33:40016) 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.910+0000 7f6a39000640 1 -- 172.21.15.33:0/3170829577 learned_addr learned my addr 172.21.15.33:0/3170829577 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a33e00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a340b2220 0x7f6a341e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39a00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 0x7f6a340acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 -- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 msgr2=0x7f6a340acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 0x7f6a340acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 -- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a340b2220 msgr2=0x7f6a341e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a340b2220 0x7f6a341e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 -- 172.21.15.33:0/3170829577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009b30 con 0x7f6a340b1e40 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39a00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 0x7f6a340acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:24.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a39000640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800e9b0 tx=0x7f6a2800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28009670 con 0x7f6a340b1e40 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800c9a0 con 0x7f6a340b1e40 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800cd50 con 0x7f6a340b1e40 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.911+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a341e7680 con 0x7f6a340b1e40 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.912+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341e6d40 con 0x7f6a340b1e40 2024-09-13T19:00:24.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.913+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3406bdf0 con 0x7f6a340b1e40 2024-09-13T19:00:24.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.913+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a28013470 con 0x7f6a340b1e40 2024-09-13T19:00:24.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.914+0000 7f6a30c00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 0x7f6a1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:24.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.914+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a28089290 con 0x7f6a340b1e40 2024-09-13T19:00:24.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.915+0000 7f6a33e00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 0x7f6a1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:24.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.915+0000 7f6a33e00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 0x7f6a1406d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b36c0 tx=0x7f6a2000a2a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:24.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:24.918+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a280547d0 con 0x7f6a340b1e40 2024-09-13T19:00:25.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.165+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6a340afa40 con 0x7f6a340b1e40 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.166+0000 7f6a30c00640 1 -- 172.21.15.33:0/3170829577 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6a28057df0 con 0x7f6a340b1e40 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.169 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:00:25.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:00:25.171 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T19:00:25.173 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T19:00:25.174 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.174 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.174 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.175 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.176 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T19:00:25.177 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T19:00:25.179 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:00:25.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:00:25.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T19:00:25.184 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:00:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 msgr2=0x7f6a1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 0x7f6a1406d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b36c0 tx=0x7f6a2000a2a0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 msgr2=0x7f6a341e54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800e9b0 tx=0x7f6a2800ee70 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 shutdown_connections 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6a1406ac00 0x7f6a1406d0c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a340b2660 0x7f6a340acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a340b2220 0x7f6a341e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 --2- 172.21.15.33:0/3170829577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a340b1e40 0x7f6a341e54d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 >> 172.21.15.33:0/3170829577 conn(0x7f6a340b0510 msgr2=0x7f6a34158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 shutdown_connections 2024-09-13T19:00:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.168+0000 7f6a3ba00640 1 -- 172.21.15.33:0/3170829577 wait complete. 2024-09-13T19:00:25.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:25.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.341+0000 7f0023200640 1 Processor -- start 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.341+0000 7f0023200640 1 -- start start 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0023200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f001c071560 0x7f001c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0023200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f001c06f4b0 0x7f001c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0023200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c0cd850 con 0x7f001c159480 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0023200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c0cd570 con 0x7f001c06f4b0 2024-09-13T19:00:25.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0023200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c0b1740 con 0x7f001c071560 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0022800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f001c06f4b0 0x7f001c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0022800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f001c06f4b0 0x7f001c0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40022/0 (socket says 172.21.15.33:40022) 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0022800640 1 -- 172.21.15.33:0/3559813848 learned_addr learned my addr 172.21.15.33:0/3559813848 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.342+0000 7f0021400640 1 --2- 172.21.15.33:0/3559813848 >> v2:172.21.15.103:3300/0 conn(0x7f001c071560 0x7f001c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.343+0000 7f0022800640 1 -- 172.21.15.33:0/3559813848 >> v2:172.21.15.103:3300/0 conn(0x7f001c071560 msgr2=0x7f001c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:25.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.343+0000 7f0022800640 1 --2- 172.21.15.33:0/3559813848 >> v2:172.21.15.103:3300/0 conn(0x7f001c071560 0x7f001c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.343+0000 7f0022800640 1 -- 172.21.15.33:0/3559813848 >> v1:172.21.15.33:6789/0 conn(0x7f001c159480 legacy=0x7f001c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.343+0000 7f0022800640 1 -- 172.21.15.33:0/3559813848 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0b1a20 con 0x7f001c06f4b0 2024-09-13T19:00:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.343+0000 7f0020a00640 1 -- 172.21.15.33:0/3559813848 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042275312 0 0) 0x7f001c0cd850 con 0x7f001c159480 2024-09-13T19:00:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.344+0000 7f0022800640 1 --2- 172.21.15.33:0/3559813848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c06f4b0 0x7f001c0b2220 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f001c06e030 tx=0x7f001802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae95c7d11ca0692 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.344+0000 7f0020a00640 1 -- 172.21.15.33:0/3559813848 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800b2d0 con 0x7f001c06f4b0 2024-09-13T19:00:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.344+0000 7f0020a00640 1 -- 172.21.15.33:0/3559813848 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001802f070 con 0x7f001c06f4b0 2024-09-13T19:00:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.344+0000 7f0020a00640 1 -- 172.21.15.33:0/3559813848 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018009820 con 0x7f001c06f4b0 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 -- 172.21.15.33:0/3559813848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c06f4b0 msgr2=0x7f001c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 --2- 172.21.15.33:0/3559813848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c06f4b0 0x7f001c0b2220 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f001c06e030 tx=0x7f001802c8b0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 -- 172.21.15.33:0/3559813848 shutdown_connections 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 --2- 172.21.15.33:0/3559813848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c06f4b0 0x7f001c0b2220 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 --2- 172.21.15.33:0/3559813848 >> v2:172.21.15.103:3300/0 conn(0x7f001c071560 0x7f001c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 -- 172.21.15.33:0/3559813848 >> 172.21.15.33:0/3559813848 conn(0x7f001c0ae310 msgr2=0x7f001c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:25.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 -- 172.21.15.33:0/3559813848 shutdown_connections 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.345+0000 7f0023200640 1 -- 172.21.15.33:0/3559813848 wait complete. 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.346+0000 7f0023200640 1 Processor -- start 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.347+0000 7f0023200640 1 -- start start 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.347+0000 7f0023200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f001c06f4b0 0x7f001c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.347+0000 7f0023200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.347+0000 7f0023200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f001c159480 0x7f001c1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0023200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0a9d80 con 0x7f001c071560 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0023200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0c3740 con 0x7f001c159480 2024-09-13T19:00:25.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0023200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c154770 con 0x7f001c06f4b0 2024-09-13T19:00:25.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40026/0 (socket says 172.21.15.33:40026) 2024-09-13T19:00:25.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 -- 172.21.15.33:0/656196011 learned_addr learned my addr 172.21.15.33:0/656196011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:25.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0022800640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f001c159480 0x7f001c1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021e00640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f001c06f4b0 0x7f001c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 -- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f001c06f4b0 msgr2=0x7f001c0ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f001c06f4b0 0x7f001c0ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 -- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f001c159480 msgr2=0x7f001c1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f001c159480 0x7f001c1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 -- 172.21.15.33:0/656196011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001800bd40 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.348+0000 7f0021400640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e980 tx=0x7f000c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.349+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c009670 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.349+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c00ca00 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.349+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c154a50 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.349+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00cd90 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.349+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c0a99a0 con 0x7f001c071560 2024-09-13T19:00:25.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.350+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c067360 con 0x7f001c071560 2024-09-13T19:00:25.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.351+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f000c013470 con 0x7f001c071560 2024-09-13T19:00:25.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.352+0000 7f0016000640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.352+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f000c089260 con 0x7f001c071560 2024-09-13T19:00:25.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.352+0000 7f0021e00640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.353+0000 7f0021e00640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 0x7f000006d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0010007fd0 tx=0x7f0010009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.356+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f000c054780 con 0x7f001c071560 2024-09-13T19:00:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.540+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f001c0b2220 con 0x7f001c071560 2024-09-13T19:00:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.541+0000 7f0016000640 1 -- 172.21.15.33:0/656196011 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12858 (secure 0 0 0) 0x7f000c087e60 con 0x7f001c071560 2024-09-13T19:00:25.544 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:25.544 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:24.718623+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 msgr2=0x7f000006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 0x7f000006d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0010007fd0 tx=0x7f0010009040 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 msgr2=0x7f001c151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e980 tx=0x7f000c00ee40 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 shutdown_connections 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f001c159480 0x7f001c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c071560 0x7f001c151770 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 --2- 172.21.15.33:0/656196011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f001c06f4b0 0x7f001c0ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 >> 172.21.15.33:0/656196011 conn(0x7f001c0ae310 msgr2=0x7f001c0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 shutdown_connections 2024-09-13T19:00:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.543+0000 7f0023200640 1 -- 172.21.15.33:0/656196011 wait complete. 2024-09-13T19:00:25.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:25.564 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:25.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.718+0000 7efe0d000640 1 Processor -- start 2024-09-13T19:00:25.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.718+0000 7efe0d000640 1 -- start start 2024-09-13T19:00:25.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe0d000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe08156f60 0x7efe0815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe0d000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efe080cafa0 0x7efe08070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe0d000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0806f5f0 con 0x7efe080714c0 2024-09-13T19:00:25.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe0d000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0815aa30 con 0x7efe08156f60 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe0d000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe08071930 con 0x7efe080cafa0 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe08156f60 0x7efe0815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe08156f60 0x7efe0815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40042/0 (socket says 172.21.15.33:40042) 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 -- 172.21.15.33:0/655393531 learned_addr learned my addr 172.21.15.33:0/655393531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efdfd400640 1 --2- 172.21.15.33:0/655393531 >> v2:172.21.15.103:3300/0 conn(0x7efe080cafa0 0x7efe08070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 -- 172.21.15.33:0/655393531 >> v2:172.21.15.103:3300/0 conn(0x7efe080cafa0 msgr2=0x7efe08070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:25.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 --2- 172.21.15.33:0/655393531 >> v2:172.21.15.103:3300/0 conn(0x7efe080cafa0 0x7efe08070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 -- 172.21.15.33:0/655393531 >> v1:172.21.15.33:6789/0 conn(0x7efe080714c0 legacy=0x7efe0815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.720+0000 7efe05e00640 1 -- 172.21.15.33:0/655393531 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08070450 con 0x7efe08156f60 2024-09-13T19:00:25.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.721+0000 7efe05e00640 1 --2- 172.21.15.33:0/655393531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe08156f60 0x7efe0815a4f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efe080b12e0 tx=0x7efdf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8891e647a3057ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.722+0000 7efe05400640 1 -- 172.21.15.33:0/655393531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8032440 con 0x7efe08156f60 2024-09-13T19:00:25.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.722+0000 7efe05400640 1 -- 172.21.15.33:0/655393531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80325a0 con 0x7efe08156f60 2024-09-13T19:00:25.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.722+0000 7efe05400640 1 -- 172.21.15.33:0/655393531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8032930 con 0x7efe08156f60 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 -- 172.21.15.33:0/655393531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe08156f60 msgr2=0x7efe0815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 --2- 172.21.15.33:0/655393531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe08156f60 0x7efe0815a4f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efe080b12e0 tx=0x7efdf802a270 comp rx=0 tx=0).stop 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 -- 172.21.15.33:0/655393531 shutdown_connections 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 --2- 172.21.15.33:0/655393531 >> v2:172.21.15.103:3300/0 conn(0x7efe080cafa0 0x7efe08070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 --2- 172.21.15.33:0/655393531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe08156f60 0x7efe0815a4f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 -- 172.21.15.33:0/655393531 >> 172.21.15.33:0/655393531 conn(0x7efe080b0580 msgr2=0x7efe080b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 -- 172.21.15.33:0/655393531 shutdown_connections 2024-09-13T19:00:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.723+0000 7efe0d000640 1 -- 172.21.15.33:0/655393531 wait complete. 2024-09-13T19:00:25.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.725+0000 7efe0d000640 1 Processor -- start 2024-09-13T19:00:25.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.725+0000 7efe0d000640 1 -- start start 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efe080cafa0 0x7efe080c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe08156f60 0x7efe080c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c9340 con 0x7efe080714c0 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe08144650 con 0x7efe08156f60 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe0d000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c86c0 con 0x7efe080cafa0 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40046/0 (socket says 172.21.15.33:40046) 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 -- 172.21.15.33:0/1384235437 learned_addr learned my addr 172.21.15.33:0/1384235437 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe06800640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe08156f60 0x7efe080c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efdfd400640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efe080cafa0 0x7efe080c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 -- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efe080cafa0 msgr2=0x7efe080c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efe080cafa0 0x7efe080c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 -- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe08156f60 msgr2=0x7efe080c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.726+0000 7efe05e00640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe08156f60 0x7efe080c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efe05e00640 1 -- 172.21.15.33:0/1384235437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80094d0 con 0x7efe080714c0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efe05e00640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efdf802a2b0 tx=0x7efdf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8032440 con 0x7efe080714c0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8030980 con 0x7efe080714c0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8030d10 con 0x7efe080714c0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080c89a0 con 0x7efe080714c0 2024-09-13T19:00:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.727+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe080c8f60 con 0x7efe080714c0 2024-09-13T19:00:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.728+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080c95b0 con 0x7efe080714c0 2024-09-13T19:00:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.729+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdf8039040 con 0x7efe080714c0 2024-09-13T19:00:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.730+0000 7efdfea00640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 0x7efde406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.730+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdf80a9990 con 0x7efe080714c0 2024-09-13T19:00:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.730+0000 7efdfd400640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 0x7efde406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.731+0000 7efdfd400640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 0x7efde406d0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe081f67a0 tx=0x7efdf000b750 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.734+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efdf8074ec0 con 0x7efe080714c0 2024-09-13T19:00:25.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.910+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe0806b7e0 con 0x7efe080714c0 2024-09-13T19:00:25.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.910+0000 7efdfea00640 1 -- 172.21.15.33:0/1384235437 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdf80410a0 con 0x7efe080714c0 2024-09-13T19:00:25.913 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 msgr2=0x7efde406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 0x7efde406d0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe081f67a0 tx=0x7efdf000b750 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 msgr2=0x7efe08144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efdf802a2b0 tx=0x7efdf80046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 shutdown_connections 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efde406ac00 0x7efde406d0c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe08156f60 0x7efe080c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efe080cafa0 0x7efe080c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 --2- 172.21.15.33:0/1384235437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe080714c0 0x7efe08144110 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 >> 172.21.15.33:0/1384235437 conn(0x7efe080b0580 msgr2=0x7efe080b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 shutdown_connections 2024-09-13T19:00:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:25.912+0000 7efe0d000640 1 -- 172.21.15.33:0/1384235437 wait complete. 2024-09-13T19:00:25.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T19:00:26.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.083+0000 7f3425c00640 1 Processor -- start 2024-09-13T19:00:26.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.084+0000 7f3425c00640 1 -- start start 2024-09-13T19:00:26.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 0x7f34200adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f34200b2840 0x7f34200b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34200ce270 con 0x7f34200b31c0 2024-09-13T19:00:26.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3420159810 con 0x7f34200b2840 2024-09-13T19:00:26.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200b3670 con 0x7f3420159430 2024-09-13T19:00:26.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3417e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f34200b2840 0x7f34200b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425200640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f34200b31c0 0x7f342015cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:60306/0 (socket says 172.21.15.33:60306) 2024-09-13T19:00:26.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f341fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 0x7f34200adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.085+0000 7f3425200640 1 -- 172.21.15.33:0/2508860905 learned_addr learned my addr 172.21.15.33:0/2508860905 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f341f400640 1 -- 172.21.15.33:0/2508860905 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520774184 0 0) 0x7f34200ce270 con 0x7f34200b31c0 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f341f400640 1 -- 172.21.15.33:0/2508860905 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3404003520 con 0x7f34200b31c0 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f3417e00640 1 -- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 msgr2=0x7f34200adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f3417e00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 0x7f34200adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f3417e00640 1 -- 172.21.15.33:0/2508860905 >> v1:172.21.15.103:6789/0 conn(0x7f34200b31c0 legacy=0x7f342015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f3417e00640 1 -- 172.21.15.33:0/2508860905 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342006c5c0 con 0x7f34200b2840 2024-09-13T19:00:26.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.086+0000 7f341fe00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 0x7f34200adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:26.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.087+0000 7f3417e00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34200b2840 0x7f34200b2c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f34080097a0 tx=0x7f340802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac94bb8bff2ff63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.087+0000 7f341f400640 1 -- 172.21.15.33:0/2508860905 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408032440 con 0x7f34200b2840 2024-09-13T19:00:26.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.087+0000 7f341f400640 1 -- 172.21.15.33:0/2508860905 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080325a0 con 0x7f34200b2840 2024-09-13T19:00:26.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.087+0000 7f341f400640 1 -- 172.21.15.33:0/2508860905 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408032930 con 0x7f34200b2840 2024-09-13T19:00:26.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 -- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34200b2840 msgr2=0x7f34200b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34200b2840 0x7f34200b2c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f34080097a0 tx=0x7f340802a180 comp rx=0 tx=0).stop 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 -- 172.21.15.33:0/2508860905 shutdown_connections 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34200b2840 0x7f34200b2c80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 --2- 172.21.15.33:0/2508860905 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3420159430 0x7f34200adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 -- 172.21.15.33:0/2508860905 >> 172.21.15.33:0/2508860905 conn(0x7f34200b0330 msgr2=0x7f34200b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 -- 172.21.15.33:0/2508860905 shutdown_connections 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.088+0000 7f3425c00640 1 -- 172.21.15.33:0/2508860905 wait complete. 2024-09-13T19:00:26.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.090+0000 7f3425c00640 1 Processor -- start 2024-09-13T19:00:26.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.090+0000 7f3425c00640 1 -- start start 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34200b2840 0x7f342014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 0x7f342015d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342015c040 con 0x7f34200b31c0 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342015c320 con 0x7f3420159430 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342015c600 con 0x7f34200b2840 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40048/0 (socket says 172.21.15.33:40048) 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 -- 172.21.15.33:0/4066824135 learned_addr learned my addr 172.21.15.33:0/4066824135 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3425200640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 0x7f342015d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f341fe00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34200b2840 0x7f342014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 -- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34200b2840 msgr2=0x7f342014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34200b2840 0x7f342014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 -- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 msgr2=0x7f342015d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.091+0000 7f3417e00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 0x7f342015d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f3417e00640 1 -- 172.21.15.33:0/4066824135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410009400 con 0x7f34200b31c0 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f3425200640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 0x7f342015d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:26.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f3417e00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f34080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340803b8d0 con 0x7f34200b31c0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340803ba50 con 0x7f34200b31c0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3408009400 con 0x7f34200b31c0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340803be00 con 0x7f34200b31c0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.092+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342015cbc0 con 0x7f34200b31c0 2024-09-13T19:00:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.093+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342015cde0 con 0x7f34200b31c0 2024-09-13T19:00:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.094+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3408039040 con 0x7f34200b31c0 2024-09-13T19:00:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.095+0000 7f341cc00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 0x7f33fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.095+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34080a9700 con 0x7f34200b31c0 2024-09-13T19:00:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.095+0000 7f341fe00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 0x7f33fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.096+0000 7f341fe00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 0x7f33fc06d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f342014dd40 tx=0x7f3410009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.099+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3408074c40 con 0x7f34200b31c0 2024-09-13T19:00:26.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.281+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f34200b2c80 con 0x7f34200b31c0 2024-09-13T19:00:26.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.282+0000 7f341cc00640 1 -- 172.21.15.33:0/4066824135 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f340804c090 con 0x7f34200b31c0 2024-09-13T19:00:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:00:26.286 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T19:00:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 msgr2=0x7f33fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 0x7f33fc06d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f342014dd40 tx=0x7f3410009190 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 msgr2=0x7f342015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f34080046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 shutdown_connections 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33fc06ac00 0x7f33fc06d0c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3420159430 0x7f342015d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34200b31c0 0x7f342015b660 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 --2- 172.21.15.33:0/4066824135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f34200b2840 0x7f342014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 >> 172.21.15.33:0/4066824135 conn(0x7f34200b0330 msgr2=0x7f342006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 shutdown_connections 2024-09-13T19:00:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.284+0000 7f3425c00640 1 -- 172.21.15.33:0/4066824135 wait complete. 2024-09-13T19:00:26.303 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T19:00:26.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T19:00:26.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.460+0000 7f62efc00640 1 Processor -- start 2024-09-13T19:00:26.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.460+0000 7f62efc00640 1 -- start start 2024-09-13T19:00:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.461+0000 7f62efc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.461+0000 7f62efc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 0x7f62e80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.461+0000 7f62efc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e806b3e0 con 0x7f62e80acdb0 2024-09-13T19:00:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.461+0000 7f62efc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80ad220 con 0x7f62e80b2d60 2024-09-13T19:00:26.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.461+0000 7f62efc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80b3370 con 0x7f62e81461a0 2024-09-13T19:00:26.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62e7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 0x7f62e80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62ed200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62e7e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 0x7f62e80ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:36108/0 (socket says 172.21.15.33:36108) 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62e7e00640 1 -- 172.21.15.33:0/3842681859 learned_addr learned my addr 172.21.15.33:0/3842681859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62edc00640 1 --1- 172.21.15.33:0/3842681859 >> v1:172.21.15.103:6789/0 conn(0x7f62e80acdb0 0x7f62e8160250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:60322/0 (socket says 172.21.15.33:60322) 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62ed200640 1 -- 172.21.15.33:0/3842681859 >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 msgr2=0x7f62e80ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62ed200640 1 --2- 172.21.15.33:0/3842681859 >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 0x7f62e80ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62ed200640 1 -- 172.21.15.33:0/3842681859 >> v1:172.21.15.103:6789/0 conn(0x7f62e80acdb0 legacy=0x7f62e8160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.462+0000 7f62ed200640 1 -- 172.21.15.33:0/3842681859 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80b3650 con 0x7f62e81461a0 2024-09-13T19:00:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.463+0000 7f62ed200640 1 --2- 172.21.15.33:0/3842681859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80b2820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097a0 tx=0x7f62dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84300515c87dcbd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62e7400640 1 -- 172.21.15.33:0/3842681859 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc032440 con 0x7f62e81461a0 2024-09-13T19:00:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62e7400640 1 -- 172.21.15.33:0/3842681859 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0325a0 con 0x7f62e81461a0 2024-09-13T19:00:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62e7400640 1 -- 172.21.15.33:0/3842681859 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc032930 con 0x7f62e81461a0 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 -- 172.21.15.33:0/3842681859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 msgr2=0x7f62e80b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 --2- 172.21.15.33:0/3842681859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80b2820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097a0 tx=0x7f62dc02a180 comp rx=0 tx=0).stop 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 -- 172.21.15.33:0/3842681859 shutdown_connections 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 --2- 172.21.15.33:0/3842681859 >> v2:172.21.15.103:3300/0 conn(0x7f62e80b2d60 0x7f62e80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 --2- 172.21.15.33:0/3842681859 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80b2820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.464+0000 7f62efc00640 1 -- 172.21.15.33:0/3842681859 >> 172.21.15.33:0/3842681859 conn(0x7f62e80b0510 msgr2=0x7f62e80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.465+0000 7f62efc00640 1 -- 172.21.15.33:0/3842681859 shutdown_connections 2024-09-13T19:00:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.465+0000 7f62efc00640 1 -- 172.21.15.33:0/3842681859 wait complete. 2024-09-13T19:00:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.466+0000 7f62efc00640 1 Processor -- start 2024-09-13T19:00:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.466+0000 7f62efc00640 1 -- start start 2024-09-13T19:00:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62e80b2d60 0x7f62e80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e815a6f0 con 0x7f62e80acdb0 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8137d20 con 0x7f62e80b2d60 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62efc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e81f2250 con 0x7f62e81461a0 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62ed200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.467+0000 7f62ed200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40056/0 (socket says 172.21.15.33:40056) 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 -- 172.21.15.33:0/156807296 learned_addr learned my addr 172.21.15.33:0/156807296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62e7e00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62e80b2d60 0x7f62e80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62edc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 -- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 msgr2=0x7f62e80cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 -- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62e80b2d60 msgr2=0x7f62e80c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62e80b2d60 0x7f62e80c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 -- 172.21.15.33:0/156807296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009400 con 0x7f62e80acdb0 2024-09-13T19:00:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62ed200640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.468+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc030b80 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.469+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc032e90 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.469+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80c3fb0 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.469+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc006e10 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.469+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e81376d0 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.470+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e80ac870 con 0x7f62e80acdb0 2024-09-13T19:00:26.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.471+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f62dc039040 con 0x7f62e80acdb0 2024-09-13T19:00:26.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.471+0000 7f62e4c00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 0x7f62c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:26.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.472+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f62dc0a9a30 con 0x7f62e80acdb0 2024-09-13T19:00:26.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.472+0000 7f62e7e00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 0x7f62c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:26.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.473+0000 7f62e7e00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 0x7f62c806d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f62e80ca370 tx=0x7f62d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:26.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.476+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f62dc074f60 con 0x7f62e80acdb0 2024-09-13T19:00:26.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:26.656+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62e815afe0 con 0x7f62e80acdb0 2024-09-13T19:00:27.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.345+0000 7f62e4c00640 1 -- 172.21.15.33:0/156807296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f62dc0410b0 con 0x7f62e80acdb0 2024-09-13T19:00:27.348 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T19:00:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 msgr2=0x7f62c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 0x7f62c806d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f62e80ca370 tx=0x7f62d4008040 comp rx=0 tx=0).stop 2024-09-13T19:00:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 msgr2=0x7f62e815a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc0046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 shutdown_connections 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f62c806ac00 0x7f62c806d0c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f62e81461a0 0x7f62e80cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62e80b2d60 0x7f62e80c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 --2- 172.21.15.33:0/156807296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62e80acdb0 0x7f62e815a1b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.350+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 >> 172.21.15.33:0/156807296 conn(0x7f62e80b0510 msgr2=0x7f62e806f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.351+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 shutdown_connections 2024-09-13T19:00:27.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.352+0000 7f62efc00640 1 -- 172.21.15.33:0/156807296 wait complete. 2024-09-13T19:00:27.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T19:00:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.539+0000 7f008f200640 1 Processor -- start 2024-09-13T19:00:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.540+0000 7f008f200640 1 -- start start 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 0x7f00880cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008f200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f008806b630 0x7f008806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00880cb8b0 con 0x7f008815a3a0 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008f200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880b3b80 con 0x7f008806b630 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00880b32e0 con 0x7f00880caf30 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008de00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f008815a3a0 0x7f00880b2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34088/0 (socket says 172.21.15.33:34088) 2024-09-13T19:00:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008de00640 1 -- 172.21.15.33:0/1535381143 learned_addr learned my addr 172.21.15.33:0/1535381143 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008d400640 1 --2- 172.21.15.33:0/1535381143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 0x7f00880cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.541+0000 7f008e800640 1 --2- 172.21.15.33:0/1535381143 >> v2:172.21.15.103:3300/0 conn(0x7f008806b630 0x7f008806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008ca00640 1 -- 172.21.15.33:0/1535381143 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283731854 0 0) 0x7f00880cb8b0 con 0x7f008815a3a0 2024-09-13T19:00:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008ca00640 1 -- 172.21.15.33:0/1535381143 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0070003520 con 0x7f008815a3a0 2024-09-13T19:00:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008d400640 1 -- 172.21.15.33:0/1535381143 >> v2:172.21.15.103:3300/0 conn(0x7f008806b630 msgr2=0x7f008806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008d400640 1 --2- 172.21.15.33:0/1535381143 >> v2:172.21.15.103:3300/0 conn(0x7f008806b630 0x7f008806bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008d400640 1 -- 172.21.15.33:0/1535381143 >> v1:172.21.15.33:6789/0 conn(0x7f008815a3a0 legacy=0x7f00880b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.542+0000 7f008d400640 1 -- 172.21.15.33:0/1535381143 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880b35c0 con 0x7f00880caf30 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.543+0000 7f008d400640 1 --2- 172.21.15.33:0/1535381143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 0x7f00880cb370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00780097a0 tx=0x7f007802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d9a746398377fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.543+0000 7f008ca00640 1 -- 172.21.15.33:0/1535381143 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802ae50 con 0x7f00880caf30 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.543+0000 7f008ca00640 1 -- 172.21.15.33:0/1535381143 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078032440 con 0x7f00880caf30 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.543+0000 7f008ca00640 1 -- 172.21.15.33:0/1535381143 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780327d0 con 0x7f00880caf30 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 -- 172.21.15.33:0/1535381143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 msgr2=0x7f00880cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 --2- 172.21.15.33:0/1535381143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 0x7f00880cb370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00780097a0 tx=0x7f007802a100 comp rx=0 tx=0).stop 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 -- 172.21.15.33:0/1535381143 shutdown_connections 2024-09-13T19:00:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 --2- 172.21.15.33:0/1535381143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00880caf30 0x7f00880cb370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 --2- 172.21.15.33:0/1535381143 >> v2:172.21.15.103:3300/0 conn(0x7f008806b630 0x7f008806bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 -- 172.21.15.33:0/1535381143 >> 172.21.15.33:0/1535381143 conn(0x7f00880ce5a0 msgr2=0x7f00880ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 -- 172.21.15.33:0/1535381143 shutdown_connections 2024-09-13T19:00:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.544+0000 7f008f200640 1 -- 172.21.15.33:0/1535381143 wait complete. 2024-09-13T19:00:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.545+0000 7f008f200640 1 Processor -- start 2024-09-13T19:00:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 -- start start 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f008806b630 0x7f0088141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 0x7f00881e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881416c0 con 0x7f008815a3a0 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0088141f30 con 0x7f00880caf30 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.546+0000 7f008f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0088142210 con 0x7f008806b630 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40072/0 (socket says 172.21.15.33:40072) 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 -- 172.21.15.33:0/1535582778 learned_addr learned my addr 172.21.15.33:0/1535582778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008d400640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 0x7f00881e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008de00640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f008806b630 0x7f0088141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 -- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f008806b630 msgr2=0x7f0088141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f008806b630 0x7f0088141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 -- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 msgr2=0x7f00881e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 0x7f00881e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008e800640 1 -- 172.21.15.33:0/1535582778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009400 con 0x7f008815a3a0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.547+0000 7f008d400640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 0x7f00881e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f008e800640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f008400efc0 tx=0x7f008400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084009ba0 con 0x7f008815a3a0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400f040 con 0x7f008815a3a0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00881424f0 con 0x7f008815a3a0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840146c0 con 0x7f008815a3a0 2024-09-13T19:00:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.548+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088142ab0 con 0x7f008815a3a0 2024-09-13T19:00:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.549+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088142ca0 con 0x7f008815a3a0 2024-09-13T19:00:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.550+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0084014820 con 0x7f008815a3a0 2024-09-13T19:00:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.551+0000 7f0082000640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 0x7f006c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.551+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0084089e00 con 0x7f008815a3a0 2024-09-13T19:00:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.551+0000 7f008de00640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 0x7f006c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.552+0000 7f008de00640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 0x7f006c06d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f007c0011e0 tx=0x7f007c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.556+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f00840550a0 con 0x7f008815a3a0 2024-09-13T19:00:27.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:27.737+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f008815b900 con 0x7f008815a3a0 2024-09-13T19:00:28.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.350+0000 7f0082000640 1 -- 172.21.15.33:0/1535582778 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f00840586c0 con 0x7f008815a3a0 2024-09-13T19:00:28.354 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T19:00:28.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 msgr2=0x7f006c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 0x7f006c06d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f007c0011e0 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-09-13T19:00:28.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 msgr2=0x7f0088142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f008400efc0 tx=0x7f008400c490 comp rx=0 tx=0).stop 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 shutdown_connections 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f006c06ac00 0x7f006c06d0c0 secure :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f007c0011e0 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f008815a3a0 0x7f0088142fd0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00880caf30 0x7f00881e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 --2- 172.21.15.33:0/1535582778 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f008806b630 0x7f0088141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.357+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 >> 172.21.15.33:0/1535582778 conn(0x7f00880ce5a0 msgr2=0x7f00880b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:28.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.359+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 shutdown_connections 2024-09-13T19:00:28.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.359+0000 7f008f200640 1 -- 172.21.15.33:0/1535582778 wait complete. 2024-09-13T19:00:28.390 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T19:00:28.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.548+0000 7f1987200640 1 Processor -- start 2024-09-13T19:00:28.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.548+0000 7f1987200640 1 -- start start 2024-09-13T19:00:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1987200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f198815a420 0x7f19880b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1987200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19880cbb00 0x7f19880cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1987200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19880b30e0 con 0x7f19880cbf40 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1987200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198815a800 con 0x7f198815a420 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1987200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880b24d0 con 0x7f19880cbb00 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f198815a420 0x7f19880b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f198815a420 0x7f19880b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40076/0 (socket says 172.21.15.33:40076) 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 -- 172.21.15.33:0/2530178240 learned_addr learned my addr 172.21.15.33:0/2530178240 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f197fe00640 1 --2- 172.21.15.33:0/2530178240 >> v2:172.21.15.103:3300/0 conn(0x7f19880cbb00 0x7f19880cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 -- 172.21.15.33:0/2530178240 >> v2:172.21.15.103:3300/0 conn(0x7f19880cbb00 msgr2=0x7f19880cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 --2- 172.21.15.33:0/2530178240 >> v2:172.21.15.103:3300/0 conn(0x7f19880cbb00 0x7f19880cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 -- 172.21.15.33:0/2530178240 >> v1:172.21.15.103:6789/0 conn(0x7f19880cbf40 legacy=0x7f198815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.550+0000 7f1985e00640 1 -- 172.21.15.33:0/2530178240 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880b27b0 con 0x7f198815a420 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.551+0000 7f1985e00640 1 --2- 172.21.15.33:0/2530178240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f198815a420 0x7f19880b1ed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f198806d420 tx=0x7f197802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e502b28e9442e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1985400640 1 -- 172.21.15.33:0/2530178240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978032440 con 0x7f198815a420 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1985400640 1 -- 172.21.15.33:0/2530178240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780325a0 con 0x7f198815a420 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1985400640 1 -- 172.21.15.33:0/2530178240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978032930 con 0x7f198815a420 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 -- 172.21.15.33:0/2530178240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f198815a420 msgr2=0x7f19880b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 --2- 172.21.15.33:0/2530178240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f198815a420 0x7f19880b1ed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f198806d420 tx=0x7f197802a270 comp rx=0 tx=0).stop 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 -- 172.21.15.33:0/2530178240 shutdown_connections 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 --2- 172.21.15.33:0/2530178240 >> v2:172.21.15.103:3300/0 conn(0x7f19880cbb00 0x7f19880cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 --2- 172.21.15.33:0/2530178240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f198815a420 0x7f19880b1ed0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.552+0000 7f1987200640 1 -- 172.21.15.33:0/2530178240 >> 172.21.15.33:0/2530178240 conn(0x7f1988069ed0 msgr2=0x7f198806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:28.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.553+0000 7f1987200640 1 -- 172.21.15.33:0/2530178240 shutdown_connections 2024-09-13T19:00:28.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.553+0000 7f1987200640 1 -- 172.21.15.33:0/2530178240 wait complete. 2024-09-13T19:00:28.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.554+0000 7f1987200640 1 Processor -- start 2024-09-13T19:00:28.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.554+0000 7f1987200640 1 -- start start 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19880cbf40 0x7f198814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 0x7f198814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881f0cb0 con 0x7f19880cbb00 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198814c900 con 0x7f198815a420 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1987200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198814cbe0 con 0x7f19880cbf40 2024-09-13T19:00:28.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1985e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1985e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40084/0 (socket says 172.21.15.33:40084) 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.555+0000 7f1985e00640 1 -- 172.21.15.33:0/2627748655 learned_addr learned my addr 172.21.15.33:0/2627748655 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f197fe00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19880cbf40 0x7f198814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1986800640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 0x7f198814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 -- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19880cbf40 msgr2=0x7f198814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19880cbf40 0x7f198814d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 -- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 msgr2=0x7f198814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 0x7f198814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 -- 172.21.15.33:0/2627748655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780094d0 con 0x7f19880cbb00 2024-09-13T19:00:28.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1986800640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 0x7f198814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:28.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.556+0000 7f1985e00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f197802a2b0 tx=0x7f19780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:28.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.557+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978032440 con 0x7f19880cbb00 2024-09-13T19:00:28.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.557+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978030ba0 con 0x7f19880cbb00 2024-09-13T19:00:28.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.557+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198814cec0 con 0x7f19880cbb00 2024-09-13T19:00:28.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.557+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197803d440 con 0x7f19880cbb00 2024-09-13T19:00:28.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.557+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198814d480 con 0x7f19880cbb00 2024-09-13T19:00:28.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.558+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19880b1ed0 con 0x7f19880cbb00 2024-09-13T19:00:28.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.559+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1978039040 con 0x7f19880cbb00 2024-09-13T19:00:28.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.560+0000 7f197e000640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 0x7f196406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.560+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f19780aa1e0 con 0x7f19880cbb00 2024-09-13T19:00:28.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.560+0000 7f197fe00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 0x7f196406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.561+0000 7f197fe00640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 0x7f196406d0f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f19880b18a0 tx=0x7f1970008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:28.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.563+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1978075490 con 0x7f19880cbb00 2024-09-13T19:00:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.781+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f198814cd20 con 0x7f19880cbb00 2024-09-13T19:00:28.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.787+0000 7f197e000640 1 -- 172.21.15.33:0/2627748655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f198814cd20 con 0x7f19880cbb00 2024-09-13T19:00:28.791 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 12 and data pool 13 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 msgr2=0x7f196406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 0x7f196406d0f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f19880b18a0 tx=0x7f1970008040 comp rx=0 tx=0).stop 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 msgr2=0x7f19881f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f197802a2b0 tx=0x7f19780046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 shutdown_connections 2024-09-13T19:00:28.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f196406ac30 0x7f196406d0f0 secure :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f19880b18a0 tx=0x7f1970008040 comp rx=0 tx=0).stop 2024-09-13T19:00:28.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f198815a420 0x7f198814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19880cbf40 0x7f198814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 --2- 172.21.15.33:0/2627748655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19880cbb00 0x7f19881f0770 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.796+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 >> 172.21.15.33:0/2627748655 conn(0x7f1988069ed0 msgr2=0x7f1988156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:28.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.798+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 shutdown_connections 2024-09-13T19:00:28.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.800+0000 7f1987200640 1 -- 172.21.15.33:0/2627748655 wait complete. 2024-09-13T19:00:28.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:28.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.983+0000 7f7258200640 1 Processor -- start 2024-09-13T19:00:28.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.983+0000 7f7258200640 1 -- start start 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.984+0000 7f7258200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7250153b20 0x7f72500b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.984+0000 7f7258200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7250153f00 con 0x7f725006f660 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.984+0000 7f7258200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500b1a40 con 0x7f7250159a80 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.984+0000 7f7258200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500ce600 con 0x7f7250153b20 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7256200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f725006f660 0x7f725006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34094/0 (socket says 172.21.15.33:34094) 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7256200640 1 -- 172.21.15.33:0/2059766630 learned_addr learned my addr 172.21.15.33:0/2059766630 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:28.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7255800640 1 --2- 172.21.15.33:0/2059766630 >> v2:172.21.15.103:3300/0 conn(0x7f7250153b20 0x7f72500b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818899907 0 0) 0x7f7250153f00 con 0x7f725006f660 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7238003520 con 0x7f725006f660 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7255800640 1 -- 172.21.15.33:0/2059766630 >> v1:172.21.15.103:6789/0 conn(0x7f7250159a80 legacy=0x7f72500b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406722767 0 0) 0x7f72500b1a40 con 0x7f7250159a80 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7255800640 1 -- 172.21.15.33:0/2059766630 >> v1:172.21.15.33:6789/0 conn(0x7f725006f660 legacy=0x7f725006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.985+0000 7f7255800640 1 -- 172.21.15.33:0/2059766630 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725015a1f0 con 0x7f7250153b20 2024-09-13T19:00:28.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f7255800640 1 --2- 172.21.15.33:0/2059766630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f72500b3990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72440097a0 tx=0x7f724402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254ea31d0633a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:28.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480019f0 con 0x7f7250153b20 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724402ac30 con 0x7f7250153b20 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f724fe00640 1 -- 172.21.15.33:0/2059766630 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244032440 con 0x7f7250153b20 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f7258200640 1 -- 172.21.15.33:0/2059766630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 msgr2=0x7f72500b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f7258200640 1 --2- 172.21.15.33:0/2059766630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f72500b3990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72440097a0 tx=0x7f724402a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.987+0000 7f7258200640 1 -- 172.21.15.33:0/2059766630 shutdown_connections 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.988+0000 7f7258200640 1 --2- 172.21.15.33:0/2059766630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f72500b3990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.988+0000 7f7258200640 1 -- 172.21.15.33:0/2059766630 >> 172.21.15.33:0/2059766630 conn(0x7f72500b0510 msgr2=0x7f72500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.988+0000 7f7258200640 1 -- 172.21.15.33:0/2059766630 shutdown_connections 2024-09-13T19:00:28.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.988+0000 7f7258200640 1 -- 172.21.15.33:0/2059766630 wait complete. 2024-09-13T19:00:28.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.989+0000 7f7258200640 1 Processor -- start 2024-09-13T19:00:28.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.989+0000 7f7258200640 1 -- start start 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725006f660 0x7f725014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f725014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250155a60 con 0x7f7250159a80 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725014eb30 con 0x7f7250153b20 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7258200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725014fa20 con 0x7f725006f660 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7256200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7256200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40094/0 (socket says 172.21.15.33:40094) 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.990+0000 7f7256200640 1 -- 172.21.15.33:0/1805844403 learned_addr learned my addr 172.21.15.33:0/1805844403 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 -- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725006f660 msgr2=0x7f725014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725006f660 0x7f725014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7254e00640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f725014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 -- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 msgr2=0x7f725014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f725014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 -- 172.21.15.33:0/1805844403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244009400 con 0x7f7250159a80 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7254e00640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f725014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7256200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f724800caf0 tx=0x7f7248002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800a700 con 0x7f7250159a80 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800a860 con 0x7f7250159a80 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800ac10 con 0x7f7250159a80 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.991+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72501553a0 con 0x7f7250159a80 2024-09-13T19:00:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.992+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72501efb70 con 0x7f7250159a80 2024-09-13T19:00:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.993+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500b3990 con 0x7f7250159a80 2024-09-13T19:00:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.994+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f72480070d0 con 0x7f7250159a80 2024-09-13T19:00:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.995+0000 7f724d600640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 0x7f723006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.995+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7248088990 con 0x7f7250159a80 2024-09-13T19:00:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.995+0000 7f7255800640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 0x7f723006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:28.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.996+0000 7f7255800640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 0x7f723006d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7244034000 tx=0x7f724402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:28.999+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7248053c00 con 0x7f7250159a80 2024-09-13T19:00:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.182+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7250155ba0 con 0x7f7250159a80 2024-09-13T19:00:29.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.184+0000 7f724d600640 1 -- 172.21.15.33:0/1805844403 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f7250155ba0 con 0x7f7250159a80 2024-09-13T19:00:29.187 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:29.187 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:28.782835+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 msgr2=0x7f723006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 0x7f723006d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7244034000 tx=0x7f724402c000 comp rx=0 tx=0).stop 2024-09-13T19:00:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 msgr2=0x7f725006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f724800caf0 tx=0x7f7248002130 comp rx=0 tx=0).stop 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 shutdown_connections 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f723006ac30 0x7f723006d0f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7250159a80 0x7f725006c4f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7250153b20 0x7f725014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 --2- 172.21.15.33:0/1805844403 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725006f660 0x7f725014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 >> 172.21.15.33:0/1805844403 conn(0x7f72500b0510 msgr2=0x7f725006fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 shutdown_connections 2024-09-13T19:00:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.186+0000 7f7258200640 1 -- 172.21.15.33:0/1805844403 wait complete. 2024-09-13T19:00:29.205 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.357+0000 7fe8b3600640 1 Processor -- start 2024-09-13T19:00:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.357+0000 7fe8b3600640 1 -- start start 2024-09-13T19:00:29.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe8ac06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8b3600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac153f00 con 0x7fe8ac0b3990 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8b3600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0b1a40 con 0x7fe8ac153b20 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8b3600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0ce600 con 0x7fe8ac159a80 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8a3e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe8ac0b3990 0x7fe8ac06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34102/0 (socket says 172.21.15.33:34102) 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8a3e00640 1 -- 172.21.15.33:0/1778012264 learned_addr learned my addr 172.21.15.33:0/1778012264 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8b1600640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe8ac06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392431929 0 0) 0x7fe8ac153f00 con 0x7fe8ac0b3990 2024-09-13T19:00:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.359+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe890003520 con 0x7fe8ac0b3990 2024-09-13T19:00:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 95993271 0 0) 0x7fe890003520 con 0x7fe8ac0b3990 2024-09-13T19:00:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 msgr2=0x7fe8ac06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe8ac06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 >> v1:172.21.15.103:6789/0 conn(0x7fe8ac153b20 legacy=0x7fe8ac0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac15a1f0 con 0x7fe8ac0b3990 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fe894001670 con 0x7fe8ac0b3990 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 >> v1:172.21.15.33:6789/0 conn(0x7fe8ac0b3990 legacy=0x7fe8ac06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8900039a0 0x7fe890003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900047c0 0x7fe890004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe890005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0ce600 con 0x7fe8900039a0 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89000dc40 con 0x7fe8900047c0 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89000de00 con 0x7fe8ac159a80 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8900039a0 0x7fe890003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8a3e00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900047c0 0x7fe890004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.360+0000 7fe8b1600640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe890005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.361+0000 7fe8b0c00640 1 -- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 msgr2=0x7fe890005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.361+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac159a80 0x7fe890005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.361+0000 7fe8b0c00640 1 -- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900047c0 msgr2=0x7fe890004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.361+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900047c0 0x7fe890004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.361+0000 7fe8b0c00640 1 -- 172.21.15.33:0/1778012264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890003520 con 0x7fe8900039a0 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.362+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8900039a0 0x7fe890003dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001720 tx=0x7fe8900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740f6273ebd590d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.364+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0052d0 con 0x7fe8900039a0 2024-09-13T19:00:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.364+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c005430 con 0x7fe8900039a0 2024-09-13T19:00:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.364+0000 7fe8abe00640 1 -- 172.21.15.33:0/1778012264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c02ab90 con 0x7fe8900039a0 2024-09-13T19:00:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 -- 172.21.15.33:0/1778012264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8900039a0 msgr2=0x7fe890003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 --2- 172.21.15.33:0/1778012264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8900039a0 0x7fe890003dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001720 tx=0x7fe8900057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b1600640 1 -- 172.21.15.33:0/1778012264 reap_dead start 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 -- 172.21.15.33:0/1778012264 shutdown_connections 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 -- 172.21.15.33:0/1778012264 >> 172.21.15.33:0/1778012264 conn(0x7fe8ac0b0510 msgr2=0x7fe8ac0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 -- 172.21.15.33:0/1778012264 shutdown_connections 2024-09-13T19:00:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.365+0000 7fe8b3600640 1 -- 172.21.15.33:0/1778012264 wait complete. 2024-09-13T19:00:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.367+0000 7fe8b3600640 1 Processor -- start 2024-09-13T19:00:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.367+0000 7fe8b3600640 1 -- start start 2024-09-13T19:00:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900039a0 0x7fe8ac155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac15a9f0 0x7fe8ac15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac157270 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac14f720 con 0x7fe8900039a0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b3600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1565f0 con 0x7fe8ac15a9f0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40112/0 (socket says 172.21.15.33:40112) 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 -- 172.21.15.33:0/156355172 learned_addr learned my addr 172.21.15.33:0/156355172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b1600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac15a9f0 0x7fe8ac15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900039a0 0x7fe8ac155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 -- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac15a9f0 msgr2=0x7fe8ac15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac15a9f0 0x7fe8ac15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 -- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900039a0 msgr2=0x7fe8ac155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900039a0 0x7fe8ac155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.368+0000 7fe8a3e00640 1 -- 172.21.15.33:0/156355172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac1568d0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8a3e00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe8940072c0 tx=0x7fe894007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894001640 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400f8e0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400fc90 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac156bb0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.369+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac15ca10 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.370+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac1573b0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.371+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe89401d460 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.372+0000 7fe8a9600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 0x7fe88806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.372+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe894089440 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.372+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 0x7fe88806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.373+0000 7fe8b0c00640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 0x7fe88806d0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe89c032000 tx=0x7fe89c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.376+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8ac1573b0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.555+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8ac1573b0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.556+0000 7fe8a9600640 1 -- 172.21.15.33:0/156355172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fe8ac1573b0 con 0x7fe8ac15c5b0 2024-09-13T19:00:29.560 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:29.560 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:28.782835+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:29.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.558+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 msgr2=0x7fe88806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.558+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 0x7fe88806d0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe89c032000 tx=0x7fe89c02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:29.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.558+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 msgr2=0x7fe8ac0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.558+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe8940072c0 tx=0x7fe894007780 comp rx=0 tx=0).stop 2024-09-13T19:00:29.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 shutdown_connections 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe88806ac00 0x7fe88806d0c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8ac15a9f0 0x7fe8ac15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac15c5b0 0x7fe8ac0af770 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 --2- 172.21.15.33:0/156355172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8900039a0 0x7fe8ac155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 >> 172.21.15.33:0/156355172 conn(0x7fe8ac0b0510 msgr2=0x7fe8ac06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 shutdown_connections 2024-09-13T19:00:29.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.559+0000 7fe8b3600640 1 -- 172.21.15.33:0/156355172 wait complete. 2024-09-13T19:00:29.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T19:00:29.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.734+0000 7f70a4a00640 1 Processor -- start 2024-09-13T19:00:29.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.734+0000 7f70a4a00640 1 -- start start 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f70a4a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a0154ad0 0x7f70a00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f70a4a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a006f830 0x7f70a006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f70a4a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a006b7c0 con 0x7f70a00ce2c0 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f70a4a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a006b5b0 con 0x7f70a0154ad0 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f70a4a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a006baa0 con 0x7f70a006f830 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f709de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a0154ad0 0x7f70a00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f709de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70a0154ad0 0x7f70a00cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40118/0 (socket says 172.21.15.33:40118) 2024-09-13T19:00:29.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.735+0000 7f709de00640 1 -- 172.21.15.33:0/2883323705 learned_addr learned my addr 172.21.15.33:0/2883323705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.736+0000 7f7095400640 1 --2- 172.21.15.33:0/2883323705 >> v2:172.21.15.103:3300/0 conn(0x7f70a006f830 0x7f70a006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.736+0000 7f709de00640 1 -- 172.21.15.33:0/2883323705 >> v2:172.21.15.103:3300/0 conn(0x7f70a006f830 msgr2=0x7f70a006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.736+0000 7f709de00640 1 --2- 172.21.15.33:0/2883323705 >> v2:172.21.15.103:3300/0 conn(0x7f70a006f830 0x7f70a006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.736+0000 7f709de00640 1 -- 172.21.15.33:0/2883323705 >> v1:172.21.15.103:6789/0 conn(0x7f70a00ce2c0 legacy=0x7f70a00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.736+0000 7f709de00640 1 -- 172.21.15.33:0/2883323705 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a006bd80 con 0x7f70a0154ad0 2024-09-13T19:00:29.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.737+0000 7f709de00640 1 --2- 172.21.15.33:0/2883323705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a00cdd80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ae4c0 tx=0x7f709002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0bc809b6c86525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.737+0000 7f709d400640 1 -- 172.21.15.33:0/2883323705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090032440 con 0x7f70a0154ad0 2024-09-13T19:00:29.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.737+0000 7f709d400640 1 -- 172.21.15.33:0/2883323705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900325a0 con 0x7f70a0154ad0 2024-09-13T19:00:29.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.737+0000 7f709d400640 1 -- 172.21.15.33:0/2883323705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090032930 con 0x7f70a0154ad0 2024-09-13T19:00:29.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 -- 172.21.15.33:0/2883323705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 msgr2=0x7f70a00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 --2- 172.21.15.33:0/2883323705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a00cdd80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f70a00ae4c0 tx=0x7f709002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 -- 172.21.15.33:0/2883323705 shutdown_connections 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 --2- 172.21.15.33:0/2883323705 >> v2:172.21.15.103:3300/0 conn(0x7f70a006f830 0x7f70a006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 --2- 172.21.15.33:0/2883323705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a00cdd80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 -- 172.21.15.33:0/2883323705 >> 172.21.15.33:0/2883323705 conn(0x7f70a00b0580 msgr2=0x7f70a00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 -- 172.21.15.33:0/2883323705 shutdown_connections 2024-09-13T19:00:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.738+0000 7f70a4a00640 1 -- 172.21.15.33:0/2883323705 wait complete. 2024-09-13T19:00:29.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.740+0000 7f70a4a00640 1 Processor -- start 2024-09-13T19:00:29.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.740+0000 7f70a4a00640 1 -- start start 2024-09-13T19:00:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0155270 0x7f70a013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a014f9d0 0x7f70a014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01503a0 con 0x7f70a0154ad0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0147a80 con 0x7f70a0155270 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f70a4a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01488e0 con 0x7f70a014f9d0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40122/0 (socket says 172.21.15.33:40122) 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 -- 172.21.15.33:0/3956279006 learned_addr learned my addr 172.21.15.33:0/3956279006 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f7095400640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0155270 0x7f70a013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709e800640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a014f9d0 0x7f70a014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 -- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a014f9d0 msgr2=0x7f70a014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a014f9d0 0x7f70a014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 -- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0155270 msgr2=0x7f70a013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0155270 0x7f70a013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.741+0000 7f709de00640 1 -- 172.21.15.33:0/3956279006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900094d0 con 0x7f70a0154ad0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f709de00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f709002a220 tx=0x7f70900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090032440 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090030980 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090030d10 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0149c80 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.742+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a0147fb0 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.743+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00cdd80 con 0x7f70a0154ad0 2024-09-13T19:00:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.744+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7090039040 con 0x7f70a0154ad0 2024-09-13T19:00:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.745+0000 7f7096a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 0x7f707c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.745+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70900a9bb0 con 0x7f70a0154ad0 2024-09-13T19:00:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.746+0000 7f7095400640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 0x7f707c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.746+0000 7f7095400640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 0x7f707c06d0f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70a0155690 tx=0x7f7088009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:29.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.750+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7090074e40 con 0x7f70a0154ad0 2024-09-13T19:00:29.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:29.974+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f70a0148a20 con 0x7f70a0154ad0 2024-09-13T19:00:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.806+0000 7f7096a00640 1 -- 172.21.15.33:0/3956279006 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f70900410b0 con 0x7f70a0154ad0 2024-09-13T19:00:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.809+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 msgr2=0x7f707c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.809+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 0x7f707c06d0f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f70a0155690 tx=0x7f7088009190 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.809+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 msgr2=0x7f70a0149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.809+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f709002a220 tx=0x7f70900046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 shutdown_connections 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f707c06ac30 0x7f707c06d0f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70a014f9d0 0x7f70a014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0155270 0x7f70a013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 --2- 172.21.15.33:0/3956279006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70a0154ad0 0x7f70a0149740 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 >> 172.21.15.33:0/3956279006 conn(0x7f70a00b0580 msgr2=0x7f70a015b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 shutdown_connections 2024-09-13T19:00:30.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.810+0000 7f70a4a00640 1 -- 172.21.15.33:0/3956279006 wait complete. 2024-09-13T19:00:30.832 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T19:00:30.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T19:00:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.994+0000 7f858be00640 1 Processor -- start 2024-09-13T19:00:30.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.994+0000 7f858be00640 1 -- start start 2024-09-13T19:00:30.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f858be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85841566f0 0x7f8584070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f858be00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858406fce0 con 0x7f85840ae060 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f858be00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858406c820 con 0x7f858406be40 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f858be00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858406f690 con 0x7f85841566f0 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f8589400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85841566f0 0x7f8584070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f8589400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85841566f0 0x7f8584070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40136/0 (socket says 172.21.15.33:40136) 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f8589e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f85840ae060 0x7f858415c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34118/0 (socket says 172.21.15.33:34118) 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.995+0000 7f8589400640 1 -- 172.21.15.33:0/2778363372 learned_addr learned my addr 172.21.15.33:0/2778363372 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:30.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.996+0000 7f8589400640 1 -- 172.21.15.33:0/2778363372 >> v1:172.21.15.103:6789/0 conn(0x7f858406be40 legacy=0x7f85840ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.996+0000 7f8589400640 1 -- 172.21.15.33:0/2778363372 >> v1:172.21.15.33:6789/0 conn(0x7f85840ae060 legacy=0x7f858415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.996+0000 7f8589400640 1 -- 172.21.15.33:0/2778363372 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858406f970 con 0x7f85841566f0 2024-09-13T19:00:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.997+0000 7f8589400640 1 --2- 172.21.15.33:0/2778363372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85841566f0 0x7f8584070170 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8578009870 tx=0x7f857802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71381e12719de53a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:31.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.997+0000 7f8583e00640 1 -- 172.21.15.33:0/2778363372 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578032440 con 0x7f85841566f0 2024-09-13T19:00:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.997+0000 7f8583e00640 1 -- 172.21.15.33:0/2778363372 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85780325a0 con 0x7f85841566f0 2024-09-13T19:00:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.997+0000 7f8583e00640 1 -- 172.21.15.33:0/2778363372 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578032930 con 0x7f85841566f0 2024-09-13T19:00:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 -- 172.21.15.33:0/2778363372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85841566f0 msgr2=0x7f8584070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 --2- 172.21.15.33:0/2778363372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85841566f0 0x7f8584070170 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8578009870 tx=0x7f857802a2a0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 -- 172.21.15.33:0/2778363372 shutdown_connections 2024-09-13T19:00:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 --2- 172.21.15.33:0/2778363372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85841566f0 0x7f8584070170 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 -- 172.21.15.33:0/2778363372 >> 172.21.15.33:0/2778363372 conn(0x7f85840b0580 msgr2=0x7f85840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 -- 172.21.15.33:0/2778363372 shutdown_connections 2024-09-13T19:00:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:30.998+0000 7f858be00640 1 -- 172.21.15.33:0/2778363372 wait complete. 2024-09-13T19:00:31.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.000+0000 7f858be00640 1 Processor -- start 2024-09-13T19:00:31.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.000+0000 7f858be00640 1 -- start start 2024-09-13T19:00:31.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f858406be40 0x7f858415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85841566f0 0x7f85840af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584153630 con 0x7f85840ae060 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584153910 con 0x7f858406be40 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f858be00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8584153bf0 con 0x7f85841566f0 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40138/0 (socket says 172.21.15.33:40138) 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 -- 172.21.15.33:0/1257784841 learned_addr learned my addr 172.21.15.33:0/1257784841 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8589400640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f858406be40 0x7f858415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8589e00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85841566f0 0x7f85840af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 -- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85841566f0 msgr2=0x7f85840af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85841566f0 0x7f85840af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 -- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f858406be40 msgr2=0x7f858415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f858406be40 0x7f858415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.001+0000 7f8588a00640 1 -- 172.21.15.33:0/1257784841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780094d0 con 0x7f85840ae060 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f8588a00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f857000c430 tx=0x7f857000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011790 con 0x7f85840ae060 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85700118f0 con 0x7f85840ae060 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011ce0 con 0x7f85840ae060 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85840cd0e0 con 0x7f85840ae060 2024-09-13T19:00:31.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.002+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858415c1b0 con 0x7f85840ae060 2024-09-13T19:00:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.003+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85840cd600 con 0x7f85840ae060 2024-09-13T19:00:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.004+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f857001c460 con 0x7f85840ae060 2024-09-13T19:00:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.005+0000 7f8581600640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.005+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85700892d0 con 0x7f85840ae060 2024-09-13T19:00:31.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.006+0000 7f8589400640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.007+0000 7f8589400640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 0x7f856406d0c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8578034000 tx=0x7f857802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.010+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85840cd600 con 0x7f85840ae060 2024-09-13T19:00:31.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.225+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f85840cd600 con 0x7f85840ae060 2024-09-13T19:00:31.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.808+0000 7f8581600640 1 -- 172.21.15.33:0/1257784841 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85840cd600 con 0x7f85840ae060 2024-09-13T19:00:31.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 msgr2=0x7f856406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 0x7f856406d0c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8578034000 tx=0x7f857802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:31.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 msgr2=0x7f85840cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f857000c430 tx=0x7f857000c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 shutdown_connections 2024-09-13T19:00:31.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85841566f0 0x7f85840af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85840ae060 0x7f85840cd8e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 --2- 172.21.15.33:0/1257784841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f858406be40 0x7f858415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 >> 172.21.15.33:0/1257784841 conn(0x7f85840b0580 msgr2=0x7f85840cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 shutdown_connections 2024-09-13T19:00:31.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.811+0000 7f858be00640 1 -- 172.21.15.33:0/1257784841 wait complete. 2024-09-13T19:00:31.832 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T19:00:31.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:31.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 Processor -- start 2024-09-13T19:00:31.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 -- start start 2024-09-13T19:00:31.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60d015d1a0 0x7f60d00b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60d015c590 0x7f60d015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d00716c0 con 0x7f60d00712e0 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d015cf40 con 0x7f60d015d1a0 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.987+0000 7f60d6400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d00b2b80 con 0x7f60d015c590 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60d015d1a0 0x7f60d00b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60d015d1a0 0x7f60d00b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40146/0 (socket says 172.21.15.33:40146) 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 -- 172.21.15.33:0/1764493785 learned_addr learned my addr 172.21.15.33:0/1764493785 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60d5a00640 1 --2- 172.21.15.33:0/1764493785 >> v2:172.21.15.103:3300/0 conn(0x7f60d015c590 0x7f60d015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 -- 172.21.15.33:0/1764493785 >> v2:172.21.15.103:3300/0 conn(0x7f60d015c590 msgr2=0x7f60d015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 --2- 172.21.15.33:0/1764493785 >> v2:172.21.15.103:3300/0 conn(0x7f60d015c590 0x7f60d015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 -- 172.21.15.33:0/1764493785 >> v1:172.21.15.103:6789/0 conn(0x7f60d00712e0 legacy=0x7f60d00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.988+0000 7f60cfe00640 1 -- 172.21.15.33:0/1764493785 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d00b2e60 con 0x7f60d015d1a0 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.989+0000 7f60cfe00640 1 --2- 172.21.15.33:0/1764493785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d015d1a0 0x7f60d00b3c20 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ce5a0 tx=0x7f60bc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7092abc99889f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.989+0000 7f60cf400640 1 -- 172.21.15.33:0/1764493785 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc032440 con 0x7f60d015d1a0 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.989+0000 7f60cf400640 1 -- 172.21.15.33:0/1764493785 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0325a0 con 0x7f60d015d1a0 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.989+0000 7f60cf400640 1 -- 172.21.15.33:0/1764493785 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc032930 con 0x7f60d015d1a0 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 -- 172.21.15.33:0/1764493785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d015d1a0 msgr2=0x7f60d00b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 --2- 172.21.15.33:0/1764493785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d015d1a0 0x7f60d00b3c20 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ce5a0 tx=0x7f60bc02a2a0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 -- 172.21.15.33:0/1764493785 shutdown_connections 2024-09-13T19:00:31.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 --2- 172.21.15.33:0/1764493785 >> v2:172.21.15.103:3300/0 conn(0x7f60d015c590 0x7f60d015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 --2- 172.21.15.33:0/1764493785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d015d1a0 0x7f60d00b3c20 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 -- 172.21.15.33:0/1764493785 >> 172.21.15.33:0/1764493785 conn(0x7f60d00ae310 msgr2=0x7f60d00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:31.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 -- 172.21.15.33:0/1764493785 shutdown_connections 2024-09-13T19:00:31.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.990+0000 7f60d6400640 1 -- 172.21.15.33:0/1764493785 wait complete. 2024-09-13T19:00:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.992+0000 7f60d6400640 1 Processor -- start 2024-09-13T19:00:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.992+0000 7f60d6400640 1 -- start start 2024-09-13T19:00:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60d015c590 0x7f60d0146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f60d015d1a0 0x7f60d014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00cdd00 con 0x7f60d00712e0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d006d380 con 0x7f60d015c590 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d6400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00cda20 con 0x7f60d015d1a0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40162/0 (socket says 172.21.15.33:40162) 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 -- 172.21.15.33:0/2990213699 learned_addr learned my addr 172.21.15.33:0/2990213699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60cfe00640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60d015c590 0x7f60d0146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5a00640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f60d015d1a0 0x7f60d014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 -- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f60d015d1a0 msgr2=0x7f60d014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f60d015d1a0 0x7f60d014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 -- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60d015c590 msgr2=0x7f60d0146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60d015c590 0x7f60d0146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.993+0000 7f60d5000640 1 -- 172.21.15.33:0/2990213699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0094d0 con 0x7f60d00712e0 2024-09-13T19:00:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60d5000640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c500 tx=0x7f60c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40052d0 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4005430 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4012850 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d006d0a0 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.994+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d0146fc0 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.995+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d0067360 con 0x7f60d00712e0 2024-09-13T19:00:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.996+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f60c40129b0 con 0x7f60d00712e0 2024-09-13T19:00:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.997+0000 7f60ccc00640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 0x7f60b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.997+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60c4088e70 con 0x7f60d00712e0 2024-09-13T19:00:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.997+0000 7f60cfe00640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 0x7f60b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:31.998+0000 7f60cfe00640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 0x7f60b006d0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f60bc034000 tx=0x7f60bc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.001+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f60c4053fc0 con 0x7f60d00712e0 2024-09-13T19:00:32.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.216+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60d015ca00 con 0x7f60d00712e0 2024-09-13T19:00:32.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.216+0000 7f60ccc00640 1 -- 172.21.15.33:0/2990213699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f60c40575e0 con 0x7f60d00712e0 2024-09-13T19:00:32.220 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:32.220 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:32.220 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 msgr2=0x7f60b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 0x7f60b006d0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f60bc034000 tx=0x7f60bc02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 msgr2=0x7f60d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c500 tx=0x7f60c400c9c0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 shutdown_connections 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f60b006ac30 0x7f60b006d0f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f60d015d1a0 0x7f60d014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60d015c590 0x7f60d0146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 --2- 172.21.15.33:0/2990213699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60d00712e0 0x7f60d0070b30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.218+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 >> 172.21.15.33:0/2990213699 conn(0x7f60d00ae310 msgr2=0x7f60d0153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:32.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.219+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 shutdown_connections 2024-09-13T19:00:32.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.219+0000 7f60d6400640 1 -- 172.21.15.33:0/2990213699 wait complete. 2024-09-13T19:00:32.238 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.390+0000 7ff7a7e00640 1 Processor -- start 2024-09-13T19:00:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.391+0000 7ff7a7e00640 1 -- start start 2024-09-13T19:00:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 0x7ff7a815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80cbfc0 con 0x7ff7a80cbac0 2024-09-13T19:00:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80707a0 con 0x7ff7a815a5c0 2024-09-13T19:00:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80cce20 con 0x7ff7a80b40c0 2024-09-13T19:00:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff7a80cbac0 0x7ff7a815aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34122/0 (socket says 172.21.15.33:34122) 2024-09-13T19:00:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a7400640 1 -- 172.21.15.33:0/3100036379 learned_addr learned my addr 172.21.15.33:0/3100036379 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff79e000640 1 --2- 172.21.15.33:0/3100036379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 0x7ff7a815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058532518 0 0) 0x7ff7a80cbfc0 con 0x7ff7a80cbac0 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78c003520 con 0x7ff7a80cbac0 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729184032 0 0) 0x7ff7a80707a0 con 0x7ff7a815a5c0 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a80cbfc0 con 0x7ff7a815a5c0 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff79e000640 1 -- 172.21.15.33:0/3100036379 >> v1:172.21.15.103:6789/0 conn(0x7ff7a815a5c0 legacy=0x7ff7a80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff79e000640 1 -- 172.21.15.33:0/3100036379 >> v1:172.21.15.33:6789/0 conn(0x7ff7a80cbac0 legacy=0x7ff7a815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.393+0000 7ff79e000640 1 -- 172.21.15.33:0/3100036379 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8070a80 con 0x7ff7a80b40c0 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.394+0000 7ff79e000640 1 --2- 172.21.15.33:0/3100036379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 0x7ff7a815a9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff790009800 tx=0x7ff79002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e8ce6856ee3d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.394+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790032440 con 0x7ff7a80b40c0 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.394+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7900325a0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.394+0000 7ff7a6000640 1 -- 172.21.15.33:0/3100036379 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790032930 con 0x7ff7a80b40c0 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3100036379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 msgr2=0x7ff7a815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3100036379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 0x7ff7a815a9a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff790009800 tx=0x7ff79002a230 comp rx=0 tx=0).stop 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3100036379 shutdown_connections 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3100036379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a80b40c0 0x7ff7a815a9a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3100036379 >> 172.21.15.33:0/3100036379 conn(0x7ff7a80ae310 msgr2=0x7ff7a80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3100036379 shutdown_connections 2024-09-13T19:00:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.395+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3100036379 wait complete. 2024-09-13T19:00:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.396+0000 7ff7a7e00640 1 Processor -- start 2024-09-13T19:00:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 -- start start 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a80cbac0 0x7ff7a815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 0x7ff7a80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a81f5660 con 0x7ff7a80b40c0 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80b3df0 con 0x7ff7a80cbac0 2024-09-13T19:00:32.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.397+0000 7ff7a7e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a815d770 con 0x7ff7a815a5c0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40168/0 (socket says 172.21.15.33:40168) 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 -- 172.21.15.33:0/3610740112 learned_addr learned my addr 172.21.15.33:0/3610740112 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff79e000640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a80cbac0 0x7ff7a815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a7400640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 0x7ff7a80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 -- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 msgr2=0x7ff7a80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 0x7ff7a80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 -- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a80cbac0 msgr2=0x7ff7a815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a80cbac0 0x7ff7a815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 -- 172.21.15.33:0/3610740112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009400 con 0x7ff7a80b40c0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a7400640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 0x7ff7a80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.398+0000 7ff7a6a00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c490 tx=0x7ff79800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.399+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980052d0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.399+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798005430 con 0x7ff7a80b40c0 2024-09-13T19:00:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.399+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a80c4220 con 0x7ff7a80b40c0 2024-09-13T19:00:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.399+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798012870 con 0x7ff7a80b40c0 2024-09-13T19:00:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.399+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a815c7b0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.400+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a8067360 con 0x7ff7a80b40c0 2024-09-13T19:00:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.401+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7980129d0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.402+0000 7ff79f400640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 0x7ff78406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.402+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff798088ee0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.402+0000 7ff79e000640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 0x7ff78406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.403+0000 7ff79e000640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 0x7ff78406d0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.406+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7980540c0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.585+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7a806ef90 con 0x7ff7a80b40c0 2024-09-13T19:00:32.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.586+0000 7ff79f400640 1 -- 172.21.15.33:0/3610740112 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7ff7980576e0 con 0x7ff7a80b40c0 2024-09-13T19:00:32.590 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:32.590 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 msgr2=0x7ff78406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 0x7ff78406d0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 msgr2=0x7ff7a81f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c490 tx=0x7ff79800c950 comp rx=0 tx=0).stop 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 shutdown_connections 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff78406ac00 0x7ff78406d0c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7a815a5c0 0x7ff7a80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a80cbac0 0x7ff7a815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 --2- 172.21.15.33:0/3610740112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7a80b40c0 0x7ff7a81f5120 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 >> 172.21.15.33:0/3610740112 conn(0x7ff7a80ae310 msgr2=0x7ff7a80ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 shutdown_connections 2024-09-13T19:00:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.589+0000 7ff7a7e00640 1 -- 172.21.15.33:0/3610740112 wait complete. 2024-09-13T19:00:32.608 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T19:00:32.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:00:32.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.762+0000 7fea5d200640 1 Processor -- start 2024-09-13T19:00:32.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.762+0000 7fea5d200640 1 -- start start 2024-09-13T19:00:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea5815a520 0x7fea5806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 0x7fea580b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5806bc00 con 0x7fea5815a520 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5806bea0 con 0x7fea580cde50 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea5d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5806c180 con 0x7fea580b1b00 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea5815a520 0x7fea5806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea5815a520 0x7fea5806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40184/0 (socket says 172.21.15.33:40184) 2024-09-13T19:00:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 -- 172.21.15.33:0/1088822369 learned_addr learned my addr 172.21.15.33:0/1088822369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55400640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea56800640 1 --2- 172.21.15.33:0/1088822369 >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 0x7fea580b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 -- 172.21.15.33:0/1088822369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 msgr2=0x7fea580cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 -- 172.21.15.33:0/1088822369 >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 msgr2=0x7fea580b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 --2- 172.21.15.33:0/1088822369 >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 0x7fea580b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea55e00640 1 -- 172.21.15.33:0/1088822369 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5806c460 con 0x7fea5815a520 2024-09-13T19:00:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.763+0000 7fea56800640 1 --2- 172.21.15.33:0/1088822369 >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 0x7fea580b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea55e00640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea5815a520 0x7fea5806b6c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fea48009870 tx=0x7fea4802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ade9dde0f249629 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea54a00640 1 -- 172.21.15.33:0/1088822369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48032440 con 0x7fea5815a520 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea54a00640 1 -- 172.21.15.33:0/1088822369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea480325a0 con 0x7fea5815a520 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea54a00640 1 -- 172.21.15.33:0/1088822369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48032930 con 0x7fea5815a520 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 -- 172.21.15.33:0/1088822369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea5815a520 msgr2=0x7fea5806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea5815a520 0x7fea5806b6c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fea48009870 tx=0x7fea4802a200 comp rx=0 tx=0).stop 2024-09-13T19:00:32.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 -- 172.21.15.33:0/1088822369 shutdown_connections 2024-09-13T19:00:32.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 --2- 172.21.15.33:0/1088822369 >> v2:172.21.15.103:3300/0 conn(0x7fea580cde50 0x7fea580b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 --2- 172.21.15.33:0/1088822369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea5815a520 0x7fea5806b6c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 -- 172.21.15.33:0/1088822369 >> 172.21.15.33:0/1088822369 conn(0x7fea580b0510 msgr2=0x7fea580b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 -- 172.21.15.33:0/1088822369 shutdown_connections 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.765+0000 7fea5d200640 1 -- 172.21.15.33:0/1088822369 wait complete. 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.767+0000 7fea5d200640 1 Processor -- start 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.767+0000 7fea5d200640 1 -- start start 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 0x7fea581f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58157370 con 0x7fea580cde50 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea581562d0 con 0x7fea5815a520 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea5d200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea581565b0 con 0x7fea580b1b00 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40186/0 (socket says 172.21.15.33:40186) 2024-09-13T19:00:32.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.768+0000 7fea55400640 1 -- 172.21.15.33:0/3023168273 learned_addr learned my addr 172.21.15.33:0/3023168273 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55e00640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea56800640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 0x7fea581f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 -- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 msgr2=0x7fea580c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 -- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 msgr2=0x7fea581f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 0x7fea581f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 -- 172.21.15.33:0/3023168273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480094d0 con 0x7fea580cde50 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea56800640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 0x7fea581f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea55400640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e890 tx=0x7fea4400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400c940 con 0x7fea580cde50 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400caa0 con 0x7fea580cde50 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400ce30 con 0x7fea580cde50 2024-09-13T19:00:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.769+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea58156890 con 0x7fea580cde50 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.770+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea58156e50 con 0x7fea580cde50 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.772+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea580cd910 con 0x7fea580cde50 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.773+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea44013470 con 0x7fea580cde50 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.773+0000 7fea4e000640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 0x7fea3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.773+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea440895b0 con 0x7fea580cde50 2024-09-13T19:00:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.773+0000 7fea55e00640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 0x7fea3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:32.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.775+0000 7fea55e00640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 0x7fea3806d0c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fea48034000 tx=0x7fea4802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:32.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.778+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fea440547a0 con 0x7fea580cde50 2024-09-13T19:00:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.953+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea580ce2e0 con 0x7fea3806ac00 2024-09-13T19:00:32.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.961+0000 7fea4e000640 1 -- 172.21.15.33:0/3023168273 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278520 (secure 0 0 0) 0x7fea48032930 con 0x7fea3806ac00 2024-09-13T19:00:32.968 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:32.970 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 msgr2=0x7fea3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 0x7fea3806d0c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fea48034000 tx=0x7fea4802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 msgr2=0x7fea58155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e890 tx=0x7fea4400ed50 comp rx=0 tx=0).stop 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 shutdown_connections 2024-09-13T19:00:32.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fea3806ac00 0x7fea3806d0c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea5815a520 0x7fea581f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea580cde50 0x7fea58155960 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 --2- 172.21.15.33:0/3023168273 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fea580b1b00 0x7fea580c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 >> 172.21.15.33:0/3023168273 conn(0x7fea580b0510 msgr2=0x7fea580af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 shutdown_connections 2024-09-13T19:00:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:32.965+0000 7fea5d200640 1 -- 172.21.15.33:0/3023168273 wait complete. 2024-09-13T19:00:32.983 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-13T19:00:31.140401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233288,"kb_used_data":8912,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754741432,"statfs":{"total":773094113280,"available":772855226368,"internally_reserved":0,"allocated":9125888,"data_stored":4519014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000727"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353811+0000","last_change":"2024-09-13T19:00:27.353811+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353811+0000","last_undegraded":"2024-09-13T19:00:27.353811+0000","last_fullsized":"2024-09-13T19:00:27.353811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349343+0000","last_change":"2024-09-13T19:00:27.349343+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349343+0000","last_undegraded":"2024-09-13T19:00:27.349343+0000","last_fullsized":"2024-09-13T19:00:27.349343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:39.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349348+0000","last_change":"2024-09-13T19:00:27.349348+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349348+0000","last_undegraded":"2024-09-13T19:00:27.349348+0000","last_fullsized":"2024-09-13T19:00:27.349348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:31.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349642+0000","last_change":"2024-09-13T19:00:27.349642+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349642+0000","last_undegraded":"2024-09-13T19:00:27.349642+0000","last_fullsized":"2024-09-13T19:00:27.349642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:50.636787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349660+0000","last_change":"2024-09-13T19:00:27.349660+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349660+0000","last_undegraded":"2024-09-13T19:00:27.349660+0000","last_fullsized":"2024-09-13T19:00:27.349660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:32.746000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.350076+0000","last_change":"2024-09-13T19:00:27.350076+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.350076+0000","last_undegraded":"2024-09-13T19:00:27.350076+0000","last_fullsized":"2024-09-13T19:00:27.350076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:21.539136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.347728+0000","last_change":"2024-09-13T19:00:27.347728+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.347728+0000","last_undegraded":"2024-09-13T19:00:27.347728+0000","last_fullsized":"2024-09-13T19:00:27.347728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:59.105096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.350768+0000","last_change":"2024-09-13T19:00:27.350768+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.350768+0000","last_undegraded":"2024-09-13T19:00:27.350768+0000","last_fullsized":"2024-09-13T19:00:27.350768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:15.934982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352770+0000","last_change":"2024-09-13T19:00:27.352770+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352770+0000","last_undegraded":"2024-09-13T19:00:27.352770+0000","last_fullsized":"2024-09-13T19:00:27.352770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352142+0000","last_change":"2024-09-13T19:00:27.352142+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352142+0000","last_undegraded":"2024-09-13T19:00:27.352142+0000","last_fullsized":"2024-09-13T19:00:27.352142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352510+0000","last_change":"2024-09-13T19:00:27.352510+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352510+0000","last_undegraded":"2024-09-13T19:00:27.352510+0000","last_fullsized":"2024-09-13T19:00:27.352510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.347986+0000","last_change":"2024-09-13T19:00:27.347986+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.347986+0000","last_undegraded":"2024-09-13T19:00:27.347986+0000","last_fullsized":"2024-09-13T19:00:27.347986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352273+0000","last_change":"2024-09-13T19:00:27.352273+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352273+0000","last_undegraded":"2024-09-13T19:00:27.352273+0000","last_fullsized":"2024-09-13T19:00:27.352273+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:16.635844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352739+0000","last_change":"2024-09-13T19:00:27.352739+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352739+0000","last_undegraded":"2024-09-13T19:00:27.352739+0000","last_fullsized":"2024-09-13T19:00:27.352739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:53.669678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.346678+0000","last_change":"2024-09-13T19:00:27.346678+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.346678+0000","last_undegraded":"2024-09-13T19:00:27.346678+0000","last_fullsized":"2024-09-13T19:00:27.346678+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.348120+0000","last_change":"2024-09-13T19:00:27.348120+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.348120+0000","last_undegraded":"2024-09-13T19:00:27.348120+0000","last_fullsized":"2024-09-13T19:00:27.348120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:31.390640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352199+0000","last_change":"2024-09-13T19:00:27.352199+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352199+0000","last_undegraded":"2024-09-13T19:00:27.352199+0000","last_fullsized":"2024-09-13T19:00:27.352199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.347532+0000","last_change":"2024-09-13T19:00:27.347532+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.347532+0000","last_undegraded":"2024-09-13T19:00:27.347532+0000","last_fullsized":"2024-09-13T19:00:27.347532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:47.940954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.347494+0000","last_change":"2024-09-13T19:00:27.347494+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.347494+0000","last_undegraded":"2024-09-13T19:00:27.347494+0000","last_fullsized":"2024-09-13T19:00:27.347494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:55.732038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353421+0000","last_change":"2024-09-13T19:00:27.353421+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353421+0000","last_undegraded":"2024-09-13T19:00:27.353421+0000","last_fullsized":"2024-09-13T19:00:27.353421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.519273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.354731+0000","last_change":"2024-09-13T19:00:27.354731+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.354731+0000","last_undegraded":"2024-09-13T19:00:27.354731+0000","last_fullsized":"2024-09-13T19:00:27.354731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.664451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.355253+0000","last_change":"2024-09-13T19:00:27.355253+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.355253+0000","last_undegraded":"2024-09-13T19:00:27.355253+0000","last_fullsized":"2024-09-13T19:00:27.355253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:57.996268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352676+0000","last_change":"2024-09-13T19:00:27.352676+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352676+0000","last_undegraded":"2024-09-13T19:00:27.352676+0000","last_fullsized":"2024-09-13T19:00:27.352676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:58.073529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.351990+0000","last_change":"2024-09-13T19:00:27.351990+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.351990+0000","last_undegraded":"2024-09-13T19:00:27.351990+0000","last_fullsized":"2024-09-13T19:00:27.351990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:18.357881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.351419+0000","last_change":"2024-09-13T19:00:27.351419+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.351419+0000","last_undegraded":"2024-09-13T19:00:27.351419+0000","last_fullsized":"2024-09-13T19:00:27.351419+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:25.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353038+0000","last_change":"2024-09-13T19:00:27.353038+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353038+0000","last_undegraded":"2024-09-13T19:00:27.353038+0000","last_fullsized":"2024-09-13T19:00:27.353038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352159+0000","last_change":"2024-09-13T19:00:27.352159+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352159+0000","last_undegraded":"2024-09-13T19:00:27.352159+0000","last_fullsized":"2024-09-13T19:00:27.352159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.347461+0000","last_change":"2024-09-13T19:00:27.347461+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.347461+0000","last_undegraded":"2024-09-13T19:00:27.347461+0000","last_fullsized":"2024-09-13T19:00:27.347461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349401+0000","last_change":"2024-09-13T19:00:27.349401+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349401+0000","last_undegraded":"2024-09-13T19:00:27.349401+0000","last_fullsized":"2024-09-13T19:00:27.349401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352168+0000","last_change":"2024-09-13T19:00:27.352168+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352168+0000","last_undegraded":"2024-09-13T19:00:27.352168+0000","last_fullsized":"2024-09-13T19:00:27.352168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.349332+0000","last_change":"2024-09-13T19:00:27.349332+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.349332+0000","last_undegraded":"2024-09-13T19:00:27.349332+0000","last_fullsized":"2024-09-13T19:00:27.349332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.346686+0000","last_change":"2024-09-13T19:00:27.346686+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.346686+0000","last_undegraded":"2024-09-13T19:00:27.346686+0000","last_fullsized":"2024-09-13T19:00:27.346686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T19:00:24.723778+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:24.723778+0000","last_peered":"2024-09-13T19:00:24.723778+0000","last_clean":"2024-09-13T19:00:24.723778+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:24.723778+0000","last_undegraded":"2024-09-13T19:00:24.723778+0000","last_fullsized":"2024-09-13T19:00:24.723778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1589248,"data_stored":1009107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.621},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.755},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.495},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.505}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.622},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":412922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.378}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.749}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.81399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.755}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.77500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":412922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.94899999999999995}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":1.006}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":1.02},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.0800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1589248,"data_stored":1009107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.624},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:00:32.989 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:00:33.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.177+0000 7fc8bca00640 1 Processor -- start 2024-09-13T19:00:33.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.177+0000 7fc8bca00640 1 -- start start 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8bca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc8b815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8bca00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80cbfc0 con 0x7fc8b80b40c0 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8bca00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80707a0 con 0x7fc8b815a5c0 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8bca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cce20 con 0x7fc8b80cbac0 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8afe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc8b80b40c0 0x7fc8b815a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56586/0 (socket says 172.21.15.33:56586) 2024-09-13T19:00:33.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8afe00640 1 -- 172.21.15.33:0/922161481 learned_addr learned my addr 172.21.15.33:0/922161481 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc8b815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369790963 0 0) 0x7fc8b80cbfc0 con 0x7fc8b80b40c0 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.179+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc89c003520 con 0x7fc8b80b40c0 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627349890 0 0) 0x7fc89c003520 con 0x7fc8b80b40c0 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 msgr2=0x7fc8b815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:33.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc8b815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 >> v1:172.21.15.103:6789/0 conn(0x7fc8b815a5c0 legacy=0x7fc8b80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8070a80 con 0x7fc8b80b40c0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fc8a0001670 con 0x7fc8b80b40c0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 >> v1:172.21.15.33:6789/0 conn(0x7fc8b80b40c0 legacy=0x7fc8b815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc89c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c003ee0 0x7fc89c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc89c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cce20 con 0x7fc89c004d00 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c00b9e0 con 0x7fc89c003ee0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c00bba0 con 0x7fc8b80cbac0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b7400640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc89c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc89c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.180+0000 7fc8afe00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c003ee0 0x7fc89c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.181+0000 7fc8b7e00640 1 -- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 msgr2=0x7fc89c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:33.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.181+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b80cbac0 0x7fc89c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.181+0000 7fc8b7e00640 1 -- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c003ee0 msgr2=0x7fc89c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:33.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.181+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c003ee0 0x7fc89c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.181+0000 7fc8b7e00640 1 -- 172.21.15.33:0/922161481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c003520 con 0x7fc89c004d00 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.182+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc89c005180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80cbef0 tx=0x7fc89c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2ac9a9f593b96a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.182+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0032600 con 0x7fc89c004d00 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.182+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b002e050 con 0x7fc89c004d00 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.182+0000 7fc8b6a00640 1 -- 172.21.15.33:0/922161481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0032980 con 0x7fc89c004d00 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 -- 172.21.15.33:0/922161481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 msgr2=0x7fc89c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 --2- 172.21.15.33:0/922161481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc89c005180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80cbef0 tx=0x7fc89c0057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8b7e00640 1 -- 172.21.15.33:0/922161481 reap_dead start 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 -- 172.21.15.33:0/922161481 shutdown_connections 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 -- 172.21.15.33:0/922161481 >> 172.21.15.33:0/922161481 conn(0x7fc8b80ae310 msgr2=0x7fc8b80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:33.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 -- 172.21.15.33:0/922161481 shutdown_connections 2024-09-13T19:00:33.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.183+0000 7fc8bca00640 1 -- 172.21.15.33:0/922161481 wait complete. 2024-09-13T19:00:33.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.184+0000 7fc8bca00640 1 Processor -- start 2024-09-13T19:00:33.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 -- start start 2024-09-13T19:00:33.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 0x7fc8b815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b8156030 0x7fc8b806c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80c7be0 con 0x7fc89c004d00 2024-09-13T19:00:33.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b815c2f0 con 0x7fc8b8156030 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.185+0000 7fc8bca00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b815c5d0 con 0x7fc8b815d8a0 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52614/0 (socket says 172.21.15.33:52614) 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 -- 172.21.15.33:0/882187985 learned_addr learned my addr 172.21.15.33:0/882187985 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8afe00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 0x7fc8b815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7e00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b8156030 0x7fc8b806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 -- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 msgr2=0x7fc8b815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 0x7fc8b815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 -- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b8156030 msgr2=0x7fc8b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b8156030 0x7fc8b806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 -- 172.21.15.33:0/882187985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b815c8b0 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8afe00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 0x7fc8b815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.186+0000 7fc8b7400640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800f7c0 tx=0x7fc8a800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.187+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800fed0 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.187+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a80052e0 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.187+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800d970 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.187+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80c37b0 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.187+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b81564e0 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.188+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8067360 con 0x7fc89c004d00 2024-09-13T19:00:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.189+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc8a800dad0 con 0x7fc89c004d00 2024-09-13T19:00:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.190+0000 7fc8af400640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 0x7fc89406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.190+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a80894d0 con 0x7fc89c004d00 2024-09-13T19:00:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.190+0000 7fc8afe00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 0x7fc89406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.191+0000 7fc8afe00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 0x7fc89406d0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80adb30 tx=0x7fc8a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.194+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc8a8054610 con 0x7fc89c004d00 2024-09-13T19:00:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.373+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8b80cb3b0 con 0x7fc89406ac00 2024-09-13T19:00:33.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.381+0000 7fc8af400640 1 -- 172.21.15.33:0/882187985 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287477 (secure 0 0 0) 0x7fc8b80cb3b0 con 0x7fc89406ac00 2024-09-13T19:00:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:33.388 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:00:33.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 msgr2=0x7fc89406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 0x7fc89406d0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80adb30 tx=0x7fc8a0009040 comp rx=0 tx=0).stop 2024-09-13T19:00:33.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 msgr2=0x7fc8b80c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800f7c0 tx=0x7fc8a800fc80 comp rx=0 tx=0).stop 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 shutdown_connections 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc89406ac00 0x7fc89406d0c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b8156030 0x7fc8b806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8b815d8a0 0x7fc8b815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 --2- 172.21.15.33:0/882187985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc89c004d00 0x7fc8b80c76a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 >> 172.21.15.33:0/882187985 conn(0x7fc8b80ae310 msgr2=0x7fc8b80b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 shutdown_connections 2024-09-13T19:00:33.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.385+0000 7fc8bca00640 1 -- 172.21.15.33:0/882187985 wait complete. 2024-09-13T19:00:33.404 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T19:00:33.140768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245940,"kb_used_data":9240,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728780,"statfs":{"total":773094113280,"available":772842270720,"internally_reserved":0,"allocated":9461760,"data_stored":4670128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797003"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812475+0000","last_change":"2024-09-13T19:00:28.808975+0000","last_active":"2024-09-13T19:00:29.812475+0000","last_peered":"2024-09-13T19:00:29.812475+0000","last_clean":"2024-09-13T19:00:29.812475+0000","last_became_active":"2024-09-13T19:00:28.808231+0000","last_became_peered":"2024-09-13T19:00:28.808231+0000","last_unstale":"2024-09-13T19:00:29.812475+0000","last_undegraded":"2024-09-13T19:00:29.812475+0000","last_fullsized":"2024-09-13T19:00:29.812475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:48.900604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800415+0000","last_change":"2024-09-13T19:00:28.810041+0000","last_active":"2024-09-13T19:00:29.800415+0000","last_peered":"2024-09-13T19:00:29.800415+0000","last_clean":"2024-09-13T19:00:29.800415+0000","last_became_active":"2024-09-13T19:00:28.809612+0000","last_became_peered":"2024-09-13T19:00:28.809612+0000","last_unstale":"2024-09-13T19:00:29.800415+0000","last_undegraded":"2024-09-13T19:00:29.800415+0000","last_fullsized":"2024-09-13T19:00:29.800415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:38.496578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795512+0000","last_change":"2024-09-13T19:00:28.816738+0000","last_active":"2024-09-13T19:00:29.795512+0000","last_peered":"2024-09-13T19:00:29.795512+0000","last_clean":"2024-09-13T19:00:29.795512+0000","last_became_active":"2024-09-13T19:00:28.816271+0000","last_became_peered":"2024-09-13T19:00:28.816271+0000","last_unstale":"2024-09-13T19:00:29.795512+0000","last_undegraded":"2024-09-13T19:00:29.795512+0000","last_fullsized":"2024-09-13T19:00:29.795512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:10.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800441+0000","last_change":"2024-09-13T19:00:28.815636+0000","last_active":"2024-09-13T19:00:29.800441+0000","last_peered":"2024-09-13T19:00:29.800441+0000","last_clean":"2024-09-13T19:00:29.800441+0000","last_became_active":"2024-09-13T19:00:28.813171+0000","last_became_peered":"2024-09-13T19:00:28.813171+0000","last_unstale":"2024-09-13T19:00:29.800441+0000","last_undegraded":"2024-09-13T19:00:29.800441+0000","last_fullsized":"2024-09-13T19:00:29.800441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811981+0000","last_change":"2024-09-13T19:00:28.806035+0000","last_active":"2024-09-13T19:00:29.811981+0000","last_peered":"2024-09-13T19:00:29.811981+0000","last_clean":"2024-09-13T19:00:29.811981+0000","last_became_active":"2024-09-13T19:00:28.805408+0000","last_became_peered":"2024-09-13T19:00:28.805408+0000","last_unstale":"2024-09-13T19:00:29.811981+0000","last_undegraded":"2024-09-13T19:00:29.811981+0000","last_fullsized":"2024-09-13T19:00:29.811981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795070+0000","last_change":"2024-09-13T19:00:28.804137+0000","last_active":"2024-09-13T19:00:29.795070+0000","last_peered":"2024-09-13T19:00:29.795070+0000","last_clean":"2024-09-13T19:00:29.795070+0000","last_became_active":"2024-09-13T19:00:28.803862+0000","last_became_peered":"2024-09-13T19:00:28.803862+0000","last_unstale":"2024-09-13T19:00:29.795070+0000","last_undegraded":"2024-09-13T19:00:29.795070+0000","last_fullsized":"2024-09-13T19:00:29.795070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:14.650077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811822+0000","last_change":"2024-09-13T19:00:28.814517+0000","last_active":"2024-09-13T19:00:29.811822+0000","last_peered":"2024-09-13T19:00:29.811822+0000","last_clean":"2024-09-13T19:00:29.811822+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.811822+0000","last_undegraded":"2024-09-13T19:00:29.811822+0000","last_fullsized":"2024-09-13T19:00:29.811822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.854629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812314+0000","last_change":"2024-09-13T19:00:28.803730+0000","last_active":"2024-09-13T19:00:29.812314+0000","last_peered":"2024-09-13T19:00:29.812314+0000","last_clean":"2024-09-13T19:00:29.812314+0000","last_became_active":"2024-09-13T19:00:28.803093+0000","last_became_peered":"2024-09-13T19:00:28.803093+0000","last_unstale":"2024-09-13T19:00:29.812314+0000","last_undegraded":"2024-09-13T19:00:29.812314+0000","last_fullsized":"2024-09-13T19:00:29.812314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:20.692961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.808120+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.807575+0000","last_became_peered":"2024-09-13T19:00:28.807575+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:53.288254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800475+0000","last_change":"2024-09-13T19:00:28.796884+0000","last_active":"2024-09-13T19:00:29.800475+0000","last_peered":"2024-09-13T19:00:29.800475+0000","last_clean":"2024-09-13T19:00:29.800475+0000","last_became_active":"2024-09-13T19:00:28.795740+0000","last_became_peered":"2024-09-13T19:00:28.795740+0000","last_unstale":"2024-09-13T19:00:29.800475+0000","last_undegraded":"2024-09-13T19:00:29.800475+0000","last_fullsized":"2024-09-13T19:00:29.800475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795308+0000","last_change":"2024-09-13T19:00:28.813653+0000","last_active":"2024-09-13T19:00:29.795308+0000","last_peered":"2024-09-13T19:00:29.795308+0000","last_clean":"2024-09-13T19:00:29.795308+0000","last_became_active":"2024-09-13T19:00:28.812284+0000","last_became_peered":"2024-09-13T19:00:28.812284+0000","last_unstale":"2024-09-13T19:00:29.795308+0000","last_undegraded":"2024-09-13T19:00:29.795308+0000","last_fullsized":"2024-09-13T19:00:29.795308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.600086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812409+0000","last_change":"2024-09-13T19:00:28.797545+0000","last_active":"2024-09-13T19:00:29.812409+0000","last_peered":"2024-09-13T19:00:29.812409+0000","last_clean":"2024-09-13T19:00:29.812409+0000","last_became_active":"2024-09-13T19:00:28.797292+0000","last_became_peered":"2024-09-13T19:00:28.797292+0000","last_unstale":"2024-09-13T19:00:29.812409+0000","last_undegraded":"2024-09-13T19:00:29.812409+0000","last_fullsized":"2024-09-13T19:00:29.812409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800315+0000","last_change":"2024-09-13T19:00:28.806721+0000","last_active":"2024-09-13T19:00:29.800315+0000","last_peered":"2024-09-13T19:00:29.800315+0000","last_clean":"2024-09-13T19:00:29.800315+0000","last_became_active":"2024-09-13T19:00:28.803130+0000","last_became_peered":"2024-09-13T19:00:28.803130+0000","last_unstale":"2024-09-13T19:00:29.800315+0000","last_undegraded":"2024-09-13T19:00:29.800315+0000","last_fullsized":"2024-09-13T19:00:29.800315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801232+0000","last_change":"2024-09-13T19:00:28.799336+0000","last_active":"2024-09-13T19:00:29.801232+0000","last_peered":"2024-09-13T19:00:29.801232+0000","last_clean":"2024-09-13T19:00:29.801232+0000","last_became_active":"2024-09-13T19:00:28.799000+0000","last_became_peered":"2024-09-13T19:00:28.799000+0000","last_unstale":"2024-09-13T19:00:29.801232+0000","last_undegraded":"2024-09-13T19:00:29.801232+0000","last_fullsized":"2024-09-13T19:00:29.801232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:54.676245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795425+0000","last_change":"2024-09-13T19:00:28.811088+0000","last_active":"2024-09-13T19:00:29.795425+0000","last_peered":"2024-09-13T19:00:29.795425+0000","last_clean":"2024-09-13T19:00:29.795425+0000","last_became_active":"2024-09-13T19:00:28.810848+0000","last_became_peered":"2024-09-13T19:00:28.810848+0000","last_unstale":"2024-09-13T19:00:29.795425+0000","last_undegraded":"2024-09-13T19:00:29.795425+0000","last_fullsized":"2024-09-13T19:00:29.795425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:03.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813072+0000","last_change":"2024-09-13T19:00:28.810985+0000","last_active":"2024-09-13T19:00:29.813072+0000","last_peered":"2024-09-13T19:00:29.813072+0000","last_clean":"2024-09-13T19:00:29.813072+0000","last_became_active":"2024-09-13T19:00:28.810680+0000","last_became_peered":"2024-09-13T19:00:28.810680+0000","last_unstale":"2024-09-13T19:00:29.813072+0000","last_undegraded":"2024-09-13T19:00:29.813072+0000","last_fullsized":"2024-09-13T19:00:29.813072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795426+0000","last_change":"2024-09-13T19:00:28.813221+0000","last_active":"2024-09-13T19:00:29.795426+0000","last_peered":"2024-09-13T19:00:29.795426+0000","last_clean":"2024-09-13T19:00:29.795426+0000","last_became_active":"2024-09-13T19:00:28.812271+0000","last_became_peered":"2024-09-13T19:00:28.812271+0000","last_unstale":"2024-09-13T19:00:29.795426+0000","last_undegraded":"2024-09-13T19:00:29.795426+0000","last_fullsized":"2024-09-13T19:00:29.795426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:17.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795254+0000","last_change":"2024-09-13T19:00:28.803498+0000","last_active":"2024-09-13T19:00:29.795254+0000","last_peered":"2024-09-13T19:00:29.795254+0000","last_clean":"2024-09-13T19:00:29.795254+0000","last_became_active":"2024-09-13T19:00:28.803226+0000","last_became_peered":"2024-09-13T19:00:28.803226+0000","last_unstale":"2024-09-13T19:00:29.795254+0000","last_undegraded":"2024-09-13T19:00:29.795254+0000","last_fullsized":"2024-09-13T19:00:29.795254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:19.364448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811934+0000","last_change":"2024-09-13T19:00:28.820581+0000","last_active":"2024-09-13T19:00:29.811934+0000","last_peered":"2024-09-13T19:00:29.811934+0000","last_clean":"2024-09-13T19:00:29.811934+0000","last_became_active":"2024-09-13T19:00:28.820011+0000","last_became_peered":"2024-09-13T19:00:28.820011+0000","last_unstale":"2024-09-13T19:00:29.811934+0000","last_undegraded":"2024-09-13T19:00:29.811934+0000","last_fullsized":"2024-09-13T19:00:29.811934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:47.794554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795037+0000","last_change":"2024-09-13T19:00:28.813775+0000","last_active":"2024-09-13T19:00:29.795037+0000","last_peered":"2024-09-13T19:00:29.795037+0000","last_clean":"2024-09-13T19:00:29.795037+0000","last_became_active":"2024-09-13T19:00:28.811975+0000","last_became_peered":"2024-09-13T19:00:28.811975+0000","last_unstale":"2024-09-13T19:00:29.795037+0000","last_undegraded":"2024-09-13T19:00:29.795037+0000","last_fullsized":"2024-09-13T19:00:29.795037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:40.891490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812018+0000","last_change":"2024-09-13T19:00:28.807295+0000","last_active":"2024-09-13T19:00:29.812018+0000","last_peered":"2024-09-13T19:00:29.812018+0000","last_clean":"2024-09-13T19:00:29.812018+0000","last_became_active":"2024-09-13T19:00:28.806583+0000","last_became_peered":"2024-09-13T19:00:28.806583+0000","last_unstale":"2024-09-13T19:00:29.812018+0000","last_undegraded":"2024-09-13T19:00:29.812018+0000","last_fullsized":"2024-09-13T19:00:29.812018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:53.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800619+0000","last_change":"2024-09-13T19:00:28.810241+0000","last_active":"2024-09-13T19:00:29.800619+0000","last_peered":"2024-09-13T19:00:29.800619+0000","last_clean":"2024-09-13T19:00:29.800619+0000","last_became_active":"2024-09-13T19:00:28.809955+0000","last_became_peered":"2024-09-13T19:00:28.809955+0000","last_unstale":"2024-09-13T19:00:29.800619+0000","last_undegraded":"2024-09-13T19:00:29.800619+0000","last_fullsized":"2024-09-13T19:00:29.800619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801014+0000","last_change":"2024-09-13T19:00:28.798670+0000","last_active":"2024-09-13T19:00:29.801014+0000","last_peered":"2024-09-13T19:00:29.801014+0000","last_clean":"2024-09-13T19:00:29.801014+0000","last_became_active":"2024-09-13T19:00:28.798380+0000","last_became_peered":"2024-09-13T19:00:28.798380+0000","last_unstale":"2024-09-13T19:00:29.801014+0000","last_undegraded":"2024-09-13T19:00:29.801014+0000","last_fullsized":"2024-09-13T19:00:29.801014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811957+0000","last_change":"2024-09-13T19:00:28.813470+0000","last_active":"2024-09-13T19:00:29.811957+0000","last_peered":"2024-09-13T19:00:29.811957+0000","last_clean":"2024-09-13T19:00:29.811957+0000","last_became_active":"2024-09-13T19:00:28.813215+0000","last_became_peered":"2024-09-13T19:00:28.813215+0000","last_unstale":"2024-09-13T19:00:29.811957+0000","last_undegraded":"2024-09-13T19:00:29.811957+0000","last_fullsized":"2024-09-13T19:00:29.811957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812031+0000","last_change":"2024-09-13T19:00:28.820335+0000","last_active":"2024-09-13T19:00:29.812031+0000","last_peered":"2024-09-13T19:00:29.812031+0000","last_clean":"2024-09-13T19:00:29.812031+0000","last_became_active":"2024-09-13T19:00:28.820067+0000","last_became_peered":"2024-09-13T19:00:28.820067+0000","last_unstale":"2024-09-13T19:00:29.812031+0000","last_undegraded":"2024-09-13T19:00:29.812031+0000","last_fullsized":"2024-09-13T19:00:29.812031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:07.329940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800248+0000","last_change":"2024-09-13T19:00:28.813908+0000","last_active":"2024-09-13T19:00:29.800248+0000","last_peered":"2024-09-13T19:00:29.800248+0000","last_clean":"2024-09-13T19:00:29.800248+0000","last_became_active":"2024-09-13T19:00:28.813585+0000","last_became_peered":"2024-09-13T19:00:28.813585+0000","last_unstale":"2024-09-13T19:00:29.800248+0000","last_undegraded":"2024-09-13T19:00:29.800248+0000","last_fullsized":"2024-09-13T19:00:29.800248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801216+0000","last_change":"2024-09-13T19:00:28.809178+0000","last_active":"2024-09-13T19:00:29.801216+0000","last_peered":"2024-09-13T19:00:29.801216+0000","last_clean":"2024-09-13T19:00:29.801216+0000","last_became_active":"2024-09-13T19:00:28.808874+0000","last_became_peered":"2024-09-13T19:00:28.808874+0000","last_unstale":"2024-09-13T19:00:29.801216+0000","last_undegraded":"2024-09-13T19:00:29.801216+0000","last_fullsized":"2024-09-13T19:00:29.801216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:44.525840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353811+0000","last_change":"2024-09-13T19:00:27.353811+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353811+0000","last_undegraded":"2024-09-13T19:00:27.353811+0000","last_fullsized":"2024-09-13T19:00:27.353811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.815987+0000","last_change":"2024-09-13T19:00:28.365834+0000","last_active":"2024-09-13T19:00:28.815987+0000","last_peered":"2024-09-13T19:00:28.815987+0000","last_clean":"2024-09-13T19:00:28.815987+0000","last_became_active":"2024-09-13T19:00:28.365494+0000","last_became_peered":"2024-09-13T19:00:28.365494+0000","last_unstale":"2024-09-13T19:00:28.815987+0000","last_undegraded":"2024-09-13T19:00:28.815987+0000","last_fullsized":"2024-09-13T19:00:28.815987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:39.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.822288+0000","last_change":"2024-09-13T19:00:28.370121+0000","last_active":"2024-09-13T19:00:28.822288+0000","last_peered":"2024-09-13T19:00:28.822288+0000","last_clean":"2024-09-13T19:00:28.822288+0000","last_became_active":"2024-09-13T19:00:28.369832+0000","last_became_peered":"2024-09-13T19:00:28.369832+0000","last_unstale":"2024-09-13T19:00:28.822288+0000","last_undegraded":"2024-09-13T19:00:28.822288+0000","last_fullsized":"2024-09-13T19:00:28.822288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:31.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800544+0000","last_change":"2024-09-13T19:00:28.800787+0000","last_active":"2024-09-13T19:00:29.800544+0000","last_peered":"2024-09-13T19:00:29.800544+0000","last_clean":"2024-09-13T19:00:29.800544+0000","last_became_active":"2024-09-13T19:00:28.800502+0000","last_became_peered":"2024-09-13T19:00:28.800502+0000","last_unstale":"2024-09-13T19:00:29.800544+0000","last_undegraded":"2024-09-13T19:00:29.800544+0000","last_fullsized":"2024-09-13T19:00:29.800544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821223+0000","last_change":"2024-09-13T19:00:28.368311+0000","last_active":"2024-09-13T19:00:28.821223+0000","last_peered":"2024-09-13T19:00:28.821223+0000","last_clean":"2024-09-13T19:00:28.821223+0000","last_became_active":"2024-09-13T19:00:28.368021+0000","last_became_peered":"2024-09-13T19:00:28.368021+0000","last_unstale":"2024-09-13T19:00:28.821223+0000","last_undegraded":"2024-09-13T19:00:28.821223+0000","last_fullsized":"2024-09-13T19:00:28.821223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:50.636787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812136+0000","last_change":"2024-09-13T19:00:28.814405+0000","last_active":"2024-09-13T19:00:29.812136+0000","last_peered":"2024-09-13T19:00:29.812136+0000","last_clean":"2024-09-13T19:00:29.812136+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.812136+0000","last_undegraded":"2024-09-13T19:00:29.812136+0000","last_fullsized":"2024-09-13T19:00:29.812136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:54.645959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.818704+0000","last_change":"2024-09-13T19:00:28.372231+0000","last_active":"2024-09-13T19:00:28.818704+0000","last_peered":"2024-09-13T19:00:28.818704+0000","last_clean":"2024-09-13T19:00:28.818704+0000","last_became_active":"2024-09-13T19:00:28.370750+0000","last_became_peered":"2024-09-13T19:00:28.370750+0000","last_unstale":"2024-09-13T19:00:28.818704+0000","last_undegraded":"2024-09-13T19:00:28.818704+0000","last_fullsized":"2024-09-13T19:00:28.818704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:32.746000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800548+0000","last_change":"2024-09-13T19:00:28.800083+0000","last_active":"2024-09-13T19:00:29.800548+0000","last_peered":"2024-09-13T19:00:29.800548+0000","last_clean":"2024-09-13T19:00:29.800548+0000","last_became_active":"2024-09-13T19:00:28.799816+0000","last_became_peered":"2024-09-13T19:00:28.799816+0000","last_unstale":"2024-09-13T19:00:29.800548+0000","last_undegraded":"2024-09-13T19:00:29.800548+0000","last_fullsized":"2024-09-13T19:00:29.800548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.643355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.816238+0000","last_change":"2024-09-13T19:00:28.367194+0000","last_active":"2024-09-13T19:00:28.816238+0000","last_peered":"2024-09-13T19:00:28.816238+0000","last_clean":"2024-09-13T19:00:28.816238+0000","last_became_active":"2024-09-13T19:00:28.366291+0000","last_became_peered":"2024-09-13T19:00:28.366291+0000","last_unstale":"2024-09-13T19:00:28.816238+0000","last_undegraded":"2024-09-13T19:00:28.816238+0000","last_fullsized":"2024-09-13T19:00:28.816238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:21.539136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799909+0000","last_change":"2024-09-13T19:00:28.814422+0000","last_active":"2024-09-13T19:00:29.799909+0000","last_peered":"2024-09-13T19:00:29.799909+0000","last_clean":"2024-09-13T19:00:29.799909+0000","last_became_active":"2024-09-13T19:00:28.814146+0000","last_became_peered":"2024-09-13T19:00:28.814146+0000","last_unstale":"2024-09-13T19:00:29.799909+0000","last_undegraded":"2024-09-13T19:00:29.799909+0000","last_fullsized":"2024-09-13T19:00:29.799909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794580+0000","last_change":"2024-09-13T19:00:28.371979+0000","last_active":"2024-09-13T19:00:28.794580+0000","last_peered":"2024-09-13T19:00:28.794580+0000","last_clean":"2024-09-13T19:00:28.794580+0000","last_became_active":"2024-09-13T19:00:28.370337+0000","last_became_peered":"2024-09-13T19:00:28.370337+0000","last_unstale":"2024-09-13T19:00:28.794580+0000","last_undegraded":"2024-09-13T19:00:28.794580+0000","last_fullsized":"2024-09-13T19:00:28.794580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:59.105096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812410+0000","last_change":"2024-09-13T19:00:28.796132+0000","last_active":"2024-09-13T19:00:29.812410+0000","last_peered":"2024-09-13T19:00:29.812410+0000","last_clean":"2024-09-13T19:00:29.812410+0000","last_became_active":"2024-09-13T19:00:28.795888+0000","last_became_peered":"2024-09-13T19:00:28.795888+0000","last_unstale":"2024-09-13T19:00:29.812410+0000","last_undegraded":"2024-09-13T19:00:29.812410+0000","last_fullsized":"2024-09-13T19:00:29.812410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.798122+0000","last_change":"2024-09-13T19:00:28.366686+0000","last_active":"2024-09-13T19:00:28.798122+0000","last_peered":"2024-09-13T19:00:28.798122+0000","last_clean":"2024-09-13T19:00:28.798122+0000","last_became_active":"2024-09-13T19:00:28.366424+0000","last_became_peered":"2024-09-13T19:00:28.366424+0000","last_unstale":"2024-09-13T19:00:28.798122+0000","last_undegraded":"2024-09-13T19:00:28.798122+0000","last_fullsized":"2024-09-13T19:00:28.798122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:15.934982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813210+0000","last_change":"2024-09-13T19:00:28.814378+0000","last_active":"2024-09-13T19:00:29.813210+0000","last_peered":"2024-09-13T19:00:29.813210+0000","last_clean":"2024-09-13T19:00:29.813210+0000","last_became_active":"2024-09-13T19:00:28.814133+0000","last_became_peered":"2024-09-13T19:00:28.814133+0000","last_unstale":"2024-09-13T19:00:29.813210+0000","last_undegraded":"2024-09-13T19:00:29.813210+0000","last_fullsized":"2024-09-13T19:00:29.813210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352770+0000","last_change":"2024-09-13T19:00:27.352770+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352770+0000","last_undegraded":"2024-09-13T19:00:27.352770+0000","last_fullsized":"2024-09-13T19:00:27.352770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812350+0000","last_change":"2024-09-13T19:00:28.803951+0000","last_active":"2024-09-13T19:00:29.812350+0000","last_peered":"2024-09-13T19:00:29.812350+0000","last_clean":"2024-09-13T19:00:29.812350+0000","last_became_active":"2024-09-13T19:00:28.803461+0000","last_became_peered":"2024-09-13T19:00:28.803461+0000","last_unstale":"2024-09-13T19:00:29.812350+0000","last_undegraded":"2024-09-13T19:00:29.812350+0000","last_fullsized":"2024-09-13T19:00:29.812350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:00.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352142+0000","last_change":"2024-09-13T19:00:27.352142+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352142+0000","last_undegraded":"2024-09-13T19:00:27.352142+0000","last_fullsized":"2024-09-13T19:00:27.352142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812712+0000","last_change":"2024-09-13T19:00:28.815486+0000","last_active":"2024-09-13T19:00:29.812712+0000","last_peered":"2024-09-13T19:00:29.812712+0000","last_clean":"2024-09-13T19:00:29.812712+0000","last_became_active":"2024-09-13T19:00:28.815155+0000","last_became_peered":"2024-09-13T19:00:28.815155+0000","last_unstale":"2024-09-13T19:00:29.812712+0000","last_undegraded":"2024-09-13T19:00:29.812712+0000","last_fullsized":"2024-09-13T19:00:29.812712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352510+0000","last_change":"2024-09-13T19:00:27.352510+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352510+0000","last_undegraded":"2024-09-13T19:00:27.352510+0000","last_fullsized":"2024-09-13T19:00:27.352510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800870+0000","last_change":"2024-09-13T19:00:28.815382+0000","last_active":"2024-09-13T19:00:29.800870+0000","last_peered":"2024-09-13T19:00:29.800870+0000","last_clean":"2024-09-13T19:00:29.800870+0000","last_became_active":"2024-09-13T19:00:28.814942+0000","last_became_peered":"2024-09-13T19:00:28.814942+0000","last_unstale":"2024-09-13T19:00:29.800870+0000","last_undegraded":"2024-09-13T19:00:29.800870+0000","last_fullsized":"2024-09-13T19:00:29.800870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823134+0000","last_change":"2024-09-13T19:00:28.373276+0000","last_active":"2024-09-13T19:00:28.823134+0000","last_peered":"2024-09-13T19:00:28.823134+0000","last_clean":"2024-09-13T19:00:28.823134+0000","last_became_active":"2024-09-13T19:00:28.372958+0000","last_became_peered":"2024-09-13T19:00:28.372958+0000","last_unstale":"2024-09-13T19:00:28.823134+0000","last_undegraded":"2024-09-13T19:00:28.823134+0000","last_fullsized":"2024-09-13T19:00:28.823134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811682+0000","last_change":"2024-09-13T19:00:28.820265+0000","last_active":"2024-09-13T19:00:29.811682+0000","last_peered":"2024-09-13T19:00:29.811682+0000","last_clean":"2024-09-13T19:00:29.811682+0000","last_became_active":"2024-09-13T19:00:28.820015+0000","last_became_peered":"2024-09-13T19:00:28.820015+0000","last_unstale":"2024-09-13T19:00:29.811682+0000","last_undegraded":"2024-09-13T19:00:29.811682+0000","last_fullsized":"2024-09-13T19:00:29.811682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823094+0000","last_change":"2024-09-13T19:00:28.370433+0000","last_active":"2024-09-13T19:00:28.823094+0000","last_peered":"2024-09-13T19:00:28.823094+0000","last_clean":"2024-09-13T19:00:28.823094+0000","last_became_active":"2024-09-13T19:00:28.369892+0000","last_became_peered":"2024-09-13T19:00:28.369892+0000","last_unstale":"2024-09-13T19:00:28.823094+0000","last_undegraded":"2024-09-13T19:00:28.823094+0000","last_fullsized":"2024-09-13T19:00:28.823094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:16.635844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800589+0000","last_change":"2024-09-13T19:00:28.807808+0000","last_active":"2024-09-13T19:00:29.800589+0000","last_peered":"2024-09-13T19:00:29.800589+0000","last_clean":"2024-09-13T19:00:29.800589+0000","last_became_active":"2024-09-13T19:00:28.807287+0000","last_became_peered":"2024-09-13T19:00:28.807287+0000","last_unstale":"2024-09-13T19:00:29.800589+0000","last_undegraded":"2024-09-13T19:00:29.800589+0000","last_fullsized":"2024-09-13T19:00:29.800589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.787946+0000","last_change":"2024-09-13T19:00:28.377480+0000","last_active":"2024-09-13T19:00:28.787946+0000","last_peered":"2024-09-13T19:00:28.787946+0000","last_clean":"2024-09-13T19:00:28.787946+0000","last_became_active":"2024-09-13T19:00:28.376960+0000","last_became_peered":"2024-09-13T19:00:28.376960+0000","last_unstale":"2024-09-13T19:00:28.787946+0000","last_undegraded":"2024-09-13T19:00:28.787946+0000","last_fullsized":"2024-09-13T19:00:28.787946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:53.669678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811803+0000","last_change":"2024-09-13T19:00:28.806548+0000","last_active":"2024-09-13T19:00:29.811803+0000","last_peered":"2024-09-13T19:00:29.811803+0000","last_clean":"2024-09-13T19:00:29.811803+0000","last_became_active":"2024-09-13T19:00:28.802337+0000","last_became_peered":"2024-09-13T19:00:28.802337+0000","last_unstale":"2024-09-13T19:00:29.811803+0000","last_undegraded":"2024-09-13T19:00:29.811803+0000","last_fullsized":"2024-09-13T19:00:29.811803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:22.232714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794909+0000","last_change":"2024-09-13T19:00:28.369519+0000","last_active":"2024-09-13T19:00:28.794909+0000","last_peered":"2024-09-13T19:00:28.794909+0000","last_clean":"2024-09-13T19:00:28.794909+0000","last_became_active":"2024-09-13T19:00:28.369150+0000","last_became_peered":"2024-09-13T19:00:28.369150+0000","last_unstale":"2024-09-13T19:00:28.794909+0000","last_undegraded":"2024-09-13T19:00:28.794909+0000","last_fullsized":"2024-09-13T19:00:28.794909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811686+0000","last_change":"2024-09-13T19:00:28.805379+0000","last_active":"2024-09-13T19:00:29.811686+0000","last_peered":"2024-09-13T19:00:29.811686+0000","last_clean":"2024-09-13T19:00:29.811686+0000","last_became_active":"2024-09-13T19:00:28.805121+0000","last_became_peered":"2024-09-13T19:00:28.805121+0000","last_unstale":"2024-09-13T19:00:29.811686+0000","last_undegraded":"2024-09-13T19:00:29.811686+0000","last_fullsized":"2024-09-13T19:00:29.811686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:32.528562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.824016+0000","last_change":"2024-09-13T19:00:28.376100+0000","last_active":"2024-09-13T19:00:28.824016+0000","last_peered":"2024-09-13T19:00:28.824016+0000","last_clean":"2024-09-13T19:00:28.824016+0000","last_became_active":"2024-09-13T19:00:28.375841+0000","last_became_peered":"2024-09-13T19:00:28.375841+0000","last_unstale":"2024-09-13T19:00:28.824016+0000","last_undegraded":"2024-09-13T19:00:28.824016+0000","last_fullsized":"2024-09-13T19:00:28.824016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:31.390640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800688+0000","last_change":"2024-09-13T19:00:28.809367+0000","last_active":"2024-09-13T19:00:29.800688+0000","last_peered":"2024-09-13T19:00:29.800688+0000","last_clean":"2024-09-13T19:00:29.800688+0000","last_became_active":"2024-09-13T19:00:28.807363+0000","last_became_peered":"2024-09-13T19:00:28.807363+0000","last_unstale":"2024-09-13T19:00:29.800688+0000","last_undegraded":"2024-09-13T19:00:29.800688+0000","last_fullsized":"2024-09-13T19:00:29.800688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352199+0000","last_change":"2024-09-13T19:00:27.352199+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352199+0000","last_undegraded":"2024-09-13T19:00:27.352199+0000","last_fullsized":"2024-09-13T19:00:27.352199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821881+0000","last_change":"2024-09-13T19:00:28.369284+0000","last_active":"2024-09-13T19:00:28.821881+0000","last_peered":"2024-09-13T19:00:28.821881+0000","last_clean":"2024-09-13T19:00:28.821881+0000","last_became_active":"2024-09-13T19:00:28.369016+0000","last_became_peered":"2024-09-13T19:00:28.369016+0000","last_unstale":"2024-09-13T19:00:28.821881+0000","last_undegraded":"2024-09-13T19:00:28.821881+0000","last_fullsized":"2024-09-13T19:00:28.821881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:47.940954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801006+0000","last_change":"2024-09-13T19:00:28.812669+0000","last_active":"2024-09-13T19:00:29.801006+0000","last_peered":"2024-09-13T19:00:29.801006+0000","last_clean":"2024-09-13T19:00:29.801006+0000","last_became_active":"2024-09-13T19:00:28.812357+0000","last_became_peered":"2024-09-13T19:00:28.812357+0000","last_unstale":"2024-09-13T19:00:29.801006+0000","last_undegraded":"2024-09-13T19:00:29.801006+0000","last_fullsized":"2024-09-13T19:00:29.801006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795700+0000","last_change":"2024-09-13T19:00:28.369758+0000","last_active":"2024-09-13T19:00:28.795700+0000","last_peered":"2024-09-13T19:00:28.795700+0000","last_clean":"2024-09-13T19:00:28.795700+0000","last_became_active":"2024-09-13T19:00:28.366342+0000","last_became_peered":"2024-09-13T19:00:28.366342+0000","last_unstale":"2024-09-13T19:00:28.795700+0000","last_undegraded":"2024-09-13T19:00:28.795700+0000","last_fullsized":"2024-09-13T19:00:28.795700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:55.732038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795417+0000","last_change":"2024-09-13T19:00:28.817448+0000","last_active":"2024-09-13T19:00:29.795417+0000","last_peered":"2024-09-13T19:00:29.795417+0000","last_clean":"2024-09-13T19:00:29.795417+0000","last_became_active":"2024-09-13T19:00:28.815546+0000","last_became_peered":"2024-09-13T19:00:28.815546+0000","last_unstale":"2024-09-13T19:00:29.795417+0000","last_undegraded":"2024-09-13T19:00:29.795417+0000","last_fullsized":"2024-09-13T19:00:29.795417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:52.684470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817769+0000","last_change":"2024-09-13T19:00:28.370089+0000","last_active":"2024-09-13T19:00:28.817769+0000","last_peered":"2024-09-13T19:00:28.817769+0000","last_clean":"2024-09-13T19:00:28.817769+0000","last_became_active":"2024-09-13T19:00:28.369842+0000","last_became_peered":"2024-09-13T19:00:28.369842+0000","last_unstale":"2024-09-13T19:00:28.817769+0000","last_undegraded":"2024-09-13T19:00:28.817769+0000","last_fullsized":"2024-09-13T19:00:28.817769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.519273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812095+0000","last_change":"2024-09-13T19:00:28.809780+0000","last_active":"2024-09-13T19:00:29.812095+0000","last_peered":"2024-09-13T19:00:29.812095+0000","last_clean":"2024-09-13T19:00:29.812095+0000","last_became_active":"2024-09-13T19:00:28.809165+0000","last_became_peered":"2024-09-13T19:00:28.809165+0000","last_unstale":"2024-09-13T19:00:29.812095+0000","last_undegraded":"2024-09-13T19:00:29.812095+0000","last_fullsized":"2024-09-13T19:00:29.812095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:32.309208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793623+0000","last_change":"2024-09-13T19:00:28.367585+0000","last_active":"2024-09-13T19:00:28.793623+0000","last_peered":"2024-09-13T19:00:28.793623+0000","last_clean":"2024-09-13T19:00:28.793623+0000","last_became_active":"2024-09-13T19:00:28.367298+0000","last_became_peered":"2024-09-13T19:00:28.367298+0000","last_unstale":"2024-09-13T19:00:28.793623+0000","last_undegraded":"2024-09-13T19:00:28.793623+0000","last_fullsized":"2024-09-13T19:00:28.793623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.664451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795115+0000","last_change":"2024-09-13T19:00:28.806322+0000","last_active":"2024-09-13T19:00:29.795115+0000","last_peered":"2024-09-13T19:00:29.795115+0000","last_clean":"2024-09-13T19:00:29.795115+0000","last_became_active":"2024-09-13T19:00:28.806063+0000","last_became_peered":"2024-09-13T19:00:28.806063+0000","last_unstale":"2024-09-13T19:00:29.795115+0000","last_undegraded":"2024-09-13T19:00:29.795115+0000","last_fullsized":"2024-09-13T19:00:29.795115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:26.684968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793626+0000","last_change":"2024-09-13T19:00:28.377051+0000","last_active":"2024-09-13T19:00:28.793626+0000","last_peered":"2024-09-13T19:00:28.793626+0000","last_clean":"2024-09-13T19:00:28.793626+0000","last_became_active":"2024-09-13T19:00:28.376590+0000","last_became_peered":"2024-09-13T19:00:28.376590+0000","last_unstale":"2024-09-13T19:00:28.793626+0000","last_undegraded":"2024-09-13T19:00:28.793626+0000","last_fullsized":"2024-09-13T19:00:28.793626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:57.996268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811841+0000","last_change":"2024-09-13T19:00:28.805849+0000","last_active":"2024-09-13T19:00:29.811841+0000","last_peered":"2024-09-13T19:00:29.811841+0000","last_clean":"2024-09-13T19:00:29.811841+0000","last_became_active":"2024-09-13T19:00:28.805522+0000","last_became_peered":"2024-09-13T19:00:28.805522+0000","last_unstale":"2024-09-13T19:00:29.811841+0000","last_undegraded":"2024-09-13T19:00:29.811841+0000","last_fullsized":"2024-09-13T19:00:29.811841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:07.000007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.788165+0000","last_change":"2024-09-13T19:00:28.368110+0000","last_active":"2024-09-13T19:00:28.788165+0000","last_peered":"2024-09-13T19:00:28.788165+0000","last_clean":"2024-09-13T19:00:28.788165+0000","last_became_active":"2024-09-13T19:00:28.367864+0000","last_became_peered":"2024-09-13T19:00:28.367864+0000","last_unstale":"2024-09-13T19:00:28.788165+0000","last_undegraded":"2024-09-13T19:00:28.788165+0000","last_fullsized":"2024-09-13T19:00:28.788165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:58.073529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801166+0000","last_change":"2024-09-13T19:00:28.806973+0000","last_active":"2024-09-13T19:00:29.801166+0000","last_peered":"2024-09-13T19:00:29.801166+0000","last_clean":"2024-09-13T19:00:29.801166+0000","last_became_active":"2024-09-13T19:00:28.806508+0000","last_became_peered":"2024-09-13T19:00:28.806508+0000","last_unstale":"2024-09-13T19:00:29.801166+0000","last_undegraded":"2024-09-13T19:00:29.801166+0000","last_fullsized":"2024-09-13T19:00:29.801166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817381+0000","last_change":"2024-09-13T19:00:28.374360+0000","last_active":"2024-09-13T19:00:28.817381+0000","last_peered":"2024-09-13T19:00:28.817381+0000","last_clean":"2024-09-13T19:00:28.817381+0000","last_became_active":"2024-09-13T19:00:28.374052+0000","last_became_peered":"2024-09-13T19:00:28.374052+0000","last_unstale":"2024-09-13T19:00:28.817381+0000","last_undegraded":"2024-09-13T19:00:28.817381+0000","last_fullsized":"2024-09-13T19:00:28.817381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:18.357881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800838+0000","last_change":"2024-09-13T19:00:28.804644+0000","last_active":"2024-09-13T19:00:29.800838+0000","last_peered":"2024-09-13T19:00:29.800838+0000","last_clean":"2024-09-13T19:00:29.800838+0000","last_became_active":"2024-09-13T19:00:28.804318+0000","last_became_peered":"2024-09-13T19:00:28.804318+0000","last_unstale":"2024-09-13T19:00:29.800838+0000","last_undegraded":"2024-09-13T19:00:29.800838+0000","last_fullsized":"2024-09-13T19:00:29.800838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.799327+0000","last_change":"2024-09-13T19:00:28.369253+0000","last_active":"2024-09-13T19:00:28.799327+0000","last_peered":"2024-09-13T19:00:28.799327+0000","last_clean":"2024-09-13T19:00:28.799327+0000","last_became_active":"2024-09-13T19:00:28.368999+0000","last_became_peered":"2024-09-13T19:00:28.368999+0000","last_unstale":"2024-09-13T19:00:28.799327+0000","last_undegraded":"2024-09-13T19:00:28.799327+0000","last_fullsized":"2024-09-13T19:00:28.799327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:25.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353038+0000","last_change":"2024-09-13T19:00:27.353038+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353038+0000","last_undegraded":"2024-09-13T19:00:27.353038+0000","last_fullsized":"2024-09-13T19:00:27.353038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801141+0000","last_change":"2024-09-13T19:00:28.815219+0000","last_active":"2024-09-13T19:00:29.801141+0000","last_peered":"2024-09-13T19:00:29.801141+0000","last_clean":"2024-09-13T19:00:29.801141+0000","last_became_active":"2024-09-13T19:00:28.814608+0000","last_became_peered":"2024-09-13T19:00:28.814608+0000","last_unstale":"2024-09-13T19:00:29.801141+0000","last_undegraded":"2024-09-13T19:00:29.801141+0000","last_fullsized":"2024-09-13T19:00:29.801141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352159+0000","last_change":"2024-09-13T19:00:27.352159+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352159+0000","last_undegraded":"2024-09-13T19:00:27.352159+0000","last_fullsized":"2024-09-13T19:00:27.352159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812046+0000","last_change":"2024-09-13T19:00:28.812693+0000","last_active":"2024-09-13T19:00:29.812046+0000","last_peered":"2024-09-13T19:00:29.812046+0000","last_clean":"2024-09-13T19:00:29.812046+0000","last_became_active":"2024-09-13T19:00:28.809943+0000","last_became_peered":"2024-09-13T19:00:28.809943+0000","last_unstale":"2024-09-13T19:00:29.812046+0000","last_undegraded":"2024-09-13T19:00:29.812046+0000","last_fullsized":"2024-09-13T19:00:29.812046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:56.738605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795445+0000","last_change":"2024-09-13T19:00:28.377131+0000","last_active":"2024-09-13T19:00:28.795445+0000","last_peered":"2024-09-13T19:00:28.795445+0000","last_clean":"2024-09-13T19:00:28.795445+0000","last_became_active":"2024-09-13T19:00:28.376871+0000","last_became_peered":"2024-09-13T19:00:28.376871+0000","last_unstale":"2024-09-13T19:00:28.795445+0000","last_undegraded":"2024-09-13T19:00:28.795445+0000","last_fullsized":"2024-09-13T19:00:28.795445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.822455+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.822143+0000","last_became_peered":"2024-09-13T19:00:28.822143+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.790525+0000","last_change":"2024-09-13T19:00:28.372034+0000","last_active":"2024-09-13T19:00:28.790525+0000","last_peered":"2024-09-13T19:00:28.790525+0000","last_clean":"2024-09-13T19:00:28.790525+0000","last_became_active":"2024-09-13T19:00:28.371752+0000","last_became_peered":"2024-09-13T19:00:28.371752+0000","last_unstale":"2024-09-13T19:00:28.790525+0000","last_undegraded":"2024-09-13T19:00:28.790525+0000","last_fullsized":"2024-09-13T19:00:28.790525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799981+0000","last_change":"2024-09-13T19:00:28.811030+0000","last_active":"2024-09-13T19:00:29.799981+0000","last_peered":"2024-09-13T19:00:29.799981+0000","last_clean":"2024-09-13T19:00:29.799981+0000","last_became_active":"2024-09-13T19:00:28.810787+0000","last_became_peered":"2024-09-13T19:00:28.810787+0000","last_unstale":"2024-09-13T19:00:29.799981+0000","last_undegraded":"2024-09-13T19:00:29.799981+0000","last_fullsized":"2024-09-13T19:00:29.799981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352168+0000","last_change":"2024-09-13T19:00:27.352168+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352168+0000","last_undegraded":"2024-09-13T19:00:27.352168+0000","last_fullsized":"2024-09-13T19:00:27.352168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791981+0000","last_change":"2024-09-13T19:00:28.361393+0000","last_active":"2024-09-13T19:00:28.791981+0000","last_peered":"2024-09-13T19:00:28.791981+0000","last_clean":"2024-09-13T19:00:28.791981+0000","last_became_active":"2024-09-13T19:00:28.361119+0000","last_became_peered":"2024-09-13T19:00:28.361119+0000","last_unstale":"2024-09-13T19:00:28.791981+0000","last_undegraded":"2024-09-13T19:00:28.791981+0000","last_fullsized":"2024-09-13T19:00:28.791981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811939+0000","last_change":"2024-09-13T19:00:28.808206+0000","last_active":"2024-09-13T19:00:29.811939+0000","last_peered":"2024-09-13T19:00:29.811939+0000","last_clean":"2024-09-13T19:00:29.811939+0000","last_became_active":"2024-09-13T19:00:28.807944+0000","last_became_peered":"2024-09-13T19:00:28.807944+0000","last_unstale":"2024-09-13T19:00:29.811939+0000","last_undegraded":"2024-09-13T19:00:29.811939+0000","last_fullsized":"2024-09-13T19:00:29.811939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:22.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817852+0000","last_change":"2024-09-13T19:00:28.376868+0000","last_active":"2024-09-13T19:00:28.817852+0000","last_peered":"2024-09-13T19:00:28.817852+0000","last_clean":"2024-09-13T19:00:28.817852+0000","last_became_active":"2024-09-13T19:00:28.376534+0000","last_became_peered":"2024-09-13T19:00:28.376534+0000","last_unstale":"2024-09-13T19:00:28.817852+0000","last_undegraded":"2024-09-13T19:00:28.817852+0000","last_fullsized":"2024-09-13T19:00:28.817852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791457+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:28.791457+0000","last_peered":"2024-09-13T19:00:28.791457+0000","last_clean":"2024-09-13T19:00:28.791457+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:28.791457+0000","last_undegraded":"2024-09-13T19:00:28.791457+0000","last_fullsized":"2024-09-13T19:00:28.791457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.754},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.505}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":439675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":1032192,"data_stored":438089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.496},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1044480,"data_stored":439653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1036288,"data_stored":438671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":438283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.437},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:00:33.409 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:00:33.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.597+0000 7f19c1400640 1 Processor -- start 2024-09-13T19:00:33.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.598+0000 7f19c1400640 1 -- start start 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c1400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19bc15a5c0 0x7f19bc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c1400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19bc15b9b0 0x7f19bc0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c1400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0cbfc0 con 0x7f19bc0cbac0 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c1400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0cce20 con 0x7f19bc15a5c0 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c1400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0707a0 con 0x7f19bc15b9b0 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19bbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19bc15a5c0 0x7f19bc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19bbe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19bc15a5c0 0x7f19bc0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52630/0 (socket says 172.21.15.33:52630) 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19bbe00640 1 -- 172.21.15.33:0/2730646318 learned_addr learned my addr 172.21.15.33:0/2730646318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.599+0000 7f19c0a00640 1 --2- 172.21.15.33:0/2730646318 >> v2:172.21.15.103:3300/0 conn(0x7f19bc15b9b0 0x7f19bc0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.600+0000 7f19bbe00640 1 -- 172.21.15.33:0/2730646318 >> v2:172.21.15.103:3300/0 conn(0x7f19bc15b9b0 msgr2=0x7f19bc0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:33.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.600+0000 7f19bbe00640 1 --2- 172.21.15.33:0/2730646318 >> v2:172.21.15.103:3300/0 conn(0x7f19bc15b9b0 0x7f19bc0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.600+0000 7f19bbe00640 1 -- 172.21.15.33:0/2730646318 >> v1:172.21.15.103:6789/0 conn(0x7f19bc0cbac0 legacy=0x7f19bc06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:33.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.600+0000 7f19bbe00640 1 -- 172.21.15.33:0/2730646318 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc070a80 con 0x7f19bc15a5c0 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19bbe00640 1 --2- 172.21.15.33:0/2730646318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0b39b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0738f0 tx=0x7f19ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe35b7acf88875e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19bb400640 1 -- 172.21.15.33:0/2730646318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac032440 con 0x7f19bc15a5c0 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19bb400640 1 -- 172.21.15.33:0/2730646318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0325a0 con 0x7f19bc15a5c0 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19bb400640 1 -- 172.21.15.33:0/2730646318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac032930 con 0x7f19bc15a5c0 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19c1400640 1 -- 172.21.15.33:0/2730646318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 msgr2=0x7f19bc0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.601+0000 7f19c1400640 1 --2- 172.21.15.33:0/2730646318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0b39b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0738f0 tx=0x7f19ac02a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 -- 172.21.15.33:0/2730646318 shutdown_connections 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 --2- 172.21.15.33:0/2730646318 >> v2:172.21.15.103:3300/0 conn(0x7f19bc15b9b0 0x7f19bc0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 --2- 172.21.15.33:0/2730646318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0b39b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 -- 172.21.15.33:0/2730646318 >> 172.21.15.33:0/2730646318 conn(0x7f19bc0ae310 msgr2=0x7f19bc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:33.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 -- 172.21.15.33:0/2730646318 shutdown_connections 2024-09-13T19:00:33.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.602+0000 7f19c1400640 1 -- 172.21.15.33:0/2730646318 wait complete. 2024-09-13T19:00:33.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.603+0000 7f19c1400640 1 Processor -- start 2024-09-13T19:00:33.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.603+0000 7f19c1400640 1 -- start start 2024-09-13T19:00:33.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc0cbac0 0x7f19bc1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15b9b0 0x7f19bc143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc154aa0 con 0x7f19bc15a5c0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc155060 con 0x7f19bc0cbac0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.604+0000 7f19c1400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc154240 con 0x7f19bc15b9b0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52644/0 (socket says 172.21.15.33:52644) 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 -- 172.21.15.33:0/2914173846 learned_addr learned my addr 172.21.15.33:0/2914173846 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19bbe00640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc0cbac0 0x7f19bc1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19c0a00640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15b9b0 0x7f19bc143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 -- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15b9b0 msgr2=0x7f19bc143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15b9b0 0x7f19bc143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 -- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc0cbac0 msgr2=0x7f19bc1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc0cbac0 0x7f19bc1523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 -- 172.21.15.33:0/2914173846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0094d0 con 0x7f19bc15a5c0 2024-09-13T19:00:33.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.605+0000 7f19b3400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c430 tx=0x7f19a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.606+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40052d0 con 0x7f19bc15a5c0 2024-09-13T19:00:33.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.606+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005430 con 0x7f19bc15a5c0 2024-09-13T19:00:33.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.606+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4003830 con 0x7f19bc15a5c0 2024-09-13T19:00:33.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.606+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc154520 con 0x7f19bc15a5c0 2024-09-13T19:00:33.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.606+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc143d90 con 0x7f19bc15a5c0 2024-09-13T19:00:33.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.607+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc067360 con 0x7f19bc15a5c0 2024-09-13T19:00:33.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.608+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19a4003990 con 0x7f19bc15a5c0 2024-09-13T19:00:33.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.608+0000 7f19b8c00640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:33.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.609+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19a4088800 con 0x7f19bc15a5c0 2024-09-13T19:00:33.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.609+0000 7f19bbe00640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:33.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.610+0000 7f19bbe00640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f19ac034000 tx=0x7f19ac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:33.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.613+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f19a4053b20 con 0x7f19bc15a5c0 2024-09-13T19:00:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.788+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19bc071280 con 0x7f199806ac00 2024-09-13T19:00:33.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.797+0000 7f19b8c00640 1 -- 172.21.15.33:0/2914173846 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287477 (secure 0 0 0) 0x7f19ac0329c0 con 0x7f199806ac00 2024-09-13T19:00:33.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:00:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 msgr2=0x7f199806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f19ac034000 tx=0x7f19ac02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 msgr2=0x7f19bc0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c430 tx=0x7f19a400c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 shutdown_connections 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f199806ac00 0x7f199806d0c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15b9b0 0x7f19bc143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc15a5c0 0x7f19bc0c3610 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 --2- 172.21.15.33:0/2914173846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc0cbac0 0x7f19bc1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 >> 172.21.15.33:0/2914173846 conn(0x7f19bc0ae310 msgr2=0x7f19bc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 shutdown_connections 2024-09-13T19:00:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:33.801+0000 7f19c1400640 1 -- 172.21.15.33:0/2914173846 wait complete. 2024-09-13T19:00:33.820 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T19:00:33.140768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245940,"kb_used_data":9240,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728780,"statfs":{"total":773094113280,"available":772842270720,"internally_reserved":0,"allocated":9461760,"data_stored":4670128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797003"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812475+0000","last_change":"2024-09-13T19:00:28.808975+0000","last_active":"2024-09-13T19:00:29.812475+0000","last_peered":"2024-09-13T19:00:29.812475+0000","last_clean":"2024-09-13T19:00:29.812475+0000","last_became_active":"2024-09-13T19:00:28.808231+0000","last_became_peered":"2024-09-13T19:00:28.808231+0000","last_unstale":"2024-09-13T19:00:29.812475+0000","last_undegraded":"2024-09-13T19:00:29.812475+0000","last_fullsized":"2024-09-13T19:00:29.812475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:48.900604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800415+0000","last_change":"2024-09-13T19:00:28.810041+0000","last_active":"2024-09-13T19:00:29.800415+0000","last_peered":"2024-09-13T19:00:29.800415+0000","last_clean":"2024-09-13T19:00:29.800415+0000","last_became_active":"2024-09-13T19:00:28.809612+0000","last_became_peered":"2024-09-13T19:00:28.809612+0000","last_unstale":"2024-09-13T19:00:29.800415+0000","last_undegraded":"2024-09-13T19:00:29.800415+0000","last_fullsized":"2024-09-13T19:00:29.800415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:38.496578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795512+0000","last_change":"2024-09-13T19:00:28.816738+0000","last_active":"2024-09-13T19:00:29.795512+0000","last_peered":"2024-09-13T19:00:29.795512+0000","last_clean":"2024-09-13T19:00:29.795512+0000","last_became_active":"2024-09-13T19:00:28.816271+0000","last_became_peered":"2024-09-13T19:00:28.816271+0000","last_unstale":"2024-09-13T19:00:29.795512+0000","last_undegraded":"2024-09-13T19:00:29.795512+0000","last_fullsized":"2024-09-13T19:00:29.795512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:10.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800441+0000","last_change":"2024-09-13T19:00:28.815636+0000","last_active":"2024-09-13T19:00:29.800441+0000","last_peered":"2024-09-13T19:00:29.800441+0000","last_clean":"2024-09-13T19:00:29.800441+0000","last_became_active":"2024-09-13T19:00:28.813171+0000","last_became_peered":"2024-09-13T19:00:28.813171+0000","last_unstale":"2024-09-13T19:00:29.800441+0000","last_undegraded":"2024-09-13T19:00:29.800441+0000","last_fullsized":"2024-09-13T19:00:29.800441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811981+0000","last_change":"2024-09-13T19:00:28.806035+0000","last_active":"2024-09-13T19:00:29.811981+0000","last_peered":"2024-09-13T19:00:29.811981+0000","last_clean":"2024-09-13T19:00:29.811981+0000","last_became_active":"2024-09-13T19:00:28.805408+0000","last_became_peered":"2024-09-13T19:00:28.805408+0000","last_unstale":"2024-09-13T19:00:29.811981+0000","last_undegraded":"2024-09-13T19:00:29.811981+0000","last_fullsized":"2024-09-13T19:00:29.811981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795070+0000","last_change":"2024-09-13T19:00:28.804137+0000","last_active":"2024-09-13T19:00:29.795070+0000","last_peered":"2024-09-13T19:00:29.795070+0000","last_clean":"2024-09-13T19:00:29.795070+0000","last_became_active":"2024-09-13T19:00:28.803862+0000","last_became_peered":"2024-09-13T19:00:28.803862+0000","last_unstale":"2024-09-13T19:00:29.795070+0000","last_undegraded":"2024-09-13T19:00:29.795070+0000","last_fullsized":"2024-09-13T19:00:29.795070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:14.650077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811822+0000","last_change":"2024-09-13T19:00:28.814517+0000","last_active":"2024-09-13T19:00:29.811822+0000","last_peered":"2024-09-13T19:00:29.811822+0000","last_clean":"2024-09-13T19:00:29.811822+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.811822+0000","last_undegraded":"2024-09-13T19:00:29.811822+0000","last_fullsized":"2024-09-13T19:00:29.811822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.854629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812314+0000","last_change":"2024-09-13T19:00:28.803730+0000","last_active":"2024-09-13T19:00:29.812314+0000","last_peered":"2024-09-13T19:00:29.812314+0000","last_clean":"2024-09-13T19:00:29.812314+0000","last_became_active":"2024-09-13T19:00:28.803093+0000","last_became_peered":"2024-09-13T19:00:28.803093+0000","last_unstale":"2024-09-13T19:00:29.812314+0000","last_undegraded":"2024-09-13T19:00:29.812314+0000","last_fullsized":"2024-09-13T19:00:29.812314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:20.692961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.808120+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.807575+0000","last_became_peered":"2024-09-13T19:00:28.807575+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:53.288254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800475+0000","last_change":"2024-09-13T19:00:28.796884+0000","last_active":"2024-09-13T19:00:29.800475+0000","last_peered":"2024-09-13T19:00:29.800475+0000","last_clean":"2024-09-13T19:00:29.800475+0000","last_became_active":"2024-09-13T19:00:28.795740+0000","last_became_peered":"2024-09-13T19:00:28.795740+0000","last_unstale":"2024-09-13T19:00:29.800475+0000","last_undegraded":"2024-09-13T19:00:29.800475+0000","last_fullsized":"2024-09-13T19:00:29.800475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795308+0000","last_change":"2024-09-13T19:00:28.813653+0000","last_active":"2024-09-13T19:00:29.795308+0000","last_peered":"2024-09-13T19:00:29.795308+0000","last_clean":"2024-09-13T19:00:29.795308+0000","last_became_active":"2024-09-13T19:00:28.812284+0000","last_became_peered":"2024-09-13T19:00:28.812284+0000","last_unstale":"2024-09-13T19:00:29.795308+0000","last_undegraded":"2024-09-13T19:00:29.795308+0000","last_fullsized":"2024-09-13T19:00:29.795308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.600086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812409+0000","last_change":"2024-09-13T19:00:28.797545+0000","last_active":"2024-09-13T19:00:29.812409+0000","last_peered":"2024-09-13T19:00:29.812409+0000","last_clean":"2024-09-13T19:00:29.812409+0000","last_became_active":"2024-09-13T19:00:28.797292+0000","last_became_peered":"2024-09-13T19:00:28.797292+0000","last_unstale":"2024-09-13T19:00:29.812409+0000","last_undegraded":"2024-09-13T19:00:29.812409+0000","last_fullsized":"2024-09-13T19:00:29.812409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800315+0000","last_change":"2024-09-13T19:00:28.806721+0000","last_active":"2024-09-13T19:00:29.800315+0000","last_peered":"2024-09-13T19:00:29.800315+0000","last_clean":"2024-09-13T19:00:29.800315+0000","last_became_active":"2024-09-13T19:00:28.803130+0000","last_became_peered":"2024-09-13T19:00:28.803130+0000","last_unstale":"2024-09-13T19:00:29.800315+0000","last_undegraded":"2024-09-13T19:00:29.800315+0000","last_fullsized":"2024-09-13T19:00:29.800315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801232+0000","last_change":"2024-09-13T19:00:28.799336+0000","last_active":"2024-09-13T19:00:29.801232+0000","last_peered":"2024-09-13T19:00:29.801232+0000","last_clean":"2024-09-13T19:00:29.801232+0000","last_became_active":"2024-09-13T19:00:28.799000+0000","last_became_peered":"2024-09-13T19:00:28.799000+0000","last_unstale":"2024-09-13T19:00:29.801232+0000","last_undegraded":"2024-09-13T19:00:29.801232+0000","last_fullsized":"2024-09-13T19:00:29.801232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:54.676245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795425+0000","last_change":"2024-09-13T19:00:28.811088+0000","last_active":"2024-09-13T19:00:29.795425+0000","last_peered":"2024-09-13T19:00:29.795425+0000","last_clean":"2024-09-13T19:00:29.795425+0000","last_became_active":"2024-09-13T19:00:28.810848+0000","last_became_peered":"2024-09-13T19:00:28.810848+0000","last_unstale":"2024-09-13T19:00:29.795425+0000","last_undegraded":"2024-09-13T19:00:29.795425+0000","last_fullsized":"2024-09-13T19:00:29.795425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:03.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813072+0000","last_change":"2024-09-13T19:00:28.810985+0000","last_active":"2024-09-13T19:00:29.813072+0000","last_peered":"2024-09-13T19:00:29.813072+0000","last_clean":"2024-09-13T19:00:29.813072+0000","last_became_active":"2024-09-13T19:00:28.810680+0000","last_became_peered":"2024-09-13T19:00:28.810680+0000","last_unstale":"2024-09-13T19:00:29.813072+0000","last_undegraded":"2024-09-13T19:00:29.813072+0000","last_fullsized":"2024-09-13T19:00:29.813072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795426+0000","last_change":"2024-09-13T19:00:28.813221+0000","last_active":"2024-09-13T19:00:29.795426+0000","last_peered":"2024-09-13T19:00:29.795426+0000","last_clean":"2024-09-13T19:00:29.795426+0000","last_became_active":"2024-09-13T19:00:28.812271+0000","last_became_peered":"2024-09-13T19:00:28.812271+0000","last_unstale":"2024-09-13T19:00:29.795426+0000","last_undegraded":"2024-09-13T19:00:29.795426+0000","last_fullsized":"2024-09-13T19:00:29.795426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:17.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795254+0000","last_change":"2024-09-13T19:00:28.803498+0000","last_active":"2024-09-13T19:00:29.795254+0000","last_peered":"2024-09-13T19:00:29.795254+0000","last_clean":"2024-09-13T19:00:29.795254+0000","last_became_active":"2024-09-13T19:00:28.803226+0000","last_became_peered":"2024-09-13T19:00:28.803226+0000","last_unstale":"2024-09-13T19:00:29.795254+0000","last_undegraded":"2024-09-13T19:00:29.795254+0000","last_fullsized":"2024-09-13T19:00:29.795254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:19.364448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811934+0000","last_change":"2024-09-13T19:00:28.820581+0000","last_active":"2024-09-13T19:00:29.811934+0000","last_peered":"2024-09-13T19:00:29.811934+0000","last_clean":"2024-09-13T19:00:29.811934+0000","last_became_active":"2024-09-13T19:00:28.820011+0000","last_became_peered":"2024-09-13T19:00:28.820011+0000","last_unstale":"2024-09-13T19:00:29.811934+0000","last_undegraded":"2024-09-13T19:00:29.811934+0000","last_fullsized":"2024-09-13T19:00:29.811934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:47.794554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795037+0000","last_change":"2024-09-13T19:00:28.813775+0000","last_active":"2024-09-13T19:00:29.795037+0000","last_peered":"2024-09-13T19:00:29.795037+0000","last_clean":"2024-09-13T19:00:29.795037+0000","last_became_active":"2024-09-13T19:00:28.811975+0000","last_became_peered":"2024-09-13T19:00:28.811975+0000","last_unstale":"2024-09-13T19:00:29.795037+0000","last_undegraded":"2024-09-13T19:00:29.795037+0000","last_fullsized":"2024-09-13T19:00:29.795037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:40.891490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812018+0000","last_change":"2024-09-13T19:00:28.807295+0000","last_active":"2024-09-13T19:00:29.812018+0000","last_peered":"2024-09-13T19:00:29.812018+0000","last_clean":"2024-09-13T19:00:29.812018+0000","last_became_active":"2024-09-13T19:00:28.806583+0000","last_became_peered":"2024-09-13T19:00:28.806583+0000","last_unstale":"2024-09-13T19:00:29.812018+0000","last_undegraded":"2024-09-13T19:00:29.812018+0000","last_fullsized":"2024-09-13T19:00:29.812018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:53.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800619+0000","last_change":"2024-09-13T19:00:28.810241+0000","last_active":"2024-09-13T19:00:29.800619+0000","last_peered":"2024-09-13T19:00:29.800619+0000","last_clean":"2024-09-13T19:00:29.800619+0000","last_became_active":"2024-09-13T19:00:28.809955+0000","last_became_peered":"2024-09-13T19:00:28.809955+0000","last_unstale":"2024-09-13T19:00:29.800619+0000","last_undegraded":"2024-09-13T19:00:29.800619+0000","last_fullsized":"2024-09-13T19:00:29.800619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801014+0000","last_change":"2024-09-13T19:00:28.798670+0000","last_active":"2024-09-13T19:00:29.801014+0000","last_peered":"2024-09-13T19:00:29.801014+0000","last_clean":"2024-09-13T19:00:29.801014+0000","last_became_active":"2024-09-13T19:00:28.798380+0000","last_became_peered":"2024-09-13T19:00:28.798380+0000","last_unstale":"2024-09-13T19:00:29.801014+0000","last_undegraded":"2024-09-13T19:00:29.801014+0000","last_fullsized":"2024-09-13T19:00:29.801014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811957+0000","last_change":"2024-09-13T19:00:28.813470+0000","last_active":"2024-09-13T19:00:29.811957+0000","last_peered":"2024-09-13T19:00:29.811957+0000","last_clean":"2024-09-13T19:00:29.811957+0000","last_became_active":"2024-09-13T19:00:28.813215+0000","last_became_peered":"2024-09-13T19:00:28.813215+0000","last_unstale":"2024-09-13T19:00:29.811957+0000","last_undegraded":"2024-09-13T19:00:29.811957+0000","last_fullsized":"2024-09-13T19:00:29.811957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812031+0000","last_change":"2024-09-13T19:00:28.820335+0000","last_active":"2024-09-13T19:00:29.812031+0000","last_peered":"2024-09-13T19:00:29.812031+0000","last_clean":"2024-09-13T19:00:29.812031+0000","last_became_active":"2024-09-13T19:00:28.820067+0000","last_became_peered":"2024-09-13T19:00:28.820067+0000","last_unstale":"2024-09-13T19:00:29.812031+0000","last_undegraded":"2024-09-13T19:00:29.812031+0000","last_fullsized":"2024-09-13T19:00:29.812031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:07.329940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800248+0000","last_change":"2024-09-13T19:00:28.813908+0000","last_active":"2024-09-13T19:00:29.800248+0000","last_peered":"2024-09-13T19:00:29.800248+0000","last_clean":"2024-09-13T19:00:29.800248+0000","last_became_active":"2024-09-13T19:00:28.813585+0000","last_became_peered":"2024-09-13T19:00:28.813585+0000","last_unstale":"2024-09-13T19:00:29.800248+0000","last_undegraded":"2024-09-13T19:00:29.800248+0000","last_fullsized":"2024-09-13T19:00:29.800248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801216+0000","last_change":"2024-09-13T19:00:28.809178+0000","last_active":"2024-09-13T19:00:29.801216+0000","last_peered":"2024-09-13T19:00:29.801216+0000","last_clean":"2024-09-13T19:00:29.801216+0000","last_became_active":"2024-09-13T19:00:28.808874+0000","last_became_peered":"2024-09-13T19:00:28.808874+0000","last_unstale":"2024-09-13T19:00:29.801216+0000","last_undegraded":"2024-09-13T19:00:29.801216+0000","last_fullsized":"2024-09-13T19:00:29.801216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:44.525840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353811+0000","last_change":"2024-09-13T19:00:27.353811+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353811+0000","last_undegraded":"2024-09-13T19:00:27.353811+0000","last_fullsized":"2024-09-13T19:00:27.353811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.815987+0000","last_change":"2024-09-13T19:00:28.365834+0000","last_active":"2024-09-13T19:00:28.815987+0000","last_peered":"2024-09-13T19:00:28.815987+0000","last_clean":"2024-09-13T19:00:28.815987+0000","last_became_active":"2024-09-13T19:00:28.365494+0000","last_became_peered":"2024-09-13T19:00:28.365494+0000","last_unstale":"2024-09-13T19:00:28.815987+0000","last_undegraded":"2024-09-13T19:00:28.815987+0000","last_fullsized":"2024-09-13T19:00:28.815987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:39.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.822288+0000","last_change":"2024-09-13T19:00:28.370121+0000","last_active":"2024-09-13T19:00:28.822288+0000","last_peered":"2024-09-13T19:00:28.822288+0000","last_clean":"2024-09-13T19:00:28.822288+0000","last_became_active":"2024-09-13T19:00:28.369832+0000","last_became_peered":"2024-09-13T19:00:28.369832+0000","last_unstale":"2024-09-13T19:00:28.822288+0000","last_undegraded":"2024-09-13T19:00:28.822288+0000","last_fullsized":"2024-09-13T19:00:28.822288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:31.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800544+0000","last_change":"2024-09-13T19:00:28.800787+0000","last_active":"2024-09-13T19:00:29.800544+0000","last_peered":"2024-09-13T19:00:29.800544+0000","last_clean":"2024-09-13T19:00:29.800544+0000","last_became_active":"2024-09-13T19:00:28.800502+0000","last_became_peered":"2024-09-13T19:00:28.800502+0000","last_unstale":"2024-09-13T19:00:29.800544+0000","last_undegraded":"2024-09-13T19:00:29.800544+0000","last_fullsized":"2024-09-13T19:00:29.800544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821223+0000","last_change":"2024-09-13T19:00:28.368311+0000","last_active":"2024-09-13T19:00:28.821223+0000","last_peered":"2024-09-13T19:00:28.821223+0000","last_clean":"2024-09-13T19:00:28.821223+0000","last_became_active":"2024-09-13T19:00:28.368021+0000","last_became_peered":"2024-09-13T19:00:28.368021+0000","last_unstale":"2024-09-13T19:00:28.821223+0000","last_undegraded":"2024-09-13T19:00:28.821223+0000","last_fullsized":"2024-09-13T19:00:28.821223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:50.636787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812136+0000","last_change":"2024-09-13T19:00:28.814405+0000","last_active":"2024-09-13T19:00:29.812136+0000","last_peered":"2024-09-13T19:00:29.812136+0000","last_clean":"2024-09-13T19:00:29.812136+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.812136+0000","last_undegraded":"2024-09-13T19:00:29.812136+0000","last_fullsized":"2024-09-13T19:00:29.812136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:54.645959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.818704+0000","last_change":"2024-09-13T19:00:28.372231+0000","last_active":"2024-09-13T19:00:28.818704+0000","last_peered":"2024-09-13T19:00:28.818704+0000","last_clean":"2024-09-13T19:00:28.818704+0000","last_became_active":"2024-09-13T19:00:28.370750+0000","last_became_peered":"2024-09-13T19:00:28.370750+0000","last_unstale":"2024-09-13T19:00:28.818704+0000","last_undegraded":"2024-09-13T19:00:28.818704+0000","last_fullsized":"2024-09-13T19:00:28.818704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:32.746000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800548+0000","last_change":"2024-09-13T19:00:28.800083+0000","last_active":"2024-09-13T19:00:29.800548+0000","last_peered":"2024-09-13T19:00:29.800548+0000","last_clean":"2024-09-13T19:00:29.800548+0000","last_became_active":"2024-09-13T19:00:28.799816+0000","last_became_peered":"2024-09-13T19:00:28.799816+0000","last_unstale":"2024-09-13T19:00:29.800548+0000","last_undegraded":"2024-09-13T19:00:29.800548+0000","last_fullsized":"2024-09-13T19:00:29.800548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.643355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.816238+0000","last_change":"2024-09-13T19:00:28.367194+0000","last_active":"2024-09-13T19:00:28.816238+0000","last_peered":"2024-09-13T19:00:28.816238+0000","last_clean":"2024-09-13T19:00:28.816238+0000","last_became_active":"2024-09-13T19:00:28.366291+0000","last_became_peered":"2024-09-13T19:00:28.366291+0000","last_unstale":"2024-09-13T19:00:28.816238+0000","last_undegraded":"2024-09-13T19:00:28.816238+0000","last_fullsized":"2024-09-13T19:00:28.816238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:21.539136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799909+0000","last_change":"2024-09-13T19:00:28.814422+0000","last_active":"2024-09-13T19:00:29.799909+0000","last_peered":"2024-09-13T19:00:29.799909+0000","last_clean":"2024-09-13T19:00:29.799909+0000","last_became_active":"2024-09-13T19:00:28.814146+0000","last_became_peered":"2024-09-13T19:00:28.814146+0000","last_unstale":"2024-09-13T19:00:29.799909+0000","last_undegraded":"2024-09-13T19:00:29.799909+0000","last_fullsized":"2024-09-13T19:00:29.799909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794580+0000","last_change":"2024-09-13T19:00:28.371979+0000","last_active":"2024-09-13T19:00:28.794580+0000","last_peered":"2024-09-13T19:00:28.794580+0000","last_clean":"2024-09-13T19:00:28.794580+0000","last_became_active":"2024-09-13T19:00:28.370337+0000","last_became_peered":"2024-09-13T19:00:28.370337+0000","last_unstale":"2024-09-13T19:00:28.794580+0000","last_undegraded":"2024-09-13T19:00:28.794580+0000","last_fullsized":"2024-09-13T19:00:28.794580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:59.105096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812410+0000","last_change":"2024-09-13T19:00:28.796132+0000","last_active":"2024-09-13T19:00:29.812410+0000","last_peered":"2024-09-13T19:00:29.812410+0000","last_clean":"2024-09-13T19:00:29.812410+0000","last_became_active":"2024-09-13T19:00:28.795888+0000","last_became_peered":"2024-09-13T19:00:28.795888+0000","last_unstale":"2024-09-13T19:00:29.812410+0000","last_undegraded":"2024-09-13T19:00:29.812410+0000","last_fullsized":"2024-09-13T19:00:29.812410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.798122+0000","last_change":"2024-09-13T19:00:28.366686+0000","last_active":"2024-09-13T19:00:28.798122+0000","last_peered":"2024-09-13T19:00:28.798122+0000","last_clean":"2024-09-13T19:00:28.798122+0000","last_became_active":"2024-09-13T19:00:28.366424+0000","last_became_peered":"2024-09-13T19:00:28.366424+0000","last_unstale":"2024-09-13T19:00:28.798122+0000","last_undegraded":"2024-09-13T19:00:28.798122+0000","last_fullsized":"2024-09-13T19:00:28.798122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:15.934982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813210+0000","last_change":"2024-09-13T19:00:28.814378+0000","last_active":"2024-09-13T19:00:29.813210+0000","last_peered":"2024-09-13T19:00:29.813210+0000","last_clean":"2024-09-13T19:00:29.813210+0000","last_became_active":"2024-09-13T19:00:28.814133+0000","last_became_peered":"2024-09-13T19:00:28.814133+0000","last_unstale":"2024-09-13T19:00:29.813210+0000","last_undegraded":"2024-09-13T19:00:29.813210+0000","last_fullsized":"2024-09-13T19:00:29.813210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352770+0000","last_change":"2024-09-13T19:00:27.352770+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352770+0000","last_undegraded":"2024-09-13T19:00:27.352770+0000","last_fullsized":"2024-09-13T19:00:27.352770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812350+0000","last_change":"2024-09-13T19:00:28.803951+0000","last_active":"2024-09-13T19:00:29.812350+0000","last_peered":"2024-09-13T19:00:29.812350+0000","last_clean":"2024-09-13T19:00:29.812350+0000","last_became_active":"2024-09-13T19:00:28.803461+0000","last_became_peered":"2024-09-13T19:00:28.803461+0000","last_unstale":"2024-09-13T19:00:29.812350+0000","last_undegraded":"2024-09-13T19:00:29.812350+0000","last_fullsized":"2024-09-13T19:00:29.812350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:00.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352142+0000","last_change":"2024-09-13T19:00:27.352142+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352142+0000","last_undegraded":"2024-09-13T19:00:27.352142+0000","last_fullsized":"2024-09-13T19:00:27.352142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812712+0000","last_change":"2024-09-13T19:00:28.815486+0000","last_active":"2024-09-13T19:00:29.812712+0000","last_peered":"2024-09-13T19:00:29.812712+0000","last_clean":"2024-09-13T19:00:29.812712+0000","last_became_active":"2024-09-13T19:00:28.815155+0000","last_became_peered":"2024-09-13T19:00:28.815155+0000","last_unstale":"2024-09-13T19:00:29.812712+0000","last_undegraded":"2024-09-13T19:00:29.812712+0000","last_fullsized":"2024-09-13T19:00:29.812712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352510+0000","last_change":"2024-09-13T19:00:27.352510+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352510+0000","last_undegraded":"2024-09-13T19:00:27.352510+0000","last_fullsized":"2024-09-13T19:00:27.352510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800870+0000","last_change":"2024-09-13T19:00:28.815382+0000","last_active":"2024-09-13T19:00:29.800870+0000","last_peered":"2024-09-13T19:00:29.800870+0000","last_clean":"2024-09-13T19:00:29.800870+0000","last_became_active":"2024-09-13T19:00:28.814942+0000","last_became_peered":"2024-09-13T19:00:28.814942+0000","last_unstale":"2024-09-13T19:00:29.800870+0000","last_undegraded":"2024-09-13T19:00:29.800870+0000","last_fullsized":"2024-09-13T19:00:29.800870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823134+0000","last_change":"2024-09-13T19:00:28.373276+0000","last_active":"2024-09-13T19:00:28.823134+0000","last_peered":"2024-09-13T19:00:28.823134+0000","last_clean":"2024-09-13T19:00:28.823134+0000","last_became_active":"2024-09-13T19:00:28.372958+0000","last_became_peered":"2024-09-13T19:00:28.372958+0000","last_unstale":"2024-09-13T19:00:28.823134+0000","last_undegraded":"2024-09-13T19:00:28.823134+0000","last_fullsized":"2024-09-13T19:00:28.823134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811682+0000","last_change":"2024-09-13T19:00:28.820265+0000","last_active":"2024-09-13T19:00:29.811682+0000","last_peered":"2024-09-13T19:00:29.811682+0000","last_clean":"2024-09-13T19:00:29.811682+0000","last_became_active":"2024-09-13T19:00:28.820015+0000","last_became_peered":"2024-09-13T19:00:28.820015+0000","last_unstale":"2024-09-13T19:00:29.811682+0000","last_undegraded":"2024-09-13T19:00:29.811682+0000","last_fullsized":"2024-09-13T19:00:29.811682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823094+0000","last_change":"2024-09-13T19:00:28.370433+0000","last_active":"2024-09-13T19:00:28.823094+0000","last_peered":"2024-09-13T19:00:28.823094+0000","last_clean":"2024-09-13T19:00:28.823094+0000","last_became_active":"2024-09-13T19:00:28.369892+0000","last_became_peered":"2024-09-13T19:00:28.369892+0000","last_unstale":"2024-09-13T19:00:28.823094+0000","last_undegraded":"2024-09-13T19:00:28.823094+0000","last_fullsized":"2024-09-13T19:00:28.823094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:16.635844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800589+0000","last_change":"2024-09-13T19:00:28.807808+0000","last_active":"2024-09-13T19:00:29.800589+0000","last_peered":"2024-09-13T19:00:29.800589+0000","last_clean":"2024-09-13T19:00:29.800589+0000","last_became_active":"2024-09-13T19:00:28.807287+0000","last_became_peered":"2024-09-13T19:00:28.807287+0000","last_unstale":"2024-09-13T19:00:29.800589+0000","last_undegraded":"2024-09-13T19:00:29.800589+0000","last_fullsized":"2024-09-13T19:00:29.800589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.787946+0000","last_change":"2024-09-13T19:00:28.377480+0000","last_active":"2024-09-13T19:00:28.787946+0000","last_peered":"2024-09-13T19:00:28.787946+0000","last_clean":"2024-09-13T19:00:28.787946+0000","last_became_active":"2024-09-13T19:00:28.376960+0000","last_became_peered":"2024-09-13T19:00:28.376960+0000","last_unstale":"2024-09-13T19:00:28.787946+0000","last_undegraded":"2024-09-13T19:00:28.787946+0000","last_fullsized":"2024-09-13T19:00:28.787946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:53.669678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811803+0000","last_change":"2024-09-13T19:00:28.806548+0000","last_active":"2024-09-13T19:00:29.811803+0000","last_peered":"2024-09-13T19:00:29.811803+0000","last_clean":"2024-09-13T19:00:29.811803+0000","last_became_active":"2024-09-13T19:00:28.802337+0000","last_became_peered":"2024-09-13T19:00:28.802337+0000","last_unstale":"2024-09-13T19:00:29.811803+0000","last_undegraded":"2024-09-13T19:00:29.811803+0000","last_fullsized":"2024-09-13T19:00:29.811803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:22.232714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794909+0000","last_change":"2024-09-13T19:00:28.369519+0000","last_active":"2024-09-13T19:00:28.794909+0000","last_peered":"2024-09-13T19:00:28.794909+0000","last_clean":"2024-09-13T19:00:28.794909+0000","last_became_active":"2024-09-13T19:00:28.369150+0000","last_became_peered":"2024-09-13T19:00:28.369150+0000","last_unstale":"2024-09-13T19:00:28.794909+0000","last_undegraded":"2024-09-13T19:00:28.794909+0000","last_fullsized":"2024-09-13T19:00:28.794909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811686+0000","last_change":"2024-09-13T19:00:28.805379+0000","last_active":"2024-09-13T19:00:29.811686+0000","last_peered":"2024-09-13T19:00:29.811686+0000","last_clean":"2024-09-13T19:00:29.811686+0000","last_became_active":"2024-09-13T19:00:28.805121+0000","last_became_peered":"2024-09-13T19:00:28.805121+0000","last_unstale":"2024-09-13T19:00:29.811686+0000","last_undegraded":"2024-09-13T19:00:29.811686+0000","last_fullsized":"2024-09-13T19:00:29.811686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:32.528562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.824016+0000","last_change":"2024-09-13T19:00:28.376100+0000","last_active":"2024-09-13T19:00:28.824016+0000","last_peered":"2024-09-13T19:00:28.824016+0000","last_clean":"2024-09-13T19:00:28.824016+0000","last_became_active":"2024-09-13T19:00:28.375841+0000","last_became_peered":"2024-09-13T19:00:28.375841+0000","last_unstale":"2024-09-13T19:00:28.824016+0000","last_undegraded":"2024-09-13T19:00:28.824016+0000","last_fullsized":"2024-09-13T19:00:28.824016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:31.390640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800688+0000","last_change":"2024-09-13T19:00:28.809367+0000","last_active":"2024-09-13T19:00:29.800688+0000","last_peered":"2024-09-13T19:00:29.800688+0000","last_clean":"2024-09-13T19:00:29.800688+0000","last_became_active":"2024-09-13T19:00:28.807363+0000","last_became_peered":"2024-09-13T19:00:28.807363+0000","last_unstale":"2024-09-13T19:00:29.800688+0000","last_undegraded":"2024-09-13T19:00:29.800688+0000","last_fullsized":"2024-09-13T19:00:29.800688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352199+0000","last_change":"2024-09-13T19:00:27.352199+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352199+0000","last_undegraded":"2024-09-13T19:00:27.352199+0000","last_fullsized":"2024-09-13T19:00:27.352199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821881+0000","last_change":"2024-09-13T19:00:28.369284+0000","last_active":"2024-09-13T19:00:28.821881+0000","last_peered":"2024-09-13T19:00:28.821881+0000","last_clean":"2024-09-13T19:00:28.821881+0000","last_became_active":"2024-09-13T19:00:28.369016+0000","last_became_peered":"2024-09-13T19:00:28.369016+0000","last_unstale":"2024-09-13T19:00:28.821881+0000","last_undegraded":"2024-09-13T19:00:28.821881+0000","last_fullsized":"2024-09-13T19:00:28.821881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:47.940954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801006+0000","last_change":"2024-09-13T19:00:28.812669+0000","last_active":"2024-09-13T19:00:29.801006+0000","last_peered":"2024-09-13T19:00:29.801006+0000","last_clean":"2024-09-13T19:00:29.801006+0000","last_became_active":"2024-09-13T19:00:28.812357+0000","last_became_peered":"2024-09-13T19:00:28.812357+0000","last_unstale":"2024-09-13T19:00:29.801006+0000","last_undegraded":"2024-09-13T19:00:29.801006+0000","last_fullsized":"2024-09-13T19:00:29.801006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795700+0000","last_change":"2024-09-13T19:00:28.369758+0000","last_active":"2024-09-13T19:00:28.795700+0000","last_peered":"2024-09-13T19:00:28.795700+0000","last_clean":"2024-09-13T19:00:28.795700+0000","last_became_active":"2024-09-13T19:00:28.366342+0000","last_became_peered":"2024-09-13T19:00:28.366342+0000","last_unstale":"2024-09-13T19:00:28.795700+0000","last_undegraded":"2024-09-13T19:00:28.795700+0000","last_fullsized":"2024-09-13T19:00:28.795700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:55.732038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795417+0000","last_change":"2024-09-13T19:00:28.817448+0000","last_active":"2024-09-13T19:00:29.795417+0000","last_peered":"2024-09-13T19:00:29.795417+0000","last_clean":"2024-09-13T19:00:29.795417+0000","last_became_active":"2024-09-13T19:00:28.815546+0000","last_became_peered":"2024-09-13T19:00:28.815546+0000","last_unstale":"2024-09-13T19:00:29.795417+0000","last_undegraded":"2024-09-13T19:00:29.795417+0000","last_fullsized":"2024-09-13T19:00:29.795417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:52.684470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817769+0000","last_change":"2024-09-13T19:00:28.370089+0000","last_active":"2024-09-13T19:00:28.817769+0000","last_peered":"2024-09-13T19:00:28.817769+0000","last_clean":"2024-09-13T19:00:28.817769+0000","last_became_active":"2024-09-13T19:00:28.369842+0000","last_became_peered":"2024-09-13T19:00:28.369842+0000","last_unstale":"2024-09-13T19:00:28.817769+0000","last_undegraded":"2024-09-13T19:00:28.817769+0000","last_fullsized":"2024-09-13T19:00:28.817769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.519273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812095+0000","last_change":"2024-09-13T19:00:28.809780+0000","last_active":"2024-09-13T19:00:29.812095+0000","last_peered":"2024-09-13T19:00:29.812095+0000","last_clean":"2024-09-13T19:00:29.812095+0000","last_became_active":"2024-09-13T19:00:28.809165+0000","last_became_peered":"2024-09-13T19:00:28.809165+0000","last_unstale":"2024-09-13T19:00:29.812095+0000","last_undegraded":"2024-09-13T19:00:29.812095+0000","last_fullsized":"2024-09-13T19:00:29.812095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:32.309208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793623+0000","last_change":"2024-09-13T19:00:28.367585+0000","last_active":"2024-09-13T19:00:28.793623+0000","last_peered":"2024-09-13T19:00:28.793623+0000","last_clean":"2024-09-13T19:00:28.793623+0000","last_became_active":"2024-09-13T19:00:28.367298+0000","last_became_peered":"2024-09-13T19:00:28.367298+0000","last_unstale":"2024-09-13T19:00:28.793623+0000","last_undegraded":"2024-09-13T19:00:28.793623+0000","last_fullsized":"2024-09-13T19:00:28.793623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.664451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795115+0000","last_change":"2024-09-13T19:00:28.806322+0000","last_active":"2024-09-13T19:00:29.795115+0000","last_peered":"2024-09-13T19:00:29.795115+0000","last_clean":"2024-09-13T19:00:29.795115+0000","last_became_active":"2024-09-13T19:00:28.806063+0000","last_became_peered":"2024-09-13T19:00:28.806063+0000","last_unstale":"2024-09-13T19:00:29.795115+0000","last_undegraded":"2024-09-13T19:00:29.795115+0000","last_fullsized":"2024-09-13T19:00:29.795115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:26.684968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793626+0000","last_change":"2024-09-13T19:00:28.377051+0000","last_active":"2024-09-13T19:00:28.793626+0000","last_peered":"2024-09-13T19:00:28.793626+0000","last_clean":"2024-09-13T19:00:28.793626+0000","last_became_active":"2024-09-13T19:00:28.376590+0000","last_became_peered":"2024-09-13T19:00:28.376590+0000","last_unstale":"2024-09-13T19:00:28.793626+0000","last_undegraded":"2024-09-13T19:00:28.793626+0000","last_fullsized":"2024-09-13T19:00:28.793626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:57.996268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811841+0000","last_change":"2024-09-13T19:00:28.805849+0000","last_active":"2024-09-13T19:00:29.811841+0000","last_peered":"2024-09-13T19:00:29.811841+0000","last_clean":"2024-09-13T19:00:29.811841+0000","last_became_active":"2024-09-13T19:00:28.805522+0000","last_became_peered":"2024-09-13T19:00:28.805522+0000","last_unstale":"2024-09-13T19:00:29.811841+0000","last_undegraded":"2024-09-13T19:00:29.811841+0000","last_fullsized":"2024-09-13T19:00:29.811841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:07.000007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.788165+0000","last_change":"2024-09-13T19:00:28.368110+0000","last_active":"2024-09-13T19:00:28.788165+0000","last_peered":"2024-09-13T19:00:28.788165+0000","last_clean":"2024-09-13T19:00:28.788165+0000","last_became_active":"2024-09-13T19:00:28.367864+0000","last_became_peered":"2024-09-13T19:00:28.367864+0000","last_unstale":"2024-09-13T19:00:28.788165+0000","last_undegraded":"2024-09-13T19:00:28.788165+0000","last_fullsized":"2024-09-13T19:00:28.788165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:58.073529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801166+0000","last_change":"2024-09-13T19:00:28.806973+0000","last_active":"2024-09-13T19:00:29.801166+0000","last_peered":"2024-09-13T19:00:29.801166+0000","last_clean":"2024-09-13T19:00:29.801166+0000","last_became_active":"2024-09-13T19:00:28.806508+0000","last_became_peered":"2024-09-13T19:00:28.806508+0000","last_unstale":"2024-09-13T19:00:29.801166+0000","last_undegraded":"2024-09-13T19:00:29.801166+0000","last_fullsized":"2024-09-13T19:00:29.801166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817381+0000","last_change":"2024-09-13T19:00:28.374360+0000","last_active":"2024-09-13T19:00:28.817381+0000","last_peered":"2024-09-13T19:00:28.817381+0000","last_clean":"2024-09-13T19:00:28.817381+0000","last_became_active":"2024-09-13T19:00:28.374052+0000","last_became_peered":"2024-09-13T19:00:28.374052+0000","last_unstale":"2024-09-13T19:00:28.817381+0000","last_undegraded":"2024-09-13T19:00:28.817381+0000","last_fullsized":"2024-09-13T19:00:28.817381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:18.357881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800838+0000","last_change":"2024-09-13T19:00:28.804644+0000","last_active":"2024-09-13T19:00:29.800838+0000","last_peered":"2024-09-13T19:00:29.800838+0000","last_clean":"2024-09-13T19:00:29.800838+0000","last_became_active":"2024-09-13T19:00:28.804318+0000","last_became_peered":"2024-09-13T19:00:28.804318+0000","last_unstale":"2024-09-13T19:00:29.800838+0000","last_undegraded":"2024-09-13T19:00:29.800838+0000","last_fullsized":"2024-09-13T19:00:29.800838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.799327+0000","last_change":"2024-09-13T19:00:28.369253+0000","last_active":"2024-09-13T19:00:28.799327+0000","last_peered":"2024-09-13T19:00:28.799327+0000","last_clean":"2024-09-13T19:00:28.799327+0000","last_became_active":"2024-09-13T19:00:28.368999+0000","last_became_peered":"2024-09-13T19:00:28.368999+0000","last_unstale":"2024-09-13T19:00:28.799327+0000","last_undegraded":"2024-09-13T19:00:28.799327+0000","last_fullsized":"2024-09-13T19:00:28.799327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:25.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353038+0000","last_change":"2024-09-13T19:00:27.353038+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353038+0000","last_undegraded":"2024-09-13T19:00:27.353038+0000","last_fullsized":"2024-09-13T19:00:27.353038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801141+0000","last_change":"2024-09-13T19:00:28.815219+0000","last_active":"2024-09-13T19:00:29.801141+0000","last_peered":"2024-09-13T19:00:29.801141+0000","last_clean":"2024-09-13T19:00:29.801141+0000","last_became_active":"2024-09-13T19:00:28.814608+0000","last_became_peered":"2024-09-13T19:00:28.814608+0000","last_unstale":"2024-09-13T19:00:29.801141+0000","last_undegraded":"2024-09-13T19:00:29.801141+0000","last_fullsized":"2024-09-13T19:00:29.801141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352159+0000","last_change":"2024-09-13T19:00:27.352159+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352159+0000","last_undegraded":"2024-09-13T19:00:27.352159+0000","last_fullsized":"2024-09-13T19:00:27.352159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812046+0000","last_change":"2024-09-13T19:00:28.812693+0000","last_active":"2024-09-13T19:00:29.812046+0000","last_peered":"2024-09-13T19:00:29.812046+0000","last_clean":"2024-09-13T19:00:29.812046+0000","last_became_active":"2024-09-13T19:00:28.809943+0000","last_became_peered":"2024-09-13T19:00:28.809943+0000","last_unstale":"2024-09-13T19:00:29.812046+0000","last_undegraded":"2024-09-13T19:00:29.812046+0000","last_fullsized":"2024-09-13T19:00:29.812046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:56.738605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795445+0000","last_change":"2024-09-13T19:00:28.377131+0000","last_active":"2024-09-13T19:00:28.795445+0000","last_peered":"2024-09-13T19:00:28.795445+0000","last_clean":"2024-09-13T19:00:28.795445+0000","last_became_active":"2024-09-13T19:00:28.376871+0000","last_became_peered":"2024-09-13T19:00:28.376871+0000","last_unstale":"2024-09-13T19:00:28.795445+0000","last_undegraded":"2024-09-13T19:00:28.795445+0000","last_fullsized":"2024-09-13T19:00:28.795445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.822455+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.822143+0000","last_became_peered":"2024-09-13T19:00:28.822143+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.790525+0000","last_change":"2024-09-13T19:00:28.372034+0000","last_active":"2024-09-13T19:00:28.790525+0000","last_peered":"2024-09-13T19:00:28.790525+0000","last_clean":"2024-09-13T19:00:28.790525+0000","last_became_active":"2024-09-13T19:00:28.371752+0000","last_became_peered":"2024-09-13T19:00:28.371752+0000","last_unstale":"2024-09-13T19:00:28.790525+0000","last_undegraded":"2024-09-13T19:00:28.790525+0000","last_fullsized":"2024-09-13T19:00:28.790525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799981+0000","last_change":"2024-09-13T19:00:28.811030+0000","last_active":"2024-09-13T19:00:29.799981+0000","last_peered":"2024-09-13T19:00:29.799981+0000","last_clean":"2024-09-13T19:00:29.799981+0000","last_became_active":"2024-09-13T19:00:28.810787+0000","last_became_peered":"2024-09-13T19:00:28.810787+0000","last_unstale":"2024-09-13T19:00:29.799981+0000","last_undegraded":"2024-09-13T19:00:29.799981+0000","last_fullsized":"2024-09-13T19:00:29.799981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352168+0000","last_change":"2024-09-13T19:00:27.352168+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352168+0000","last_undegraded":"2024-09-13T19:00:27.352168+0000","last_fullsized":"2024-09-13T19:00:27.352168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791981+0000","last_change":"2024-09-13T19:00:28.361393+0000","last_active":"2024-09-13T19:00:28.791981+0000","last_peered":"2024-09-13T19:00:28.791981+0000","last_clean":"2024-09-13T19:00:28.791981+0000","last_became_active":"2024-09-13T19:00:28.361119+0000","last_became_peered":"2024-09-13T19:00:28.361119+0000","last_unstale":"2024-09-13T19:00:28.791981+0000","last_undegraded":"2024-09-13T19:00:28.791981+0000","last_fullsized":"2024-09-13T19:00:28.791981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811939+0000","last_change":"2024-09-13T19:00:28.808206+0000","last_active":"2024-09-13T19:00:29.811939+0000","last_peered":"2024-09-13T19:00:29.811939+0000","last_clean":"2024-09-13T19:00:29.811939+0000","last_became_active":"2024-09-13T19:00:28.807944+0000","last_became_peered":"2024-09-13T19:00:28.807944+0000","last_unstale":"2024-09-13T19:00:29.811939+0000","last_undegraded":"2024-09-13T19:00:29.811939+0000","last_fullsized":"2024-09-13T19:00:29.811939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:22.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817852+0000","last_change":"2024-09-13T19:00:28.376868+0000","last_active":"2024-09-13T19:00:28.817852+0000","last_peered":"2024-09-13T19:00:28.817852+0000","last_clean":"2024-09-13T19:00:28.817852+0000","last_became_active":"2024-09-13T19:00:28.376534+0000","last_became_peered":"2024-09-13T19:00:28.376534+0000","last_unstale":"2024-09-13T19:00:28.817852+0000","last_undegraded":"2024-09-13T19:00:28.817852+0000","last_fullsized":"2024-09-13T19:00:28.817852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791457+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:28.791457+0000","last_peered":"2024-09-13T19:00:28.791457+0000","last_clean":"2024-09-13T19:00:28.791457+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:28.791457+0000","last_undegraded":"2024-09-13T19:00:28.791457+0000","last_fullsized":"2024-09-13T19:00:28.791457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.754},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.505}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":439675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":1032192,"data_stored":438089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.496},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1044480,"data_stored":439653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1036288,"data_stored":438671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":438283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.437},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:00:33.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-09-13T19:00:33.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-09-13T19:00:33.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.353811+0000', 'last_change': '2024-09-13T19:00:27.353811+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.353811+0000', 'last_undegraded': '2024-09-13T19:00:27.353811+0000', 'last_fullsized': '2024-09-13T19:00:27.353811+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352770+0000', 'last_change': '2024-09-13T19:00:27.352770+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352770+0000', 'last_undegraded': '2024-09-13T19:00:27.352770+0000', 'last_fullsized': '2024-09-13T19:00:27.352770+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352142+0000', 'last_change': '2024-09-13T19:00:27.352142+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352142+0000', 'last_undegraded': '2024-09-13T19:00:27.352142+0000', 'last_fullsized': '2024-09-13T19:00:27.352142+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352510+0000', 'last_change': '2024-09-13T19:00:27.352510+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352510+0000', 'last_undegraded': '2024-09-13T19:00:27.352510+0000', 'last_fullsized': '2024-09-13T19:00:27.352510+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2024-09-13T19:00:33.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352199+0000', 'last_change': '2024-09-13T19:00:27.352199+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352199+0000', 'last_undegraded': '2024-09-13T19:00:27.352199+0000', 'last_fullsized': '2024-09-13T19:00:27.352199+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.353038+0000', 'last_change': '2024-09-13T19:00:27.353038+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.353038+0000', 'last_undegraded': '2024-09-13T19:00:27.353038+0000', 'last_fullsized': '2024-09-13T19:00:27.353038+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352159+0000', 'last_change': '2024-09-13T19:00:27.352159+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352159+0000', 'last_undegraded': '2024-09-13T19:00:27.352159+0000', 'last_fullsized': '2024-09-13T19:00:27.352159+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2024-09-13T19:00:33.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:00:27.352168+0000', 'last_change': '2024-09-13T19:00:27.352168+0000', 'last_active': '2024-09-13T19:00:27.336484+0000', 'last_peered': '2024-09-13T19:00:27.336484+0000', 'last_clean': '2024-09-13T19:00:27.336484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:27.352168+0000', 'last_undegraded': '2024-09-13T19:00:27.352168+0000', 'last_fullsized': '2024-09-13T19:00:27.352168+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:27.336484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:00:33.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-09-13T19:00:33.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:00:28.343051+0000', 'last_change': '2024-09-13T19:00:28.343051+0000', 'last_active': '2024-09-13T19:00:28.343051+0000', 'last_peered': '2024-09-13T19:00:28.343051+0000', 'last_clean': '2024-09-13T19:00:28.343051+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:00:28.343051+0000', 'last_undegraded': '2024-09-13T19:00:28.343051+0000', 'last_fullsized': '2024-09-13T19:00:28.343051+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'last_clean_scrub_stamp': '2024-09-13T19:00:28.343051+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:00:33.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T19:00:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.012+0000 7f7156400640 1 Processor -- start 2024-09-13T19:00:34.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.012+0000 7f7156400640 1 -- start start 2024-09-13T19:00:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7156400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f71500b1b00 0x7f71500cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7156400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f71500cde50 0x7f715015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7156400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715006bea0 con 0x7f715015a520 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7156400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715006c180 con 0x7f71500b1b00 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7156400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715006c460 con 0x7f71500cde50 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f71500b1b00 0x7f71500cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f71500b1b00 0x7f71500cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52648/0 (socket says 172.21.15.33:52648) 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 -- 172.21.15.33:0/4190030805 learned_addr learned my addr 172.21.15.33:0/4190030805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:34.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f714fe00640 1 --2- 172.21.15.33:0/4190030805 >> v2:172.21.15.103:3300/0 conn(0x7f71500cde50 0x7f715015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 -- 172.21.15.33:0/4190030805 >> v2:172.21.15.103:3300/0 conn(0x7f71500cde50 msgr2=0x7f715015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 --2- 172.21.15.33:0/4190030805 >> v2:172.21.15.103:3300/0 conn(0x7f71500cde50 0x7f715015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 -- 172.21.15.33:0/4190030805 >> v1:172.21.15.103:6789/0 conn(0x7f715015a520 legacy=0x7f715006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.014+0000 7f7146a00640 1 -- 172.21.15.33:0/4190030805 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715006c740 con 0x7f71500b1b00 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.015+0000 7f7146a00640 1 --2- 172.21.15.33:0/4190030805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71500cd910 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f71500cc5f0 tx=0x7f713802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0af2f94d800148f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f714ea00640 1 -- 172.21.15.33:0/4190030805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138032440 con 0x7f71500b1b00 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f714ea00640 1 -- 172.21.15.33:0/4190030805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71380325a0 con 0x7f71500b1b00 2024-09-13T19:00:34.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f714ea00640 1 -- 172.21.15.33:0/4190030805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138032930 con 0x7f71500b1b00 2024-09-13T19:00:34.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 -- 172.21.15.33:0/4190030805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 msgr2=0x7f71500cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 --2- 172.21.15.33:0/4190030805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71500cd910 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f71500cc5f0 tx=0x7f713802a270 comp rx=0 tx=0).stop 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 -- 172.21.15.33:0/4190030805 shutdown_connections 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 --2- 172.21.15.33:0/4190030805 >> v2:172.21.15.103:3300/0 conn(0x7f71500cde50 0x7f715015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 --2- 172.21.15.33:0/4190030805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71500cd910 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 -- 172.21.15.33:0/4190030805 >> 172.21.15.33:0/4190030805 conn(0x7f71500b0510 msgr2=0x7f71500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 -- 172.21.15.33:0/4190030805 shutdown_connections 2024-09-13T19:00:34.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.016+0000 7f7156400640 1 -- 172.21.15.33:0/4190030805 wait complete. 2024-09-13T19:00:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.018+0000 7f7156400640 1 Processor -- start 2024-09-13T19:00:34.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.018+0000 7f7156400640 1 -- start start 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500cde50 0x7f71500af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f715015a520 0x7f71500af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71501f30b0 con 0x7f71500b1b00 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71501f2430 con 0x7f71500cde50 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7156400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71501f2710 con 0x7f715015a520 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f714f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f714f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52658/0 (socket says 172.21.15.33:52658) 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f714f400640 1 -- 172.21.15.33:0/755647053 learned_addr learned my addr 172.21.15.33:0/755647053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f7146a00640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500cde50 0x7f71500af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.019+0000 7f714fe00640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f715015a520 0x7f71500af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 -- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f715015a520 msgr2=0x7f71500af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f715015a520 0x7f71500af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 -- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500cde50 msgr2=0x7f71500af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500cde50 0x7f71500af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 -- 172.21.15.33:0/755647053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380094d0 con 0x7f71500b1b00 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f714f400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f714000c400 tx=0x7f714000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400052d0 con 0x7f71500b1b00 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140005430 con 0x7f71500b1b00 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140003830 con 0x7f71500b1b00 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71501f29f0 con 0x7f71500b1b00 2024-09-13T19:00:34.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.020+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71501f5500 con 0x7f71500b1b00 2024-09-13T19:00:34.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.021+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500b3b00 con 0x7f71500b1b00 2024-09-13T19:00:34.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.022+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7140003990 con 0x7f71500b1b00 2024-09-13T19:00:34.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.023+0000 7f7147e00640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 0x7f712c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.023+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7140088830 con 0x7f71500b1b00 2024-09-13T19:00:34.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.024+0000 7f7146a00640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 0x7f712c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.025+0000 7f7146a00640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 0x7f712c06d0c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7138034000 tx=0x7f713802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.027+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7140053ab0 con 0x7f71500b1b00 2024-09-13T19:00:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.273+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f71500cd910 con 0x7f71500b1b00 2024-09-13T19:00:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.274+0000 7f7147e00640 1 -- 172.21.15.33:0/755647053 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1593 (secure 0 0 0) 0x7f71400570d0 con 0x7f71500b1b00 2024-09-13T19:00:34.277 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:34.277 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":223,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253822,"num_in_osds":8,"osd_in_since":1726253813,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"unknown","count":11},{"state_name":"creating+peering","count":8}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592036,"bytes_used":251842560,"bytes_avail":772842270720,"bytes_total":773094113280,"unknown_pgs_ratio":0.11340206116437912,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":1943,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6735}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-13T19:00:17.137750+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T19:00:34.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 msgr2=0x7f712c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 0x7f712c06d0c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7138034000 tx=0x7f713802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 msgr2=0x7f71501f4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f714000c400 tx=0x7f714000c8c0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 shutdown_connections 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f712c06ac00 0x7f712c06d0c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f715015a520 0x7f71500af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71500cde50 0x7f71500af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 --2- 172.21.15.33:0/755647053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71500b1b00 0x7f71501f4fc0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 >> 172.21.15.33:0/755647053 conn(0x7f71500b0510 msgr2=0x7f71500cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 shutdown_connections 2024-09-13T19:00:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.276+0000 7f7156400640 1 -- 172.21.15.33:0/755647053 wait complete. 2024-09-13T19:00:34.295 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T19:00:34.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:00:34.340 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T19:00:34.337+0000 7f188a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T19:00:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.449+0000 7f1351800640 1 Processor -- start 2024-09-13T19:00:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.449+0000 7f1351800640 1 -- start start 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f1351800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f134c15a520 0x7f134c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f1351800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f134c0b1b00 0x7f134c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f1351800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c06bc00 con 0x7f134c0cde50 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f1351800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c06bea0 con 0x7f134c15a520 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f1351800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c06c180 con 0x7f134c0b1b00 2024-09-13T19:00:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f134aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f134c15a520 0x7f134c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f134aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f134c15a520 0x7f134c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52670/0 (socket says 172.21.15.33:52670) 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.450+0000 7f134aa00640 1 -- 172.21.15.33:0/2949485894 learned_addr learned my addr 172.21.15.33:0/2949485894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f1342000640 1 --2- 172.21.15.33:0/2949485894 >> v2:172.21.15.103:3300/0 conn(0x7f134c0b1b00 0x7f134c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f134aa00640 1 -- 172.21.15.33:0/2949485894 >> v2:172.21.15.103:3300/0 conn(0x7f134c0b1b00 msgr2=0x7f134c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f134aa00640 1 --2- 172.21.15.33:0/2949485894 >> v2:172.21.15.103:3300/0 conn(0x7f134c0b1b00 0x7f134c0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f134aa00640 1 -- 172.21.15.33:0/2949485894 >> v1:172.21.15.33:6789/0 conn(0x7f134c0cde50 legacy=0x7f134c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f134aa00640 1 -- 172.21.15.33:0/2949485894 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c06c460 con 0x7f134c15a520 2024-09-13T19:00:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.451+0000 7f134a000640 1 -- 172.21.15.33:0/2949485894 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511202972 0 0) 0x7f134c06bc00 con 0x7f134c0cde50 2024-09-13T19:00:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.452+0000 7f134aa00640 1 --2- 172.21.15.33:0/2949485894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c15a520 0x7f134c06b6c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f134c06dad0 tx=0x7f133c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8652f8f9498f850 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.452+0000 7f134a000640 1 -- 172.21.15.33:0/2949485894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c031600 con 0x7f134c15a520 2024-09-13T19:00:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.452+0000 7f134a000640 1 -- 172.21.15.33:0/2949485894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c02d050 con 0x7f134c15a520 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.452+0000 7f134a000640 1 -- 172.21.15.33:0/2949485894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c031980 con 0x7f134c15a520 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 -- 172.21.15.33:0/2949485894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c15a520 msgr2=0x7f134c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 --2- 172.21.15.33:0/2949485894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c15a520 0x7f134c06b6c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f134c06dad0 tx=0x7f133c02a730 comp rx=0 tx=0).stop 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 -- 172.21.15.33:0/2949485894 shutdown_connections 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 --2- 172.21.15.33:0/2949485894 >> v2:172.21.15.103:3300/0 conn(0x7f134c0b1b00 0x7f134c0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 --2- 172.21.15.33:0/2949485894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c15a520 0x7f134c06b6c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 -- 172.21.15.33:0/2949485894 >> 172.21.15.33:0/2949485894 conn(0x7f134c0b0510 msgr2=0x7f134c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 -- 172.21.15.33:0/2949485894 shutdown_connections 2024-09-13T19:00:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.453+0000 7f1351800640 1 -- 172.21.15.33:0/2949485894 wait complete. 2024-09-13T19:00:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.455+0000 7f1351800640 1 Processor -- start 2024-09-13T19:00:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.455+0000 7f1351800640 1 -- start start 2024-09-13T19:00:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 0x7f134c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 0x7f134c0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c0c4bc0 con 0x7f134c0b1b00 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15bc00 con 0x7f134c0cde50 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1351800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15c180 con 0x7f134c15a520 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52684/0 (socket says 172.21.15.33:52684) 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 -- 172.21.15.33:0/3872281351 learned_addr learned my addr 172.21.15.33:0/3872281351 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1342000640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 0x7f134c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134b400640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 0x7f134c0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 -- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 msgr2=0x7f134c0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 0x7f134c0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 -- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 msgr2=0x7f134c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 0x7f134c1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134aa00640 1 -- 172.21.15.33:0/3872281351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c009b30 con 0x7f134c0b1b00 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f1342000640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 0x7f134c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.456+0000 7f134b400640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 0x7f134c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f134aa00640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f133c000f80 tx=0x7f133c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c03d860 con 0x7f134c0b1b00 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c03da00 con 0x7f134c0b1b00 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c03ddb0 con 0x7f134c0b1b00 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c1f64a0 con 0x7f134c0b1b00 2024-09-13T19:00:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.457+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c15be10 con 0x7f134c0b1b00 2024-09-13T19:00:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.458+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c0cd910 con 0x7f134c0b1b00 2024-09-13T19:00:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.459+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f133c03b400 con 0x7f134c0b1b00 2024-09-13T19:00:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.460+0000 7f1343400640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 0x7f132806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.460+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f133c0aa310 con 0x7f134c0b1b00 2024-09-13T19:00:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.460+0000 7f1342000640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 0x7f132806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:34.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.461+0000 7f1342000640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 0x7f132806d0c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f134c0ad850 tx=0x7f1334008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.464+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f133c075450 con 0x7f134c0b1b00 2024-09-13T19:00:34.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.639+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f134c0ce2c0 con 0x7f132806ac00 2024-09-13T19:00:34.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.648+0000 7f1343400640 1 -- 172.21.15.33:0/3872281351 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287477 (secure 0 0 0) 0x7f1334009e10 con 0x7f132806ac00 2024-09-13T19:00:34.656 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:34.658 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:00:34.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 msgr2=0x7f132806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 0x7f132806d0c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f134c0ad850 tx=0x7f1334008040 comp rx=0 tx=0).stop 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 msgr2=0x7f134c14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f133c000f80 tx=0x7f133c004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 shutdown_connections 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f132806ac00 0x7f132806d0c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f134c15a520 0x7f134c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.651+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c0cde50 0x7f134c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.652+0000 7f1351800640 1 --2- 172.21.15.33:0/3872281351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f134c0b1b00 0x7f134c14d0a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.652+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 >> 172.21.15.33:0/3872281351 conn(0x7f134c0b0510 msgr2=0x7f134c0ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.652+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 shutdown_connections 2024-09-13T19:00:34.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:34.652+0000 7f1351800640 1 -- 172.21.15.33:0/3872281351 wait complete. 2024-09-13T19:00:34.670 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T19:00:33.140768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245940,"kb_used_data":9240,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728780,"statfs":{"total":773094113280,"available":772842270720,"internally_reserved":0,"allocated":9461760,"data_stored":4670128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797003"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812475+0000","last_change":"2024-09-13T19:00:28.808975+0000","last_active":"2024-09-13T19:00:29.812475+0000","last_peered":"2024-09-13T19:00:29.812475+0000","last_clean":"2024-09-13T19:00:29.812475+0000","last_became_active":"2024-09-13T19:00:28.808231+0000","last_became_peered":"2024-09-13T19:00:28.808231+0000","last_unstale":"2024-09-13T19:00:29.812475+0000","last_undegraded":"2024-09-13T19:00:29.812475+0000","last_fullsized":"2024-09-13T19:00:29.812475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:48.900604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800415+0000","last_change":"2024-09-13T19:00:28.810041+0000","last_active":"2024-09-13T19:00:29.800415+0000","last_peered":"2024-09-13T19:00:29.800415+0000","last_clean":"2024-09-13T19:00:29.800415+0000","last_became_active":"2024-09-13T19:00:28.809612+0000","last_became_peered":"2024-09-13T19:00:28.809612+0000","last_unstale":"2024-09-13T19:00:29.800415+0000","last_undegraded":"2024-09-13T19:00:29.800415+0000","last_fullsized":"2024-09-13T19:00:29.800415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:38.496578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795512+0000","last_change":"2024-09-13T19:00:28.816738+0000","last_active":"2024-09-13T19:00:29.795512+0000","last_peered":"2024-09-13T19:00:29.795512+0000","last_clean":"2024-09-13T19:00:29.795512+0000","last_became_active":"2024-09-13T19:00:28.816271+0000","last_became_peered":"2024-09-13T19:00:28.816271+0000","last_unstale":"2024-09-13T19:00:29.795512+0000","last_undegraded":"2024-09-13T19:00:29.795512+0000","last_fullsized":"2024-09-13T19:00:29.795512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:10.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800441+0000","last_change":"2024-09-13T19:00:28.815636+0000","last_active":"2024-09-13T19:00:29.800441+0000","last_peered":"2024-09-13T19:00:29.800441+0000","last_clean":"2024-09-13T19:00:29.800441+0000","last_became_active":"2024-09-13T19:00:28.813171+0000","last_became_peered":"2024-09-13T19:00:28.813171+0000","last_unstale":"2024-09-13T19:00:29.800441+0000","last_undegraded":"2024-09-13T19:00:29.800441+0000","last_fullsized":"2024-09-13T19:00:29.800441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811981+0000","last_change":"2024-09-13T19:00:28.806035+0000","last_active":"2024-09-13T19:00:29.811981+0000","last_peered":"2024-09-13T19:00:29.811981+0000","last_clean":"2024-09-13T19:00:29.811981+0000","last_became_active":"2024-09-13T19:00:28.805408+0000","last_became_peered":"2024-09-13T19:00:28.805408+0000","last_unstale":"2024-09-13T19:00:29.811981+0000","last_undegraded":"2024-09-13T19:00:29.811981+0000","last_fullsized":"2024-09-13T19:00:29.811981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795070+0000","last_change":"2024-09-13T19:00:28.804137+0000","last_active":"2024-09-13T19:00:29.795070+0000","last_peered":"2024-09-13T19:00:29.795070+0000","last_clean":"2024-09-13T19:00:29.795070+0000","last_became_active":"2024-09-13T19:00:28.803862+0000","last_became_peered":"2024-09-13T19:00:28.803862+0000","last_unstale":"2024-09-13T19:00:29.795070+0000","last_undegraded":"2024-09-13T19:00:29.795070+0000","last_fullsized":"2024-09-13T19:00:29.795070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:14.650077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811822+0000","last_change":"2024-09-13T19:00:28.814517+0000","last_active":"2024-09-13T19:00:29.811822+0000","last_peered":"2024-09-13T19:00:29.811822+0000","last_clean":"2024-09-13T19:00:29.811822+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.811822+0000","last_undegraded":"2024-09-13T19:00:29.811822+0000","last_fullsized":"2024-09-13T19:00:29.811822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.854629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812314+0000","last_change":"2024-09-13T19:00:28.803730+0000","last_active":"2024-09-13T19:00:29.812314+0000","last_peered":"2024-09-13T19:00:29.812314+0000","last_clean":"2024-09-13T19:00:29.812314+0000","last_became_active":"2024-09-13T19:00:28.803093+0000","last_became_peered":"2024-09-13T19:00:28.803093+0000","last_unstale":"2024-09-13T19:00:29.812314+0000","last_undegraded":"2024-09-13T19:00:29.812314+0000","last_fullsized":"2024-09-13T19:00:29.812314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:20.692961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.808120+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.807575+0000","last_became_peered":"2024-09-13T19:00:28.807575+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:53.288254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800475+0000","last_change":"2024-09-13T19:00:28.796884+0000","last_active":"2024-09-13T19:00:29.800475+0000","last_peered":"2024-09-13T19:00:29.800475+0000","last_clean":"2024-09-13T19:00:29.800475+0000","last_became_active":"2024-09-13T19:00:28.795740+0000","last_became_peered":"2024-09-13T19:00:28.795740+0000","last_unstale":"2024-09-13T19:00:29.800475+0000","last_undegraded":"2024-09-13T19:00:29.800475+0000","last_fullsized":"2024-09-13T19:00:29.800475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795308+0000","last_change":"2024-09-13T19:00:28.813653+0000","last_active":"2024-09-13T19:00:29.795308+0000","last_peered":"2024-09-13T19:00:29.795308+0000","last_clean":"2024-09-13T19:00:29.795308+0000","last_became_active":"2024-09-13T19:00:28.812284+0000","last_became_peered":"2024-09-13T19:00:28.812284+0000","last_unstale":"2024-09-13T19:00:29.795308+0000","last_undegraded":"2024-09-13T19:00:29.795308+0000","last_fullsized":"2024-09-13T19:00:29.795308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.600086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812409+0000","last_change":"2024-09-13T19:00:28.797545+0000","last_active":"2024-09-13T19:00:29.812409+0000","last_peered":"2024-09-13T19:00:29.812409+0000","last_clean":"2024-09-13T19:00:29.812409+0000","last_became_active":"2024-09-13T19:00:28.797292+0000","last_became_peered":"2024-09-13T19:00:28.797292+0000","last_unstale":"2024-09-13T19:00:29.812409+0000","last_undegraded":"2024-09-13T19:00:29.812409+0000","last_fullsized":"2024-09-13T19:00:29.812409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800315+0000","last_change":"2024-09-13T19:00:28.806721+0000","last_active":"2024-09-13T19:00:29.800315+0000","last_peered":"2024-09-13T19:00:29.800315+0000","last_clean":"2024-09-13T19:00:29.800315+0000","last_became_active":"2024-09-13T19:00:28.803130+0000","last_became_peered":"2024-09-13T19:00:28.803130+0000","last_unstale":"2024-09-13T19:00:29.800315+0000","last_undegraded":"2024-09-13T19:00:29.800315+0000","last_fullsized":"2024-09-13T19:00:29.800315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801232+0000","last_change":"2024-09-13T19:00:28.799336+0000","last_active":"2024-09-13T19:00:29.801232+0000","last_peered":"2024-09-13T19:00:29.801232+0000","last_clean":"2024-09-13T19:00:29.801232+0000","last_became_active":"2024-09-13T19:00:28.799000+0000","last_became_peered":"2024-09-13T19:00:28.799000+0000","last_unstale":"2024-09-13T19:00:29.801232+0000","last_undegraded":"2024-09-13T19:00:29.801232+0000","last_fullsized":"2024-09-13T19:00:29.801232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:54.676245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795425+0000","last_change":"2024-09-13T19:00:28.811088+0000","last_active":"2024-09-13T19:00:29.795425+0000","last_peered":"2024-09-13T19:00:29.795425+0000","last_clean":"2024-09-13T19:00:29.795425+0000","last_became_active":"2024-09-13T19:00:28.810848+0000","last_became_peered":"2024-09-13T19:00:28.810848+0000","last_unstale":"2024-09-13T19:00:29.795425+0000","last_undegraded":"2024-09-13T19:00:29.795425+0000","last_fullsized":"2024-09-13T19:00:29.795425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:03.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813072+0000","last_change":"2024-09-13T19:00:28.810985+0000","last_active":"2024-09-13T19:00:29.813072+0000","last_peered":"2024-09-13T19:00:29.813072+0000","last_clean":"2024-09-13T19:00:29.813072+0000","last_became_active":"2024-09-13T19:00:28.810680+0000","last_became_peered":"2024-09-13T19:00:28.810680+0000","last_unstale":"2024-09-13T19:00:29.813072+0000","last_undegraded":"2024-09-13T19:00:29.813072+0000","last_fullsized":"2024-09-13T19:00:29.813072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795426+0000","last_change":"2024-09-13T19:00:28.813221+0000","last_active":"2024-09-13T19:00:29.795426+0000","last_peered":"2024-09-13T19:00:29.795426+0000","last_clean":"2024-09-13T19:00:29.795426+0000","last_became_active":"2024-09-13T19:00:28.812271+0000","last_became_peered":"2024-09-13T19:00:28.812271+0000","last_unstale":"2024-09-13T19:00:29.795426+0000","last_undegraded":"2024-09-13T19:00:29.795426+0000","last_fullsized":"2024-09-13T19:00:29.795426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:17.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795254+0000","last_change":"2024-09-13T19:00:28.803498+0000","last_active":"2024-09-13T19:00:29.795254+0000","last_peered":"2024-09-13T19:00:29.795254+0000","last_clean":"2024-09-13T19:00:29.795254+0000","last_became_active":"2024-09-13T19:00:28.803226+0000","last_became_peered":"2024-09-13T19:00:28.803226+0000","last_unstale":"2024-09-13T19:00:29.795254+0000","last_undegraded":"2024-09-13T19:00:29.795254+0000","last_fullsized":"2024-09-13T19:00:29.795254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:19.364448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811934+0000","last_change":"2024-09-13T19:00:28.820581+0000","last_active":"2024-09-13T19:00:29.811934+0000","last_peered":"2024-09-13T19:00:29.811934+0000","last_clean":"2024-09-13T19:00:29.811934+0000","last_became_active":"2024-09-13T19:00:28.820011+0000","last_became_peered":"2024-09-13T19:00:28.820011+0000","last_unstale":"2024-09-13T19:00:29.811934+0000","last_undegraded":"2024-09-13T19:00:29.811934+0000","last_fullsized":"2024-09-13T19:00:29.811934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:47.794554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795037+0000","last_change":"2024-09-13T19:00:28.813775+0000","last_active":"2024-09-13T19:00:29.795037+0000","last_peered":"2024-09-13T19:00:29.795037+0000","last_clean":"2024-09-13T19:00:29.795037+0000","last_became_active":"2024-09-13T19:00:28.811975+0000","last_became_peered":"2024-09-13T19:00:28.811975+0000","last_unstale":"2024-09-13T19:00:29.795037+0000","last_undegraded":"2024-09-13T19:00:29.795037+0000","last_fullsized":"2024-09-13T19:00:29.795037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:40.891490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812018+0000","last_change":"2024-09-13T19:00:28.807295+0000","last_active":"2024-09-13T19:00:29.812018+0000","last_peered":"2024-09-13T19:00:29.812018+0000","last_clean":"2024-09-13T19:00:29.812018+0000","last_became_active":"2024-09-13T19:00:28.806583+0000","last_became_peered":"2024-09-13T19:00:28.806583+0000","last_unstale":"2024-09-13T19:00:29.812018+0000","last_undegraded":"2024-09-13T19:00:29.812018+0000","last_fullsized":"2024-09-13T19:00:29.812018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:53.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800619+0000","last_change":"2024-09-13T19:00:28.810241+0000","last_active":"2024-09-13T19:00:29.800619+0000","last_peered":"2024-09-13T19:00:29.800619+0000","last_clean":"2024-09-13T19:00:29.800619+0000","last_became_active":"2024-09-13T19:00:28.809955+0000","last_became_peered":"2024-09-13T19:00:28.809955+0000","last_unstale":"2024-09-13T19:00:29.800619+0000","last_undegraded":"2024-09-13T19:00:29.800619+0000","last_fullsized":"2024-09-13T19:00:29.800619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801014+0000","last_change":"2024-09-13T19:00:28.798670+0000","last_active":"2024-09-13T19:00:29.801014+0000","last_peered":"2024-09-13T19:00:29.801014+0000","last_clean":"2024-09-13T19:00:29.801014+0000","last_became_active":"2024-09-13T19:00:28.798380+0000","last_became_peered":"2024-09-13T19:00:28.798380+0000","last_unstale":"2024-09-13T19:00:29.801014+0000","last_undegraded":"2024-09-13T19:00:29.801014+0000","last_fullsized":"2024-09-13T19:00:29.801014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811957+0000","last_change":"2024-09-13T19:00:28.813470+0000","last_active":"2024-09-13T19:00:29.811957+0000","last_peered":"2024-09-13T19:00:29.811957+0000","last_clean":"2024-09-13T19:00:29.811957+0000","last_became_active":"2024-09-13T19:00:28.813215+0000","last_became_peered":"2024-09-13T19:00:28.813215+0000","last_unstale":"2024-09-13T19:00:29.811957+0000","last_undegraded":"2024-09-13T19:00:29.811957+0000","last_fullsized":"2024-09-13T19:00:29.811957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812031+0000","last_change":"2024-09-13T19:00:28.820335+0000","last_active":"2024-09-13T19:00:29.812031+0000","last_peered":"2024-09-13T19:00:29.812031+0000","last_clean":"2024-09-13T19:00:29.812031+0000","last_became_active":"2024-09-13T19:00:28.820067+0000","last_became_peered":"2024-09-13T19:00:28.820067+0000","last_unstale":"2024-09-13T19:00:29.812031+0000","last_undegraded":"2024-09-13T19:00:29.812031+0000","last_fullsized":"2024-09-13T19:00:29.812031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:07.329940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800248+0000","last_change":"2024-09-13T19:00:28.813908+0000","last_active":"2024-09-13T19:00:29.800248+0000","last_peered":"2024-09-13T19:00:29.800248+0000","last_clean":"2024-09-13T19:00:29.800248+0000","last_became_active":"2024-09-13T19:00:28.813585+0000","last_became_peered":"2024-09-13T19:00:28.813585+0000","last_unstale":"2024-09-13T19:00:29.800248+0000","last_undegraded":"2024-09-13T19:00:29.800248+0000","last_fullsized":"2024-09-13T19:00:29.800248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801216+0000","last_change":"2024-09-13T19:00:28.809178+0000","last_active":"2024-09-13T19:00:29.801216+0000","last_peered":"2024-09-13T19:00:29.801216+0000","last_clean":"2024-09-13T19:00:29.801216+0000","last_became_active":"2024-09-13T19:00:28.808874+0000","last_became_peered":"2024-09-13T19:00:28.808874+0000","last_unstale":"2024-09-13T19:00:29.801216+0000","last_undegraded":"2024-09-13T19:00:29.801216+0000","last_fullsized":"2024-09-13T19:00:29.801216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:44.525840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353811+0000","last_change":"2024-09-13T19:00:27.353811+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353811+0000","last_undegraded":"2024-09-13T19:00:27.353811+0000","last_fullsized":"2024-09-13T19:00:27.353811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.815987+0000","last_change":"2024-09-13T19:00:28.365834+0000","last_active":"2024-09-13T19:00:28.815987+0000","last_peered":"2024-09-13T19:00:28.815987+0000","last_clean":"2024-09-13T19:00:28.815987+0000","last_became_active":"2024-09-13T19:00:28.365494+0000","last_became_peered":"2024-09-13T19:00:28.365494+0000","last_unstale":"2024-09-13T19:00:28.815987+0000","last_undegraded":"2024-09-13T19:00:28.815987+0000","last_fullsized":"2024-09-13T19:00:28.815987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:39.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.822288+0000","last_change":"2024-09-13T19:00:28.370121+0000","last_active":"2024-09-13T19:00:28.822288+0000","last_peered":"2024-09-13T19:00:28.822288+0000","last_clean":"2024-09-13T19:00:28.822288+0000","last_became_active":"2024-09-13T19:00:28.369832+0000","last_became_peered":"2024-09-13T19:00:28.369832+0000","last_unstale":"2024-09-13T19:00:28.822288+0000","last_undegraded":"2024-09-13T19:00:28.822288+0000","last_fullsized":"2024-09-13T19:00:28.822288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:31.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800544+0000","last_change":"2024-09-13T19:00:28.800787+0000","last_active":"2024-09-13T19:00:29.800544+0000","last_peered":"2024-09-13T19:00:29.800544+0000","last_clean":"2024-09-13T19:00:29.800544+0000","last_became_active":"2024-09-13T19:00:28.800502+0000","last_became_peered":"2024-09-13T19:00:28.800502+0000","last_unstale":"2024-09-13T19:00:29.800544+0000","last_undegraded":"2024-09-13T19:00:29.800544+0000","last_fullsized":"2024-09-13T19:00:29.800544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821223+0000","last_change":"2024-09-13T19:00:28.368311+0000","last_active":"2024-09-13T19:00:28.821223+0000","last_peered":"2024-09-13T19:00:28.821223+0000","last_clean":"2024-09-13T19:00:28.821223+0000","last_became_active":"2024-09-13T19:00:28.368021+0000","last_became_peered":"2024-09-13T19:00:28.368021+0000","last_unstale":"2024-09-13T19:00:28.821223+0000","last_undegraded":"2024-09-13T19:00:28.821223+0000","last_fullsized":"2024-09-13T19:00:28.821223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:50.636787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812136+0000","last_change":"2024-09-13T19:00:28.814405+0000","last_active":"2024-09-13T19:00:29.812136+0000","last_peered":"2024-09-13T19:00:29.812136+0000","last_clean":"2024-09-13T19:00:29.812136+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.812136+0000","last_undegraded":"2024-09-13T19:00:29.812136+0000","last_fullsized":"2024-09-13T19:00:29.812136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:54.645959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.818704+0000","last_change":"2024-09-13T19:00:28.372231+0000","last_active":"2024-09-13T19:00:28.818704+0000","last_peered":"2024-09-13T19:00:28.818704+0000","last_clean":"2024-09-13T19:00:28.818704+0000","last_became_active":"2024-09-13T19:00:28.370750+0000","last_became_peered":"2024-09-13T19:00:28.370750+0000","last_unstale":"2024-09-13T19:00:28.818704+0000","last_undegraded":"2024-09-13T19:00:28.818704+0000","last_fullsized":"2024-09-13T19:00:28.818704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:32.746000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800548+0000","last_change":"2024-09-13T19:00:28.800083+0000","last_active":"2024-09-13T19:00:29.800548+0000","last_peered":"2024-09-13T19:00:29.800548+0000","last_clean":"2024-09-13T19:00:29.800548+0000","last_became_active":"2024-09-13T19:00:28.799816+0000","last_became_peered":"2024-09-13T19:00:28.799816+0000","last_unstale":"2024-09-13T19:00:29.800548+0000","last_undegraded":"2024-09-13T19:00:29.800548+0000","last_fullsized":"2024-09-13T19:00:29.800548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.643355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.816238+0000","last_change":"2024-09-13T19:00:28.367194+0000","last_active":"2024-09-13T19:00:28.816238+0000","last_peered":"2024-09-13T19:00:28.816238+0000","last_clean":"2024-09-13T19:00:28.816238+0000","last_became_active":"2024-09-13T19:00:28.366291+0000","last_became_peered":"2024-09-13T19:00:28.366291+0000","last_unstale":"2024-09-13T19:00:28.816238+0000","last_undegraded":"2024-09-13T19:00:28.816238+0000","last_fullsized":"2024-09-13T19:00:28.816238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:21.539136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799909+0000","last_change":"2024-09-13T19:00:28.814422+0000","last_active":"2024-09-13T19:00:29.799909+0000","last_peered":"2024-09-13T19:00:29.799909+0000","last_clean":"2024-09-13T19:00:29.799909+0000","last_became_active":"2024-09-13T19:00:28.814146+0000","last_became_peered":"2024-09-13T19:00:28.814146+0000","last_unstale":"2024-09-13T19:00:29.799909+0000","last_undegraded":"2024-09-13T19:00:29.799909+0000","last_fullsized":"2024-09-13T19:00:29.799909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794580+0000","last_change":"2024-09-13T19:00:28.371979+0000","last_active":"2024-09-13T19:00:28.794580+0000","last_peered":"2024-09-13T19:00:28.794580+0000","last_clean":"2024-09-13T19:00:28.794580+0000","last_became_active":"2024-09-13T19:00:28.370337+0000","last_became_peered":"2024-09-13T19:00:28.370337+0000","last_unstale":"2024-09-13T19:00:28.794580+0000","last_undegraded":"2024-09-13T19:00:28.794580+0000","last_fullsized":"2024-09-13T19:00:28.794580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:59.105096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812410+0000","last_change":"2024-09-13T19:00:28.796132+0000","last_active":"2024-09-13T19:00:29.812410+0000","last_peered":"2024-09-13T19:00:29.812410+0000","last_clean":"2024-09-13T19:00:29.812410+0000","last_became_active":"2024-09-13T19:00:28.795888+0000","last_became_peered":"2024-09-13T19:00:28.795888+0000","last_unstale":"2024-09-13T19:00:29.812410+0000","last_undegraded":"2024-09-13T19:00:29.812410+0000","last_fullsized":"2024-09-13T19:00:29.812410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.798122+0000","last_change":"2024-09-13T19:00:28.366686+0000","last_active":"2024-09-13T19:00:28.798122+0000","last_peered":"2024-09-13T19:00:28.798122+0000","last_clean":"2024-09-13T19:00:28.798122+0000","last_became_active":"2024-09-13T19:00:28.366424+0000","last_became_peered":"2024-09-13T19:00:28.366424+0000","last_unstale":"2024-09-13T19:00:28.798122+0000","last_undegraded":"2024-09-13T19:00:28.798122+0000","last_fullsized":"2024-09-13T19:00:28.798122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:15.934982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813210+0000","last_change":"2024-09-13T19:00:28.814378+0000","last_active":"2024-09-13T19:00:29.813210+0000","last_peered":"2024-09-13T19:00:29.813210+0000","last_clean":"2024-09-13T19:00:29.813210+0000","last_became_active":"2024-09-13T19:00:28.814133+0000","last_became_peered":"2024-09-13T19:00:28.814133+0000","last_unstale":"2024-09-13T19:00:29.813210+0000","last_undegraded":"2024-09-13T19:00:29.813210+0000","last_fullsized":"2024-09-13T19:00:29.813210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352770+0000","last_change":"2024-09-13T19:00:27.352770+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352770+0000","last_undegraded":"2024-09-13T19:00:27.352770+0000","last_fullsized":"2024-09-13T19:00:27.352770+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812350+0000","last_change":"2024-09-13T19:00:28.803951+0000","last_active":"2024-09-13T19:00:29.812350+0000","last_peered":"2024-09-13T19:00:29.812350+0000","last_clean":"2024-09-13T19:00:29.812350+0000","last_became_active":"2024-09-13T19:00:28.803461+0000","last_became_peered":"2024-09-13T19:00:28.803461+0000","last_unstale":"2024-09-13T19:00:29.812350+0000","last_undegraded":"2024-09-13T19:00:29.812350+0000","last_fullsized":"2024-09-13T19:00:29.812350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:00.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352142+0000","last_change":"2024-09-13T19:00:27.352142+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352142+0000","last_undegraded":"2024-09-13T19:00:27.352142+0000","last_fullsized":"2024-09-13T19:00:27.352142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812712+0000","last_change":"2024-09-13T19:00:28.815486+0000","last_active":"2024-09-13T19:00:29.812712+0000","last_peered":"2024-09-13T19:00:29.812712+0000","last_clean":"2024-09-13T19:00:29.812712+0000","last_became_active":"2024-09-13T19:00:28.815155+0000","last_became_peered":"2024-09-13T19:00:28.815155+0000","last_unstale":"2024-09-13T19:00:29.812712+0000","last_undegraded":"2024-09-13T19:00:29.812712+0000","last_fullsized":"2024-09-13T19:00:29.812712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352510+0000","last_change":"2024-09-13T19:00:27.352510+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352510+0000","last_undegraded":"2024-09-13T19:00:27.352510+0000","last_fullsized":"2024-09-13T19:00:27.352510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800870+0000","last_change":"2024-09-13T19:00:28.815382+0000","last_active":"2024-09-13T19:00:29.800870+0000","last_peered":"2024-09-13T19:00:29.800870+0000","last_clean":"2024-09-13T19:00:29.800870+0000","last_became_active":"2024-09-13T19:00:28.814942+0000","last_became_peered":"2024-09-13T19:00:28.814942+0000","last_unstale":"2024-09-13T19:00:29.800870+0000","last_undegraded":"2024-09-13T19:00:29.800870+0000","last_fullsized":"2024-09-13T19:00:29.800870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823134+0000","last_change":"2024-09-13T19:00:28.373276+0000","last_active":"2024-09-13T19:00:28.823134+0000","last_peered":"2024-09-13T19:00:28.823134+0000","last_clean":"2024-09-13T19:00:28.823134+0000","last_became_active":"2024-09-13T19:00:28.372958+0000","last_became_peered":"2024-09-13T19:00:28.372958+0000","last_unstale":"2024-09-13T19:00:28.823134+0000","last_undegraded":"2024-09-13T19:00:28.823134+0000","last_fullsized":"2024-09-13T19:00:28.823134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811682+0000","last_change":"2024-09-13T19:00:28.820265+0000","last_active":"2024-09-13T19:00:29.811682+0000","last_peered":"2024-09-13T19:00:29.811682+0000","last_clean":"2024-09-13T19:00:29.811682+0000","last_became_active":"2024-09-13T19:00:28.820015+0000","last_became_peered":"2024-09-13T19:00:28.820015+0000","last_unstale":"2024-09-13T19:00:29.811682+0000","last_undegraded":"2024-09-13T19:00:29.811682+0000","last_fullsized":"2024-09-13T19:00:29.811682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823094+0000","last_change":"2024-09-13T19:00:28.370433+0000","last_active":"2024-09-13T19:00:28.823094+0000","last_peered":"2024-09-13T19:00:28.823094+0000","last_clean":"2024-09-13T19:00:28.823094+0000","last_became_active":"2024-09-13T19:00:28.369892+0000","last_became_peered":"2024-09-13T19:00:28.369892+0000","last_unstale":"2024-09-13T19:00:28.823094+0000","last_undegraded":"2024-09-13T19:00:28.823094+0000","last_fullsized":"2024-09-13T19:00:28.823094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:16.635844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800589+0000","last_change":"2024-09-13T19:00:28.807808+0000","last_active":"2024-09-13T19:00:29.800589+0000","last_peered":"2024-09-13T19:00:29.800589+0000","last_clean":"2024-09-13T19:00:29.800589+0000","last_became_active":"2024-09-13T19:00:28.807287+0000","last_became_peered":"2024-09-13T19:00:28.807287+0000","last_unstale":"2024-09-13T19:00:29.800589+0000","last_undegraded":"2024-09-13T19:00:29.800589+0000","last_fullsized":"2024-09-13T19:00:29.800589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.787946+0000","last_change":"2024-09-13T19:00:28.377480+0000","last_active":"2024-09-13T19:00:28.787946+0000","last_peered":"2024-09-13T19:00:28.787946+0000","last_clean":"2024-09-13T19:00:28.787946+0000","last_became_active":"2024-09-13T19:00:28.376960+0000","last_became_peered":"2024-09-13T19:00:28.376960+0000","last_unstale":"2024-09-13T19:00:28.787946+0000","last_undegraded":"2024-09-13T19:00:28.787946+0000","last_fullsized":"2024-09-13T19:00:28.787946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:53.669678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811803+0000","last_change":"2024-09-13T19:00:28.806548+0000","last_active":"2024-09-13T19:00:29.811803+0000","last_peered":"2024-09-13T19:00:29.811803+0000","last_clean":"2024-09-13T19:00:29.811803+0000","last_became_active":"2024-09-13T19:00:28.802337+0000","last_became_peered":"2024-09-13T19:00:28.802337+0000","last_unstale":"2024-09-13T19:00:29.811803+0000","last_undegraded":"2024-09-13T19:00:29.811803+0000","last_fullsized":"2024-09-13T19:00:29.811803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:22.232714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794909+0000","last_change":"2024-09-13T19:00:28.369519+0000","last_active":"2024-09-13T19:00:28.794909+0000","last_peered":"2024-09-13T19:00:28.794909+0000","last_clean":"2024-09-13T19:00:28.794909+0000","last_became_active":"2024-09-13T19:00:28.369150+0000","last_became_peered":"2024-09-13T19:00:28.369150+0000","last_unstale":"2024-09-13T19:00:28.794909+0000","last_undegraded":"2024-09-13T19:00:28.794909+0000","last_fullsized":"2024-09-13T19:00:28.794909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811686+0000","last_change":"2024-09-13T19:00:28.805379+0000","last_active":"2024-09-13T19:00:29.811686+0000","last_peered":"2024-09-13T19:00:29.811686+0000","last_clean":"2024-09-13T19:00:29.811686+0000","last_became_active":"2024-09-13T19:00:28.805121+0000","last_became_peered":"2024-09-13T19:00:28.805121+0000","last_unstale":"2024-09-13T19:00:29.811686+0000","last_undegraded":"2024-09-13T19:00:29.811686+0000","last_fullsized":"2024-09-13T19:00:29.811686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:32.528562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.824016+0000","last_change":"2024-09-13T19:00:28.376100+0000","last_active":"2024-09-13T19:00:28.824016+0000","last_peered":"2024-09-13T19:00:28.824016+0000","last_clean":"2024-09-13T19:00:28.824016+0000","last_became_active":"2024-09-13T19:00:28.375841+0000","last_became_peered":"2024-09-13T19:00:28.375841+0000","last_unstale":"2024-09-13T19:00:28.824016+0000","last_undegraded":"2024-09-13T19:00:28.824016+0000","last_fullsized":"2024-09-13T19:00:28.824016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:31.390640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800688+0000","last_change":"2024-09-13T19:00:28.809367+0000","last_active":"2024-09-13T19:00:29.800688+0000","last_peered":"2024-09-13T19:00:29.800688+0000","last_clean":"2024-09-13T19:00:29.800688+0000","last_became_active":"2024-09-13T19:00:28.807363+0000","last_became_peered":"2024-09-13T19:00:28.807363+0000","last_unstale":"2024-09-13T19:00:29.800688+0000","last_undegraded":"2024-09-13T19:00:29.800688+0000","last_fullsized":"2024-09-13T19:00:29.800688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352199+0000","last_change":"2024-09-13T19:00:27.352199+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352199+0000","last_undegraded":"2024-09-13T19:00:27.352199+0000","last_fullsized":"2024-09-13T19:00:27.352199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821881+0000","last_change":"2024-09-13T19:00:28.369284+0000","last_active":"2024-09-13T19:00:28.821881+0000","last_peered":"2024-09-13T19:00:28.821881+0000","last_clean":"2024-09-13T19:00:28.821881+0000","last_became_active":"2024-09-13T19:00:28.369016+0000","last_became_peered":"2024-09-13T19:00:28.369016+0000","last_unstale":"2024-09-13T19:00:28.821881+0000","last_undegraded":"2024-09-13T19:00:28.821881+0000","last_fullsized":"2024-09-13T19:00:28.821881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:47.940954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801006+0000","last_change":"2024-09-13T19:00:28.812669+0000","last_active":"2024-09-13T19:00:29.801006+0000","last_peered":"2024-09-13T19:00:29.801006+0000","last_clean":"2024-09-13T19:00:29.801006+0000","last_became_active":"2024-09-13T19:00:28.812357+0000","last_became_peered":"2024-09-13T19:00:28.812357+0000","last_unstale":"2024-09-13T19:00:29.801006+0000","last_undegraded":"2024-09-13T19:00:29.801006+0000","last_fullsized":"2024-09-13T19:00:29.801006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795700+0000","last_change":"2024-09-13T19:00:28.369758+0000","last_active":"2024-09-13T19:00:28.795700+0000","last_peered":"2024-09-13T19:00:28.795700+0000","last_clean":"2024-09-13T19:00:28.795700+0000","last_became_active":"2024-09-13T19:00:28.366342+0000","last_became_peered":"2024-09-13T19:00:28.366342+0000","last_unstale":"2024-09-13T19:00:28.795700+0000","last_undegraded":"2024-09-13T19:00:28.795700+0000","last_fullsized":"2024-09-13T19:00:28.795700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:55.732038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795417+0000","last_change":"2024-09-13T19:00:28.817448+0000","last_active":"2024-09-13T19:00:29.795417+0000","last_peered":"2024-09-13T19:00:29.795417+0000","last_clean":"2024-09-13T19:00:29.795417+0000","last_became_active":"2024-09-13T19:00:28.815546+0000","last_became_peered":"2024-09-13T19:00:28.815546+0000","last_unstale":"2024-09-13T19:00:29.795417+0000","last_undegraded":"2024-09-13T19:00:29.795417+0000","last_fullsized":"2024-09-13T19:00:29.795417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:52.684470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817769+0000","last_change":"2024-09-13T19:00:28.370089+0000","last_active":"2024-09-13T19:00:28.817769+0000","last_peered":"2024-09-13T19:00:28.817769+0000","last_clean":"2024-09-13T19:00:28.817769+0000","last_became_active":"2024-09-13T19:00:28.369842+0000","last_became_peered":"2024-09-13T19:00:28.369842+0000","last_unstale":"2024-09-13T19:00:28.817769+0000","last_undegraded":"2024-09-13T19:00:28.817769+0000","last_fullsized":"2024-09-13T19:00:28.817769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.519273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812095+0000","last_change":"2024-09-13T19:00:28.809780+0000","last_active":"2024-09-13T19:00:29.812095+0000","last_peered":"2024-09-13T19:00:29.812095+0000","last_clean":"2024-09-13T19:00:29.812095+0000","last_became_active":"2024-09-13T19:00:28.809165+0000","last_became_peered":"2024-09-13T19:00:28.809165+0000","last_unstale":"2024-09-13T19:00:29.812095+0000","last_undegraded":"2024-09-13T19:00:29.812095+0000","last_fullsized":"2024-09-13T19:00:29.812095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:32.309208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793623+0000","last_change":"2024-09-13T19:00:28.367585+0000","last_active":"2024-09-13T19:00:28.793623+0000","last_peered":"2024-09-13T19:00:28.793623+0000","last_clean":"2024-09-13T19:00:28.793623+0000","last_became_active":"2024-09-13T19:00:28.367298+0000","last_became_peered":"2024-09-13T19:00:28.367298+0000","last_unstale":"2024-09-13T19:00:28.793623+0000","last_undegraded":"2024-09-13T19:00:28.793623+0000","last_fullsized":"2024-09-13T19:00:28.793623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.664451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795115+0000","last_change":"2024-09-13T19:00:28.806322+0000","last_active":"2024-09-13T19:00:29.795115+0000","last_peered":"2024-09-13T19:00:29.795115+0000","last_clean":"2024-09-13T19:00:29.795115+0000","last_became_active":"2024-09-13T19:00:28.806063+0000","last_became_peered":"2024-09-13T19:00:28.806063+0000","last_unstale":"2024-09-13T19:00:29.795115+0000","last_undegraded":"2024-09-13T19:00:29.795115+0000","last_fullsized":"2024-09-13T19:00:29.795115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:26.684968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793626+0000","last_change":"2024-09-13T19:00:28.377051+0000","last_active":"2024-09-13T19:00:28.793626+0000","last_peered":"2024-09-13T19:00:28.793626+0000","last_clean":"2024-09-13T19:00:28.793626+0000","last_became_active":"2024-09-13T19:00:28.376590+0000","last_became_peered":"2024-09-13T19:00:28.376590+0000","last_unstale":"2024-09-13T19:00:28.793626+0000","last_undegraded":"2024-09-13T19:00:28.793626+0000","last_fullsized":"2024-09-13T19:00:28.793626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:57.996268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811841+0000","last_change":"2024-09-13T19:00:28.805849+0000","last_active":"2024-09-13T19:00:29.811841+0000","last_peered":"2024-09-13T19:00:29.811841+0000","last_clean":"2024-09-13T19:00:29.811841+0000","last_became_active":"2024-09-13T19:00:28.805522+0000","last_became_peered":"2024-09-13T19:00:28.805522+0000","last_unstale":"2024-09-13T19:00:29.811841+0000","last_undegraded":"2024-09-13T19:00:29.811841+0000","last_fullsized":"2024-09-13T19:00:29.811841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:07.000007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.788165+0000","last_change":"2024-09-13T19:00:28.368110+0000","last_active":"2024-09-13T19:00:28.788165+0000","last_peered":"2024-09-13T19:00:28.788165+0000","last_clean":"2024-09-13T19:00:28.788165+0000","last_became_active":"2024-09-13T19:00:28.367864+0000","last_became_peered":"2024-09-13T19:00:28.367864+0000","last_unstale":"2024-09-13T19:00:28.788165+0000","last_undegraded":"2024-09-13T19:00:28.788165+0000","last_fullsized":"2024-09-13T19:00:28.788165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:58.073529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801166+0000","last_change":"2024-09-13T19:00:28.806973+0000","last_active":"2024-09-13T19:00:29.801166+0000","last_peered":"2024-09-13T19:00:29.801166+0000","last_clean":"2024-09-13T19:00:29.801166+0000","last_became_active":"2024-09-13T19:00:28.806508+0000","last_became_peered":"2024-09-13T19:00:28.806508+0000","last_unstale":"2024-09-13T19:00:29.801166+0000","last_undegraded":"2024-09-13T19:00:29.801166+0000","last_fullsized":"2024-09-13T19:00:29.801166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817381+0000","last_change":"2024-09-13T19:00:28.374360+0000","last_active":"2024-09-13T19:00:28.817381+0000","last_peered":"2024-09-13T19:00:28.817381+0000","last_clean":"2024-09-13T19:00:28.817381+0000","last_became_active":"2024-09-13T19:00:28.374052+0000","last_became_peered":"2024-09-13T19:00:28.374052+0000","last_unstale":"2024-09-13T19:00:28.817381+0000","last_undegraded":"2024-09-13T19:00:28.817381+0000","last_fullsized":"2024-09-13T19:00:28.817381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:18.357881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800838+0000","last_change":"2024-09-13T19:00:28.804644+0000","last_active":"2024-09-13T19:00:29.800838+0000","last_peered":"2024-09-13T19:00:29.800838+0000","last_clean":"2024-09-13T19:00:29.800838+0000","last_became_active":"2024-09-13T19:00:28.804318+0000","last_became_peered":"2024-09-13T19:00:28.804318+0000","last_unstale":"2024-09-13T19:00:29.800838+0000","last_undegraded":"2024-09-13T19:00:29.800838+0000","last_fullsized":"2024-09-13T19:00:29.800838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.799327+0000","last_change":"2024-09-13T19:00:28.369253+0000","last_active":"2024-09-13T19:00:28.799327+0000","last_peered":"2024-09-13T19:00:28.799327+0000","last_clean":"2024-09-13T19:00:28.799327+0000","last_became_active":"2024-09-13T19:00:28.368999+0000","last_became_peered":"2024-09-13T19:00:28.368999+0000","last_unstale":"2024-09-13T19:00:28.799327+0000","last_undegraded":"2024-09-13T19:00:28.799327+0000","last_fullsized":"2024-09-13T19:00:28.799327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:25.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.353038+0000","last_change":"2024-09-13T19:00:27.353038+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.353038+0000","last_undegraded":"2024-09-13T19:00:27.353038+0000","last_fullsized":"2024-09-13T19:00:27.353038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801141+0000","last_change":"2024-09-13T19:00:28.815219+0000","last_active":"2024-09-13T19:00:29.801141+0000","last_peered":"2024-09-13T19:00:29.801141+0000","last_clean":"2024-09-13T19:00:29.801141+0000","last_became_active":"2024-09-13T19:00:28.814608+0000","last_became_peered":"2024-09-13T19:00:28.814608+0000","last_unstale":"2024-09-13T19:00:29.801141+0000","last_undegraded":"2024-09-13T19:00:29.801141+0000","last_fullsized":"2024-09-13T19:00:29.801141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352159+0000","last_change":"2024-09-13T19:00:27.352159+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352159+0000","last_undegraded":"2024-09-13T19:00:27.352159+0000","last_fullsized":"2024-09-13T19:00:27.352159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812046+0000","last_change":"2024-09-13T19:00:28.812693+0000","last_active":"2024-09-13T19:00:29.812046+0000","last_peered":"2024-09-13T19:00:29.812046+0000","last_clean":"2024-09-13T19:00:29.812046+0000","last_became_active":"2024-09-13T19:00:28.809943+0000","last_became_peered":"2024-09-13T19:00:28.809943+0000","last_unstale":"2024-09-13T19:00:29.812046+0000","last_undegraded":"2024-09-13T19:00:29.812046+0000","last_fullsized":"2024-09-13T19:00:29.812046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:56.738605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795445+0000","last_change":"2024-09-13T19:00:28.377131+0000","last_active":"2024-09-13T19:00:28.795445+0000","last_peered":"2024-09-13T19:00:28.795445+0000","last_clean":"2024-09-13T19:00:28.795445+0000","last_became_active":"2024-09-13T19:00:28.376871+0000","last_became_peered":"2024-09-13T19:00:28.376871+0000","last_unstale":"2024-09-13T19:00:28.795445+0000","last_undegraded":"2024-09-13T19:00:28.795445+0000","last_fullsized":"2024-09-13T19:00:28.795445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.822455+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.822143+0000","last_became_peered":"2024-09-13T19:00:28.822143+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.790525+0000","last_change":"2024-09-13T19:00:28.372034+0000","last_active":"2024-09-13T19:00:28.790525+0000","last_peered":"2024-09-13T19:00:28.790525+0000","last_clean":"2024-09-13T19:00:28.790525+0000","last_became_active":"2024-09-13T19:00:28.371752+0000","last_became_peered":"2024-09-13T19:00:28.371752+0000","last_unstale":"2024-09-13T19:00:28.790525+0000","last_undegraded":"2024-09-13T19:00:28.790525+0000","last_fullsized":"2024-09-13T19:00:28.790525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799981+0000","last_change":"2024-09-13T19:00:28.811030+0000","last_active":"2024-09-13T19:00:29.799981+0000","last_peered":"2024-09-13T19:00:29.799981+0000","last_clean":"2024-09-13T19:00:29.799981+0000","last_became_active":"2024-09-13T19:00:28.810787+0000","last_became_peered":"2024-09-13T19:00:28.810787+0000","last_unstale":"2024-09-13T19:00:29.799981+0000","last_undegraded":"2024-09-13T19:00:29.799981+0000","last_fullsized":"2024-09-13T19:00:29.799981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-13T19:00:27.352168+0000","last_change":"2024-09-13T19:00:27.352168+0000","last_active":"2024-09-13T19:00:27.336484+0000","last_peered":"2024-09-13T19:00:27.336484+0000","last_clean":"2024-09-13T19:00:27.336484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:27.352168+0000","last_undegraded":"2024-09-13T19:00:27.352168+0000","last_fullsized":"2024-09-13T19:00:27.352168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:00:28.343051+0000","last_change":"2024-09-13T19:00:28.343051+0000","last_active":"2024-09-13T19:00:28.343051+0000","last_peered":"2024-09-13T19:00:28.343051+0000","last_clean":"2024-09-13T19:00:28.343051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:00:28.343051+0000","last_undegraded":"2024-09-13T19:00:28.343051+0000","last_fullsized":"2024-09-13T19:00:28.343051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791981+0000","last_change":"2024-09-13T19:00:28.361393+0000","last_active":"2024-09-13T19:00:28.791981+0000","last_peered":"2024-09-13T19:00:28.791981+0000","last_clean":"2024-09-13T19:00:28.791981+0000","last_became_active":"2024-09-13T19:00:28.361119+0000","last_became_peered":"2024-09-13T19:00:28.361119+0000","last_unstale":"2024-09-13T19:00:28.791981+0000","last_undegraded":"2024-09-13T19:00:28.791981+0000","last_fullsized":"2024-09-13T19:00:28.791981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811939+0000","last_change":"2024-09-13T19:00:28.808206+0000","last_active":"2024-09-13T19:00:29.811939+0000","last_peered":"2024-09-13T19:00:29.811939+0000","last_clean":"2024-09-13T19:00:29.811939+0000","last_became_active":"2024-09-13T19:00:28.807944+0000","last_became_peered":"2024-09-13T19:00:28.807944+0000","last_unstale":"2024-09-13T19:00:29.811939+0000","last_undegraded":"2024-09-13T19:00:29.811939+0000","last_fullsized":"2024-09-13T19:00:29.811939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:22.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817852+0000","last_change":"2024-09-13T19:00:28.376868+0000","last_active":"2024-09-13T19:00:28.817852+0000","last_peered":"2024-09-13T19:00:28.817852+0000","last_clean":"2024-09-13T19:00:28.817852+0000","last_became_active":"2024-09-13T19:00:28.376534+0000","last_became_peered":"2024-09-13T19:00:28.376534+0000","last_unstale":"2024-09-13T19:00:28.817852+0000","last_undegraded":"2024-09-13T19:00:28.817852+0000","last_fullsized":"2024-09-13T19:00:28.817852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791457+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:28.791457+0000","last_peered":"2024-09-13T19:00:28.791457+0000","last_clean":"2024-09-13T19:00:28.791457+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:28.791457+0000","last_undegraded":"2024-09-13T19:00:28.791457+0000","last_fullsized":"2024-09-13T19:00:28.791457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.754},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":418739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.505}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":439675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":1032192,"data_stored":438089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.496},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1044480,"data_stored":439653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1036288,"data_stored":438671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":438283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.437},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:00:37.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:00:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.842+0000 7f5386400640 1 Processor -- start 2024-09-13T19:00:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.842+0000 7f5386400640 1 -- start start 2024-09-13T19:00:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f5386400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800b1b00 0x7f53800cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f5386400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53800cde50 0x7f538015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f5386400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538006bea0 con 0x7f538015a520 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f5386400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538006c180 con 0x7f53800cde50 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f5386400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538006c460 con 0x7f53800b1b00 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.843+0000 7f537fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53800cde50 0x7f538015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53800cde50 0x7f538015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52698/0 (socket says 172.21.15.33:52698) 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 -- 172.21.15.33:0/157273060 learned_addr learned my addr 172.21.15.33:0/157273060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537ea00640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800b1b00 0x7f53800cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 -- 172.21.15.33:0/157273060 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800b1b00 msgr2=0x7f53800cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800b1b00 0x7f53800cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 -- 172.21.15.33:0/157273060 >> v1:172.21.15.103:6789/0 conn(0x7f538015a520 legacy=0x7f538006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.844+0000 7f537fe00640 1 -- 172.21.15.33:0/157273060 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538006c740 con 0x7f53800cde50 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.845+0000 7f537fe00640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53800cde50 0x7f538015a900 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e80 tx=0x7f537802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedfc9d270fa8373 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.845+0000 7f537e000640 1 -- 172.21.15.33:0/157273060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378031600 con 0x7f53800cde50 2024-09-13T19:00:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.845+0000 7f537e000640 1 -- 172.21.15.33:0/157273060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537802d050 con 0x7f53800cde50 2024-09-13T19:00:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.845+0000 7f537e000640 1 -- 172.21.15.33:0/157273060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378031980 con 0x7f53800cde50 2024-09-13T19:00:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 -- 172.21.15.33:0/157273060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53800cde50 msgr2=0x7f538015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53800cde50 0x7f538015a900 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e80 tx=0x7f537802a750 comp rx=0 tx=0).stop 2024-09-13T19:00:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 -- 172.21.15.33:0/157273060 shutdown_connections 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53800cde50 0x7f538015a900 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 --2- 172.21.15.33:0/157273060 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800b1b00 0x7f53800cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 -- 172.21.15.33:0/157273060 >> 172.21.15.33:0/157273060 conn(0x7f53800b0510 msgr2=0x7f53800b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 -- 172.21.15.33:0/157273060 shutdown_connections 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.846+0000 7f5386400640 1 -- 172.21.15.33:0/157273060 wait complete. 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.848+0000 7f5386400640 1 Processor -- start 2024-09-13T19:00:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.848+0000 7f5386400640 1 -- start start 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800b1b00 0x7f53801f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800cde50 0x7f538014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801f5af0 con 0x7f538015a520 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801f2f40 con 0x7f53800b1b00 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f5386400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53801f6450 con 0x7f53800cde50 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52706/0 (socket says 172.21.15.33:52706) 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 -- 172.21.15.33:0/753830344 learned_addr learned my addr 172.21.15.33:0/753830344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537ea00640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800cde50 0x7f538014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537f400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800b1b00 0x7f53801f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 -- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800cde50 msgr2=0x7f538014f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800cde50 0x7f538014f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 -- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800b1b00 msgr2=0x7f53801f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800b1b00 0x7f53801f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.849+0000 7f537fe00640 1 -- 172.21.15.33:0/753830344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009b30 con 0x7f538015a520 2024-09-13T19:00:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f537fe00640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5378034040 tx=0x7f5378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537803d860 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537803d9e0 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537803dd90 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538014f7b0 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.850+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53801f2c60 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.851+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53800cd910 con 0x7f538015a520 2024-09-13T19:00:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.852+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f537803b400 con 0x7f538015a520 2024-09-13T19:00:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.853+0000 7f5377400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 0x7f536006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.853+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53780a9df0 con 0x7f538015a520 2024-09-13T19:00:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.854+0000 7f537f400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 0x7f536006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.854+0000 7f537f400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 0x7f536006d0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53800ad1f0 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:37.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:37.858+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5378075070 con 0x7f538015a520 2024-09-13T19:00:38.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.033+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f538006cf40 con 0x7f536006ac00 2024-09-13T19:00:38.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.041+0000 7f5377400640 1 -- 172.21.15.33:0/753830344 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289355 (secure 0 0 0) 0x7f5370001d10 con 0x7f536006ac00 2024-09-13T19:00:38.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:38.049 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:00:38.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.045+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 msgr2=0x7f536006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.045+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 0x7f536006d0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53800ad1f0 tx=0x7f5370009040 comp rx=0 tx=0).stop 2024-09-13T19:00:38.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.045+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 msgr2=0x7f53801f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.045+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5378034040 tx=0x7f5378004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 shutdown_connections 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536006ac00 0x7f536006d0c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f538015a520 0x7f53801f1f50 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53800cde50 0x7f538014f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 --2- 172.21.15.33:0/753830344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800b1b00 0x7f53801f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 >> 172.21.15.33:0/753830344 conn(0x7f53800b0510 msgr2=0x7f538006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 shutdown_connections 2024-09-13T19:00:38.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.046+0000 7f5386400640 1 -- 172.21.15.33:0/753830344 wait complete. 2024-09-13T19:00:38.063 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-13T19:00:37.141843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245992,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728728,"statfs":{"total":773094113280,"available":772842217472,"internally_reserved":0,"allocated":9510912,"data_stored":4690172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.355668"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812125+0000","last_change":"2024-09-13T19:00:28.818662+0000","last_active":"2024-09-13T19:00:29.812125+0000","last_peered":"2024-09-13T19:00:29.812125+0000","last_clean":"2024-09-13T19:00:29.812125+0000","last_became_active":"2024-09-13T19:00:28.813653+0000","last_became_peered":"2024-09-13T19:00:28.813653+0000","last_unstale":"2024-09-13T19:00:29.812125+0000","last_undegraded":"2024-09-13T19:00:29.812125+0000","last_fullsized":"2024-09-13T19:00:29.812125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:32.397207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812475+0000","last_change":"2024-09-13T19:00:28.808975+0000","last_active":"2024-09-13T19:00:29.812475+0000","last_peered":"2024-09-13T19:00:29.812475+0000","last_clean":"2024-09-13T19:00:29.812475+0000","last_became_active":"2024-09-13T19:00:28.808231+0000","last_became_peered":"2024-09-13T19:00:28.808231+0000","last_unstale":"2024-09-13T19:00:29.812475+0000","last_undegraded":"2024-09-13T19:00:29.812475+0000","last_fullsized":"2024-09-13T19:00:29.812475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:48.900604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800415+0000","last_change":"2024-09-13T19:00:28.810041+0000","last_active":"2024-09-13T19:00:29.800415+0000","last_peered":"2024-09-13T19:00:29.800415+0000","last_clean":"2024-09-13T19:00:29.800415+0000","last_became_active":"2024-09-13T19:00:28.809612+0000","last_became_peered":"2024-09-13T19:00:28.809612+0000","last_unstale":"2024-09-13T19:00:29.800415+0000","last_undegraded":"2024-09-13T19:00:29.800415+0000","last_fullsized":"2024-09-13T19:00:29.800415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:38.496578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795512+0000","last_change":"2024-09-13T19:00:28.816738+0000","last_active":"2024-09-13T19:00:29.795512+0000","last_peered":"2024-09-13T19:00:29.795512+0000","last_clean":"2024-09-13T19:00:29.795512+0000","last_became_active":"2024-09-13T19:00:28.816271+0000","last_became_peered":"2024-09-13T19:00:28.816271+0000","last_unstale":"2024-09-13T19:00:29.795512+0000","last_undegraded":"2024-09-13T19:00:29.795512+0000","last_fullsized":"2024-09-13T19:00:29.795512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:10.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800441+0000","last_change":"2024-09-13T19:00:28.815636+0000","last_active":"2024-09-13T19:00:29.800441+0000","last_peered":"2024-09-13T19:00:29.800441+0000","last_clean":"2024-09-13T19:00:29.800441+0000","last_became_active":"2024-09-13T19:00:28.813171+0000","last_became_peered":"2024-09-13T19:00:28.813171+0000","last_unstale":"2024-09-13T19:00:29.800441+0000","last_undegraded":"2024-09-13T19:00:29.800441+0000","last_fullsized":"2024-09-13T19:00:29.800441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811981+0000","last_change":"2024-09-13T19:00:28.806035+0000","last_active":"2024-09-13T19:00:29.811981+0000","last_peered":"2024-09-13T19:00:29.811981+0000","last_clean":"2024-09-13T19:00:29.811981+0000","last_became_active":"2024-09-13T19:00:28.805408+0000","last_became_peered":"2024-09-13T19:00:28.805408+0000","last_unstale":"2024-09-13T19:00:29.811981+0000","last_undegraded":"2024-09-13T19:00:29.811981+0000","last_fullsized":"2024-09-13T19:00:29.811981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795070+0000","last_change":"2024-09-13T19:00:28.804137+0000","last_active":"2024-09-13T19:00:29.795070+0000","last_peered":"2024-09-13T19:00:29.795070+0000","last_clean":"2024-09-13T19:00:29.795070+0000","last_became_active":"2024-09-13T19:00:28.803862+0000","last_became_peered":"2024-09-13T19:00:28.803862+0000","last_unstale":"2024-09-13T19:00:29.795070+0000","last_undegraded":"2024-09-13T19:00:29.795070+0000","last_fullsized":"2024-09-13T19:00:29.795070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:14.650077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811822+0000","last_change":"2024-09-13T19:00:28.814517+0000","last_active":"2024-09-13T19:00:29.811822+0000","last_peered":"2024-09-13T19:00:29.811822+0000","last_clean":"2024-09-13T19:00:29.811822+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.811822+0000","last_undegraded":"2024-09-13T19:00:29.811822+0000","last_fullsized":"2024-09-13T19:00:29.811822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.854629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812314+0000","last_change":"2024-09-13T19:00:28.803730+0000","last_active":"2024-09-13T19:00:29.812314+0000","last_peered":"2024-09-13T19:00:29.812314+0000","last_clean":"2024-09-13T19:00:29.812314+0000","last_became_active":"2024-09-13T19:00:28.803093+0000","last_became_peered":"2024-09-13T19:00:28.803093+0000","last_unstale":"2024-09-13T19:00:29.812314+0000","last_undegraded":"2024-09-13T19:00:29.812314+0000","last_fullsized":"2024-09-13T19:00:29.812314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:20.692961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812149+0000","last_change":"2024-09-13T19:00:28.818420+0000","last_active":"2024-09-13T19:00:29.812149+0000","last_peered":"2024-09-13T19:00:29.812149+0000","last_clean":"2024-09-13T19:00:29.812149+0000","last_became_active":"2024-09-13T19:00:28.818183+0000","last_became_peered":"2024-09-13T19:00:28.818183+0000","last_unstale":"2024-09-13T19:00:29.812149+0000","last_undegraded":"2024-09-13T19:00:29.812149+0000","last_fullsized":"2024-09-13T19:00:29.812149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:32.309208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.808120+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.807575+0000","last_became_peered":"2024-09-13T19:00:28.807575+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:53.288254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811662+0000","last_change":"2024-09-13T19:00:28.808499+0000","last_active":"2024-09-13T19:00:29.811662+0000","last_peered":"2024-09-13T19:00:29.811662+0000","last_clean":"2024-09-13T19:00:29.811662+0000","last_became_active":"2024-09-13T19:00:28.808247+0000","last_became_peered":"2024-09-13T19:00:28.808247+0000","last_unstale":"2024-09-13T19:00:29.811662+0000","last_undegraded":"2024-09-13T19:00:29.811662+0000","last_fullsized":"2024-09-13T19:00:29.811662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.854629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800475+0000","last_change":"2024-09-13T19:00:28.796884+0000","last_active":"2024-09-13T19:00:29.800475+0000","last_peered":"2024-09-13T19:00:29.800475+0000","last_clean":"2024-09-13T19:00:29.800475+0000","last_became_active":"2024-09-13T19:00:28.795740+0000","last_became_peered":"2024-09-13T19:00:28.795740+0000","last_unstale":"2024-09-13T19:00:29.800475+0000","last_undegraded":"2024-09-13T19:00:29.800475+0000","last_fullsized":"2024-09-13T19:00:29.800475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795308+0000","last_change":"2024-09-13T19:00:28.813653+0000","last_active":"2024-09-13T19:00:29.795308+0000","last_peered":"2024-09-13T19:00:29.795308+0000","last_clean":"2024-09-13T19:00:29.795308+0000","last_became_active":"2024-09-13T19:00:28.812284+0000","last_became_peered":"2024-09-13T19:00:28.812284+0000","last_unstale":"2024-09-13T19:00:29.795308+0000","last_undegraded":"2024-09-13T19:00:29.795308+0000","last_fullsized":"2024-09-13T19:00:29.795308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:05.600086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812409+0000","last_change":"2024-09-13T19:00:28.797545+0000","last_active":"2024-09-13T19:00:29.812409+0000","last_peered":"2024-09-13T19:00:29.812409+0000","last_clean":"2024-09-13T19:00:29.812409+0000","last_became_active":"2024-09-13T19:00:28.797292+0000","last_became_peered":"2024-09-13T19:00:28.797292+0000","last_unstale":"2024-09-13T19:00:29.812409+0000","last_undegraded":"2024-09-13T19:00:29.812409+0000","last_fullsized":"2024-09-13T19:00:29.812409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800315+0000","last_change":"2024-09-13T19:00:28.806721+0000","last_active":"2024-09-13T19:00:29.800315+0000","last_peered":"2024-09-13T19:00:29.800315+0000","last_clean":"2024-09-13T19:00:29.800315+0000","last_became_active":"2024-09-13T19:00:28.803130+0000","last_became_peered":"2024-09-13T19:00:28.803130+0000","last_unstale":"2024-09-13T19:00:29.800315+0000","last_undegraded":"2024-09-13T19:00:29.800315+0000","last_fullsized":"2024-09-13T19:00:29.800315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801232+0000","last_change":"2024-09-13T19:00:28.799336+0000","last_active":"2024-09-13T19:00:29.801232+0000","last_peered":"2024-09-13T19:00:29.801232+0000","last_clean":"2024-09-13T19:00:29.801232+0000","last_became_active":"2024-09-13T19:00:28.799000+0000","last_became_peered":"2024-09-13T19:00:28.799000+0000","last_unstale":"2024-09-13T19:00:29.801232+0000","last_undegraded":"2024-09-13T19:00:29.801232+0000","last_fullsized":"2024-09-13T19:00:29.801232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:54.676245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795425+0000","last_change":"2024-09-13T19:00:28.811088+0000","last_active":"2024-09-13T19:00:29.795425+0000","last_peered":"2024-09-13T19:00:29.795425+0000","last_clean":"2024-09-13T19:00:29.795425+0000","last_became_active":"2024-09-13T19:00:28.810848+0000","last_became_peered":"2024-09-13T19:00:28.810848+0000","last_unstale":"2024-09-13T19:00:29.795425+0000","last_undegraded":"2024-09-13T19:00:29.795425+0000","last_fullsized":"2024-09-13T19:00:29.795425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:03.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813072+0000","last_change":"2024-09-13T19:00:28.810985+0000","last_active":"2024-09-13T19:00:29.813072+0000","last_peered":"2024-09-13T19:00:29.813072+0000","last_clean":"2024-09-13T19:00:29.813072+0000","last_became_active":"2024-09-13T19:00:28.810680+0000","last_became_peered":"2024-09-13T19:00:28.810680+0000","last_unstale":"2024-09-13T19:00:29.813072+0000","last_undegraded":"2024-09-13T19:00:29.813072+0000","last_fullsized":"2024-09-13T19:00:29.813072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795426+0000","last_change":"2024-09-13T19:00:28.813221+0000","last_active":"2024-09-13T19:00:29.795426+0000","last_peered":"2024-09-13T19:00:29.795426+0000","last_clean":"2024-09-13T19:00:29.795426+0000","last_became_active":"2024-09-13T19:00:28.812271+0000","last_became_peered":"2024-09-13T19:00:28.812271+0000","last_unstale":"2024-09-13T19:00:29.795426+0000","last_undegraded":"2024-09-13T19:00:29.795426+0000","last_fullsized":"2024-09-13T19:00:29.795426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:17.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795254+0000","last_change":"2024-09-13T19:00:28.803498+0000","last_active":"2024-09-13T19:00:29.795254+0000","last_peered":"2024-09-13T19:00:29.795254+0000","last_clean":"2024-09-13T19:00:29.795254+0000","last_became_active":"2024-09-13T19:00:28.803226+0000","last_became_peered":"2024-09-13T19:00:28.803226+0000","last_unstale":"2024-09-13T19:00:29.795254+0000","last_undegraded":"2024-09-13T19:00:29.795254+0000","last_fullsized":"2024-09-13T19:00:29.795254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:19.364448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811934+0000","last_change":"2024-09-13T19:00:28.820581+0000","last_active":"2024-09-13T19:00:29.811934+0000","last_peered":"2024-09-13T19:00:29.811934+0000","last_clean":"2024-09-13T19:00:29.811934+0000","last_became_active":"2024-09-13T19:00:28.820011+0000","last_became_peered":"2024-09-13T19:00:28.820011+0000","last_unstale":"2024-09-13T19:00:29.811934+0000","last_undegraded":"2024-09-13T19:00:29.811934+0000","last_fullsized":"2024-09-13T19:00:29.811934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:47.794554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811560+0000","last_change":"2024-09-13T19:00:28.812763+0000","last_active":"2024-09-13T19:00:29.811560+0000","last_peered":"2024-09-13T19:00:29.811560+0000","last_clean":"2024-09-13T19:00:29.811560+0000","last_became_active":"2024-09-13T19:00:28.812468+0000","last_became_peered":"2024-09-13T19:00:28.812468+0000","last_unstale":"2024-09-13T19:00:29.811560+0000","last_undegraded":"2024-09-13T19:00:29.811560+0000","last_fullsized":"2024-09-13T19:00:29.811560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:07.000007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795037+0000","last_change":"2024-09-13T19:00:28.813775+0000","last_active":"2024-09-13T19:00:29.795037+0000","last_peered":"2024-09-13T19:00:29.795037+0000","last_clean":"2024-09-13T19:00:29.795037+0000","last_became_active":"2024-09-13T19:00:28.811975+0000","last_became_peered":"2024-09-13T19:00:28.811975+0000","last_unstale":"2024-09-13T19:00:29.795037+0000","last_undegraded":"2024-09-13T19:00:29.795037+0000","last_fullsized":"2024-09-13T19:00:29.795037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:40.891490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812018+0000","last_change":"2024-09-13T19:00:28.807295+0000","last_active":"2024-09-13T19:00:29.812018+0000","last_peered":"2024-09-13T19:00:29.812018+0000","last_clean":"2024-09-13T19:00:29.812018+0000","last_became_active":"2024-09-13T19:00:28.806583+0000","last_became_peered":"2024-09-13T19:00:28.806583+0000","last_unstale":"2024-09-13T19:00:29.812018+0000","last_undegraded":"2024-09-13T19:00:29.812018+0000","last_fullsized":"2024-09-13T19:00:29.812018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:53.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800619+0000","last_change":"2024-09-13T19:00:28.810241+0000","last_active":"2024-09-13T19:00:29.800619+0000","last_peered":"2024-09-13T19:00:29.800619+0000","last_clean":"2024-09-13T19:00:29.800619+0000","last_became_active":"2024-09-13T19:00:28.809955+0000","last_became_peered":"2024-09-13T19:00:28.809955+0000","last_unstale":"2024-09-13T19:00:29.800619+0000","last_undegraded":"2024-09-13T19:00:29.800619+0000","last_fullsized":"2024-09-13T19:00:29.800619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801014+0000","last_change":"2024-09-13T19:00:28.798670+0000","last_active":"2024-09-13T19:00:29.801014+0000","last_peered":"2024-09-13T19:00:29.801014+0000","last_clean":"2024-09-13T19:00:29.801014+0000","last_became_active":"2024-09-13T19:00:28.798380+0000","last_became_peered":"2024-09-13T19:00:28.798380+0000","last_unstale":"2024-09-13T19:00:29.801014+0000","last_undegraded":"2024-09-13T19:00:29.801014+0000","last_fullsized":"2024-09-13T19:00:29.801014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811728+0000","last_change":"2024-09-13T19:00:28.813222+0000","last_active":"2024-09-13T19:00:29.811728+0000","last_peered":"2024-09-13T19:00:29.811728+0000","last_clean":"2024-09-13T19:00:29.811728+0000","last_became_active":"2024-09-13T19:00:28.812918+0000","last_became_peered":"2024-09-13T19:00:28.812918+0000","last_unstale":"2024-09-13T19:00:29.811728+0000","last_undegraded":"2024-09-13T19:00:29.811728+0000","last_fullsized":"2024-09-13T19:00:29.811728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:40.171075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811957+0000","last_change":"2024-09-13T19:00:28.813470+0000","last_active":"2024-09-13T19:00:29.811957+0000","last_peered":"2024-09-13T19:00:29.811957+0000","last_clean":"2024-09-13T19:00:29.811957+0000","last_became_active":"2024-09-13T19:00:28.813215+0000","last_became_peered":"2024-09-13T19:00:28.813215+0000","last_unstale":"2024-09-13T19:00:29.811957+0000","last_undegraded":"2024-09-13T19:00:29.811957+0000","last_fullsized":"2024-09-13T19:00:29.811957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812031+0000","last_change":"2024-09-13T19:00:28.820335+0000","last_active":"2024-09-13T19:00:29.812031+0000","last_peered":"2024-09-13T19:00:29.812031+0000","last_clean":"2024-09-13T19:00:29.812031+0000","last_became_active":"2024-09-13T19:00:28.820067+0000","last_became_peered":"2024-09-13T19:00:28.820067+0000","last_unstale":"2024-09-13T19:00:29.812031+0000","last_undegraded":"2024-09-13T19:00:29.812031+0000","last_fullsized":"2024-09-13T19:00:29.812031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:07.329940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800248+0000","last_change":"2024-09-13T19:00:28.813908+0000","last_active":"2024-09-13T19:00:29.800248+0000","last_peered":"2024-09-13T19:00:29.800248+0000","last_clean":"2024-09-13T19:00:29.800248+0000","last_became_active":"2024-09-13T19:00:28.813585+0000","last_became_peered":"2024-09-13T19:00:28.813585+0000","last_unstale":"2024-09-13T19:00:29.800248+0000","last_undegraded":"2024-09-13T19:00:29.800248+0000","last_fullsized":"2024-09-13T19:00:29.800248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811477+0000","last_change":"2024-09-13T19:00:28.812387+0000","last_active":"2024-09-13T19:00:29.811477+0000","last_peered":"2024-09-13T19:00:29.811477+0000","last_clean":"2024-09-13T19:00:29.811477+0000","last_became_active":"2024-09-13T19:00:28.812111+0000","last_became_peered":"2024-09-13T19:00:28.812111+0000","last_unstale":"2024-09-13T19:00:29.811477+0000","last_undegraded":"2024-09-13T19:00:29.811477+0000","last_fullsized":"2024-09-13T19:00:29.811477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:41.375831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801216+0000","last_change":"2024-09-13T19:00:28.809178+0000","last_active":"2024-09-13T19:00:29.801216+0000","last_peered":"2024-09-13T19:00:29.801216+0000","last_clean":"2024-09-13T19:00:29.801216+0000","last_became_active":"2024-09-13T19:00:28.808874+0000","last_became_peered":"2024-09-13T19:00:28.808874+0000","last_unstale":"2024-09-13T19:00:29.801216+0000","last_undegraded":"2024-09-13T19:00:29.801216+0000","last_fullsized":"2024-09-13T19:00:29.801216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:44.525840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.819436+0000","last_change":"2024-09-13T19:00:28.378869+0000","last_active":"2024-09-13T19:00:28.819436+0000","last_peered":"2024-09-13T19:00:28.819436+0000","last_clean":"2024-09-13T19:00:28.819436+0000","last_became_active":"2024-09-13T19:00:28.378570+0000","last_became_peered":"2024-09-13T19:00:28.378570+0000","last_unstale":"2024-09-13T19:00:28.819436+0000","last_undegraded":"2024-09-13T19:00:28.819436+0000","last_fullsized":"2024-09-13T19:00:28.819436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:31.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812234+0000","last_change":"2024-09-13T19:00:28.804430+0000","last_active":"2024-09-13T19:00:29.812234+0000","last_peered":"2024-09-13T19:00:29.812234+0000","last_clean":"2024-09-13T19:00:29.812234+0000","last_became_active":"2024-09-13T19:00:28.804134+0000","last_became_peered":"2024-09-13T19:00:28.804134+0000","last_unstale":"2024-09-13T19:00:29.812234+0000","last_undegraded":"2024-09-13T19:00:29.812234+0000","last_fullsized":"2024-09-13T19:00:29.812234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:22.351065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.815987+0000","last_change":"2024-09-13T19:00:28.365834+0000","last_active":"2024-09-13T19:00:28.815987+0000","last_peered":"2024-09-13T19:00:28.815987+0000","last_clean":"2024-09-13T19:00:28.815987+0000","last_became_active":"2024-09-13T19:00:28.365494+0000","last_became_peered":"2024-09-13T19:00:28.365494+0000","last_unstale":"2024-09-13T19:00:28.815987+0000","last_undegraded":"2024-09-13T19:00:28.815987+0000","last_fullsized":"2024-09-13T19:00:28.815987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:39.164508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812474+0000","last_change":"2024-09-13T19:00:28.817375+0000","last_active":"2024-09-13T19:00:29.812474+0000","last_peered":"2024-09-13T19:00:29.812474+0000","last_clean":"2024-09-13T19:00:29.812474+0000","last_became_active":"2024-09-13T19:00:28.817062+0000","last_became_peered":"2024-09-13T19:00:28.817062+0000","last_unstale":"2024-09-13T19:00:29.812474+0000","last_undegraded":"2024-09-13T19:00:29.812474+0000","last_fullsized":"2024-09-13T19:00:29.812474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:21.006831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.822288+0000","last_change":"2024-09-13T19:00:28.370121+0000","last_active":"2024-09-13T19:00:28.822288+0000","last_peered":"2024-09-13T19:00:28.822288+0000","last_clean":"2024-09-13T19:00:28.822288+0000","last_became_active":"2024-09-13T19:00:28.369832+0000","last_became_peered":"2024-09-13T19:00:28.369832+0000","last_unstale":"2024-09-13T19:00:28.822288+0000","last_undegraded":"2024-09-13T19:00:28.822288+0000","last_fullsized":"2024-09-13T19:00:28.822288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:31.302641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800544+0000","last_change":"2024-09-13T19:00:28.800787+0000","last_active":"2024-09-13T19:00:29.800544+0000","last_peered":"2024-09-13T19:00:29.800544+0000","last_clean":"2024-09-13T19:00:29.800544+0000","last_became_active":"2024-09-13T19:00:28.800502+0000","last_became_peered":"2024-09-13T19:00:28.800502+0000","last_unstale":"2024-09-13T19:00:29.800544+0000","last_undegraded":"2024-09-13T19:00:29.800544+0000","last_fullsized":"2024-09-13T19:00:29.800544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:03.265587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821223+0000","last_change":"2024-09-13T19:00:28.368311+0000","last_active":"2024-09-13T19:00:28.821223+0000","last_peered":"2024-09-13T19:00:28.821223+0000","last_clean":"2024-09-13T19:00:28.821223+0000","last_became_active":"2024-09-13T19:00:28.368021+0000","last_became_peered":"2024-09-13T19:00:28.368021+0000","last_unstale":"2024-09-13T19:00:28.821223+0000","last_undegraded":"2024-09-13T19:00:28.821223+0000","last_fullsized":"2024-09-13T19:00:28.821223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:50.636787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812136+0000","last_change":"2024-09-13T19:00:28.814405+0000","last_active":"2024-09-13T19:00:29.812136+0000","last_peered":"2024-09-13T19:00:29.812136+0000","last_clean":"2024-09-13T19:00:29.812136+0000","last_became_active":"2024-09-13T19:00:28.814087+0000","last_became_peered":"2024-09-13T19:00:28.814087+0000","last_unstale":"2024-09-13T19:00:29.812136+0000","last_undegraded":"2024-09-13T19:00:29.812136+0000","last_fullsized":"2024-09-13T19:00:29.812136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:54.645959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.818704+0000","last_change":"2024-09-13T19:00:28.372231+0000","last_active":"2024-09-13T19:00:28.818704+0000","last_peered":"2024-09-13T19:00:28.818704+0000","last_clean":"2024-09-13T19:00:28.818704+0000","last_became_active":"2024-09-13T19:00:28.370750+0000","last_became_peered":"2024-09-13T19:00:28.370750+0000","last_unstale":"2024-09-13T19:00:28.818704+0000","last_undegraded":"2024-09-13T19:00:28.818704+0000","last_fullsized":"2024-09-13T19:00:28.818704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:32.746000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800548+0000","last_change":"2024-09-13T19:00:28.800083+0000","last_active":"2024-09-13T19:00:29.800548+0000","last_peered":"2024-09-13T19:00:29.800548+0000","last_clean":"2024-09-13T19:00:29.800548+0000","last_became_active":"2024-09-13T19:00:28.799816+0000","last_became_peered":"2024-09-13T19:00:28.799816+0000","last_unstale":"2024-09-13T19:00:29.800548+0000","last_undegraded":"2024-09-13T19:00:29.800548+0000","last_fullsized":"2024-09-13T19:00:29.800548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.643355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.816238+0000","last_change":"2024-09-13T19:00:28.367194+0000","last_active":"2024-09-13T19:00:28.816238+0000","last_peered":"2024-09-13T19:00:28.816238+0000","last_clean":"2024-09-13T19:00:28.816238+0000","last_became_active":"2024-09-13T19:00:28.366291+0000","last_became_peered":"2024-09-13T19:00:28.366291+0000","last_unstale":"2024-09-13T19:00:28.816238+0000","last_undegraded":"2024-09-13T19:00:28.816238+0000","last_fullsized":"2024-09-13T19:00:28.816238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:21.539136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799909+0000","last_change":"2024-09-13T19:00:28.814422+0000","last_active":"2024-09-13T19:00:29.799909+0000","last_peered":"2024-09-13T19:00:29.799909+0000","last_clean":"2024-09-13T19:00:29.799909+0000","last_became_active":"2024-09-13T19:00:28.814146+0000","last_became_peered":"2024-09-13T19:00:28.814146+0000","last_unstale":"2024-09-13T19:00:29.799909+0000","last_undegraded":"2024-09-13T19:00:29.799909+0000","last_fullsized":"2024-09-13T19:00:29.799909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:09.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794580+0000","last_change":"2024-09-13T19:00:28.371979+0000","last_active":"2024-09-13T19:00:28.794580+0000","last_peered":"2024-09-13T19:00:28.794580+0000","last_clean":"2024-09-13T19:00:28.794580+0000","last_became_active":"2024-09-13T19:00:28.370337+0000","last_became_peered":"2024-09-13T19:00:28.370337+0000","last_unstale":"2024-09-13T19:00:28.794580+0000","last_undegraded":"2024-09-13T19:00:28.794580+0000","last_fullsized":"2024-09-13T19:00:28.794580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:59.105096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812410+0000","last_change":"2024-09-13T19:00:28.796132+0000","last_active":"2024-09-13T19:00:29.812410+0000","last_peered":"2024-09-13T19:00:29.812410+0000","last_clean":"2024-09-13T19:00:29.812410+0000","last_became_active":"2024-09-13T19:00:28.795888+0000","last_became_peered":"2024-09-13T19:00:28.795888+0000","last_unstale":"2024-09-13T19:00:29.812410+0000","last_undegraded":"2024-09-13T19:00:29.812410+0000","last_fullsized":"2024-09-13T19:00:29.812410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.798122+0000","last_change":"2024-09-13T19:00:28.366686+0000","last_active":"2024-09-13T19:00:28.798122+0000","last_peered":"2024-09-13T19:00:28.798122+0000","last_clean":"2024-09-13T19:00:28.798122+0000","last_became_active":"2024-09-13T19:00:28.366424+0000","last_became_peered":"2024-09-13T19:00:28.366424+0000","last_unstale":"2024-09-13T19:00:28.798122+0000","last_undegraded":"2024-09-13T19:00:28.798122+0000","last_fullsized":"2024-09-13T19:00:28.798122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:15.934982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.813210+0000","last_change":"2024-09-13T19:00:28.814378+0000","last_active":"2024-09-13T19:00:29.813210+0000","last_peered":"2024-09-13T19:00:29.813210+0000","last_clean":"2024-09-13T19:00:29.813210+0000","last_became_active":"2024-09-13T19:00:28.814133+0000","last_became_peered":"2024-09-13T19:00:28.814133+0000","last_unstale":"2024-09-13T19:00:29.813210+0000","last_undegraded":"2024-09-13T19:00:29.813210+0000","last_fullsized":"2024-09-13T19:00:29.813210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.802852+0000","last_change":"2024-09-13T19:00:28.371425+0000","last_active":"2024-09-13T19:00:28.802852+0000","last_peered":"2024-09-13T19:00:28.802852+0000","last_clean":"2024-09-13T19:00:28.802852+0000","last_became_active":"2024-09-13T19:00:28.371018+0000","last_became_peered":"2024-09-13T19:00:28.371018+0000","last_unstale":"2024-09-13T19:00:28.802852+0000","last_undegraded":"2024-09-13T19:00:28.802852+0000","last_fullsized":"2024-09-13T19:00:28.802852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:54.107373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812350+0000","last_change":"2024-09-13T19:00:28.803951+0000","last_active":"2024-09-13T19:00:29.812350+0000","last_peered":"2024-09-13T19:00:29.812350+0000","last_clean":"2024-09-13T19:00:29.812350+0000","last_became_active":"2024-09-13T19:00:28.803461+0000","last_became_peered":"2024-09-13T19:00:28.803461+0000","last_unstale":"2024-09-13T19:00:29.812350+0000","last_undegraded":"2024-09-13T19:00:29.812350+0000","last_fullsized":"2024-09-13T19:00:29.812350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:00.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.805159+0000","last_change":"2024-09-13T19:00:28.361251+0000","last_active":"2024-09-13T19:00:28.805159+0000","last_peered":"2024-09-13T19:00:28.805159+0000","last_clean":"2024-09-13T19:00:28.805159+0000","last_became_active":"2024-09-13T19:00:28.360965+0000","last_became_peered":"2024-09-13T19:00:28.360965+0000","last_unstale":"2024-09-13T19:00:28.805159+0000","last_undegraded":"2024-09-13T19:00:28.805159+0000","last_fullsized":"2024-09-13T19:00:28.805159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:09.283998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812712+0000","last_change":"2024-09-13T19:00:28.815486+0000","last_active":"2024-09-13T19:00:29.812712+0000","last_peered":"2024-09-13T19:00:29.812712+0000","last_clean":"2024-09-13T19:00:29.812712+0000","last_became_active":"2024-09-13T19:00:28.815155+0000","last_became_peered":"2024-09-13T19:00:28.815155+0000","last_unstale":"2024-09-13T19:00:29.812712+0000","last_undegraded":"2024-09-13T19:00:29.812712+0000","last_fullsized":"2024-09-13T19:00:29.812712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.818995+0000","last_change":"2024-09-13T19:00:28.368558+0000","last_active":"2024-09-13T19:00:28.818995+0000","last_peered":"2024-09-13T19:00:28.818995+0000","last_clean":"2024-09-13T19:00:28.818995+0000","last_became_active":"2024-09-13T19:00:28.368297+0000","last_became_peered":"2024-09-13T19:00:28.368297+0000","last_unstale":"2024-09-13T19:00:28.818995+0000","last_undegraded":"2024-09-13T19:00:28.818995+0000","last_fullsized":"2024-09-13T19:00:28.818995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:51.446590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800870+0000","last_change":"2024-09-13T19:00:28.815382+0000","last_active":"2024-09-13T19:00:29.800870+0000","last_peered":"2024-09-13T19:00:29.800870+0000","last_clean":"2024-09-13T19:00:29.800870+0000","last_became_active":"2024-09-13T19:00:28.814942+0000","last_became_peered":"2024-09-13T19:00:28.814942+0000","last_unstale":"2024-09-13T19:00:29.800870+0000","last_undegraded":"2024-09-13T19:00:29.800870+0000","last_fullsized":"2024-09-13T19:00:29.800870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823134+0000","last_change":"2024-09-13T19:00:28.373276+0000","last_active":"2024-09-13T19:00:28.823134+0000","last_peered":"2024-09-13T19:00:28.823134+0000","last_clean":"2024-09-13T19:00:28.823134+0000","last_became_active":"2024-09-13T19:00:28.372958+0000","last_became_peered":"2024-09-13T19:00:28.372958+0000","last_unstale":"2024-09-13T19:00:28.823134+0000","last_undegraded":"2024-09-13T19:00:28.823134+0000","last_fullsized":"2024-09-13T19:00:28.823134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811682+0000","last_change":"2024-09-13T19:00:28.820265+0000","last_active":"2024-09-13T19:00:29.811682+0000","last_peered":"2024-09-13T19:00:29.811682+0000","last_clean":"2024-09-13T19:00:29.811682+0000","last_became_active":"2024-09-13T19:00:28.820015+0000","last_became_peered":"2024-09-13T19:00:28.820015+0000","last_unstale":"2024-09-13T19:00:29.811682+0000","last_undegraded":"2024-09-13T19:00:29.811682+0000","last_fullsized":"2024-09-13T19:00:29.811682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.823094+0000","last_change":"2024-09-13T19:00:28.370433+0000","last_active":"2024-09-13T19:00:28.823094+0000","last_peered":"2024-09-13T19:00:28.823094+0000","last_clean":"2024-09-13T19:00:28.823094+0000","last_became_active":"2024-09-13T19:00:28.369892+0000","last_became_peered":"2024-09-13T19:00:28.369892+0000","last_unstale":"2024-09-13T19:00:28.823094+0000","last_undegraded":"2024-09-13T19:00:28.823094+0000","last_fullsized":"2024-09-13T19:00:28.823094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:16.635844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800589+0000","last_change":"2024-09-13T19:00:28.807808+0000","last_active":"2024-09-13T19:00:29.800589+0000","last_peered":"2024-09-13T19:00:29.800589+0000","last_clean":"2024-09-13T19:00:29.800589+0000","last_became_active":"2024-09-13T19:00:28.807287+0000","last_became_peered":"2024-09-13T19:00:28.807287+0000","last_unstale":"2024-09-13T19:00:29.800589+0000","last_undegraded":"2024-09-13T19:00:29.800589+0000","last_fullsized":"2024-09-13T19:00:29.800589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.787946+0000","last_change":"2024-09-13T19:00:28.377480+0000","last_active":"2024-09-13T19:00:28.787946+0000","last_peered":"2024-09-13T19:00:28.787946+0000","last_clean":"2024-09-13T19:00:28.787946+0000","last_became_active":"2024-09-13T19:00:28.376960+0000","last_became_peered":"2024-09-13T19:00:28.376960+0000","last_unstale":"2024-09-13T19:00:28.787946+0000","last_undegraded":"2024-09-13T19:00:28.787946+0000","last_fullsized":"2024-09-13T19:00:28.787946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:53.669678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811803+0000","last_change":"2024-09-13T19:00:28.806548+0000","last_active":"2024-09-13T19:00:29.811803+0000","last_peered":"2024-09-13T19:00:29.811803+0000","last_clean":"2024-09-13T19:00:29.811803+0000","last_became_active":"2024-09-13T19:00:28.802337+0000","last_became_peered":"2024-09-13T19:00:28.802337+0000","last_unstale":"2024-09-13T19:00:29.811803+0000","last_undegraded":"2024-09-13T19:00:29.811803+0000","last_fullsized":"2024-09-13T19:00:29.811803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:22.232714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.794909+0000","last_change":"2024-09-13T19:00:28.369519+0000","last_active":"2024-09-13T19:00:28.794909+0000","last_peered":"2024-09-13T19:00:28.794909+0000","last_clean":"2024-09-13T19:00:28.794909+0000","last_became_active":"2024-09-13T19:00:28.369150+0000","last_became_peered":"2024-09-13T19:00:28.369150+0000","last_unstale":"2024-09-13T19:00:28.794909+0000","last_undegraded":"2024-09-13T19:00:28.794909+0000","last_fullsized":"2024-09-13T19:00:28.794909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811686+0000","last_change":"2024-09-13T19:00:28.805379+0000","last_active":"2024-09-13T19:00:29.811686+0000","last_peered":"2024-09-13T19:00:29.811686+0000","last_clean":"2024-09-13T19:00:29.811686+0000","last_became_active":"2024-09-13T19:00:28.805121+0000","last_became_peered":"2024-09-13T19:00:28.805121+0000","last_unstale":"2024-09-13T19:00:29.811686+0000","last_undegraded":"2024-09-13T19:00:29.811686+0000","last_fullsized":"2024-09-13T19:00:29.811686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:32.528562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.824016+0000","last_change":"2024-09-13T19:00:28.376100+0000","last_active":"2024-09-13T19:00:28.824016+0000","last_peered":"2024-09-13T19:00:28.824016+0000","last_clean":"2024-09-13T19:00:28.824016+0000","last_became_active":"2024-09-13T19:00:28.375841+0000","last_became_peered":"2024-09-13T19:00:28.375841+0000","last_unstale":"2024-09-13T19:00:28.824016+0000","last_undegraded":"2024-09-13T19:00:28.824016+0000","last_fullsized":"2024-09-13T19:00:28.824016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:31.390640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800688+0000","last_change":"2024-09-13T19:00:28.809367+0000","last_active":"2024-09-13T19:00:29.800688+0000","last_peered":"2024-09-13T19:00:29.800688+0000","last_clean":"2024-09-13T19:00:29.800688+0000","last_became_active":"2024-09-13T19:00:28.807363+0000","last_became_peered":"2024-09-13T19:00:28.807363+0000","last_unstale":"2024-09-13T19:00:29.800688+0000","last_undegraded":"2024-09-13T19:00:29.800688+0000","last_fullsized":"2024-09-13T19:00:29.800688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.717089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.811129+0000","last_change":"2024-09-13T19:00:28.375312+0000","last_active":"2024-09-13T19:00:28.811129+0000","last_peered":"2024-09-13T19:00:28.811129+0000","last_clean":"2024-09-13T19:00:28.811129+0000","last_became_active":"2024-09-13T19:00:28.375050+0000","last_became_peered":"2024-09-13T19:00:28.375050+0000","last_unstale":"2024-09-13T19:00:28.811129+0000","last_undegraded":"2024-09-13T19:00:28.811129+0000","last_fullsized":"2024-09-13T19:00:28.811129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:18.868176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812337+0000","last_change":"2024-09-13T19:00:28.811785+0000","last_active":"2024-09-13T19:00:29.812337+0000","last_peered":"2024-09-13T19:00:29.812337+0000","last_clean":"2024-09-13T19:00:29.812337+0000","last_became_active":"2024-09-13T19:00:28.811466+0000","last_became_peered":"2024-09-13T19:00:28.811466+0000","last_unstale":"2024-09-13T19:00:29.812337+0000","last_undegraded":"2024-09-13T19:00:29.812337+0000","last_fullsized":"2024-09-13T19:00:29.812337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.821881+0000","last_change":"2024-09-13T19:00:28.369284+0000","last_active":"2024-09-13T19:00:28.821881+0000","last_peered":"2024-09-13T19:00:28.821881+0000","last_clean":"2024-09-13T19:00:28.821881+0000","last_became_active":"2024-09-13T19:00:28.369016+0000","last_became_peered":"2024-09-13T19:00:28.369016+0000","last_unstale":"2024-09-13T19:00:28.821881+0000","last_undegraded":"2024-09-13T19:00:28.821881+0000","last_fullsized":"2024-09-13T19:00:28.821881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:47.940954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801006+0000","last_change":"2024-09-13T19:00:28.812669+0000","last_active":"2024-09-13T19:00:29.801006+0000","last_peered":"2024-09-13T19:00:29.801006+0000","last_clean":"2024-09-13T19:00:29.801006+0000","last_became_active":"2024-09-13T19:00:28.812357+0000","last_became_peered":"2024-09-13T19:00:28.812357+0000","last_unstale":"2024-09-13T19:00:29.801006+0000","last_undegraded":"2024-09-13T19:00:29.801006+0000","last_fullsized":"2024-09-13T19:00:29.801006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:18.786352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795700+0000","last_change":"2024-09-13T19:00:28.369758+0000","last_active":"2024-09-13T19:00:28.795700+0000","last_peered":"2024-09-13T19:00:28.795700+0000","last_clean":"2024-09-13T19:00:28.795700+0000","last_became_active":"2024-09-13T19:00:28.366342+0000","last_became_peered":"2024-09-13T19:00:28.366342+0000","last_unstale":"2024-09-13T19:00:28.795700+0000","last_undegraded":"2024-09-13T19:00:28.795700+0000","last_fullsized":"2024-09-13T19:00:28.795700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:55.732038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795417+0000","last_change":"2024-09-13T19:00:28.817448+0000","last_active":"2024-09-13T19:00:29.795417+0000","last_peered":"2024-09-13T19:00:29.795417+0000","last_clean":"2024-09-13T19:00:29.795417+0000","last_became_active":"2024-09-13T19:00:28.815546+0000","last_became_peered":"2024-09-13T19:00:28.815546+0000","last_unstale":"2024-09-13T19:00:29.795417+0000","last_undegraded":"2024-09-13T19:00:29.795417+0000","last_fullsized":"2024-09-13T19:00:29.795417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:52.684470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817769+0000","last_change":"2024-09-13T19:00:28.370089+0000","last_active":"2024-09-13T19:00:28.817769+0000","last_peered":"2024-09-13T19:00:28.817769+0000","last_clean":"2024-09-13T19:00:28.817769+0000","last_became_active":"2024-09-13T19:00:28.369842+0000","last_became_peered":"2024-09-13T19:00:28.369842+0000","last_unstale":"2024-09-13T19:00:28.817769+0000","last_undegraded":"2024-09-13T19:00:28.817769+0000","last_fullsized":"2024-09-13T19:00:28.817769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.519273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812095+0000","last_change":"2024-09-13T19:00:28.809780+0000","last_active":"2024-09-13T19:00:29.812095+0000","last_peered":"2024-09-13T19:00:29.812095+0000","last_clean":"2024-09-13T19:00:29.812095+0000","last_became_active":"2024-09-13T19:00:28.809165+0000","last_became_peered":"2024-09-13T19:00:28.809165+0000","last_unstale":"2024-09-13T19:00:29.812095+0000","last_undegraded":"2024-09-13T19:00:29.812095+0000","last_fullsized":"2024-09-13T19:00:29.812095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:32.309208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793623+0000","last_change":"2024-09-13T19:00:28.367585+0000","last_active":"2024-09-13T19:00:28.793623+0000","last_peered":"2024-09-13T19:00:28.793623+0000","last_clean":"2024-09-13T19:00:28.793623+0000","last_became_active":"2024-09-13T19:00:28.367298+0000","last_became_peered":"2024-09-13T19:00:28.367298+0000","last_unstale":"2024-09-13T19:00:28.793623+0000","last_undegraded":"2024-09-13T19:00:28.793623+0000","last_fullsized":"2024-09-13T19:00:28.793623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:23.664451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.795115+0000","last_change":"2024-09-13T19:00:28.806322+0000","last_active":"2024-09-13T19:00:29.795115+0000","last_peered":"2024-09-13T19:00:29.795115+0000","last_clean":"2024-09-13T19:00:29.795115+0000","last_became_active":"2024-09-13T19:00:28.806063+0000","last_became_peered":"2024-09-13T19:00:28.806063+0000","last_unstale":"2024-09-13T19:00:29.795115+0000","last_undegraded":"2024-09-13T19:00:29.795115+0000","last_fullsized":"2024-09-13T19:00:29.795115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:26.684968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.793626+0000","last_change":"2024-09-13T19:00:28.377051+0000","last_active":"2024-09-13T19:00:28.793626+0000","last_peered":"2024-09-13T19:00:28.793626+0000","last_clean":"2024-09-13T19:00:28.793626+0000","last_became_active":"2024-09-13T19:00:28.376590+0000","last_became_peered":"2024-09-13T19:00:28.376590+0000","last_unstale":"2024-09-13T19:00:28.793626+0000","last_undegraded":"2024-09-13T19:00:28.793626+0000","last_fullsized":"2024-09-13T19:00:28.793626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:57.996268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811841+0000","last_change":"2024-09-13T19:00:28.805849+0000","last_active":"2024-09-13T19:00:29.811841+0000","last_peered":"2024-09-13T19:00:29.811841+0000","last_clean":"2024-09-13T19:00:29.811841+0000","last_became_active":"2024-09-13T19:00:28.805522+0000","last_became_peered":"2024-09-13T19:00:28.805522+0000","last_unstale":"2024-09-13T19:00:29.811841+0000","last_undegraded":"2024-09-13T19:00:29.811841+0000","last_fullsized":"2024-09-13T19:00:29.811841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:07.000007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.788165+0000","last_change":"2024-09-13T19:00:28.368110+0000","last_active":"2024-09-13T19:00:28.788165+0000","last_peered":"2024-09-13T19:00:28.788165+0000","last_clean":"2024-09-13T19:00:28.788165+0000","last_became_active":"2024-09-13T19:00:28.367864+0000","last_became_peered":"2024-09-13T19:00:28.367864+0000","last_unstale":"2024-09-13T19:00:28.788165+0000","last_undegraded":"2024-09-13T19:00:28.788165+0000","last_fullsized":"2024-09-13T19:00:28.788165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:58.073529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801166+0000","last_change":"2024-09-13T19:00:28.806973+0000","last_active":"2024-09-13T19:00:29.801166+0000","last_peered":"2024-09-13T19:00:29.801166+0000","last_clean":"2024-09-13T19:00:29.801166+0000","last_became_active":"2024-09-13T19:00:28.806508+0000","last_became_peered":"2024-09-13T19:00:28.806508+0000","last_unstale":"2024-09-13T19:00:29.801166+0000","last_undegraded":"2024-09-13T19:00:29.801166+0000","last_fullsized":"2024-09-13T19:00:29.801166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817381+0000","last_change":"2024-09-13T19:00:28.374360+0000","last_active":"2024-09-13T19:00:28.817381+0000","last_peered":"2024-09-13T19:00:28.817381+0000","last_clean":"2024-09-13T19:00:28.817381+0000","last_became_active":"2024-09-13T19:00:28.374052+0000","last_became_peered":"2024-09-13T19:00:28.374052+0000","last_unstale":"2024-09-13T19:00:28.817381+0000","last_undegraded":"2024-09-13T19:00:28.817381+0000","last_fullsized":"2024-09-13T19:00:28.817381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:18.357881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.800838+0000","last_change":"2024-09-13T19:00:28.804644+0000","last_active":"2024-09-13T19:00:29.800838+0000","last_peered":"2024-09-13T19:00:29.800838+0000","last_clean":"2024-09-13T19:00:29.800838+0000","last_became_active":"2024-09-13T19:00:28.804318+0000","last_became_peered":"2024-09-13T19:00:28.804318+0000","last_unstale":"2024-09-13T19:00:29.800838+0000","last_undegraded":"2024-09-13T19:00:29.800838+0000","last_fullsized":"2024-09-13T19:00:29.800838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.799327+0000","last_change":"2024-09-13T19:00:28.369253+0000","last_active":"2024-09-13T19:00:28.799327+0000","last_peered":"2024-09-13T19:00:28.799327+0000","last_clean":"2024-09-13T19:00:28.799327+0000","last_became_active":"2024-09-13T19:00:28.368999+0000","last_became_peered":"2024-09-13T19:00:28.368999+0000","last_unstale":"2024-09-13T19:00:28.799327+0000","last_undegraded":"2024-09-13T19:00:28.799327+0000","last_fullsized":"2024-09-13T19:00:28.799327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:25.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811884+0000","last_change":"2024-09-13T19:00:28.815297+0000","last_active":"2024-09-13T19:00:29.811884+0000","last_peered":"2024-09-13T19:00:29.811884+0000","last_clean":"2024-09-13T19:00:29.811884+0000","last_became_active":"2024-09-13T19:00:28.815009+0000","last_became_peered":"2024-09-13T19:00:28.815009+0000","last_unstale":"2024-09-13T19:00:29.811884+0000","last_undegraded":"2024-09-13T19:00:29.811884+0000","last_fullsized":"2024-09-13T19:00:29.811884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:00.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.802872+0000","last_change":"2024-09-13T19:00:28.376222+0000","last_active":"2024-09-13T19:00:28.802872+0000","last_peered":"2024-09-13T19:00:28.802872+0000","last_clean":"2024-09-13T19:00:28.802872+0000","last_became_active":"2024-09-13T19:00:28.375921+0000","last_became_peered":"2024-09-13T19:00:28.375921+0000","last_unstale":"2024-09-13T19:00:28.802872+0000","last_undegraded":"2024-09-13T19:00:28.802872+0000","last_fullsized":"2024-09-13T19:00:28.802872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:52.333821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.801141+0000","last_change":"2024-09-13T19:00:28.815219+0000","last_active":"2024-09-13T19:00:29.801141+0000","last_peered":"2024-09-13T19:00:29.801141+0000","last_clean":"2024-09-13T19:00:29.801141+0000","last_became_active":"2024-09-13T19:00:28.814608+0000","last_became_peered":"2024-09-13T19:00:28.814608+0000","last_unstale":"2024-09-13T19:00:29.801141+0000","last_undegraded":"2024-09-13T19:00:29.801141+0000","last_fullsized":"2024-09-13T19:00:29.801141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.080710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.800168+0000","last_change":"2024-09-13T19:00:28.368070+0000","last_active":"2024-09-13T19:00:28.800168+0000","last_peered":"2024-09-13T19:00:28.800168+0000","last_clean":"2024-09-13T19:00:28.800168+0000","last_became_active":"2024-09-13T19:00:28.367620+0000","last_became_peered":"2024-09-13T19:00:28.367620+0000","last_unstale":"2024-09-13T19:00:28.800168+0000","last_undegraded":"2024-09-13T19:00:28.800168+0000","last_fullsized":"2024-09-13T19:00:28.800168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:33.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812046+0000","last_change":"2024-09-13T19:00:28.812693+0000","last_active":"2024-09-13T19:00:29.812046+0000","last_peered":"2024-09-13T19:00:29.812046+0000","last_clean":"2024-09-13T19:00:29.812046+0000","last_became_active":"2024-09-13T19:00:28.809943+0000","last_became_peered":"2024-09-13T19:00:28.809943+0000","last_unstale":"2024-09-13T19:00:29.812046+0000","last_undegraded":"2024-09-13T19:00:29.812046+0000","last_fullsized":"2024-09-13T19:00:29.812046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:56.738605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.795445+0000","last_change":"2024-09-13T19:00:28.377131+0000","last_active":"2024-09-13T19:00:28.795445+0000","last_peered":"2024-09-13T19:00:28.795445+0000","last_clean":"2024-09-13T19:00:28.795445+0000","last_became_active":"2024-09-13T19:00:28.376871+0000","last_became_peered":"2024-09-13T19:00:28.376871+0000","last_unstale":"2024-09-13T19:00:28.795445+0000","last_undegraded":"2024-09-13T19:00:28.795445+0000","last_fullsized":"2024-09-13T19:00:28.795445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.812233+0000","last_change":"2024-09-13T19:00:28.822455+0000","last_active":"2024-09-13T19:00:29.812233+0000","last_peered":"2024-09-13T19:00:29.812233+0000","last_clean":"2024-09-13T19:00:29.812233+0000","last_became_active":"2024-09-13T19:00:28.822143+0000","last_became_peered":"2024-09-13T19:00:28.822143+0000","last_unstale":"2024-09-13T19:00:29.812233+0000","last_undegraded":"2024-09-13T19:00:29.812233+0000","last_fullsized":"2024-09-13T19:00:29.812233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:38.016913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.790525+0000","last_change":"2024-09-13T19:00:28.372034+0000","last_active":"2024-09-13T19:00:28.790525+0000","last_peered":"2024-09-13T19:00:28.790525+0000","last_clean":"2024-09-13T19:00:28.790525+0000","last_became_active":"2024-09-13T19:00:28.371752+0000","last_became_peered":"2024-09-13T19:00:28.371752+0000","last_unstale":"2024-09-13T19:00:28.790525+0000","last_undegraded":"2024-09-13T19:00:28.790525+0000","last_fullsized":"2024-09-13T19:00:28.790525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:57.399579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.799981+0000","last_change":"2024-09-13T19:00:28.811030+0000","last_active":"2024-09-13T19:00:29.799981+0000","last_peered":"2024-09-13T19:00:29.799981+0000","last_clean":"2024-09-13T19:00:29.799981+0000","last_became_active":"2024-09-13T19:00:28.810787+0000","last_became_peered":"2024-09-13T19:00:28.810787+0000","last_unstale":"2024-09-13T19:00:29.799981+0000","last_undegraded":"2024-09-13T19:00:29.799981+0000","last_fullsized":"2024-09-13T19:00:29.799981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:59.080097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.799980+0000","last_change":"2024-09-13T19:00:28.374487+0000","last_active":"2024-09-13T19:00:28.799980+0000","last_peered":"2024-09-13T19:00:28.799980+0000","last_clean":"2024-09-13T19:00:28.799980+0000","last_became_active":"2024-09-13T19:00:28.374092+0000","last_became_peered":"2024-09-13T19:00:28.374092+0000","last_unstale":"2024-09-13T19:00:28.799980+0000","last_undegraded":"2024-09-13T19:00:28.799980+0000","last_fullsized":"2024-09-13T19:00:28.799980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:20.218949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811612+0000","last_change":"2024-09-13T19:00:28.816070+0000","last_active":"2024-09-13T19:00:29.811612+0000","last_peered":"2024-09-13T19:00:29.811612+0000","last_clean":"2024-09-13T19:00:29.811612+0000","last_became_active":"2024-09-13T19:00:28.815683+0000","last_became_peered":"2024-09-13T19:00:28.815683+0000","last_unstale":"2024-09-13T19:00:29.811612+0000","last_undegraded":"2024-09-13T19:00:29.811612+0000","last_fullsized":"2024-09-13T19:00:29.811612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:56.738605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791981+0000","last_change":"2024-09-13T19:00:28.361393+0000","last_active":"2024-09-13T19:00:28.791981+0000","last_peered":"2024-09-13T19:00:28.791981+0000","last_clean":"2024-09-13T19:00:28.791981+0000","last_became_active":"2024-09-13T19:00:28.361119+0000","last_became_peered":"2024-09-13T19:00:28.361119+0000","last_unstale":"2024-09-13T19:00:28.791981+0000","last_undegraded":"2024-09-13T19:00:28.791981+0000","last_fullsized":"2024-09-13T19:00:28.791981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:06.323373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T19:00:29.811939+0000","last_change":"2024-09-13T19:00:28.808206+0000","last_active":"2024-09-13T19:00:29.811939+0000","last_peered":"2024-09-13T19:00:29.811939+0000","last_clean":"2024-09-13T19:00:29.811939+0000","last_became_active":"2024-09-13T19:00:28.807944+0000","last_became_peered":"2024-09-13T19:00:28.807944+0000","last_unstale":"2024-09-13T19:00:29.811939+0000","last_undegraded":"2024-09-13T19:00:29.811939+0000","last_fullsized":"2024-09-13T19:00:29.811939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:28.343051+0000","last_clean_scrub_stamp":"2024-09-13T19:00:28.343051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:22.628450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.817852+0000","last_change":"2024-09-13T19:00:28.376868+0000","last_active":"2024-09-13T19:00:28.817852+0000","last_peered":"2024-09-13T19:00:28.817852+0000","last_clean":"2024-09-13T19:00:28.817852+0000","last_became_active":"2024-09-13T19:00:28.376534+0000","last_became_peered":"2024-09-13T19:00:28.376534+0000","last_unstale":"2024-09-13T19:00:28.817852+0000","last_undegraded":"2024-09-13T19:00:28.817852+0000","last_fullsized":"2024-09-13T19:00:28.817852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:00:27.336484+0000","last_clean_scrub_stamp":"2024-09-13T19:00:27.336484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:19.686394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T19:00:28.791457+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:28.791457+0000","last_peered":"2024-09-13T19:00:28.791457+0000","last_clean":"2024-09-13T19:00:28.791457+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:28.791457+0000","last_undegraded":"2024-09-13T19:00:28.791457+0000","last_fullsized":"2024-09-13T19:00:28.791457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.754},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":438783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.86299999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.96999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":439675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":1032192,"data_stored":438089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.496},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1044480,"data_stored":439653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1036288,"data_stored":438671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":438283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1630208,"data_stored":1028491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.437},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:00:38.068 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T19:00:38.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T19:00:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.264+0000 7f3aa5e00640 1 Processor -- start 2024-09-13T19:00:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.265+0000 7f3aa5e00640 1 -- start start 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa5e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3aa006c4b0 0x7f3aa01636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa5e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa0159010 con 0x7f3aa0158c30 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa5e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa00b2940 con 0x7f3aa00b23d0 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa5e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00cbde0 con 0x7f3aa006c4b0 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3aa0158c30 0x7f3aa00b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56598/0 (socket says 172.21.15.33:56598) 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa4a00640 1 -- 172.21.15.33:0/1581145577 learned_addr learned my addr 172.21.15.33:0/1581145577 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.266+0000 7f3aa5400640 1 --2- 172.21.15.33:0/1581145577 >> v2:172.21.15.103:3300/0 conn(0x7f3aa006c4b0 0x7f3aa01636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637587987 0 0) 0x7f3aa0159010 con 0x7f3aa0158c30 2024-09-13T19:00:38.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a88003520 con 0x7f3aa0158c30 2024-09-13T19:00:38.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1486483940 0 0) 0x7f3a88003520 con 0x7f3aa0158c30 2024-09-13T19:00:38.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 >> v2:172.21.15.103:3300/0 conn(0x7f3aa006c4b0 msgr2=0x7f3aa01636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:38.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 --2- 172.21.15.33:0/1581145577 >> v2:172.21.15.103:3300/0 conn(0x7f3aa006c4b0 0x7f3aa01636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 >> v1:172.21.15.103:6789/0 conn(0x7f3aa00b23d0 legacy=0x7f3aa006bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00b2c20 con 0x7f3aa0158c30 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f3a94001670 con 0x7f3aa0158c30 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3aa5400640 1 --2- 172.21.15.33:0/1581145577 >> v2:172.21.15.103:3300/0 conn(0x7f3aa006c4b0 0x7f3aa01636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 >> v1:172.21.15.33:6789/0 conn(0x7f3aa0158c30 legacy=0x7f3aa00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 0x7f3a88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a880047c0 0x7f3a88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a88005180 0x7f3a8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa00cbde0 con 0x7f3a88003970 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8800c020 con 0x7f3a880047c0 2024-09-13T19:00:38.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8800e3f0 con 0x7f3a88005180 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.267+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 0x7f3a88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3a9fe00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a880047c0 0x7f3a88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa5400640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a88005180 0x7f3a8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa4a00640 1 -- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a88005180 msgr2=0x7f3a8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3a88005180 0x7f3a8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa4a00640 1 -- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a880047c0 msgr2=0x7f3a88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:38.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a880047c0 0x7f3a88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa4a00640 1 -- 172.21.15.33:0/1581145577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a88003520 con 0x7f3a88003970 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.268+0000 7f3aa5400640 1 -- 172.21.15.33:0/1581145577 reap_dead start 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.269+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 0x7f3a88003d90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c240 tx=0x7f3a880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb26859d2f85b9b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.269+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94005ad0 con 0x7f3a88003970 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.269+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9402d070 con 0x7f3a88003970 2024-09-13T19:00:38.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.269+0000 7f3a9f400640 1 -- 172.21.15.33:0/1581145577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94007070 con 0x7f3a88003970 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 -- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 msgr2=0x7f3a88003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 0x7f3a88003d90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c240 tx=0x7f3a880057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 -- 172.21.15.33:0/1581145577 shutdown_connections 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/1581145577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a88003970 0x7f3a88003d90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 -- 172.21.15.33:0/1581145577 >> 172.21.15.33:0/1581145577 conn(0x7f3aa0069ed0 msgr2=0x7f3aa006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 -- 172.21.15.33:0/1581145577 shutdown_connections 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.270+0000 7f3aa5e00640 1 -- 172.21.15.33:0/1581145577 wait complete. 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.271+0000 7f3aa5e00640 1 Processor -- start 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.272+0000 7f3aa5e00640 1 -- start start 2024-09-13T19:00:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.272+0000 7f3aa5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88003970 0x7f3aa014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3aa0153750 0x7f3aa0150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0155120 con 0x7f3aa0153bd0 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0154080 con 0x7f3a88003970 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0154360 con 0x7f3aa0153750 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52734/0 (socket says 172.21.15.33:52734) 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 -- 172.21.15.33:0/2986572933 learned_addr learned my addr 172.21.15.33:0/2986572933 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3a9fe00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3aa0153750 0x7f3aa0150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88003970 0x7f3aa014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 -- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3aa0153750 msgr2=0x7f3aa0150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3aa0153750 0x7f3aa0150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 -- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88003970 msgr2=0x7f3aa014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88003970 0x7f3aa014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.273+0000 7f3aa5400640 1 -- 172.21.15.33:0/2986572933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0154640 con 0x7f3aa0153bd0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3aa5400640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00718c0 tx=0x7f3a98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800e040 con 0x7f3aa0153bd0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800f040 con 0x7f3aa0153bd0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98003bd0 con 0x7f3aa0153bd0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0154920 con 0x7f3aa0153bd0 2024-09-13T19:00:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.274+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa01519e0 con 0x7f3aa0153bd0 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.275+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa014d8f0 con 0x7f3aa0153bd0 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.276+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a98015430 con 0x7f3aa0153bd0 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.277+0000 7f3a9cc00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 0x7f3a8006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.277+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a98089b40 con 0x7f3aa0153bd0 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.277+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 0x7f3a8006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.278+0000 7f3aa4a00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 0x7f3a8006d0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3a94032000 tx=0x7f3a9402d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.281+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a98054d30 con 0x7f3aa0153bd0 2024-09-13T19:00:38.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.525+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3aa00b1bb0 con 0x7f3aa0153bd0 2024-09-13T19:00:38.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.529+0000 7f3a9cc00640 1 -- 172.21.15.33:0/2986572933 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3a98058350 con 0x7f3aa0153bd0 2024-09-13T19:00:38.531 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T19:00:38.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 msgr2=0x7f3a8006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 0x7f3a8006d0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3a94032000 tx=0x7f3a9402d000 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 msgr2=0x7f3aa01514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00718c0 tx=0x7f3a98009f90 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 shutdown_connections 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3a8006ac30 0x7f3a8006d0f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0153bd0 0x7f3aa01514a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3aa0153750 0x7f3aa0150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 --2- 172.21.15.33:0/2986572933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a88003970 0x7f3aa014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 >> 172.21.15.33:0/2986572933 conn(0x7f3aa0069ed0 msgr2=0x7f3aa014e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 shutdown_connections 2024-09-13T19:00:38.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.531+0000 7f3aa5e00640 1 -- 172.21.15.33:0/2986572933 wait complete. 2024-09-13T19:00:38.550 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:38.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.704+0000 7f2d16e00640 1 Processor -- start 2024-09-13T19:00:38.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.704+0000 7f2d16e00640 1 -- start start 2024-09-13T19:00:38.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d16e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 0x7f2d100b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d16e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d100cbac0 0x7f2d100b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d16e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d100cbfc0 con 0x7f2d100afe10 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d16e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100cce20 con 0x7f2d100cbac0 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d16e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100707a0 con 0x7f2d1015a5c0 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d15000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d100cbac0 0x7f2d100b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d15000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d100cbac0 0x7f2d100b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52742/0 (socket says 172.21.15.33:52742) 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.705+0000 7f2d15000640 1 -- 172.21.15.33:0/2868079971 learned_addr learned my addr 172.21.15.33:0/2868079971 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15a00640 1 --2- 172.21.15.33:0/2868079971 >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 0x7f2d100b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15000640 1 -- 172.21.15.33:0/2868079971 >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 msgr2=0x7f2d100b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15000640 1 --2- 172.21.15.33:0/2868079971 >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 0x7f2d100b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15000640 1 -- 172.21.15.33:0/2868079971 >> v1:172.21.15.103:6789/0 conn(0x7f2d100afe10 legacy=0x7f2d1006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:38.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15000640 1 -- 172.21.15.33:0/2868079971 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10070a80 con 0x7f2d100cbac0 2024-09-13T19:00:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.706+0000 7f2d15a00640 1 --2- 172.21.15.33:0/2868079971 >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 0x7f2d100b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.707+0000 7f2d15000640 1 --2- 172.21.15.33:0/2868079971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d100cbac0 0x7f2d100b3ef0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2d10067270 tx=0x7f2cfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bfe18f51e7099f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.707+0000 7f2d0fe00640 1 -- 172.21.15.33:0/2868079971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc032440 con 0x7f2d100cbac0 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.707+0000 7f2d0fe00640 1 -- 172.21.15.33:0/2868079971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0325a0 con 0x7f2d100cbac0 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.707+0000 7f2d0fe00640 1 -- 172.21.15.33:0/2868079971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc032930 con 0x7f2d100cbac0 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 -- 172.21.15.33:0/2868079971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d100cbac0 msgr2=0x7f2d100b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 --2- 172.21.15.33:0/2868079971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d100cbac0 0x7f2d100b3ef0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2d10067270 tx=0x7f2cfc02a230 comp rx=0 tx=0).stop 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 -- 172.21.15.33:0/2868079971 shutdown_connections 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 --2- 172.21.15.33:0/2868079971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d100cbac0 0x7f2d100b3ef0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 --2- 172.21.15.33:0/2868079971 >> v2:172.21.15.103:3300/0 conn(0x7f2d1015a5c0 0x7f2d100b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 -- 172.21.15.33:0/2868079971 >> 172.21.15.33:0/2868079971 conn(0x7f2d100ae310 msgr2=0x7f2d100ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 -- 172.21.15.33:0/2868079971 shutdown_connections 2024-09-13T19:00:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.708+0000 7f2d16e00640 1 -- 172.21.15.33:0/2868079971 wait complete. 2024-09-13T19:00:38.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.709+0000 7f2d16e00640 1 Processor -- start 2024-09-13T19:00:38.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 -- start start 2024-09-13T19:00:38.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d100afe10 0x7f2d10142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d100cbac0 0x7f2d10151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10142550 con 0x7f2d1015a5c0 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10142bb0 con 0x7f2d100afe10 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.710+0000 7f2d16e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10152f30 con 0x7f2d100cbac0 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52748/0 (socket says 172.21.15.33:52748) 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 -- 172.21.15.33:0/1124710154 learned_addr learned my addr 172.21.15.33:0/1124710154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d15000640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d100cbac0 0x7f2d10151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d15a00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d100afe10 0x7f2d10142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 -- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d100cbac0 msgr2=0x7f2d10151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d100cbac0 0x7f2d10151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 -- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d100afe10 msgr2=0x7f2d10142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d100afe10 0x7f2d10142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.711+0000 7f2d16400640 1 -- 172.21.15.33:0/1124710154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0094d0 con 0x7f2d1015a5c0 2024-09-13T19:00:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d16400640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800c7b0 tx=0x7f2d0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08004b60 con 0x7f2d1015a5c0 2024-09-13T19:00:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08004cc0 con 0x7f2d1015a5c0 2024-09-13T19:00:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800aa90 con 0x7f2d1015a5c0 2024-09-13T19:00:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d101518a0 con 0x7f2d1015a5c0 2024-09-13T19:00:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.712+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d10152970 con 0x7f2d1015a5c0 2024-09-13T19:00:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.713+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d10067360 con 0x7f2d1015a5c0 2024-09-13T19:00:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.714+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d0800abf0 con 0x7f2d1015a5c0 2024-09-13T19:00:38.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.715+0000 7f2d0d600640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 0x7f2cf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:38.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.715+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d08089480 con 0x7f2d1015a5c0 2024-09-13T19:00:38.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.715+0000 7f2d15a00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 0x7f2cf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:38.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.716+0000 7f2d15a00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 0x7f2cf006d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400aac0 tx=0x7f2d04008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.719+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d08054670 con 0x7f2d1015a5c0 2024-09-13T19:00:38.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.936+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d10142d60 con 0x7f2d1015a5c0 2024-09-13T19:00:38.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.936+0000 7f2d0d600640 1 -- 172.21.15.33:0/1124710154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f2d08057c90 con 0x7f2d1015a5c0 2024-09-13T19:00:38.939 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:38.939 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:38.939 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 msgr2=0x7f2cf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 0x7f2cf006d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400aac0 tx=0x7f2d04008040 comp rx=0 tx=0).stop 2024-09-13T19:00:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 msgr2=0x7f2d10152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800c7b0 tx=0x7f2d0800cc70 comp rx=0 tx=0).stop 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 shutdown_connections 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2cf006ac00 0x7f2cf006d0c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d1015a5c0 0x7f2d10152060 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d100cbac0 0x7f2d10151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 --2- 172.21.15.33:0/1124710154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d100afe10 0x7f2d10142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 >> 172.21.15.33:0/1124710154 conn(0x7f2d100ae310 msgr2=0x7f2d10157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 shutdown_connections 2024-09-13T19:00:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:38.939+0000 7f2d16e00640 1 -- 172.21.15.33:0/1124710154 wait complete. 2024-09-13T19:00:39.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T19:00:28.783151+0000', 'modified': '2024-09-13T19:00:31.806100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6735}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6735': {'gid': 6735, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6834/198206524', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 198206524}, {'type': 'v1', 'addr': '172.21.15.33:6834', 'nonce': 198206524}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T19:00:39.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T19:00:39.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T19:00:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.516+0000 7ff04da00640 1 Processor -- start 2024-09-13T19:00:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.517+0000 7ff04da00640 1 -- start start 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0481592c0 0x7ff0480b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0481596a0 0x7ff048069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff04806f330 0x7ff04806a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480b1670 con 0x7ff0481596a0 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480b1950 con 0x7ff0481592c0 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff04da00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480b1c30 con 0x7ff04806f330 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff03f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0481596a0 0x7ff048069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff03f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0481596a0 0x7ff048069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52752/0 (socket says 172.21.15.33:52752) 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.518+0000 7ff03f400640 1 -- 172.21.15.33:0/2437687813 learned_addr learned my addr 172.21.15.33:0/2437687813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff047e00640 1 --2- 172.21.15.33:0/2437687813 >> v2:172.21.15.103:3300/0 conn(0x7ff0481592c0 0x7ff0480b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff04d000640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff04806f330 0x7ff04806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff03f400640 1 -- 172.21.15.33:0/2437687813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff04806f330 msgr2=0x7ff04806a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff03f400640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff04806f330 0x7ff04806a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff03f400640 1 -- 172.21.15.33:0/2437687813 >> v2:172.21.15.103:3300/0 conn(0x7ff0481592c0 msgr2=0x7ff0480b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff03f400640 1 --2- 172.21.15.33:0/2437687813 >> v2:172.21.15.103:3300/0 conn(0x7ff0481592c0 0x7ff0480b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.519+0000 7ff03f400640 1 -- 172.21.15.33:0/2437687813 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480b1f10 con 0x7ff0481596a0 2024-09-13T19:00:39.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.520+0000 7ff03f400640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0481596a0 0x7ff048069ed0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff048066ca0 tx=0x7ff03002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacc8bb38a9ff8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.520+0000 7ff047400640 1 -- 172.21.15.33:0/2437687813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030032440 con 0x7ff0481596a0 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.520+0000 7ff047400640 1 -- 172.21.15.33:0/2437687813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300325a0 con 0x7ff0481596a0 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.520+0000 7ff047400640 1 -- 172.21.15.33:0/2437687813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030032930 con 0x7ff0481596a0 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 -- 172.21.15.33:0/2437687813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0481596a0 msgr2=0x7ff048069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0481596a0 0x7ff048069ed0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff048066ca0 tx=0x7ff03002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 -- 172.21.15.33:0/2437687813 shutdown_connections 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff04806f330 0x7ff04806a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 --2- 172.21.15.33:0/2437687813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0481596a0 0x7ff048069ed0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 --2- 172.21.15.33:0/2437687813 >> v2:172.21.15.103:3300/0 conn(0x7ff0481592c0 0x7ff0480b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 -- 172.21.15.33:0/2437687813 >> 172.21.15.33:0/2437687813 conn(0x7ff0480affd0 msgr2=0x7ff0480b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 -- 172.21.15.33:0/2437687813 shutdown_connections 2024-09-13T19:00:39.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.521+0000 7ff04da00640 1 -- 172.21.15.33:0/2437687813 wait complete. 2024-09-13T19:00:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.523+0000 7ff04da00640 1 Processor -- start 2024-09-13T19:00:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.523+0000 7ff04da00640 1 -- start start 2024-09-13T19:00:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481592c0 0x7ff048140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0481596a0 0x7ff0481412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048141830 con 0x7ff04806f330 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048155040 con 0x7ff0481592c0 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04da00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff048155320 con 0x7ff0481596a0 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52762/0 (socket says 172.21.15.33:52762) 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 -- 172.21.15.33:0/3906571214 learned_addr learned my addr 172.21.15.33:0/3906571214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff04d000640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0481596a0 0x7ff0481412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff03f400640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481592c0 0x7ff048140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 -- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0481596a0 msgr2=0x7ff0481412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0481596a0 0x7ff0481412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 -- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481592c0 msgr2=0x7ff048140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481592c0 0x7ff048140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.524+0000 7ff047e00640 1 -- 172.21.15.33:0/3906571214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094d0 con 0x7ff04806f330 2024-09-13T19:00:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff047e00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff03800d800 tx=0x7ff03800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff044c00640 1 -- 172.21.15.33:0/3906571214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800b6c0 con 0x7ff04806f330 2024-09-13T19:00:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff044c00640 1 -- 172.21.15.33:0/3906571214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800b820 con 0x7ff04806f330 2024-09-13T19:00:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff044c00640 1 -- 172.21.15.33:0/3906571214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800bbb0 con 0x7ff04806f330 2024-09-13T19:00:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff048155600 con 0x7ff04806f330 2024-09-13T19:00:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.525+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff048154c60 con 0x7ff04806f330 2024-09-13T19:00:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.527+0000 7ff044c00640 1 -- 172.21.15.33:0/3906571214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff03800bd10 con 0x7ff04806f330 2024-09-13T19:00:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.528+0000 7ff044c00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 0x7ff02406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.529+0000 7ff044c00640 1 -- 172.21.15.33:0/3906571214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff038089970 con 0x7ff04806f330 2024-09-13T19:00:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.529+0000 7ff03f400640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 0x7ff02406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.529+0000 7ff051e62740 1 Processor -- start 2024-09-13T19:00:39.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 -- start start 2024-09-13T19:00:39.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff03f400640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 0x7ff02406d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff03002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e51840 0x563178e51c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e9f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178dbaab0 con 0x563178e4f000 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178db8240 con 0x563178e51840 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.530+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x563178db3b30 con 0x563178e78cf0 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52776/0 (socket says 172.21.15.33:52776) 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 -- 172.21.15.33:0/857146046 learned_addr learned my addr 172.21.15.33:0/857146046 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff047e00640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e51840 0x563178e51c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff04d000640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e9f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 -- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 msgr2=0x563178e9f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e9f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 -- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e51840 msgr2=0x563178e51c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e51840 0x563178e51c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 -- 172.21.15.33:0/857146046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563178d7ebd0 con 0x563178e4f000 2024-09-13T19:00:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff04d000640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e9f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:39.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.531+0000 7ff03f400640 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff03002a7d0 tx=0x7ff03002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf4a0b302f4daba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.532+0000 7ff03cc00640 1 -- 172.21.15.33:0/857146046 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03003c670 con 0x563178e4f000 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.532+0000 7ff03cc00640 1 -- 172.21.15.33:0/857146046 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03003c7d0 con 0x563178e4f000 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.532+0000 7ff03cc00640 1 -- 172.21.15.33:0/857146046 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03003cb60 con 0x563178e4f000 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.532+0000 7ff051e62740 1 -- 172.21.15.33:0/857146046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 msgr2=0x563178e9ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.532+0000 7ff051e62740 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff03002a7d0 tx=0x7ff03002c000 comp rx=0 tx=0).stop 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 -- 172.21.15.33:0/857146046 shutdown_connections 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e9f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e4f000 0x563178e9ed10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 --2- 172.21.15.33:0/857146046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e51840 0x563178e51c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 -- 172.21.15.33:0/857146046 >> 172.21.15.33:0/857146046 conn(0x563178e4df70 msgr2=0x563178e96420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 -- 172.21.15.33:0/857146046 shutdown_connections 2024-09-13T19:00:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 -- 172.21.15.33:0/857146046 wait complete. 2024-09-13T19:00:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.533+0000 7ff051e62740 1 -- start start 2024-09-13T19:00:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.534+0000 7ff051e62740 1 Processor -- start 2024-09-13T19:00:39.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e7a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e7a8f0 0x563178e76390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178d55260 con 0x563178e51840 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178d54f00 con 0x563178e78cf0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x563178b1af20 con 0x563178e7a8f0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff051e62740 10 client.0 _ll_register_callbacks cb 0x563178dad1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52778/0 (socket says 172.21.15.33:52778) 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 -- 172.21.15.33:0/4271801981 learned_addr learned my addr 172.21.15.33:0/4271801981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff03f400640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e7a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff04d000640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e7a8f0 0x563178e76390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 -- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e7a8f0 msgr2=0x563178e76390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e7a8f0 0x563178e76390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 -- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 msgr2=0x563178e7a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e7a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff047e00640 1 -- 172.21.15.33:0/4271801981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480b1f10 con 0x563178e51840 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.535+0000 7ff03f400640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e7a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff047e00640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff038054c70 tx=0x7ff038058830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bb8ba5eaad9f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038054e80 con 0x563178e51840 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff038054fe0 con 0x563178e51840 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563178dddcd0 con 0x563178e51840 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff03805c150 con 0x563178e51840 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 10 client.6888 fetch_fsmap learned FSMap version 47 2024-09-13T19:00:39.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x563178db21b0 con 0x563178e51840 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563178dddcd0 con 0x563178e51840 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff038057c60 con 0x563178e51840 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 10 client.6888 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 10 client.6888 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 20 client.6888 populate_metadata read hostname 'smithi033' 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e778e0 0x563178eb3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 4 client.6888 mds_command: new command op to 6735 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.536+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 --> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563178aa73c0 con 0x563178e778e0 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.537+0000 7ff03f400640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e778e0 0x563178eb3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.537+0000 7ff03f400640 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e778e0 0x563178eb3550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7df7bd3baf7430cd server_cookie=fb0038e92b33c399 in_seq=0 out_seq=0 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.537+0000 7ff035600640 10 client.6888 ms_handle_connect on v2:172.21.15.33:6832/198206524 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff035600640 1 -- 172.21.15.33:0/4271801981 <== mds.0 v2:172.21.15.33:6832/198206524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563178aa73c0 con 0x563178e778e0 2024-09-13T19:00:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff035600640 10 client.6888 handle_command_reply: tid=0 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 client.6888 shutdown 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 msgr2=0x563178e7c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff038054c70 tx=0x7ff038058830 comp rx=0 tx=0).stop 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 shutdown_connections 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e7a8f0 0x563178e76390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e778e0 0x563178eb3550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e7a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 --2- 172.21.15.33:0/4271801981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e7c7d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff035600640 0 client.6888 ms_handle_reset on v2:172.21.15.33:6832/198206524 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 >> 172.21.15.33:0/4271801981 conn(0x563178e4f000 msgr2=0x563178e9a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.538+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 shutdown_connections 2024-09-13T19:00:39.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.539+0000 7ff051e62740 1 -- 172.21.15.33:0/4271801981 wait complete. 2024-09-13T19:00:39.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.539+0000 7ff051e62740 20 client.6888 trim_cache size 0 max 16384 2024-09-13T19:00:39.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.554+0000 7ff051e62740 1 Processor -- start 2024-09-13T19:00:39.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.554+0000 7ff051e62740 1 -- start start 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e51840 0x563178ef6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e93740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178e77070 con 0x563178e7a8f0 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178e9b290 con 0x563178e78cf0 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x563178e51c20 con 0x563178e51840 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff04d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.555+0000 7ff04d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52788/0 (socket says 172.21.15.33:52788) 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 -- 172.21.15.33:0/299836703 learned_addr learned my addr 172.21.15.33:0/299836703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff047e00640 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e51840 0x563178ef6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff03f400640 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e93740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 -- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e51840 msgr2=0x563178ef6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e51840 0x563178ef6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 -- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 msgr2=0x563178e93740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e93740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 -- 172.21.15.33:0/299836703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563178d54470 con 0x563178e7a8f0 2024-09-13T19:00:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff04d000640 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff040009f00 tx=0x7ff040007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c4c96145f29af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.556+0000 7ff03d600640 1 -- 172.21.15.33:0/299836703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040017640 con 0x563178e7a8f0 2024-09-13T19:00:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff03d600640 1 -- 172.21.15.33:0/299836703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000f040 con 0x563178e7a8f0 2024-09-13T19:00:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff03d600640 1 -- 172.21.15.33:0/299836703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400179e0 con 0x563178e7a8f0 2024-09-13T19:00:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 -- 172.21.15.33:0/299836703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 msgr2=0x563178e93c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff040009f00 tx=0x7ff040007700 comp rx=0 tx=0).stop 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 -- 172.21.15.33:0/299836703 shutdown_connections 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e7a8f0 0x563178e93c80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e78cf0 0x563178e93740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 --2- 172.21.15.33:0/299836703 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e51840 0x563178ef6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 -- 172.21.15.33:0/299836703 >> 172.21.15.33:0/299836703 conn(0x563178e4f000 msgr2=0x563178e9aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 -- 172.21.15.33:0/299836703 shutdown_connections 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.557+0000 7ff051e62740 1 -- 172.21.15.33:0/299836703 wait complete. 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.558+0000 7ff051e62740 1 -- start start 2024-09-13T19:00:39.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.558+0000 7ff051e62740 1 Processor -- start 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e93710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e7a8f0 0x563178e998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178e9da60 con 0x563178e51840 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x563178e7a1d0 con 0x563178e7a8f0 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x563178eb53a0 con 0x563178e78cf0 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff051e62740 10 client.0 _ll_register_callbacks cb 0x7ff0380580d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:00:39.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff047e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52804/0 (socket says 172.21.15.33:52804) 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.559+0000 7ff047e00640 1 -- 172.21.15.33:0/435321586 learned_addr learned my addr 172.21.15.33:0/435321586 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 -- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 msgr2=0x563178e93710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e93710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 -- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e7a8f0 msgr2=0x563178e998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e7a8f0 0x563178e998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 -- 172.21.15.33:0/435321586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff040009b30 con 0x563178e51840 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff047e00640 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff038058470 tx=0x7ff038054be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934a0b8df75363ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff035600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380582b0 con 0x563178e51840 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff038058e70 con 0x563178e51840 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff03003c7d0 con 0x563178e51840 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff038077200 con 0x563178e51840 2024-09-13T19:00:39.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff051e62740 10 client.6894 fetch_fsmap learned FSMap version 47 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x563178d79980 con 0x563178e51840 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.560+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03003c7d0 con 0x563178e51840 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff0380606d0 con 0x563178e51840 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 10 client.6894 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 10 client.6894 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 20 client.6894 populate_metadata read hostname 'smithi033' 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e99e20 0x563178ef5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 4 client.6894 mds_command: new command op to 6735 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 --> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563178ab86c0 con 0x563178e99e20 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff03f400640 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e99e20 0x563178ef5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff03f400640 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e99e20 0x563178ef5930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91017830aaefefcd server_cookie=39f22e8d2dd49c24 in_seq=0 out_seq=0 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.561+0000 7ff035600640 10 client.6894 ms_handle_connect on v2:172.21.15.33:6832/198206524 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff035600640 1 -- 172.21.15.33:0/435321586 <== mds.0 v2:172.21.15.33:6832/198206524 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563178ab86c0 con 0x563178e99e20 2024-09-13T19:00:39.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff035600640 10 client.6894 handle_command_reply: tid=0 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 client.6894 shutdown 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 msgr2=0x563178e762b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff038058470 tx=0x7ff038054be0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 shutdown_connections 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:6832/198206524,v1:172.21.15.33:6834/198206524] conn(0x563178e99e20 0x563178ef5930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563178e7a8f0 0x563178e998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x563178e78cf0 0x563178e93710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 --2- 172.21.15.33:0/435321586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563178e51840 0x563178e762b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 >> 172.21.15.33:0/435321586 conn(0x563178e4f000 msgr2=0x563178e96240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff035600640 0 client.6894 ms_handle_reset on v2:172.21.15.33:6832/198206524 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 shutdown_connections 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 1 -- 172.21.15.33:0/435321586 wait complete. 2024-09-13T19:00:39.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.562+0000 7ff051e62740 20 client.6894 trim_cache size 0 max 16384 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 6735, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.776284564999999, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 47, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-09-13T19:00:39.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 15.873620118 2024-09-13T19:00:39.570 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:00:39.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 msgr2=0x7ff02406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 0x7ff02406d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff03002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:39.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 msgr2=0x7ff048152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff03800d800 tx=0x7ff03800dcc0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 shutdown_connections 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff02406ac00 0x7ff02406d0c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff0481596a0 0x7ff0481412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481592c0 0x7ff048140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 --2- 172.21.15.33:0/3906571214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04806f330 0x7ff048152ea0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 >> 172.21.15.33:0/3906571214 conn(0x7ff0480affd0 msgr2=0x7ff0480b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 shutdown_connections 2024-09-13T19:00:39.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.563+0000 7ff04da00640 1 -- 172.21.15.33:0/3906571214 wait complete. 2024-09-13T19:00:39.581 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:00:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.734+0000 7f82d8c00640 1 Processor -- start 2024-09-13T19:00:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.734+0000 7f82d8c00640 1 -- start start 2024-09-13T19:00:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82d406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d8c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d4153f00 con 0x7f82d4153b20 2024-09-13T19:00:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d8c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40b1a40 con 0x7f82d40b3990 2024-09-13T19:00:39.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d8c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40ce600 con 0x7f82d4159a80 2024-09-13T19:00:39.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d1e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f82d4153b20 0x7f82d40b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56612/0 (socket says 172.21.15.33:56612) 2024-09-13T19:00:39.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.735+0000 7f82d1e00640 1 -- 172.21.15.33:0/3042570435 learned_addr learned my addr 172.21.15.33:0/3042570435 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d2800640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82d406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820746385 0 0) 0x7f82d4153f00 con 0x7f82d4153b20 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b8003520 con 0x7f82d4153b20 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919512276 0 0) 0x7f82b8003520 con 0x7f82d4153b20 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 msgr2=0x7f82d406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82d406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 >> v1:172.21.15.103:6789/0 conn(0x7f82d40b3990 legacy=0x7f82d406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d415a1f0 con 0x7f82d4153b20 2024-09-13T19:00:39.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f82c4001670 con 0x7f82d4153b20 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 >> v1:172.21.15.33:6789/0 conn(0x7f82d4153b20 legacy=0x7f82d40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82b80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b8003f20 0x7f82b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40ce600 con 0x7f82b8004d00 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b800ba60 con 0x7f82b8003f20 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.736+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b800bc20 con 0x7f82d4159a80 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d1e00640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82b80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82c9400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b8003f20 0x7f82b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 -- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 msgr2=0x7f82b80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d4159a80 0x7f82b80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 -- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b8003f20 msgr2=0x7f82b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:39.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b8003f20 0x7f82b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82d2800640 1 -- 172.21.15.33:0/3042570435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8003520 con 0x7f82b8004d00 2024-09-13T19:00:39.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.737+0000 7f82c9400640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82b8003f20 0x7f82b80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.738+0000 7f82d2800640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82b8005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009fc0 tx=0x7f82b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d27554a8e1cc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.738+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0305f0 con 0x7f82b8004d00 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.738+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc00f040 con 0x7f82b8004d00 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.738+0000 7f82d1400640 1 -- 172.21.15.33:0/3042570435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc030990 con 0x7f82b8004d00 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 -- 172.21.15.33:0/3042570435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 msgr2=0x7f82b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 --2- 172.21.15.33:0/3042570435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82b8005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009fc0 tx=0x7f82b80057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d2800640 1 -- 172.21.15.33:0/3042570435 reap_dead start 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 -- 172.21.15.33:0/3042570435 shutdown_connections 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 -- 172.21.15.33:0/3042570435 >> 172.21.15.33:0/3042570435 conn(0x7f82d40b0510 msgr2=0x7f82d40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 -- 172.21.15.33:0/3042570435 shutdown_connections 2024-09-13T19:00:39.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.739+0000 7f82d8c00640 1 -- 172.21.15.33:0/3042570435 wait complete. 2024-09-13T19:00:39.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.741+0000 7f82d8c00640 1 Processor -- start 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.741+0000 7f82d8c00640 1 -- start start 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 0x7f82d40afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d40b0070 0x7f82d414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d41550d0 con 0x7f82b8004d00 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40af080 con 0x7f82d414ee90 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d8c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40af360 con 0x7f82d40b0070 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52818/0 (socket says 172.21.15.33:52818) 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d1e00640 1 -- 172.21.15.33:0/1609694155 learned_addr learned my addr 172.21.15.33:0/1609694155 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82c9400640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 0x7f82d40afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.742+0000 7f82d2800640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d40b0070 0x7f82d414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 -- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d40b0070 msgr2=0x7f82d414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d40b0070 0x7f82d414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 -- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 msgr2=0x7f82d40afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 0x7f82d40afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 -- 172.21.15.33:0/1609694155 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d41540b0 con 0x7f82b8004d00 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82c9400640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 0x7f82d40afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d1e00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007290 tx=0x7f82c4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4004ea0 con 0x7f82b8004d00 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400f9c0 con 0x7f82b8004d00 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400fd70 con 0x7f82b8004d00 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d4154390 con 0x7f82b8004d00 2024-09-13T19:00:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.743+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d40aecc0 con 0x7f82b8004d00 2024-09-13T19:00:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.744+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d4071960 con 0x7f82b8004d00 2024-09-13T19:00:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.745+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82c401d460 con 0x7f82b8004d00 2024-09-13T19:00:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.746+0000 7f82caa00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 0x7f82b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.746+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82c40896e0 con 0x7f82b8004d00 2024-09-13T19:00:39.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.747+0000 7f82c9400640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 0x7f82b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:39.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.747+0000 7f82c9400640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 0x7f82b006d0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82d40aec50 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:39.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.750+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f82c4054790 con 0x7f82b8004d00 2024-09-13T19:00:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.965+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82d40b1ed0 con 0x7f82b8004d00 2024-09-13T19:00:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.966+0000 7f82caa00640 1 -- 172.21.15.33:0/1609694155 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82c4057db0 con 0x7f82b8004d00 2024-09-13T19:00:39.968 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 msgr2=0x7f82b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 0x7f82b006d0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82d40aec50 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 msgr2=0x7f82d4154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f82c4007290 tx=0x7f82c4007750 comp rx=0 tx=0).stop 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 shutdown_connections 2024-09-13T19:00:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82b006ac00 0x7f82b006d0c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82d40b0070 0x7f82d414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82d414ee90 0x7f82d40afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 --2- 172.21.15.33:0/1609694155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8004d00 0x7f82d4154b90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 >> 172.21.15.33:0/1609694155 conn(0x7f82d40b0510 msgr2=0x7f82d40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 shutdown_connections 2024-09-13T19:00:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:39.968+0000 7f82d8c00640 1 -- 172.21.15.33:0/1609694155 wait complete. 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:39.986 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:00:39.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:00:39.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:00:39.987 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:39.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:39.987 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T19:00:40.023 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:00:40.023 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:00:40.023 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T19:00:40.024 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:40.025 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:40.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.027 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:00:40.118 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T19:00:40.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.121 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T19:00:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T19:00:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:00:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T19:00:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T19:00:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:00:40.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T19:00:40.158 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T19:00:40.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.305 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T19:00:40.340 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T19:00:40.340 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T19:00:40.341 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:40.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T19:00:40.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:40.436 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:40.472 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:00:40.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:40.472 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:40.547 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:00:40.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.547 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:40.675 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:40.675 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:40.676 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:40.691 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:40.691 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:40.691 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:40.691 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:40.691 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:40.713 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:00:40.714 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:00:40.715 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T19:00:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:00:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:00:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:00:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:00:40.719 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:00:40.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:40.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:40.775 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:00:40.819 INFO:teuthology.orchestra.run.smithi033.stdout:client6664 2024-09-13T19:00:40.819 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:40.820 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:40.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:00:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.086+0000 7f04dd800640 1 Processor -- start 2024-09-13T19:00:41.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.086+0000 7f04dd800640 1 -- start start 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04dd800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 0x7f04d80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04dd800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04d80cde50 0x7f04d815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04dd800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d806bea0 con 0x7f04d815a520 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04dd800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d806c180 con 0x7f04d80cde50 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04dd800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d806c460 con 0x7f04d80b1b00 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04d6a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f04d815a520 0x7f04d806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56622/0 (socket says 172.21.15.33:56622) 2024-09-13T19:00:41.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04d6a00640 1 -- 172.21.15.33:0/1217478397 learned_addr learned my addr 172.21.15.33:0/1217478397 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04cfe00640 1 --2- 172.21.15.33:0/1217478397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 0x7f04d80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.088+0000 7f04d7400640 1 --2- 172.21.15.33:0/1217478397 >> v2:172.21.15.103:3300/0 conn(0x7f04d80cde50 0x7f04d815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.089+0000 7f04cfe00640 1 -- 172.21.15.33:0/1217478397 >> v2:172.21.15.103:3300/0 conn(0x7f04d80cde50 msgr2=0x7f04d815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.089+0000 7f04cfe00640 1 --2- 172.21.15.33:0/1217478397 >> v2:172.21.15.103:3300/0 conn(0x7f04d80cde50 0x7f04d815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.089+0000 7f04d6000640 1 -- 172.21.15.33:0/1217478397 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656111564 0 0) 0x7f04d806bea0 con 0x7f04d815a520 2024-09-13T19:00:41.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.089+0000 7f04cfe00640 1 -- 172.21.15.33:0/1217478397 >> v1:172.21.15.33:6789/0 conn(0x7f04d815a520 legacy=0x7f04d806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.089+0000 7f04cfe00640 1 -- 172.21.15.33:0/1217478397 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d806c740 con 0x7f04d80b1b00 2024-09-13T19:00:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.090+0000 7f04cfe00640 1 --2- 172.21.15.33:0/1217478397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 0x7f04d80cd910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097d0 tx=0x7f04c002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e9b4bb7f0a4c4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.090+0000 7f04d6000640 1 -- 172.21.15.33:0/1217478397 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0032440 con 0x7f04d80b1b00 2024-09-13T19:00:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.090+0000 7f04d6000640 1 -- 172.21.15.33:0/1217478397 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c00325a0 con 0x7f04d80b1b00 2024-09-13T19:00:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.090+0000 7f04d6000640 1 -- 172.21.15.33:0/1217478397 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0032930 con 0x7f04d80b1b00 2024-09-13T19:00:41.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 -- 172.21.15.33:0/1217478397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 msgr2=0x7f04d80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 --2- 172.21.15.33:0/1217478397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 0x7f04d80cd910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097d0 tx=0x7f04c002a1c0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 -- 172.21.15.33:0/1217478397 shutdown_connections 2024-09-13T19:00:41.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 --2- 172.21.15.33:0/1217478397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d80b1b00 0x7f04d80cd910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 --2- 172.21.15.33:0/1217478397 >> v2:172.21.15.103:3300/0 conn(0x7f04d80cde50 0x7f04d815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 -- 172.21.15.33:0/1217478397 >> 172.21.15.33:0/1217478397 conn(0x7f04d80b0510 msgr2=0x7f04d80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:41.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 -- 172.21.15.33:0/1217478397 shutdown_connections 2024-09-13T19:00:41.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.091+0000 7f04dd800640 1 -- 172.21.15.33:0/1217478397 wait complete. 2024-09-13T19:00:41.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.092+0000 7f04dd800640 1 Processor -- start 2024-09-13T19:00:41.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.093+0000 7f04dd800640 1 -- start start 2024-09-13T19:00:41.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.093+0000 7f04dd800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d80b1b00 0x7f04d8071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.093+0000 7f04dd800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04dd800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d815a520 0x7f04d815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04dd800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81539f0 con 0x7f04d80cde50 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04dd800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d80c4080 con 0x7f04d80b1b00 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04dd800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d8071690 con 0x7f04d815a520 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52834/0 (socket says 172.21.15.33:52834) 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 -- 172.21.15.33:0/2403075071 learned_addr learned my addr 172.21.15.33:0/2403075071 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04d7400640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d815a520 0x7f04d815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04d6a00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d80b1b00 0x7f04d8071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 -- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d815a520 msgr2=0x7f04d815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d815a520 0x7f04d815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 -- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d80b1b00 msgr2=0x7f04d8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d80b1b00 0x7f04d8071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.094+0000 7f04cfe00640 1 -- 172.21.15.33:0/2403075071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009400 con 0x7f04d80cde50 2024-09-13T19:00:41.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04cfe00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000c00 tx=0x7f04c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0032440 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0004230 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d80c3820 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0006e10 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.095+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d80c3da0 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.096+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d80cd910 con 0x7f04d80cde50 2024-09-13T19:00:41.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.097+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f04c0039050 con 0x7f04d80cde50 2024-09-13T19:00:41.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.098+0000 7f04cea00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 0x7f04b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:41.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.098+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04c00a9b40 con 0x7f04d80cde50 2024-09-13T19:00:41.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.098+0000 7f04d6a00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 0x7f04b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:41.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.099+0000 7f04d6a00640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 0x7f04b406d0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007fd0 tx=0x7f04c8007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.102+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f04c0074dc0 con 0x7f04d80cde50 2024-09-13T19:00:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.322+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04d8157d00 con 0x7f04d80cde50 2024-09-13T19:00:41.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.323+0000 7f04cea00640 1 -- 172.21.15.33:0/2403075071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f04c004b020 con 0x7f04d80cde50 2024-09-13T19:00:41.325 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:00:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 msgr2=0x7f04b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 0x7f04b406d0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007fd0 tx=0x7f04c8007de0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 msgr2=0x7f04d80caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000c00 tx=0x7f04c00046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 shutdown_connections 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f04b406ac30 0x7f04b406d0f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04d815a520 0x7f04d815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04d80cde50 0x7f04d80caad0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 --2- 172.21.15.33:0/2403075071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d80b1b00 0x7f04d8071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 >> 172.21.15.33:0/2403075071 conn(0x7f04d80b0510 msgr2=0x7f04d80cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 shutdown_connections 2024-09-13T19:00:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:41.325+0000 7f04dd800640 1 -- 172.21.15.33:0/2403075071 wait complete. 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:00:41.344 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:41.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.345 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:41.386 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42508sec preferred_lft 42508sec 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T19:00:41.387 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T19:00:41.388 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:00:41.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.389 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:00:41.487 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T19:00:41.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.490 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:00:41.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.528 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T19:00:41.528 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T19:00:41.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T19:00:41.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T19:00:41.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T19:00:41.529 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T19:00:41.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.674 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:00:41.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T19:00:41.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T19:00:41.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:41.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T19:00:41.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:41.807 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:41.843 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:00:41.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:00:41.844 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:41.917 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:00:41.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:41.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:42.046 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:42.046 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:42.046 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:42.061 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:42.061 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:42.061 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:42.061 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:42.061 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:42.083 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:00:42.083 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:00:42.083 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:00:42.083 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:00:42.084 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:00:42.084 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:00:42.084 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:00:42.084 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:00:42.085 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T19:00:42.085 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:00:42.085 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:00:42.085 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:00:42.085 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:00:42.090 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:00:42.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:42.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:00:42.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:00:42.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.146 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:00:42.225 INFO:teuthology.orchestra.run.smithi103.stdout:client6673 2024-09-13T19:00:42.226 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:42.226 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:42.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.303 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T19:00:42.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T19:00:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-13T19:00:42.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:00:42.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.424 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T19:00:42.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:00:42.464 INFO:teuthology.orchestra.run.smithi103.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-13T19:00:42.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.465 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir) 2024-09-13T19:00:42.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.504 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T19:00:42.580 INFO:teuthology.orchestra.run.smithi033.stdout:10 2024-09-13T19:00:42.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:42.581 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-13T19:00:42.617 INFO:teuthology.orchestra.run.smithi103.stdout:10 2024-09-13T19:00:42.617 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T19:00:42.617 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:42.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:42.815 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T19:00:42.815 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:42.816 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:42.851 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:42.852 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:42.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.122+0000 7f74c7000640 1 Processor -- start 2024-09-13T19:00:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.122+0000 7f74c7000640 1 -- start start 2024-09-13T19:00:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74c7000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74c00b1b00 0x7f74c00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74c7000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c006bea0 con 0x7f74c015a520 2024-09-13T19:00:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74c7000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c006c180 con 0x7f74c00cde50 2024-09-13T19:00:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74c7000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c006c460 con 0x7f74c00b1b00 2024-09-13T19:00:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74bfe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f74c015a520 0x7f74c006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50908/0 (socket says 172.21.15.33:50908) 2024-09-13T19:00:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74bfe00640 1 -- 172.21.15.33:0/446771342 learned_addr learned my addr 172.21.15.33:0/446771342 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.123+0000 7f74b7e00640 1 --2- 172.21.15.33:0/446771342 >> v2:172.21.15.103:3300/0 conn(0x7f74c00b1b00 0x7f74c00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.124+0000 7f74bf400640 1 -- 172.21.15.33:0/446771342 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137325324 0 0) 0x7f74c006bea0 con 0x7f74c015a520 2024-09-13T19:00:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.124+0000 7f74bf400640 1 -- 172.21.15.33:0/446771342 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a4003520 con 0x7f74c015a520 2024-09-13T19:00:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.124+0000 7f74b7e00640 1 -- 172.21.15.33:0/446771342 >> v1:172.21.15.103:6789/0 conn(0x7f74c00cde50 legacy=0x7f74c015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.124+0000 7f74b7e00640 1 -- 172.21.15.33:0/446771342 >> v1:172.21.15.33:6789/0 conn(0x7f74c015a520 legacy=0x7f74c006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.124+0000 7f74b7e00640 1 -- 172.21.15.33:0/446771342 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c006c740 con 0x7f74c00b1b00 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.125+0000 7f74b7e00640 1 --2- 172.21.15.33:0/446771342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c00cd910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d1cf5d55c4ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.125+0000 7f74bf400640 1 -- 172.21.15.33:0/446771342 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8032440 con 0x7f74c00b1b00 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.125+0000 7f74bf400640 1 -- 172.21.15.33:0/446771342 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a80325a0 con 0x7f74c00b1b00 2024-09-13T19:00:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.125+0000 7f74bf400640 1 -- 172.21.15.33:0/446771342 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8032930 con 0x7f74c00b1b00 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 -- 172.21.15.33:0/446771342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 msgr2=0x7f74c00cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 --2- 172.21.15.33:0/446771342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c00cd910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802a230 comp rx=0 tx=0).stop 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 -- 172.21.15.33:0/446771342 shutdown_connections 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 --2- 172.21.15.33:0/446771342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c00cd910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 -- 172.21.15.33:0/446771342 >> 172.21.15.33:0/446771342 conn(0x7f74c00b0510 msgr2=0x7f74c00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 -- 172.21.15.33:0/446771342 shutdown_connections 2024-09-13T19:00:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.126+0000 7f74c7000640 1 -- 172.21.15.33:0/446771342 wait complete. 2024-09-13T19:00:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.127+0000 7f74c7000640 1 Processor -- start 2024-09-13T19:00:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 -- start start 2024-09-13T19:00:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 0x7f74c00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c014c760 con 0x7f74c00cde50 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.128+0000 7f74c7000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00ab6e0 con 0x7f74c00b1b00 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74c7000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00ab9c0 con 0x7f74c015a520 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46972/0 (socket says 172.21.15.33:46972) 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 -- 172.21.15.33:0/2520128173 learned_addr learned my addr 172.21.15.33:0/2520128173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74bfe00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74c5000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 0x7f74c00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 -- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 msgr2=0x7f74c00cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 0x7f74c00cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 -- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 msgr2=0x7f74c014c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c014c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74b7e00640 1 -- 172.21.15.33:0/2520128173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009400 con 0x7f74c00cde50 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.129+0000 7f74c5000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 0x7f74c00cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74b7e00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74a8035040 tx=0x7f74a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8006e10 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8032e90 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c00abca0 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8030be0 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.130+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c00ac260 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.131+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c00ccf60 con 0x7f74c00cde50 2024-09-13T19:00:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.132+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74a8039040 con 0x7f74c00cde50 2024-09-13T19:00:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.133+0000 7f74bcc00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 0x7f749c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.133+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74a80a9dc0 con 0x7f74c00cde50 2024-09-13T19:00:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.134+0000 7f74bfe00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 0x7f749c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.134+0000 7f74bfe00640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 0x7f749c06d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011e0 tx=0x7f74b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.138+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f74a80750b0 con 0x7f74c00cde50 2024-09-13T19:00:43.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.320+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c00ac450 con 0x7f74c00cde50 2024-09-13T19:00:43.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.321+0000 7f74bcc00640 1 -- 172.21.15.33:0/2520128173 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f74a8030d40 con 0x7f74c00cde50 2024-09-13T19:00:43.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.323+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 msgr2=0x7f749c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.323+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 0x7f749c06d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011e0 tx=0x7f74b0009040 comp rx=0 tx=0).stop 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.323+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 msgr2=0x7f74c00ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.323+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74a8035040 tx=0x7f74a80046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 shutdown_connections 2024-09-13T19:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749c06ac00 0x7f749c06d0c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74c015a520 0x7f74c00cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74c00cde50 0x7f74c00ad260 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 --2- 172.21.15.33:0/2520128173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c00b1b00 0x7f74c014c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 >> 172.21.15.33:0/2520128173 conn(0x7f74c00b0510 msgr2=0x7f74c00aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 shutdown_connections 2024-09-13T19:00:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.324+0000 7f74c7000640 1 -- 172.21.15.33:0/2520128173 wait complete. 2024-09-13T19:00:43.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:00:26.699583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:00:27.780305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:43.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:43.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.500+0000 7fc7ba600640 1 Processor -- start 2024-09-13T19:00:43.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.500+0000 7fc7ba600640 1 -- start start 2024-09-13T19:00:43.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7ba600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc7b4071460 0x7fc7b406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7ba600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40b2890 con 0x7fc7b40b31b0 2024-09-13T19:00:43.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7ba600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40b1880 con 0x7fc7b41461c0 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7ba600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40b1ad0 con 0x7fc7b4071460 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7b2a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc7b40b31b0 0x7fc7b406bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50910/0 (socket says 172.21.15.33:50910) 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7b3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc7b4071460 0x7fc7b406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.501+0000 7fc7b2a00640 1 -- 172.21.15.33:0/1295874943 learned_addr learned my addr 172.21.15.33:0/1295874943 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.502+0000 7fc7b3e00640 1 -- 172.21.15.33:0/1295874943 >> v1:172.21.15.103:6789/0 conn(0x7fc7b41461c0 legacy=0x7fc7b40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.502+0000 7fc7b3e00640 1 -- 172.21.15.33:0/1295874943 >> v1:172.21.15.33:6789/0 conn(0x7fc7b40b31b0 legacy=0x7fc7b406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.502+0000 7fc7b3e00640 1 -- 172.21.15.33:0/1295874943 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40b1db0 con 0x7fc7b4071460 2024-09-13T19:00:43.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.502+0000 7fc7b2000640 1 -- 172.21.15.33:0/1295874943 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497249708 0 0) 0x7fc7b40b2890 con 0x7fc7b40b31b0 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.503+0000 7fc7b3e00640 1 --2- 172.21.15.33:0/1295874943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b4071460 0x7fc7b406c5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce72d7027141352 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.503+0000 7fc7b2000640 1 -- 172.21.15.33:0/1295874943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac031600 con 0x7fc7b4071460 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.503+0000 7fc7b2000640 1 -- 172.21.15.33:0/1295874943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac02d050 con 0x7fc7b4071460 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.503+0000 7fc7b2000640 1 -- 172.21.15.33:0/1295874943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac031980 con 0x7fc7b4071460 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 -- 172.21.15.33:0/1295874943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b4071460 msgr2=0x7fc7b406c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 --2- 172.21.15.33:0/1295874943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b4071460 0x7fc7b406c5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac02a5d0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 -- 172.21.15.33:0/1295874943 shutdown_connections 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 --2- 172.21.15.33:0/1295874943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b4071460 0x7fc7b406c5b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 -- 172.21.15.33:0/1295874943 >> 172.21.15.33:0/1295874943 conn(0x7fc7b40b0580 msgr2=0x7fc7b40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 -- 172.21.15.33:0/1295874943 shutdown_connections 2024-09-13T19:00:43.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.504+0000 7fc7ba600640 1 -- 172.21.15.33:0/1295874943 wait complete. 2024-09-13T19:00:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.505+0000 7fc7ba600640 1 Processor -- start 2024-09-13T19:00:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.505+0000 7fc7ba600640 1 -- start start 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b4071460 0x7fc7b415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7b40b31b0 0x7fc7b4159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4159190 con 0x7fc7b41461c0 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4158580 con 0x7fc7b4071460 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.506+0000 7fc7ba600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4158860 con 0x7fc7b40b31b0 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46998/0 (socket says 172.21.15.33:46998) 2024-09-13T19:00:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 -- 172.21.15.33:0/258086748 learned_addr learned my addr 172.21.15.33:0/258086748 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b2a00640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7b40b31b0 0x7fc7b4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3400640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b4071460 0x7fc7b415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 -- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7b40b31b0 msgr2=0x7fc7b4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7b40b31b0 0x7fc7b4159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 -- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b4071460 msgr2=0x7fc7b415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b4071460 0x7fc7b415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 -- 172.21.15.33:0/258086748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac009a70 con 0x7fc7b41461c0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.507+0000 7fc7b3e00640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.508+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac030830 con 0x7fc7b41461c0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.508+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac030990 con 0x7fc7b41461c0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.508+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac030d00 con 0x7fc7b41461c0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.508+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b4158b40 con 0x7fc7b41461c0 2024-09-13T19:00:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.508+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b415b860 con 0x7fc7b41461c0 2024-09-13T19:00:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.509+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b415ba40 con 0x7fc7b41461c0 2024-09-13T19:00:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.510+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7ac043410 con 0x7fc7b41461c0 2024-09-13T19:00:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.510+0000 7fc7ab400640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 0x7fc79406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.511+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7ac0aa710 con 0x7fc7b41461c0 2024-09-13T19:00:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.511+0000 7fc7b3400640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 0x7fc79406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.512+0000 7fc7b3400640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 0x7fc79406d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4158510 tx=0x7fc7a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.515+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc7ac079540 con 0x7fc7b41461c0 2024-09-13T19:00:43.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.691+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7b40b2aa0 con 0x7fc7b41461c0 2024-09-13T19:00:43.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.691+0000 7fc7ab400640 1 -- 172.21.15.33:0/258086748 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7ac030e60 con 0x7fc7b41461c0 2024-09-13T19:00:43.694 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:43.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 msgr2=0x7fc79406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 0x7fc79406d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4158510 tx=0x7fc7a4009040 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 msgr2=0x7fc7b415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009d90 tx=0x7fc7ac004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 shutdown_connections 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc79406ac00 0x7fc79406d0c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b41461c0 0x7fc7b415cec0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc7b40b31b0 0x7fc7b4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 --2- 172.21.15.33:0/258086748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b4071460 0x7fc7b415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 >> 172.21.15.33:0/258086748 conn(0x7fc7b40b0580 msgr2=0x7fc7b406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 shutdown_connections 2024-09-13T19:00:43.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.694+0000 7fc7ba600640 1 -- 172.21.15.33:0/258086748 wait complete. 2024-09-13T19:00:43.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.868+0000 7fc76e000640 1 Processor -- start 2024-09-13T19:00:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.868+0000 7fc76e000640 1 -- start start 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.869+0000 7fc76e000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc768154ad0 0x7fc7680cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc76e000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc76806f830 0x7fc76806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc76e000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76806b7c0 con 0x7fc7680ce2c0 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc76e000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76806b5b0 con 0x7fc76806f830 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc76e000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76806baa0 con 0x7fc768154ad0 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc76806f830 0x7fc76806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc76806f830 0x7fc76806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47008/0 (socket says 172.21.15.33:47008) 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 -- 172.21.15.33:0/4133373878 learned_addr learned my addr 172.21.15.33:0/4133373878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc767400640 1 --2- 172.21.15.33:0/4133373878 >> v2:172.21.15.103:3300/0 conn(0x7fc768154ad0 0x7fc7680cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 -- 172.21.15.33:0/4133373878 >> v2:172.21.15.103:3300/0 conn(0x7fc768154ad0 msgr2=0x7fc7680cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 --2- 172.21.15.33:0/4133373878 >> v2:172.21.15.103:3300/0 conn(0x7fc768154ad0 0x7fc7680cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 -- 172.21.15.33:0/4133373878 >> v1:172.21.15.103:6789/0 conn(0x7fc7680ce2c0 legacy=0x7fc7680cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.870+0000 7fc75ea00640 1 -- 172.21.15.33:0/4133373878 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76806bd80 con 0x7fc76806f830 2024-09-13T19:00:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.871+0000 7fc75ea00640 1 --2- 172.21.15.33:0/4133373878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76806f830 0x7fc76806fee0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc7680b1340 tx=0x7fc75002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c656b835b6d75d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.871+0000 7fc766a00640 1 -- 172.21.15.33:0/4133373878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750032440 con 0x7fc76806f830 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc766a00640 1 -- 172.21.15.33:0/4133373878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7500325a0 con 0x7fc76806f830 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc766a00640 1 -- 172.21.15.33:0/4133373878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750032930 con 0x7fc76806f830 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 -- 172.21.15.33:0/4133373878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76806f830 msgr2=0x7fc76806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 --2- 172.21.15.33:0/4133373878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76806f830 0x7fc76806fee0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc7680b1340 tx=0x7fc75002a1f0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 -- 172.21.15.33:0/4133373878 shutdown_connections 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 --2- 172.21.15.33:0/4133373878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76806f830 0x7fc76806fee0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 --2- 172.21.15.33:0/4133373878 >> v2:172.21.15.103:3300/0 conn(0x7fc768154ad0 0x7fc7680cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 -- 172.21.15.33:0/4133373878 >> 172.21.15.33:0/4133373878 conn(0x7fc7680b0580 msgr2=0x7fc7680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 -- 172.21.15.33:0/4133373878 shutdown_connections 2024-09-13T19:00:43.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.872+0000 7fc76e000640 1 -- 172.21.15.33:0/4133373878 wait complete. 2024-09-13T19:00:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.874+0000 7fc76e000640 1 Processor -- start 2024-09-13T19:00:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.874+0000 7fc76e000640 1 -- start start 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc76815bbf0 0x7fc76815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76813f610 0x7fc76815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815c950 con 0x7fc76813f610 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815c0b0 con 0x7fc76815bbf0 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc76e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815c390 con 0x7fc768154ad0 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc767400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc75ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc76815bbf0 0x7fc76815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc767400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:54792/0 (socket says 172.21.15.33:54792) 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc767400640 1 -- 172.21.15.33:0/91516365 learned_addr learned my addr 172.21.15.33:0/91516365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.875+0000 7fc767e00640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76813f610 0x7fc76815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 -- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc76815bbf0 msgr2=0x7fc76815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc76815bbf0 0x7fc76815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 -- 172.21.15.33:0/91516365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76813f610 msgr2=0x7fc76815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76813f610 0x7fc76815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 -- 172.21.15.33:0/91516365 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500094d0 con 0x7fc768154ad0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc767400640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc75800e870 tx=0x7fc75800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580094f0 con 0x7fc768154ad0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800c940 con 0x7fc768154ad0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800ccf0 con 0x7fc768154ad0 2024-09-13T19:00:43.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76815c670 con 0x7fc768154ad0 2024-09-13T19:00:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.876+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc768143370 con 0x7fc768154ad0 2024-09-13T19:00:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.877+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc768143560 con 0x7fc768154ad0 2024-09-13T19:00:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.878+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc758013470 con 0x7fc768154ad0 2024-09-13T19:00:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.879+0000 7fc75fe00640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 0x7fc74406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.879+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7580893a0 con 0x7fc768154ad0 2024-09-13T19:00:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.880+0000 7fc75ea00640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 0x7fc74406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.881+0000 7fc75ea00640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 0x7fc74406d0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc750034000 tx=0x7fc75002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:43.884+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc758054620 con 0x7fc768154ad0 2024-09-13T19:00:44.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.063+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7680cdd80 con 0x7fc768154ad0 2024-09-13T19:00:44.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.064+0000 7fc75fe00640 1 -- 172.21.15.33:0/91516365 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc758057c40 con 0x7fc768154ad0 2024-09-13T19:00:44.067 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 msgr2=0x7fc74406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 0x7fc74406d0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc750034000 tx=0x7fc75002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 msgr2=0x7fc76815b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc75800e870 tx=0x7fc75800ed30 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 shutdown_connections 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc74406ac00 0x7fc74406d0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76813f610 0x7fc76815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc76815bbf0 0x7fc76815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 --2- 172.21.15.33:0/91516365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc768154ad0 0x7fc76815b6b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 >> 172.21.15.33:0/91516365 conn(0x7fc7680b0580 msgr2=0x7fc76815e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 shutdown_connections 2024-09-13T19:00:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.067+0000 7fc76e000640 1 -- 172.21.15.33:0/91516365 wait complete. 2024-09-13T19:00:44.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.243+0000 7f6434400640 1 Processor -- start 2024-09-13T19:00:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.243+0000 7f6434400640 1 -- start start 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.244+0000 7f6434400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f642c156f60 0x7f642c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.244+0000 7f6434400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 0x7f642c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.244+0000 7f6434400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c06f5f0 con 0x7f642c0cafa0 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.244+0000 7f6434400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c15aa30 con 0x7f642c156f60 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.244+0000 7f6434400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c070450 con 0x7f642c071690 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f642c0cafa0 0x7f642c070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50912/0 (socket says 172.21.15.33:50912) 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431000640 1 -- 172.21.15.33:0/437577367 learned_addr learned my addr 172.21.15.33:0/437577367 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6432400640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 0x7f642c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431a00640 1 --2- 172.21.15.33:0/437577367 >> v2:172.21.15.103:3300/0 conn(0x7f642c156f60 0x7f642c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f642be00640 1 -- 172.21.15.33:0/437577367 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391576732 0 0) 0x7f642c06f5f0 con 0x7f642c0cafa0 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f642be00640 1 -- 172.21.15.33:0/437577367 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6414003520 con 0x7f642c0cafa0 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431a00640 1 -- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 msgr2=0x7f642c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431a00640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 0x7f642c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431a00640 1 -- 172.21.15.33:0/437577367 >> v1:172.21.15.33:6789/0 conn(0x7f642c0cafa0 legacy=0x7f642c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6431a00640 1 -- 172.21.15.33:0/437577367 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c06f840 con 0x7f642c156f60 2024-09-13T19:00:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.245+0000 7f6432400640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 0x7f642c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:44.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.246+0000 7f6431a00640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c156f60 0x7f642c15a4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f64200097a0 tx=0x7f642002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21497bd5399c7003 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f642be00640 1 -- 172.21.15.33:0/437577367 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420032440 con 0x7f642c156f60 2024-09-13T19:00:44.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f642be00640 1 -- 172.21.15.33:0/437577367 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64200325a0 con 0x7f642c156f60 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f642be00640 1 -- 172.21.15.33:0/437577367 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420032910 con 0x7f642c156f60 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 -- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c156f60 msgr2=0x7f642c15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c156f60 0x7f642c15a4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f64200097a0 tx=0x7f642002a180 comp rx=0 tx=0).stop 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 -- 172.21.15.33:0/437577367 shutdown_connections 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c071690 0x7f642c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 --2- 172.21.15.33:0/437577367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c156f60 0x7f642c15a4f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 -- 172.21.15.33:0/437577367 >> 172.21.15.33:0/437577367 conn(0x7f642c0b0580 msgr2=0x7f642c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 -- 172.21.15.33:0/437577367 shutdown_connections 2024-09-13T19:00:44.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.247+0000 7f6434400640 1 -- 172.21.15.33:0/437577367 wait complete. 2024-09-13T19:00:44.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.249+0000 7f6434400640 1 Processor -- start 2024-09-13T19:00:44.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.249+0000 7f6434400640 1 -- start start 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 0x7f642c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 0x7f642c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15bb70 con 0x7f642c071690 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c1f3510 con 0x7f642c0cafa0 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6434400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c1f37f0 con 0x7f642c156f60 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6431a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6431a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47020/0 (socket says 172.21.15.33:47020) 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.250+0000 7f6431a00640 1 -- 172.21.15.33:0/2384723339 learned_addr learned my addr 172.21.15.33:0/2384723339 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431000640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 0x7f642c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6432400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 0x7f642c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 -- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 msgr2=0x7f642c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 0x7f642c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 -- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 msgr2=0x7f642c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 0x7f642c15b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 -- 172.21.15.33:0/2384723339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424009a70 con 0x7f642c071690 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431000640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 0x7f642c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6432400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 0x7f642c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6431a00640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f642002a1c0 tx=0x7f64200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420006e10 con 0x7f642c071690 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64200044c0 con 0x7f642c071690 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420003830 con 0x7f642c071690 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.251+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6420009400 con 0x7f642c071690 2024-09-13T19:00:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.252+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c1f3db0 con 0x7f642c071690 2024-09-13T19:00:44.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.253+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c157340 con 0x7f642c071690 2024-09-13T19:00:44.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.254+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6420003990 con 0x7f642c071690 2024-09-13T19:00:44.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.254+0000 7f6429600640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 0x7f640c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.254+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64200aa010 con 0x7f642c071690 2024-09-13T19:00:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.255+0000 7f6431000640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 0x7f640c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.255+0000 7f6431000640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 0x7f640c06d0c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f642c155d20 tx=0x7f6418009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.259+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f64200751f0 con 0x7f642c071690 2024-09-13T19:00:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.439+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f642c0aeb30 con 0x7f642c071690 2024-09-13T19:00:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.439+0000 7f6429600640 1 -- 172.21.15.33:0/2384723339 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6420078810 con 0x7f642c071690 2024-09-13T19:00:44.442 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 msgr2=0x7f640c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 0x7f640c06d0c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f642c155d20 tx=0x7f6418009040 comp rx=0 tx=0).stop 2024-09-13T19:00:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 msgr2=0x7f642c14a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f642002a1c0 tx=0x7f64200046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 shutdown_connections 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f640c06ac00 0x7f640c06d0c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f642c156f60 0x7f642c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c0cafa0 0x7f642c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 --2- 172.21.15.33:0/2384723339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f642c071690 0x7f642c14a1c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 >> 172.21.15.33:0/2384723339 conn(0x7f642c0b0580 msgr2=0x7f642c0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 shutdown_connections 2024-09-13T19:00:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.442+0000 7f6434400640 1 -- 172.21.15.33:0/2384723339 wait complete. 2024-09-13T19:00:44.460 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:00:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.614+0000 7fc192a00640 1 Processor -- start 2024-09-13T19:00:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.614+0000 7fc192a00640 1 -- start start 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc192a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc18c159610 0x7fc18c070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc192a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc18c070540 0x7fc18c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc192a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0b39e0 con 0x7fc18c0b35c0 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc192a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c1599f0 con 0x7fc18c159610 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc192a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0709e0 con 0x7fc18c070540 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc18be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc18c159610 0x7fc18c070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc18be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc18c159610 0x7fc18c070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47034/0 (socket says 172.21.15.33:47034) 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.615+0000 7fc18be00640 1 -- 172.21.15.33:0/189953813 learned_addr learned my addr 172.21.15.33:0/189953813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:44.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18b400640 1 --2- 172.21.15.33:0/189953813 >> v2:172.21.15.103:3300/0 conn(0x7fc18c070540 0x7fc18c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18be00640 1 -- 172.21.15.33:0/189953813 >> v2:172.21.15.103:3300/0 conn(0x7fc18c070540 msgr2=0x7fc18c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18be00640 1 --2- 172.21.15.33:0/189953813 >> v2:172.21.15.103:3300/0 conn(0x7fc18c070540 0x7fc18c0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18be00640 1 -- 172.21.15.33:0/189953813 >> v1:172.21.15.33:6789/0 conn(0x7fc18c0b35c0 legacy=0x7fc18c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18be00640 1 -- 172.21.15.33:0/189953813 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c070cc0 con 0x7fc18c159610 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.616+0000 7fc18aa00640 1 -- 172.21.15.33:0/189953813 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269575516 0 0) 0x7fc18c0b39e0 con 0x7fc18c0b35c0 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.617+0000 7fc18be00640 1 --2- 172.21.15.33:0/189953813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c159610 0x7fc18c070000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0b2e40 tx=0x7fc17c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70ecdfcbdc7f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.617+0000 7fc18aa00640 1 -- 172.21.15.33:0/189953813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c032640 con 0x7fc18c159610 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.617+0000 7fc18aa00640 1 -- 172.21.15.33:0/189953813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c0327a0 con 0x7fc18c159610 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.617+0000 7fc18aa00640 1 -- 172.21.15.33:0/189953813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c032b30 con 0x7fc18c159610 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 -- 172.21.15.33:0/189953813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c159610 msgr2=0x7fc18c070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 --2- 172.21.15.33:0/189953813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c159610 0x7fc18c070000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0b2e40 tx=0x7fc17c02c940 comp rx=0 tx=0).stop 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 -- 172.21.15.33:0/189953813 shutdown_connections 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 --2- 172.21.15.33:0/189953813 >> v2:172.21.15.103:3300/0 conn(0x7fc18c070540 0x7fc18c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 --2- 172.21.15.33:0/189953813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c159610 0x7fc18c070000 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 -- 172.21.15.33:0/189953813 >> 172.21.15.33:0/189953813 conn(0x7fc18c0b0510 msgr2=0x7fc18c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:44.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 -- 172.21.15.33:0/189953813 shutdown_connections 2024-09-13T19:00:44.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.618+0000 7fc192a00640 1 -- 172.21.15.33:0/189953813 wait complete. 2024-09-13T19:00:44.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.619+0000 7fc192a00640 1 Processor -- start 2024-09-13T19:00:44.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.620+0000 7fc192a00640 1 -- start start 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.620+0000 7fc192a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc18c070540 0x7fc18c1f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.620+0000 7fc192a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.620+0000 7fc192a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 0x7fc18c1ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc192a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c1eda40 con 0x7fc18c0b35c0 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc192a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c1503f0 con 0x7fc18c159610 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc192a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c1506d0 con 0x7fc18c070540 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47038/0 (socket says 172.21.15.33:47038) 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 -- 172.21.15.33:0/1064218990 learned_addr learned my addr 172.21.15.33:0/1064218990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18be00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc18c070540 0x7fc18c1f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc190a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 0x7fc18c1ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 -- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc18c070540 msgr2=0x7fc18c1f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc18c070540 0x7fc18c1f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 -- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 msgr2=0x7fc18c1ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 0x7fc18c1ed500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 -- 172.21.15.33:0/1064218990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c00b770 con 0x7fc18c0b35c0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc190a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 0x7fc18c1ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.621+0000 7fc18b400640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc17800d800 tx=0x7fc17800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.622+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800b6c0 con 0x7fc18c0b35c0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.622+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800b820 con 0x7fc18c0b35c0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.622+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800bbb0 con 0x7fc18c0b35c0 2024-09-13T19:00:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.622+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c1f1280 con 0x7fc18c0b35c0 2024-09-13T19:00:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.622+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c1f1840 con 0x7fc18c0b35c0 2024-09-13T19:00:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.623+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c1f1a00 con 0x7fc18c0b35c0 2024-09-13T19:00:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.624+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc17800bd10 con 0x7fc18c0b35c0 2024-09-13T19:00:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.625+0000 7fc183e00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 0x7fc16c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.625+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1780898e0 con 0x7fc18c0b35c0 2024-09-13T19:00:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.625+0000 7fc18be00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 0x7fc16c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.626+0000 7fc18be00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 0x7fc16c06d0c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc17c037000 tx=0x7fc17c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.629+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc178054a20 con 0x7fc18c0b35c0 2024-09-13T19:00:44.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.827+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc18c06d010 con 0x7fc18c0b35c0 2024-09-13T19:00:44.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.827+0000 7fc183e00640 1 -- 172.21.15.33:0/1064218990 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc178058040 con 0x7fc18c0b35c0 2024-09-13T19:00:44.830 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:00:44.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 msgr2=0x7fc16c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 0x7fc16c06d0c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc17c037000 tx=0x7fc17c032000 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 msgr2=0x7fc18c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc17800d800 tx=0x7fc17800dcc0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 shutdown_connections 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fc16c06ac00 0x7fc16c06d0c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c159610 0x7fc18c1ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc18c0b35c0 0x7fc18c1529e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 --2- 172.21.15.33:0/1064218990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc18c070540 0x7fc18c1f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 >> 172.21.15.33:0/1064218990 conn(0x7fc18c0b0510 msgr2=0x7fc18c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 shutdown_connections 2024-09-13T19:00:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:44.830+0000 7fc192a00640 1 -- 172.21.15.33:0/1064218990 wait complete. 2024-09-13T19:00:44.848 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T19:00:44.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:44.848 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T19:00:44.911 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:00:44.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:44.912 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T19:00:44.947 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:44.947 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:44.987 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:44.987 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:45.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.220+0000 7f49de200640 1 Processor -- start 2024-09-13T19:00:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.220+0000 7f49de200640 1 -- start start 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49de200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49d815fdd0 0x7f49d80d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49de200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49de200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d81601b0 con 0x7f49d80b1c50 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49de200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80cd6a0 con 0x7f49d815fdd0 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49de200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80d2400 con 0x7f49d80d1fd0 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49dce00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49d815fdd0 0x7f49d80d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49d7e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f49d80b1c50 0x7f49d81603b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50928/0 (socket says 172.21.15.33:50928) 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.221+0000 7f49d7e00640 1 -- 172.21.15.33:0/4148669993 learned_addr learned my addr 172.21.15.33:0/4148669993 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49dd800640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49dce00640 1 -- 172.21.15.33:0/4148669993 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 msgr2=0x7f49d8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49dce00640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49dce00640 1 -- 172.21.15.33:0/4148669993 >> v1:172.21.15.33:6789/0 conn(0x7f49d80b1c50 legacy=0x7f49d81603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49d7400640 1 -- 172.21.15.33:0/4148669993 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600066330 0 0) 0x7f49d81601b0 con 0x7f49d80b1c50 2024-09-13T19:00:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.222+0000 7f49dce00640 1 -- 172.21.15.33:0/4148669993 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80d17e0 con 0x7f49d815fdd0 2024-09-13T19:00:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.223+0000 7f49dce00640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d80d1a90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0097a0 tx=0x7f49cc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbc4dc80a3d291f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.223+0000 7f49d7400640 1 -- 172.21.15.33:0/4148669993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc02ae50 con 0x7f49d815fdd0 2024-09-13T19:00:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.223+0000 7f49d7400640 1 -- 172.21.15.33:0/4148669993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc032440 con 0x7f49d815fdd0 2024-09-13T19:00:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.223+0000 7f49d7400640 1 -- 172.21.15.33:0/4148669993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0327d0 con 0x7f49d815fdd0 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 -- 172.21.15.33:0/4148669993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 msgr2=0x7f49d80d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d80d1a90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0097a0 tx=0x7f49cc02a100 comp rx=0 tx=0).stop 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 -- 172.21.15.33:0/4148669993 shutdown_connections 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 --2- 172.21.15.33:0/4148669993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d80d1a90 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 -- 172.21.15.33:0/4148669993 >> 172.21.15.33:0/4148669993 conn(0x7f49d806a7c0 msgr2=0x7f49d806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 -- 172.21.15.33:0/4148669993 shutdown_connections 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.224+0000 7f49de200640 1 -- 172.21.15.33:0/4148669993 wait complete. 2024-09-13T19:00:45.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.225+0000 7f49de200640 1 Processor -- start 2024-09-13T19:00:45.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.225+0000 7f49de200640 1 -- start start 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 0x7f49d815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8158290 con 0x7f49d815fdd0 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8158560 con 0x7f49d80b1c50 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.226+0000 7f49de200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8158840 con 0x7f49d80d1fd0 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47062/0 (socket says 172.21.15.33:47062) 2024-09-13T19:00:45.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 -- 172.21.15.33:0/3118992344 learned_addr learned my addr 172.21.15.33:0/3118992344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49d7e00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dce00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 0x7f49d815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 -- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 msgr2=0x7f49d8157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 -- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 msgr2=0x7f49d815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 0x7f49d815af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 -- 172.21.15.33:0/3118992344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc009400 con 0x7f49d815fdd0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49d7e00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dce00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 0x7f49d815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.227+0000 7f49dd800640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f49d0007e60 tx=0x7f49d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.228+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0014420 con 0x7f49d815fdd0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.228+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d00145a0 con 0x7f49d815fdd0 2024-09-13T19:00:45.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.228+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0014950 con 0x7f49d815fdd0 2024-09-13T19:00:45.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.228+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8158b20 con 0x7f49d815fdd0 2024-09-13T19:00:45.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.228+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d81590e0 con 0x7f49d815fdd0 2024-09-13T19:00:45.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.229+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80cd2f0 con 0x7f49d815fdd0 2024-09-13T19:00:45.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.230+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49d0014ab0 con 0x7f49d815fdd0 2024-09-13T19:00:45.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.231+0000 7f49d4c00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 0x7f49b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.231+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d0089bc0 con 0x7f49d815fdd0 2024-09-13T19:00:45.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.231+0000 7f49dce00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 0x7f49b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.232+0000 7f49dce00640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 0x7f49b806d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f49cc034000 tx=0x7f49cc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.235+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f49d0054e30 con 0x7f49d815fdd0 2024-09-13T19:00:45.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.416+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d80b4d50 con 0x7f49d815fdd0 2024-09-13T19:00:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.417+0000 7f49d4c00640 1 -- 172.21.15.33:0/3118992344 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f49d0058450 con 0x7f49d815fdd0 2024-09-13T19:00:45.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:45.420 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 msgr2=0x7f49b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 0x7f49b806d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f49cc034000 tx=0x7f49cc02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 msgr2=0x7f49d814ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f49d0007e60 tx=0x7f49d000e4b0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 shutdown_connections 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f49b806ac00 0x7f49b806d0c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d815fdd0 0x7f49d814ca10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f49d80d1fd0 0x7f49d8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 --2- 172.21.15.33:0/3118992344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d80b1c50 0x7f49d815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 >> 172.21.15.33:0/3118992344 conn(0x7f49d806a7c0 msgr2=0x7f49d815e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 shutdown_connections 2024-09-13T19:00:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.420+0000 7f49de200640 1 -- 172.21.15.33:0/3118992344 wait complete. 2024-09-13T19:00:45.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:00:26.699583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:00:27.780305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:45.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:45.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.596+0000 7f18ca200640 1 Processor -- start 2024-09-13T19:00:45.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.596+0000 7f18ca200640 1 -- start start 2024-09-13T19:00:45.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18ca200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18ca200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18c406b2c0 0x7f18c406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18ca200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c406de20 con 0x7f18c406bc40 2024-09-13T19:00:45.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18ca200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c415cfd0 con 0x7f18c406b2c0 2024-09-13T19:00:45.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18ca200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c406e100 con 0x7f18c40b54c0 2024-09-13T19:00:45.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18bbe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18c406b2c0 0x7f18c406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.597+0000 7f18c8e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18c406b2c0 0x7f18c406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:47662/0 (socket says 172.21.15.33:47662) 2024-09-13T19:00:45.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18c8e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:54844/0 (socket says 172.21.15.33:54844) 2024-09-13T19:00:45.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 -- 172.21.15.33:0/1822904086 learned_addr learned my addr 172.21.15.33:0/1822904086 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 -- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 msgr2=0x7f18c40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 -- 172.21.15.33:0/1822904086 >> v1:172.21.15.103:6789/0 conn(0x7f18c406bc40 legacy=0x7f18c40b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18c3e00640 1 -- 172.21.15.33:0/1822904086 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266960153 0 0) 0x7f18c406de20 con 0x7f18c406bc40 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18bbe00640 1 -- 172.21.15.33:0/1822904086 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c406e3e0 con 0x7f18c406b2c0 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.598+0000 7f18c8e00640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:45.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.599+0000 7f18bbe00640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406b2c0 0x7f18c406b700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009870 tx=0x7f18ac02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d62ec5dcd8c8b512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.599+0000 7f18c3e00640 1 -- 172.21.15.33:0/1822904086 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac032440 con 0x7f18c406b2c0 2024-09-13T19:00:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.599+0000 7f18c3e00640 1 -- 172.21.15.33:0/1822904086 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac0325a0 con 0x7f18c406b2c0 2024-09-13T19:00:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.599+0000 7f18c3e00640 1 -- 172.21.15.33:0/1822904086 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac032930 con 0x7f18c406b2c0 2024-09-13T19:00:45.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 -- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406b2c0 msgr2=0x7f18c406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406b2c0 0x7f18c406b700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009870 tx=0x7f18ac02a1c0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 -- 172.21.15.33:0/1822904086 shutdown_connections 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406b2c0 0x7f18c406b700 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 --2- 172.21.15.33:0/1822904086 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c40b54c0 0x7f18c40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 -- 172.21.15.33:0/1822904086 >> 172.21.15.33:0/1822904086 conn(0x7f18c40d06d0 msgr2=0x7f18c40d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 -- 172.21.15.33:0/1822904086 shutdown_connections 2024-09-13T19:00:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.600+0000 7f18ca200640 1 -- 172.21.15.33:0/1822904086 wait complete. 2024-09-13T19:00:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.602+0000 7f18ca200640 1 Processor -- start 2024-09-13T19:00:45.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.602+0000 7f18ca200640 1 -- start start 2024-09-13T19:00:45.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 0x7f18c41f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406bc40 0x7f18c41f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40a94c0 con 0x7f18c40b54c0 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c41f31b0 con 0x7f18c406bc40 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18ca200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40a88b0 con 0x7f18c406b2c0 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18c9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18c8e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 0x7f18c41f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406bc40 0x7f18c41f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18c9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47076/0 (socket says 172.21.15.33:47076) 2024-09-13T19:00:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.603+0000 7f18c9800640 1 -- 172.21.15.33:0/2936197761 learned_addr learned my addr 172.21.15.33:0/2936197761 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:45.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 -- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 msgr2=0x7f18c41f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 0x7f18c41f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 -- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406bc40 msgr2=0x7f18c41f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406bc40 0x7f18c41f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 -- 172.21.15.33:0/2936197761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009400 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c8e00640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 0x7f18c41f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c9800640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c740 tx=0x7f18bc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003da0 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00ce50 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc005290 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac0094d0 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.604+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c40a8e70 con 0x7f18c40b54c0 2024-09-13T19:00:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.605+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c40a9630 con 0x7f18c40b54c0 2024-09-13T19:00:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.606+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18bc0053f0 con 0x7f18c40b54c0 2024-09-13T19:00:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.608+0000 7f18c1600640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 0x7f18a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.608+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18bc088a90 con 0x7f18c40b54c0 2024-09-13T19:00:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.608+0000 7f18c8e00640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 0x7f18a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.609+0000 7f18c8e00640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 0x7f18a006d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f18b4011380 tx=0x7f18b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.612+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18bc053d10 con 0x7f18c40b54c0 2024-09-13T19:00:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.793+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18c406c0c0 con 0x7f18c40b54c0 2024-09-13T19:00:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.794+0000 7f18c1600640 1 -- 172.21.15.33:0/2936197761 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18bc017070 con 0x7f18c40b54c0 2024-09-13T19:00:45.797 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 msgr2=0x7f18a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 0x7f18a006d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f18b4011380 tx=0x7f18b4009190 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 msgr2=0x7f18c40aa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c740 tx=0x7f18bc00cc00 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 shutdown_connections 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f18a006ac00 0x7f18a006d0c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c40b54c0 0x7f18c40aa500 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18c406bc40 0x7f18c41f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 --2- 172.21.15.33:0/2936197761 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f18c406b2c0 0x7f18c41f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 >> 172.21.15.33:0/2936197761 conn(0x7f18c40d06d0 msgr2=0x7f18c40d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:45.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 shutdown_connections 2024-09-13T19:00:45.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.796+0000 7f18ca200640 1 -- 172.21.15.33:0/2936197761 wait complete. 2024-09-13T19:00:45.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:45.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.970+0000 7fa6a5c00640 1 Processor -- start 2024-09-13T19:00:45.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.970+0000 7fa6a5c00640 1 -- start start 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa6a5c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6a0154ad0 0x7fa6a00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa6a5c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa6a5c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a006b7c0 con 0x7fa6a006f830 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa6a5c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a006b5b0 con 0x7fa6a00ce2c0 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa6a5c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a006baa0 con 0x7fa6a0154ad0 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa69f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa69f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47082/0 (socket says 172.21.15.33:47082) 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.971+0000 7fa69f400640 1 -- 172.21.15.33:0/750897746 learned_addr learned my addr 172.21.15.33:0/750897746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:45.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.972+0000 7fa69ea00640 1 --2- 172.21.15.33:0/750897746 >> v2:172.21.15.103:3300/0 conn(0x7fa6a0154ad0 0x7fa6a00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.972+0000 7fa69f400640 1 -- 172.21.15.33:0/750897746 >> v2:172.21.15.103:3300/0 conn(0x7fa6a0154ad0 msgr2=0x7fa6a00cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.972+0000 7fa69f400640 1 --2- 172.21.15.33:0/750897746 >> v2:172.21.15.103:3300/0 conn(0x7fa6a0154ad0 0x7fa6a00cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.972+0000 7fa69f400640 1 -- 172.21.15.33:0/750897746 >> v1:172.21.15.103:6789/0 conn(0x7fa6a006f830 legacy=0x7fa6a006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.972+0000 7fa69f400640 1 -- 172.21.15.33:0/750897746 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a006bd80 con 0x7fa6a00ce2c0 2024-09-13T19:00:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.973+0000 7fa69f400640 1 --2- 172.21.15.33:0/750897746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b1340 tx=0x7fa69802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8958bcc01c72b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.973+0000 7fa69e000640 1 -- 172.21.15.33:0/750897746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698031600 con 0x7fa6a00ce2c0 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.973+0000 7fa69e000640 1 -- 172.21.15.33:0/750897746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69802d050 con 0x7fa6a00ce2c0 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.973+0000 7fa69e000640 1 -- 172.21.15.33:0/750897746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698031980 con 0x7fa6a00ce2c0 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 -- 172.21.15.33:0/750897746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a00ce2c0 msgr2=0x7fa6a00cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/750897746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00b1340 tx=0x7fa69802a6a0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 -- 172.21.15.33:0/750897746 shutdown_connections 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/750897746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a00ce2c0 0x7fa6a00cbac0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/750897746 >> v2:172.21.15.103:3300/0 conn(0x7fa6a0154ad0 0x7fa6a00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 -- 172.21.15.33:0/750897746 >> 172.21.15.33:0/750897746 conn(0x7fa6a00b0580 msgr2=0x7fa6a00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 -- 172.21.15.33:0/750897746 shutdown_connections 2024-09-13T19:00:45.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.974+0000 7fa6a5c00640 1 -- 172.21.15.33:0/750897746 wait complete. 2024-09-13T19:00:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.976+0000 7fa6a5c00640 1 Processor -- start 2024-09-13T19:00:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.976+0000 7fa6a5c00640 1 -- start start 2024-09-13T19:00:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0154ad0 0x7fa6a0146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6a014eb40 0x7fa6a014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a014f500 con 0x7fa6a015b5a0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a015ba40 con 0x7fa6a0154ad0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a015bd20 con 0x7fa6a014eb40 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47098/0 (socket says 172.21.15.33:47098) 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 -- 172.21.15.33:0/3224245537 learned_addr learned my addr 172.21.15.33:0/3224245537 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa69f400640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6a014eb40 0x7fa6a014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa69ea00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0154ad0 0x7fa6a0146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 -- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6a014eb40 msgr2=0x7fa6a014efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6a014eb40 0x7fa6a014efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 -- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0154ad0 msgr2=0x7fa6a0146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0154ad0 0x7fa6a0146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.977+0000 7fa697e00640 1 -- 172.21.15.33:0/3224245537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698009b30 con 0x7fa6a015b5a0 2024-09-13T19:00:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa697e00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c450 tx=0x7fa68800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880052d0 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688005430 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688012870 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a015c000 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.978+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a015c5c0 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.979+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a01f25e0 con 0x7fa6a015b5a0 2024-09-13T19:00:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.980+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa6880129d0 con 0x7fa6a015b5a0 2024-09-13T19:00:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.981+0000 7fa696a00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 0x7fa67c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.981+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa688088f10 con 0x7fa6a015b5a0 2024-09-13T19:00:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.981+0000 7fa69ea00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 0x7fa67c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:45.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.982+0000 7fa69ea00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 0x7fa67c06d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa690009a30 tx=0x7fa690008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:45.985+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa688054050 con 0x7fa6a015b5a0 2024-09-13T19:00:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.164+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6a00afc70 con 0x7fa6a015b5a0 2024-09-13T19:00:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.165+0000 7fa696a00640 1 -- 172.21.15.33:0/3224245537 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa688057670 con 0x7fa6a015b5a0 2024-09-13T19:00:46.167 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 msgr2=0x7fa67c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 0x7fa67c06d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa690009a30 tx=0x7fa690008040 comp rx=0 tx=0).stop 2024-09-13T19:00:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 msgr2=0x7fa6a015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c450 tx=0x7fa68800c910 comp rx=0 tx=0).stop 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 shutdown_connections 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa67c06ac00 0x7fa67c06d0c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa6a014eb40 0x7fa6a014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6a015b5a0 0x7fa6a015d3a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 --2- 172.21.15.33:0/3224245537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a0154ad0 0x7fa6a0146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 >> 172.21.15.33:0/3224245537 conn(0x7fa6a00b0580 msgr2=0x7fa6a015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 shutdown_connections 2024-09-13T19:00:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.167+0000 7fa6a5c00640 1 -- 172.21.15.33:0/3224245537 wait complete. 2024-09-13T19:00:46.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.342+0000 7faeabe00640 1 Processor -- start 2024-09-13T19:00:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.342+0000 7faeabe00640 1 -- start start 2024-09-13T19:00:46.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeabe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7faeac15a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeabe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac157310 con 0x7faeac156f30 2024-09-13T19:00:46.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeabe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0b29c0 con 0x7faeac06b630 2024-09-13T19:00:46.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeabe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b2ca0 con 0x7faeac0b1db0 2024-09-13T19:00:46.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeaaa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faeac156f30 0x7faeac0b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50942/0 (socket says 172.21.15.33:50942) 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeaaa00640 1 -- 172.21.15.33:0/2058450169 learned_addr learned my addr 172.21.15.33:0/2058450169 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faea3e00640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7faeac15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380439886 0 0) 0x7faeac157310 con 0x7faeac156f30 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.344+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae90003520 con 0x7faeac156f30 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587194199 0 0) 0x7fae90003520 con 0x7faeac156f30 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 msgr2=0x7faeac15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7faeac15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 >> v1:172.21.15.103:6789/0 conn(0x7faeac06b630 legacy=0x7faeac0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0b2f80 con 0x7faeac156f30 2024-09-13T19:00:46.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fae9c001670 con 0x7faeac156f30 2024-09-13T19:00:46.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 >> v1:172.21.15.33:6789/0 conn(0x7faeac156f30 legacy=0x7faeac0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900039a0 0x7fae90003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7fae900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7fae90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b2ca0 con 0x7fae90004d00 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9000ba30 con 0x7fae900039a0 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9000bbc0 con 0x7faeac0b1db0 2024-09-13T19:00:46.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeab400640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7fae90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faea3e00640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7fae900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.345+0000 7faeaaa00640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900039a0 0x7fae90003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.346+0000 7faeab400640 1 -- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 msgr2=0x7fae900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.346+0000 7faeab400640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac0b1db0 0x7fae900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.346+0000 7faeab400640 1 -- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900039a0 msgr2=0x7fae90003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:46.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.346+0000 7faeab400640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae900039a0 0x7fae90003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.346+0000 7faeab400640 1 -- 172.21.15.33:0/2058450169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90003520 con 0x7fae90004d00 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeab400640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7fae90005180 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faea4001f90 tx=0x7fae900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7957cd5d0179b898 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4031600 con 0x7fae90004d00 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea402d050 con 0x7fae90004d00 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeaa000640 1 -- 172.21.15.33:0/2058450169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40319c0 con 0x7fae90004d00 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 -- 172.21.15.33:0/2058450169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 msgr2=0x7fae90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 --2- 172.21.15.33:0/2058450169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7fae90005180 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7faea4001f90 tx=0x7fae900057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeab400640 1 -- 172.21.15.33:0/2058450169 reap_dead start 2024-09-13T19:00:46.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 -- 172.21.15.33:0/2058450169 shutdown_connections 2024-09-13T19:00:46.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 -- 172.21.15.33:0/2058450169 >> 172.21.15.33:0/2058450169 conn(0x7faeac069ed0 msgr2=0x7faeac06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:46.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 -- 172.21.15.33:0/2058450169 shutdown_connections 2024-09-13T19:00:46.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.347+0000 7faeabe00640 1 -- 172.21.15.33:0/2058450169 wait complete. 2024-09-13T19:00:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.349+0000 7faeabe00640 1 Processor -- start 2024-09-13T19:00:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.349+0000 7faeabe00640 1 -- start start 2024-09-13T19:00:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac148cb0 0x7faeac1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 0x7faeac1f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac155e70 con 0x7fae90004d00 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1362a0 con 0x7faeac1f67b0 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeabe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac156110 con 0x7faeac148cb0 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeaaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeaaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47112/0 (socket says 172.21.15.33:47112) 2024-09-13T19:00:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeaaa00640 1 -- 172.21.15.33:0/3417056844 learned_addr learned my addr 172.21.15.33:0/3417056844 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faea3e00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac148cb0 0x7faeac1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.350+0000 7faeab400640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 0x7faeac1f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 -- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac148cb0 msgr2=0x7faeac1f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac148cb0 0x7faeac1f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 -- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 msgr2=0x7faeac1f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 0x7faeac1f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 -- 172.21.15.33:0/3417056844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac1563f0 con 0x7fae90004d00 2024-09-13T19:00:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeab400640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 0x7faeac1f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeaaa00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fae9c004f70 tx=0x7fae9c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00f750 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c00f8b0 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac136580 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00fc60 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.351+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac156910 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.353+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac156630 con 0x7fae90004d00 2024-09-13T19:00:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.353+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae9c01d460 con 0x7fae90004d00 2024-09-13T19:00:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.355+0000 7faea2a00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 0x7fae8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.355+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae9c089480 con 0x7fae90004d00 2024-09-13T19:00:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.355+0000 7faea3e00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 0x7fae8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.356+0000 7faea3e00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 0x7fae8806d0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faeac14ec10 tx=0x7fae94009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.359+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faeac156630 con 0x7fae90004d00 2024-09-13T19:00:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.537+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faeac156630 con 0x7fae90004d00 2024-09-13T19:00:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.537+0000 7faea2a00640 1 -- 172.21.15.33:0/3417056844 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7faeac156630 con 0x7fae90004d00 2024-09-13T19:00:46.540 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 msgr2=0x7fae8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 0x7fae8806d0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faeac14ec10 tx=0x7fae94009190 comp rx=0 tx=0).stop 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 msgr2=0x7faeac135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fae9c004f70 tx=0x7fae9c007430 comp rx=0 tx=0).stop 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 shutdown_connections 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fae8806ac00 0x7fae8806d0c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeac1f67b0 0x7faeac1f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faeac148cb0 0x7faeac1f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 --2- 172.21.15.33:0/3417056844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae90004d00 0x7faeac135940 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 >> 172.21.15.33:0/3417056844 conn(0x7faeac069ed0 msgr2=0x7faeac0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.539+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 shutdown_connections 2024-09-13T19:00:46.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.540+0000 7faeabe00640 1 -- 172.21.15.33:0/3417056844 wait complete. 2024-09-13T19:00:46.557 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:00:46.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.711+0000 7f4327200640 1 Processor -- start 2024-09-13T19:00:46.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.711+0000 7f4327200640 1 -- start start 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.712+0000 7f4327200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432815dc30 0x7f43280cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.712+0000 7f4327200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f432806a5e0 0x7f4328070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.712+0000 7f4327200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43280cb8d0 con 0x7f43280cb3d0 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.712+0000 7f4327200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432815e010 con 0x7f432806a5e0 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.712+0000 7f4327200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280cbbb0 con 0x7f432815dc30 2024-09-13T19:00:46.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4326800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f432806a5e0 0x7f4328070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4325400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f43280cb3d0 0x7f4328069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50948/0 (socket says 172.21.15.33:50948) 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4325400640 1 -- 172.21.15.33:0/3361706860 learned_addr learned my addr 172.21.15.33:0/3361706860 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4325e00640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432815dc30 0x7f43280cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4326800640 1 -- 172.21.15.33:0/3361706860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432815dc30 msgr2=0x7f43280cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4326800640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432815dc30 0x7f43280cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4326800640 1 -- 172.21.15.33:0/3361706860 >> v1:172.21.15.33:6789/0 conn(0x7f43280cb3d0 legacy=0x7f4328069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4326800640 1 -- 172.21.15.33:0/3361706860 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280cbe90 con 0x7f432806a5e0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.713+0000 7f4324a00640 1 -- 172.21.15.33:0/3361706860 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947800481 0 0) 0x7f43280cb8d0 con 0x7f43280cb3d0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.714+0000 7f4326800640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f432806a5e0 0x7f4328070430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf205a00cd730a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.714+0000 7f4324a00640 1 -- 172.21.15.33:0/3361706860 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320007740 con 0x7f432806a5e0 2024-09-13T19:00:46.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4324a00640 1 -- 172.21.15.33:0/3361706860 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002d050 con 0x7f432806a5e0 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4324a00640 1 -- 172.21.15.33:0/3361706860 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320007ac0 con 0x7f432806a5e0 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 -- 172.21.15.33:0/3361706860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f432806a5e0 msgr2=0x7f4328070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f432806a5e0 0x7f4328070430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002a660 comp rx=0 tx=0).stop 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 -- 172.21.15.33:0/3361706860 shutdown_connections 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f432806a5e0 0x7f4328070430 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 --2- 172.21.15.33:0/3361706860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432815dc30 0x7f43280cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 -- 172.21.15.33:0/3361706860 >> 172.21.15.33:0/3361706860 conn(0x7f43280affd0 msgr2=0x7f43280b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 -- 172.21.15.33:0/3361706860 shutdown_connections 2024-09-13T19:00:46.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.715+0000 7f4327200640 1 -- 172.21.15.33:0/3361706860 wait complete. 2024-09-13T19:00:46.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.717+0000 7f4327200640 1 Processor -- start 2024-09-13T19:00:46.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.717+0000 7f4327200640 1 -- start start 2024-09-13T19:00:46.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432806a5e0 0x7f4328159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432815dc30 0x7f4328149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328149580 con 0x7f43280cb3d0 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280a9860 con 0x7f432815dc30 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4327200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43281541f0 con 0x7f432806a5e0 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4325400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4325400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47120/0 (socket says 172.21.15.33:47120) 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4325400640 1 -- 172.21.15.33:0/1736750547 learned_addr learned my addr 172.21.15.33:0/1736750547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4325e00640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432806a5e0 0x7f4328159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.718+0000 7f4326800640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432815dc30 0x7f4328149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 -- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432806a5e0 msgr2=0x7f4328159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432806a5e0 0x7f4328159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 -- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432815dc30 msgr2=0x7f4328149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432815dc30 0x7f4328149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 -- 172.21.15.33:0/1736750547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009a70 con 0x7f43280cb3d0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4325400640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f431400c4b0 tx=0x7f431400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140074e0 con 0x7f43280cb3d0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314007660 con 0x7f43280cb3d0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314004a20 con 0x7f43280cb3d0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43281544d0 con 0x7f43280cb3d0 2024-09-13T19:00:46.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.719+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4328154a90 con 0x7f43280cb3d0 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.720+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4328067320 con 0x7f43280cb3d0 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.722+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4314004b80 con 0x7f43280cb3d0 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.722+0000 7f431e000640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 0x7f430806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.722+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4314088470 con 0x7f43280cb3d0 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.723+0000 7f4325e00640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 0x7f430806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.723+0000 7f4325e00640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 0x7f430806d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4318009aa0 tx=0x7f4318009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:46.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.727+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f43140537b0 con 0x7f43280cb3d0 2024-09-13T19:00:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.918+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4328154c80 con 0x7f43280cb3d0 2024-09-13T19:00:46.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.918+0000 7f431e000640 1 -- 172.21.15.33:0/1736750547 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4314056dd0 con 0x7f43280cb3d0 2024-09-13T19:00:46.921 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 msgr2=0x7f430806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 0x7f430806d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4318009aa0 tx=0x7f4318009190 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 msgr2=0x7f4328148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f431400c4b0 tx=0x7f431400c970 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 shutdown_connections 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f430806ac00 0x7f430806d0c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f432815dc30 0x7f4328149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43280cb3d0 0x7f4328148b00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 --2- 172.21.15.33:0/1736750547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f432806a5e0 0x7f4328159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 >> 172.21.15.33:0/1736750547 conn(0x7f43280affd0 msgr2=0x7f4328069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 shutdown_connections 2024-09-13T19:00:46.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:46.920+0000 7f4327200640 1 -- 172.21.15.33:0/1736750547 wait complete. 2024-09-13T19:00:46.938 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T19:00:46.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:46.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T19:00:47.009 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:00:47.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:00:47.010 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T19:00:47.047 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:47.047 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:47.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:47.083 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:47.083 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:47.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:47.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:47.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.278+0000 7f51fb600640 1 Processor -- start 2024-09-13T19:00:47.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.278+0000 7f51fb600640 1 -- start start 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51fb600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f51f4159a80 0x7f51f406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51fb600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f4153f00 con 0x7f51f40b3990 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51fb600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40b1a40 con 0x7f51f4153b20 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51fb600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40ce600 con 0x7f51f4159a80 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f9600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f51f4159a80 0x7f51f406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f3e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f51f40b3990 0x7f51f406f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50960/0 (socket says 172.21.15.33:50960) 2024-09-13T19:00:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f3e00640 1 -- 172.21.15.33:0/487310884 learned_addr learned my addr 172.21.15.33:0/487310884 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f9600640 1 -- 172.21.15.33:0/487310884 >> v1:172.21.15.103:6789/0 conn(0x7f51f4153b20 legacy=0x7f51f40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f9600640 1 -- 172.21.15.33:0/487310884 >> v1:172.21.15.33:6789/0 conn(0x7f51f40b3990 legacy=0x7f51f406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.280+0000 7f51f9600640 1 -- 172.21.15.33:0/487310884 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f415a1f0 con 0x7f51f4159a80 2024-09-13T19:00:47.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.281+0000 7f51f9600640 1 --2- 172.21.15.33:0/487310884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4159a80 0x7f51f406d060 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d90 tx=0x7f51ec02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cce1d0c4c8a86f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51f3400640 1 -- 172.21.15.33:0/487310884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec007740 con 0x7f51f4159a80 2024-09-13T19:00:47.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51f3400640 1 -- 172.21.15.33:0/487310884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec02d050 con 0x7f51f4159a80 2024-09-13T19:00:47.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51f3400640 1 -- 172.21.15.33:0/487310884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec007ac0 con 0x7f51f4159a80 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 -- 172.21.15.33:0/487310884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4159a80 msgr2=0x7f51f406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 --2- 172.21.15.33:0/487310884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4159a80 0x7f51f406d060 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d90 tx=0x7f51ec02a5f0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 -- 172.21.15.33:0/487310884 shutdown_connections 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 --2- 172.21.15.33:0/487310884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4159a80 0x7f51f406d060 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 -- 172.21.15.33:0/487310884 >> 172.21.15.33:0/487310884 conn(0x7f51f40b0510 msgr2=0x7f51f40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 -- 172.21.15.33:0/487310884 shutdown_connections 2024-09-13T19:00:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.282+0000 7f51fb600640 1 -- 172.21.15.33:0/487310884 wait complete. 2024-09-13T19:00:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.284+0000 7f51fb600640 1 Processor -- start 2024-09-13T19:00:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.284+0000 7f51fb600640 1 -- start start 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 0x7f51f414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f51f4159a80 0x7f51f40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4156f10 con 0x7f51f4153b20 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f414c4c0 con 0x7f51f40b3990 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51fb600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4155e70 con 0x7f51f4159a80 2024-09-13T19:00:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47142/0 (socket says 172.21.15.33:47142) 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51f3e00640 1 -- 172.21.15.33:0/1532269458 learned_addr learned my addr 172.21.15.33:0/1532269458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51f8c00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 0x7f51f414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.285+0000 7f51f9600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f51f4159a80 0x7f51f40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 -- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f51f4159a80 msgr2=0x7f51f40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f51f4159a80 0x7f51f40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 -- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 msgr2=0x7f51f414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 0x7f51f414bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 -- 172.21.15.33:0/1532269458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009a70 con 0x7f51f4153b20 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f8c00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 0x7f51f414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f3e00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c5a0 tx=0x7f51e000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00074e0 con 0x7f51f4153b20 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0007640 con 0x7f51f4153b20 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004a20 con 0x7f51f4153b20 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4156150 con 0x7f51f4153b20 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.286+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4156710 con 0x7f51f4153b20 2024-09-13T19:00:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.288+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f40b1ed0 con 0x7f51f4153b20 2024-09-13T19:00:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.288+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f51e0004b80 con 0x7f51f4153b20 2024-09-13T19:00:47.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.289+0000 7f51f0c00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 0x7f51d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.289+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51e0088620 con 0x7f51f4153b20 2024-09-13T19:00:47.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.290+0000 7f51f8c00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 0x7f51d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.290+0000 7f51f8c00640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 0x7f51d406d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f60 tx=0x7f51e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.293+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51e00538b0 con 0x7f51f4153b20 2024-09-13T19:00:47.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.509+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51f40cdfd0 con 0x7f51f4153b20 2024-09-13T19:00:47.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.510+0000 7f51f0c00640 1 -- 172.21.15.33:0/1532269458 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f51e0018090 con 0x7f51f4153b20 2024-09-13T19:00:47.512 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:47.512 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:47.513 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 msgr2=0x7f51d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 0x7f51d406d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f60 tx=0x7f51e8009040 comp rx=0 tx=0).stop 2024-09-13T19:00:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 msgr2=0x7f51f40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c5a0 tx=0x7f51e000ca60 comp rx=0 tx=0).stop 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 shutdown_connections 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f51d406ac00 0x7f51d406d0c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f51f4159a80 0x7f51f40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f4153b20 0x7f51f40b20e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 --2- 172.21.15.33:0/1532269458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f40b3990 0x7f51f414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 >> 172.21.15.33:0/1532269458 conn(0x7f51f40b0510 msgr2=0x7f51f40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 shutdown_connections 2024-09-13T19:00:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.512+0000 7f51fb600640 1 -- 172.21.15.33:0/1532269458 wait complete. 2024-09-13T19:00:47.530 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.682+0000 7f3f55800640 1 Processor -- start 2024-09-13T19:00:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.682+0000 7f3f55800640 1 -- start start 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f55800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f5015a520 0x7f3f5006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f55800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5006bc00 con 0x7f3f500ce020 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f55800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5006bea0 con 0x7f3f500b1b00 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f55800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5006c180 con 0x7f3f5015a520 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f5015a520 0x7f3f5006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4f400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3f500ce020 0x7f3f5015a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50972/0 (socket says 172.21.15.33:50972) 2024-09-13T19:00:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4ea00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3f5015a520 0x7f3f5006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47146/0 (socket says 172.21.15.33:47146) 2024-09-13T19:00:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4f400640 1 -- 172.21.15.33:0/1575614434 learned_addr learned my addr 172.21.15.33:0/1575614434 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4ea00640 1 -- 172.21.15.33:0/1575614434 >> v1:172.21.15.103:6789/0 conn(0x7f3f500b1b00 legacy=0x7f3f500cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4ea00640 1 -- 172.21.15.33:0/1575614434 >> v1:172.21.15.33:6789/0 conn(0x7f3f500ce020 legacy=0x7f3f5015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.684+0000 7f3f4ea00640 1 -- 172.21.15.33:0/1575614434 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5006c460 con 0x7f3f5015a520 2024-09-13T19:00:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.685+0000 7f3f4ea00640 1 --2- 172.21.15.33:0/1575614434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5015a520 0x7f3f5006b6c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fb83f8ed3ef971 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f4e000640 1 -- 172.21.15.33:0/1575614434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40032440 con 0x7f3f5015a520 2024-09-13T19:00:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f4e000640 1 -- 172.21.15.33:0/1575614434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400325a0 con 0x7f3f5015a520 2024-09-13T19:00:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f4e000640 1 -- 172.21.15.33:0/1575614434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40032930 con 0x7f3f5015a520 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f55800640 1 -- 172.21.15.33:0/1575614434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5015a520 msgr2=0x7f3f5006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f55800640 1 --2- 172.21.15.33:0/1575614434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5015a520 0x7f3f5006b6c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f55800640 1 -- 172.21.15.33:0/1575614434 shutdown_connections 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f55800640 1 --2- 172.21.15.33:0/1575614434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5015a520 0x7f3f5006b6c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.686+0000 7f3f55800640 1 -- 172.21.15.33:0/1575614434 >> 172.21.15.33:0/1575614434 conn(0x7f3f500b0510 msgr2=0x7f3f500b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.687+0000 7f3f55800640 1 -- 172.21.15.33:0/1575614434 shutdown_connections 2024-09-13T19:00:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.687+0000 7f3f55800640 1 -- 172.21.15.33:0/1575614434 wait complete. 2024-09-13T19:00:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.688+0000 7f3f55800640 1 Processor -- start 2024-09-13T19:00:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.688+0000 7f3f55800640 1 -- start start 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f500b1b00 0x7f3f50155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5015a520 0x7f3f50152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50155210 con 0x7f3f500ce020 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50153770 con 0x7f3f5015a520 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f55800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50154590 con 0x7f3f500b1b00 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f46000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f46000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47148/0 (socket says 172.21.15.33:47148) 2024-09-13T19:00:47.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.689+0000 7f3f46000640 1 -- 172.21.15.33:0/1354239526 learned_addr learned my addr 172.21.15.33:0/1354239526 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:47.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f4f400640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5015a520 0x7f3f50152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f4ea00640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f500b1b00 0x7f3f50155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 -- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f500b1b00 msgr2=0x7f3f50155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f500b1b00 0x7f3f50155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 -- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5015a520 msgr2=0x7f3f50152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5015a520 0x7f3f50152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 -- 172.21.15.33:0/1354239526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40009400 con 0x7f3f500ce020 2024-09-13T19:00:47.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f46000640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c430 tx=0x7f3f3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011790 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.690+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380118f0 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.691+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011ce0 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.691+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50154870 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.691+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50154e30 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.692+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50155350 con 0x7f3f500ce020 2024-09-13T19:00:47.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.693+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f3801c460 con 0x7f3f500ce020 2024-09-13T19:00:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.693+0000 7f3f47400640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 0x7f3f2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.694+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f38089280 con 0x7f3f500ce020 2024-09-13T19:00:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.694+0000 7f3f4ea00640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 0x7f3f2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.694+0000 7f3f4ea00640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 0x7f3f2c06d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3f40034000 tx=0x7f3f4002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.698+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f50155350 con 0x7f3f500ce020 2024-09-13T19:00:47.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.879+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f50155350 con 0x7f3f500ce020 2024-09-13T19:00:47.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.881+0000 7f3f47400640 1 -- 172.21.15.33:0/1354239526 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7f3f50155350 con 0x7f3f500ce020 2024-09-13T19:00:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:47.884 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 msgr2=0x7f3f2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 0x7f3f2c06d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3f40034000 tx=0x7f3f4002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 msgr2=0x7f3f50153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c430 tx=0x7f3f3800c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 shutdown_connections 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3f2c06ac00 0x7f3f2c06d0c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5015a520 0x7f3f50152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f500ce020 0x7f3f50153e90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 --2- 172.21.15.33:0/1354239526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f500b1b00 0x7f3f50155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 >> 172.21.15.33:0/1354239526 conn(0x7f3f500b0510 msgr2=0x7f3f500ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 shutdown_connections 2024-09-13T19:00:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:47.883+0000 7f3f55800640 1 -- 172.21.15.33:0/1354239526 wait complete. 2024-09-13T19:00:47.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:00:26.699583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:00:27.780305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:47.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.058+0000 7ff567a00640 1 Processor -- start 2024-09-13T19:00:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.058+0000 7ff567a00640 1 -- start start 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.059+0000 7ff567a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff560071690 0x7ff56015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff567a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56006f5f0 con 0x7ff5600cafa0 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff567a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff560070450 con 0x7ff560156f60 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff567a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56015aa30 con 0x7ff560071690 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff565a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff5600cafa0 0x7ff5600cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50980/0 (socket says 172.21.15.33:50980) 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff565a00640 1 -- 172.21.15.33:0/2758882322 learned_addr learned my addr 172.21.15.33:0/2758882322 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55fe00640 1 --2- 172.21.15.33:0/2758882322 >> v2:172.21.15.103:3300/0 conn(0x7ff560071690 0x7ff56015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707158159 0 0) 0x7ff56006f5f0 con 0x7ff5600cafa0 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff548003520 con 0x7ff5600cafa0 2024-09-13T19:00:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55fe00640 1 -- 172.21.15.33:0/2758882322 >> v1:172.21.15.103:6789/0 conn(0x7ff560156f60 legacy=0x7ff560070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338512009 0 0) 0x7ff560070450 con 0x7ff560156f60 2024-09-13T19:00:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55fe00640 1 -- 172.21.15.33:0/2758882322 >> v1:172.21.15.33:6789/0 conn(0x7ff5600cafa0 legacy=0x7ff5600cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.060+0000 7ff55fe00640 1 -- 172.21.15.33:0/2758882322 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56006f840 con 0x7ff560071690 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.061+0000 7ff55fe00640 1 --2- 172.21.15.33:0/2758882322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560071690 0x7ff56015a4f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097a0 tx=0x7ff54c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b49755a3a4c8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c032440 con 0x7ff560071690 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0325a0 con 0x7ff560071690 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff55f400640 1 -- 172.21.15.33:0/2758882322 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c032910 con 0x7ff560071690 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff567a00640 1 -- 172.21.15.33:0/2758882322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560071690 msgr2=0x7ff56015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff567a00640 1 --2- 172.21.15.33:0/2758882322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560071690 0x7ff56015a4f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097a0 tx=0x7ff54c02a230 comp rx=0 tx=0).stop 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff567a00640 1 -- 172.21.15.33:0/2758882322 shutdown_connections 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff567a00640 1 --2- 172.21.15.33:0/2758882322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560071690 0x7ff56015a4f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.062+0000 7ff567a00640 1 -- 172.21.15.33:0/2758882322 >> 172.21.15.33:0/2758882322 conn(0x7ff5600b0580 msgr2=0x7ff5600b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.063+0000 7ff567a00640 1 -- 172.21.15.33:0/2758882322 shutdown_connections 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.063+0000 7ff567a00640 1 -- 172.21.15.33:0/2758882322 wait complete. 2024-09-13T19:00:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.064+0000 7ff567a00640 1 Processor -- start 2024-09-13T19:00:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.064+0000 7ff567a00640 1 -- start start 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5600cafa0 0x7ff5601f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560156f60 0x7ff56015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5601541d0 con 0x7ff560071690 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5601e8cf0 con 0x7ff560156f60 2024-09-13T19:00:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff567a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff560153550 con 0x7ff5600cafa0 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.065+0000 7ff565000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47162/0 (socket says 172.21.15.33:47162) 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 -- 172.21.15.33:0/1124753480 learned_addr learned my addr 172.21.15.33:0/1124753480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff55fe00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5600cafa0 0x7ff5601f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560156f60 0x7ff56015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 -- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5600cafa0 msgr2=0x7ff5601f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5600cafa0 0x7ff5601f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 -- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560156f60 msgr2=0x7ff56015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560156f60 0x7ff56015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 -- 172.21.15.33:0/1124753480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c009400 con 0x7ff560071690 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.066+0000 7ff565000640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c3c0 tx=0x7ff55400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.067+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5540035f0 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.067+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554003770 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.067+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554003b20 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.067+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff560153830 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.067+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff560153df0 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.068+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560157340 con 0x7ff560071690 2024-09-13T19:00:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.069+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff554003c80 con 0x7ff560071690 2024-09-13T19:00:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.070+0000 7ff55cc00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 0x7ff54006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.070+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff554088780 con 0x7ff560071690 2024-09-13T19:00:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.070+0000 7ff55fe00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 0x7ff54006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.071+0000 7ff55fe00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 0x7ff54006d0f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff54c034000 tx=0x7ff54c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.074+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff554053aa0 con 0x7ff560071690 2024-09-13T19:00:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.252+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5600008d0 con 0x7ff560071690 2024-09-13T19:00:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.253+0000 7ff55cc00640 1 -- 172.21.15.33:0/1124753480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff554017020 con 0x7ff560071690 2024-09-13T19:00:48.255 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 msgr2=0x7ff54006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 0x7ff54006d0f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff54c034000 tx=0x7ff54c02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 msgr2=0x7ff5601e87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c3c0 tx=0x7ff55400c880 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 shutdown_connections 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff54006ac30 0x7ff54006d0f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff560156f60 0x7ff56015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff5600cafa0 0x7ff5601f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 --2- 172.21.15.33:0/1124753480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff560071690 0x7ff5601e87b0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 >> 172.21.15.33:0/1124753480 conn(0x7ff5600b0580 msgr2=0x7ff56006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 shutdown_connections 2024-09-13T19:00:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.255+0000 7ff567a00640 1 -- 172.21.15.33:0/1124753480 wait complete. 2024-09-13T19:00:48.273 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:00:48.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.429+0000 7f16b8a00640 1 Processor -- start 2024-09-13T19:00:48.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.429+0000 7f16b8a00640 1 -- start start 2024-09-13T19:00:48.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.430+0000 7f16b8a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16b4156f30 0x7f16b415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.430+0000 7f16b8a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16b40b1db0 0x7f16b40cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.430+0000 7f16b8a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b4157310 con 0x7f16b406b630 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.430+0000 7f16b8a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b40b29c0 con 0x7f16b40b1db0 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.430+0000 7f16b8a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b40b2ca0 con 0x7f16b4156f30 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16b40b1db0 0x7f16b40cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16b40b1db0 0x7f16b40cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47176/0 (socket says 172.21.15.33:47176) 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 -- 172.21.15.33:0/3182959936 learned_addr learned my addr 172.21.15.33:0/3182959936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3400640 1 --2- 172.21.15.33:0/3182959936 >> v2:172.21.15.103:3300/0 conn(0x7f16b4156f30 0x7f16b415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 -- 172.21.15.33:0/3182959936 >> v2:172.21.15.103:3300/0 conn(0x7f16b4156f30 msgr2=0x7f16b415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 --2- 172.21.15.33:0/3182959936 >> v2:172.21.15.103:3300/0 conn(0x7f16b4156f30 0x7f16b415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 -- 172.21.15.33:0/3182959936 >> v1:172.21.15.103:6789/0 conn(0x7f16b406b630 legacy=0x7f16b40b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.431+0000 7f16b3e00640 1 -- 172.21.15.33:0/3182959936 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40b2f80 con 0x7f16b40b1db0 2024-09-13T19:00:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.432+0000 7f16b3e00640 1 --2- 172.21.15.33:0/3182959936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b40b1db0 0x7f16b40cc4a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f16b406d630 tx=0x7f16ac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fa6b57a1533019 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.432+0000 7f16b2a00640 1 -- 172.21.15.33:0/3182959936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac031600 con 0x7f16b40b1db0 2024-09-13T19:00:48.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b2a00640 1 -- 172.21.15.33:0/3182959936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac02d050 con 0x7f16b40b1db0 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b2a00640 1 -- 172.21.15.33:0/3182959936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac031980 con 0x7f16b40b1db0 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 -- 172.21.15.33:0/3182959936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b40b1db0 msgr2=0x7f16b40cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3182959936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b40b1db0 0x7f16b40cc4a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f16b406d630 tx=0x7f16ac02a730 comp rx=0 tx=0).stop 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 -- 172.21.15.33:0/3182959936 shutdown_connections 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3182959936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b40b1db0 0x7f16b40cc4a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3182959936 >> v2:172.21.15.103:3300/0 conn(0x7f16b4156f30 0x7f16b415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 -- 172.21.15.33:0/3182959936 >> 172.21.15.33:0/3182959936 conn(0x7f16b4069ed0 msgr2=0x7f16b406a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 -- 172.21.15.33:0/3182959936 shutdown_connections 2024-09-13T19:00:48.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.433+0000 7f16b8a00640 1 -- 172.21.15.33:0/3182959936 wait complete. 2024-09-13T19:00:48.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.435+0000 7f16b8a00640 1 Processor -- start 2024-09-13T19:00:48.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.435+0000 7f16b8a00640 1 -- start start 2024-09-13T19:00:48.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b406b630 0x7f16b415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16b40b1db0 0x7f16b4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41efc50 con 0x7f16b4156f30 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40c4710 con 0x7f16b406b630 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b8a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41f3190 con 0x7f16b40b1db0 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47190/0 (socket says 172.21.15.33:47190) 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b3e00640 1 -- 172.21.15.33:0/3524197855 learned_addr learned my addr 172.21.15.33:0/3524197855 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16b3400640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b406b630 0x7f16b415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.436+0000 7f16abe00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16b40b1db0 0x7f16b4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 -- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16b40b1db0 msgr2=0x7f16b4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16b40b1db0 0x7f16b4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 -- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b406b630 msgr2=0x7f16b415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b406b630 0x7f16b415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 -- 172.21.15.33:0/3524197855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac009b30 con 0x7f16b4156f30 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b3e00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f16ac034040 tx=0x7f16ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac03d860 con 0x7f16b4156f30 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac03d9c0 con 0x7f16b4156f30 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac03dd70 con 0x7f16b4156f30 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b40c39f0 con 0x7f16b4156f30 2024-09-13T19:00:48.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.437+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b40c4050 con 0x7f16b4156f30 2024-09-13T19:00:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.438+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b40c4850 con 0x7f16b4156f30 2024-09-13T19:00:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.439+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f16ac03b400 con 0x7f16b4156f30 2024-09-13T19:00:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.440+0000 7f16ab400640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 0x7f169006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.440+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16ac0a9fb0 con 0x7f16b4156f30 2024-09-13T19:00:48.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.441+0000 7f16b3400640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 0x7f169006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.441+0000 7f16b3400640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 0x7f169006d0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009aa0 tx=0x7f16a4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.444+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f16ac075230 con 0x7f16b4156f30 2024-09-13T19:00:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.620+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16b415a460 con 0x7f16b4156f30 2024-09-13T19:00:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.620+0000 7f16ab400640 1 -- 172.21.15.33:0/3524197855 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16ac009510 con 0x7f16b4156f30 2024-09-13T19:00:48.623 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 msgr2=0x7f169006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 0x7f169006d0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009aa0 tx=0x7f16a4009190 comp rx=0 tx=0).stop 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 msgr2=0x7f16b41f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f16ac034040 tx=0x7f16ac004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 shutdown_connections 2024-09-13T19:00:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f169006ac30 0x7f169006d0f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16b4156f30 0x7f16b41f2c50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16b40b1db0 0x7f16b4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 --2- 172.21.15.33:0/3524197855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16b406b630 0x7f16b415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.622+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 >> 172.21.15.33:0/3524197855 conn(0x7f16b4069ed0 msgr2=0x7f16b40cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.623+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 shutdown_connections 2024-09-13T19:00:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.623+0000 7f16b8a00640 1 -- 172.21.15.33:0/3524197855 wait complete. 2024-09-13T19:00:48.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:00:48.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.797+0000 7f5e36400640 1 Processor -- start 2024-09-13T19:00:48.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.797+0000 7f5e36400640 1 -- start start 2024-09-13T19:00:48.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.798+0000 7f5e36400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5e3006c710 0x7f5e3006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.798+0000 7f5e36400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e300b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e36400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300cc150 con 0x7f5e3015a3d0 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e36400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300b29d0 con 0x7f5e3006c710 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e36400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3006b670 con 0x7f5e300b2080 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5e3006c710 0x7f5e3006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5e3006c710 0x7f5e3006cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47202/0 (socket says 172.21.15.33:47202) 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e2f400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5e3015a3d0 0x7f5e300cba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50990/0 (socket says 172.21.15.33:50990) 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 -- 172.21.15.33:0/524911318 learned_addr learned my addr 172.21.15.33:0/524911318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e2fe00640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e300b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 -- 172.21.15.33:0/524911318 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 msgr2=0x7f5e300b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e300b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 -- 172.21.15.33:0/524911318 >> v1:172.21.15.33:6789/0 conn(0x7f5e3015a3d0 legacy=0x7f5e300cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e26a00640 1 -- 172.21.15.33:0/524911318 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3006b950 con 0x7f5e3006c710 2024-09-13T19:00:48.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.799+0000 7f5e2fe00640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e300b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.800+0000 7f5e26a00640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e3006cb60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009870 tx=0x7f5e1802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c98c86572b84a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e2ea00640 1 -- 172.21.15.33:0/524911318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1802ae90 con 0x7f5e3006c710 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e2ea00640 1 -- 172.21.15.33:0/524911318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18032440 con 0x7f5e3006c710 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e2ea00640 1 -- 172.21.15.33:0/524911318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180327d0 con 0x7f5e3006c710 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 -- 172.21.15.33:0/524911318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 msgr2=0x7f5e3006cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e3006cb60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009870 tx=0x7f5e1802a140 comp rx=0 tx=0).stop 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 -- 172.21.15.33:0/524911318 shutdown_connections 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e300b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 --2- 172.21.15.33:0/524911318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e3006cb60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 -- 172.21.15.33:0/524911318 >> 172.21.15.33:0/524911318 conn(0x7f5e30066290 msgr2=0x7f5e30069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 -- 172.21.15.33:0/524911318 shutdown_connections 2024-09-13T19:00:48.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.801+0000 7f5e36400640 1 -- 172.21.15.33:0/524911318 wait complete. 2024-09-13T19:00:48.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.803+0000 7f5e36400640 1 Processor -- start 2024-09-13T19:00:48.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.803+0000 7f5e36400640 1 -- start start 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e30070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3015a3d0 0x7f5e300ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301ec670 con 0x7f5e3006c710 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3015bad0 con 0x7f5e3015a3d0 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e36400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301f2c10 con 0x7f5e300b2080 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47218/0 (socket says 172.21.15.33:47218) 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2f400640 1 -- 172.21.15.33:0/59222470 learned_addr learned my addr 172.21.15.33:0/59222470 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:48.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e26a00640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e30070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2fe00640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3015a3d0 0x7f5e300ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2f400640 1 -- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 msgr2=0x7f5e30070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.804+0000 7f5e2f400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e30070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e2f400640 1 -- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3015a3d0 msgr2=0x7f5e300ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e2f400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3015a3d0 0x7f5e300ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e2f400640 1 -- 172.21.15.33:0/59222470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180094d0 con 0x7f5e3006c710 2024-09-13T19:00:48.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e2f400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c3e0 tx=0x7f5e2000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200074e0 con 0x7f5e3006c710 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20007640 con 0x7f5e3006c710 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e301f30a0 con 0x7f5e3006c710 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200049e0 con 0x7f5e3006c710 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.805+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e301f22e0 con 0x7f5e3006c710 2024-09-13T19:00:48.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.806+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e30067360 con 0x7f5e3006c710 2024-09-13T19:00:48.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.807+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e20004b40 con 0x7f5e3006c710 2024-09-13T19:00:48.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.808+0000 7f5e27e00640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 0x7f5e0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:48.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.808+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e20088dc0 con 0x7f5e3006c710 2024-09-13T19:00:48.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.808+0000 7f5e26a00640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 0x7f5e0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:48.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.809+0000 7f5e26a00640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 0x7f5e0c06d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:48.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.812+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5e20053f00 con 0x7f5e3006c710 2024-09-13T19:00:48.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.991+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e300b1990 con 0x7f5e3006c710 2024-09-13T19:00:48.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.992+0000 7f5e27e00640 1 -- 172.21.15.33:0/59222470 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e20057520 con 0x7f5e3006c710 2024-09-13T19:00:48.994 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 msgr2=0x7f5e0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 0x7f5e0c06d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 msgr2=0x7f5e30155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c3e0 tx=0x7f5e2000c8a0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 shutdown_connections 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e0c06ac00 0x7f5e0c06d0c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3015a3d0 0x7f5e300ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e300b2080 0x7f5e30070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 --2- 172.21.15.33:0/59222470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e3006c710 0x7f5e30155ff0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:48.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 >> 172.21.15.33:0/59222470 conn(0x7f5e30066290 msgr2=0x7f5e300cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:48.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 shutdown_connections 2024-09-13T19:00:48.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:48.994+0000 7f5e36400640 1 -- 172.21.15.33:0/59222470 wait complete. 2024-09-13T19:00:49.012 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.164+0000 7f017c400640 1 Processor -- start 2024-09-13T19:00:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.164+0000 7f017c400640 1 -- start start 2024-09-13T19:00:49.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.165+0000 7f017c400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 0x7f0174159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.165+0000 7f017c400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0174159fc0 con 0x7f0174153b20 2024-09-13T19:00:49.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.165+0000 7f017c400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0174153f00 con 0x7f017406f660 2024-09-13T19:00:49.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.165+0000 7f017c400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740b3df0 con 0x7f01740b3990 2024-09-13T19:00:49.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.165+0000 7f0179a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0174153b20 0x7f01740b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50998/0 (socket says 172.21.15.33:50998) 2024-09-13T19:00:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0179a00640 1 -- 172.21.15.33:0/2658026977 learned_addr learned my addr 172.21.15.33:0/2658026977 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0179000640 1 --2- 172.21.15.33:0/2658026977 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 0x7f0174159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316691638 0 0) 0x7f0174159fc0 con 0x7f0174153b20 2024-09-13T19:00:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c003520 con 0x7f0174153b20 2024-09-13T19:00:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0179000640 1 -- 172.21.15.33:0/2658026977 >> v1:172.21.15.103:6789/0 conn(0x7f017406f660 legacy=0x7f017406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746806093 0 0) 0x7f0174153f00 con 0x7f017406f660 2024-09-13T19:00:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0179000640 1 -- 172.21.15.33:0/2658026977 >> v1:172.21.15.33:6789/0 conn(0x7f0174153b20 legacy=0x7f01740b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.166+0000 7f0179000640 1 -- 172.21.15.33:0/2658026977 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740b1a40 con 0x7f01740b3990 2024-09-13T19:00:49.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.167+0000 7f0179000640 1 --2- 172.21.15.33:0/2658026977 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 0x7f0174159a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01600097d0 tx=0x7f016002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3bbb52b41fb0ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160032440 con 0x7f01740b3990 2024-09-13T19:00:49.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600325a0 con 0x7f01740b3990 2024-09-13T19:00:49.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f0173e00640 1 -- 172.21.15.33:0/2658026977 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160032930 con 0x7f01740b3990 2024-09-13T19:00:49.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 -- 172.21.15.33:0/2658026977 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 msgr2=0x7f0174159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 --2- 172.21.15.33:0/2658026977 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 0x7f0174159a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01600097d0 tx=0x7f016002a210 comp rx=0 tx=0).stop 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 -- 172.21.15.33:0/2658026977 shutdown_connections 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 --2- 172.21.15.33:0/2658026977 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01740b3990 0x7f0174159a80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 -- 172.21.15.33:0/2658026977 >> 172.21.15.33:0/2658026977 conn(0x7f01740b0510 msgr2=0x7f01740b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 -- 172.21.15.33:0/2658026977 shutdown_connections 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.168+0000 7f017c400640 1 -- 172.21.15.33:0/2658026977 wait complete. 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.170+0000 7f017c400640 1 Processor -- start 2024-09-13T19:00:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.170+0000 7f017c400640 1 -- start start 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01740b3990 0x7f017415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0174153b20 0x7f017415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01741f2530 con 0x7f017406f660 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01741f2810 con 0x7f01740b3990 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017c400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01741f2af0 con 0x7f0174153b20 2024-09-13T19:00:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f0179a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f0179a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47224/0 (socket says 172.21.15.33:47224) 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f0179a00640 1 -- 172.21.15.33:0/2201375486 learned_addr learned my addr 172.21.15.33:0/2201375486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f0179000640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01740b3990 0x7f017415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.171+0000 7f017a400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0174153b20 0x7f017415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 -- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0174153b20 msgr2=0x7f017415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0174153b20 0x7f017415c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 -- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01740b3990 msgr2=0x7f017415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01740b3990 0x7f017415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 -- 172.21.15.33:0/2201375486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160009400 con 0x7f017406f660 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0179a00640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f016800c430 tx=0x7f016800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168005ce0 con 0x7f017406f660 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168005e40 con 0x7f017406f660 2024-09-13T19:00:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680072f0 con 0x7f017406f660 2024-09-13T19:00:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01741f2dd0 con 0x7f017406f660 2024-09-13T19:00:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.172+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01741f2190 con 0x7f017406f660 2024-09-13T19:00:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.174+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017406faf0 con 0x7f017406f660 2024-09-13T19:00:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.174+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0168007450 con 0x7f017406f660 2024-09-13T19:00:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.175+0000 7f0171600640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 0x7f015406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.175+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0168088990 con 0x7f017406f660 2024-09-13T19:00:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.176+0000 7f0179000640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 0x7f015406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.176+0000 7f0179000640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 0x7f015406d0c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0160034000 tx=0x7f016002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.179+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0168053c10 con 0x7f017406f660 2024-09-13T19:00:49.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.394+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0174073630 con 0x7f017406f660 2024-09-13T19:00:49.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.395+0000 7f0171600640 1 -- 172.21.15.33:0/2201375486 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f0168017020 con 0x7f017406f660 2024-09-13T19:00:49.397 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:49.397 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:49.398 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:49.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 msgr2=0x7f015406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 0x7f015406d0c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0160034000 tx=0x7f016002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 msgr2=0x7f0174153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f016800c430 tx=0x7f016800c8f0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 shutdown_connections 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f015406ac00 0x7f015406d0c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0174153b20 0x7f017415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01740b3990 0x7f017415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 --2- 172.21.15.33:0/2201375486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f017406f660 0x7f0174153290 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 >> 172.21.15.33:0/2201375486 conn(0x7f01740b0510 msgr2=0x7f0174159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 shutdown_connections 2024-09-13T19:00:49.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.397+0000 7f017c400640 1 -- 172.21.15.33:0/2201375486 wait complete. 2024-09-13T19:00:49.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.569+0000 7fe5a3e00640 1 Processor -- start 2024-09-13T19:00:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.569+0000 7fe5a3e00640 1 -- start start 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a3e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40cd850 con 0x7fe5a4159480 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a3e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40cd570 con 0x7fe5a406f4b0 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40b1740 con 0x7fe5a4071560 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a2a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe5a4159480 0x7fe5a4070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51014/0 (socket says 172.21.15.33:51014) 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.570+0000 7fe5a2a00640 1 -- 172.21.15.33:0/3378712406 learned_addr learned my addr 172.21.15.33:0/3378712406 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe59a000640 1 --2- 172.21.15.33:0/3378712406 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581067160 0 0) 0x7fe5a40cd850 con 0x7fe5a4159480 2024-09-13T19:00:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe588003520 con 0x7fe5a4159480 2024-09-13T19:00:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174808020 0 0) 0x7fe5a40cd570 con 0x7fe5a406f4b0 2024-09-13T19:00:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a40cd850 con 0x7fe5a406f4b0 2024-09-13T19:00:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe59a000640 1 -- 172.21.15.33:0/3378712406 >> v1:172.21.15.103:6789/0 conn(0x7fe5a406f4b0 legacy=0x7fe5a40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe59a000640 1 -- 172.21.15.33:0/3378712406 >> v1:172.21.15.33:6789/0 conn(0x7fe5a4159480 legacy=0x7fe5a4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992654788 0 0) 0x7fe588003520 con 0x7fe5a4159480 2024-09-13T19:00:49.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.571+0000 7fe59a000640 1 -- 172.21.15.33:0/3378712406 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b1a20 con 0x7fe5a4071560 2024-09-13T19:00:49.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.572+0000 7fe59a000640 1 --2- 172.21.15.33:0/3378712406 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a40ccf90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097d0 tx=0x7fe58c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a831bf0c932758d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594001670 con 0x7fe5a4071560 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c02ab90 con 0x7fe5a4071560 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a2000640 1 -- 172.21.15.33:0/3378712406 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c032440 con 0x7fe5a4071560 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3378712406 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 msgr2=0x7fe5a40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3378712406 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a40ccf90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097d0 tx=0x7fe58c02a100 comp rx=0 tx=0).stop 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3378712406 shutdown_connections 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3378712406 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a40ccf90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3378712406 >> 172.21.15.33:0/3378712406 conn(0x7fe5a40ae310 msgr2=0x7fe5a40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3378712406 shutdown_connections 2024-09-13T19:00:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.573+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3378712406 wait complete. 2024-09-13T19:00:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.575+0000 7fe5a3e00640 1 Processor -- start 2024-09-13T19:00:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.575+0000 7fe5a3e00640 1 -- start start 2024-09-13T19:00:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a406f4b0 0x7fe5a414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a41509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4159e10 con 0x7fe5a4159480 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4151050 con 0x7fe5a406f4b0 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4151330 con 0x7fe5a4071560 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47226/0 (socket says 172.21.15.33:47226) 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a3400640 1 -- 172.21.15.33:0/3354211146 learned_addr learned my addr 172.21.15.33:0/3354211146 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe5a2a00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a406f4b0 0x7fe5a414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.576+0000 7fe59a000640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a41509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 -- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 msgr2=0x7fe5a41509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a41509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 -- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a406f4b0 msgr2=0x7fe5a414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a406f4b0 0x7fe5a414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 -- 172.21.15.33:0/3354211146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c009400 con 0x7fe5a4159480 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3400640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c7a0 tx=0x7fe59c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c003b70 con 0x7fe5a4159480 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c003cf0 con 0x7fe5a4159480 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00aa90 con 0x7fe5a4159480 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4151610 con 0x7fe5a4159480 2024-09-13T19:00:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.577+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a4151bd0 con 0x7fe5a4159480 2024-09-13T19:00:49.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.579+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4067360 con 0x7fe5a4159480 2024-09-13T19:00:49.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.580+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe59c00abf0 con 0x7fe5a4159480 2024-09-13T19:00:49.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.580+0000 7fe59b400640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.581+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe59c089190 con 0x7fe5a4159480 2024-09-13T19:00:49.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.581+0000 7fe5a2a00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.582+0000 7fe5a2a00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 0x7fe58006d0c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe5940019e0 tx=0x7fe594001970 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.585+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe59c0543a0 con 0x7fe5a4159480 2024-09-13T19:00:49.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.766+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a40667c0 con 0x7fe5a4159480 2024-09-13T19:00:49.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.768+0000 7fe59b400640 1 -- 172.21.15.33:0/3354211146 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7fe59c0579c0 con 0x7fe5a4159480 2024-09-13T19:00:49.770 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:49.770 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:49.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 msgr2=0x7fe58006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 0x7fe58006d0c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe5940019e0 tx=0x7fe594001970 comp rx=0 tx=0).stop 2024-09-13T19:00:49.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 msgr2=0x7fe5a41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c7a0 tx=0x7fe59c00cc60 comp rx=0 tx=0).stop 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 shutdown_connections 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe58006ac00 0x7fe58006d0c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5a4159480 0x7fe5a41598d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5a4071560 0x7fe5a41509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 --2- 172.21.15.33:0/3354211146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a406f4b0 0x7fe5a414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 >> 172.21.15.33:0/3354211146 conn(0x7fe5a40ae310 msgr2=0x7fe5a40b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 shutdown_connections 2024-09-13T19:00:49.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.770+0000 7fe5a3e00640 1 -- 172.21.15.33:0/3354211146 wait complete. 2024-09-13T19:00:49.788 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T19:00:49.789 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:49.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.943+0000 7f1eebe00640 1 Processor -- start 2024-09-13T19:00:49.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.943+0000 7f1eebe00640 1 -- start start 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1eebe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1ee40b3a40 0x7f1ee41428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1eebe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ee40ac870 0x7f1ee40acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1eebe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee413fbc0 con 0x7f1ee4160370 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1eebe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee406cca0 con 0x7f1ee40b3a40 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1eebe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee415ce80 con 0x7f1ee40ac870 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1ee9400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1ee40b3a40 0x7f1ee41428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1ee8a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1ee4160370 0x7f1ee40b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51030/0 (socket says 172.21.15.33:51030) 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1ee9400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1ee40b3a40 0x7f1ee41428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47240/0 (socket says 172.21.15.33:47240) 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.944+0000 7f1ee8a00640 1 -- 172.21.15.33:0/1138360896 learned_addr learned my addr 172.21.15.33:0/1138360896 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.945+0000 7f1ee9e00640 1 --2- 172.21.15.33:0/1138360896 >> v2:172.21.15.103:3300/0 conn(0x7f1ee40ac870 0x7f1ee40acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.945+0000 7f1ee9400640 1 -- 172.21.15.33:0/1138360896 >> v2:172.21.15.103:3300/0 conn(0x7f1ee40ac870 msgr2=0x7f1ee40acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.945+0000 7f1ee9400640 1 --2- 172.21.15.33:0/1138360896 >> v2:172.21.15.103:3300/0 conn(0x7f1ee40ac870 0x7f1ee40acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.945+0000 7f1ee9400640 1 -- 172.21.15.33:0/1138360896 >> v1:172.21.15.33:6789/0 conn(0x7f1ee4160370 legacy=0x7f1ee40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.945+0000 7f1ee9400640 1 -- 172.21.15.33:0/1138360896 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40ad1c0 con 0x7f1ee40b3a40 2024-09-13T19:00:49.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.946+0000 7f1ee9400640 1 --2- 172.21.15.33:0/1138360896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee40b3a40 0x7f1ee41428a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1ee406f5f0 tx=0x7f1ed802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ab5e196ab0f932 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.946+0000 7f1ee3e00640 1 -- 172.21.15.33:0/1138360896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed802add0 con 0x7f1ee40b3a40 2024-09-13T19:00:49.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.946+0000 7f1ee3e00640 1 -- 172.21.15.33:0/1138360896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed8032440 con 0x7f1ee40b3a40 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.946+0000 7f1ee3e00640 1 -- 172.21.15.33:0/1138360896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80327d0 con 0x7f1ee40b3a40 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 -- 172.21.15.33:0/1138360896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee40b3a40 msgr2=0x7f1ee41428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1138360896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee40b3a40 0x7f1ee41428a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1ee406f5f0 tx=0x7f1ed802a080 comp rx=0 tx=0).stop 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 -- 172.21.15.33:0/1138360896 shutdown_connections 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1138360896 >> v2:172.21.15.103:3300/0 conn(0x7f1ee40ac870 0x7f1ee40acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1138360896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee40b3a40 0x7f1ee41428a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 -- 172.21.15.33:0/1138360896 >> 172.21.15.33:0/1138360896 conn(0x7f1ee40b0510 msgr2=0x7f1ee40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 -- 172.21.15.33:0/1138360896 shutdown_connections 2024-09-13T19:00:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.947+0000 7f1eebe00640 1 -- 172.21.15.33:0/1138360896 wait complete. 2024-09-13T19:00:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.948+0000 7f1eebe00640 1 Processor -- start 2024-09-13T19:00:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.948+0000 7f1eebe00640 1 -- start start 2024-09-13T19:00:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee40ac870 0x7f1ee4144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1ee40b3a40 0x7f1ee413e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee413edf0 con 0x7f1ee4160370 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4153ea0 con 0x7f1ee40ac870 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.949+0000 7f1eebe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4145040 con 0x7f1ee40b3a40 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47246/0 (socket says 172.21.15.33:47246) 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 -- 172.21.15.33:0/1660944438 learned_addr learned my addr 172.21.15.33:0/1660944438 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9400640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee40ac870 0x7f1ee4144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee8a00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1ee40b3a40 0x7f1ee413e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 -- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1ee40b3a40 msgr2=0x7f1ee413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1ee40b3a40 0x7f1ee413e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 -- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee40ac870 msgr2=0x7f1ee4144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee40ac870 0x7f1ee4144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 -- 172.21.15.33:0/1660944438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8009400 con 0x7f1ee4160370 2024-09-13T19:00:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.950+0000 7f1ee9e00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007e40 tx=0x7f1edc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.951+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc014620 con 0x7f1ee4160370 2024-09-13T19:00:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.951+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc00ee90 con 0x7f1ee4160370 2024-09-13T19:00:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.951+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee413e830 con 0x7f1ee4160370 2024-09-13T19:00:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.951+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0149e0 con 0x7f1ee4160370 2024-09-13T19:00:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.951+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee41540f0 con 0x7f1ee4160370 2024-09-13T19:00:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.952+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee41611b0 con 0x7f1ee4160370 2024-09-13T19:00:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.953+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1edc014b40 con 0x7f1ee4160370 2024-09-13T19:00:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.954+0000 7f1ee1600640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 0x7f1ec406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.954+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1edc089bc0 con 0x7f1ee4160370 2024-09-13T19:00:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.954+0000 7f1ee9400640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 0x7f1ec406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.955+0000 7f1ee9400640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 0x7f1ec406d0c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8034000 tx=0x7f1ed802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:49.958+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1edc054e40 con 0x7f1ee4160370 2024-09-13T19:00:50.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.171+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ee40ce4d0 con 0x7f1ee4160370 2024-09-13T19:00:50.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.172+0000 7f1ee1600640 1 -- 172.21.15.33:0/1660944438 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f1edc058460 con 0x7f1ee4160370 2024-09-13T19:00:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:50.174 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:50.175 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 msgr2=0x7f1ec406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 0x7f1ec406d0c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8034000 tx=0x7f1ed802e000 comp rx=0 tx=0).stop 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 msgr2=0x7f1ee4141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007e40 tx=0x7f1edc00e4b0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 shutdown_connections 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1ec406ac00 0x7f1ec406d0c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ee4160370 0x7f1ee4141f20 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1ee40b3a40 0x7f1ee413e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 --2- 172.21.15.33:0/1660944438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee40ac870 0x7f1ee4144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.174+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 >> 172.21.15.33:0/1660944438 conn(0x7f1ee40b0510 msgr2=0x7f1ee4071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.175+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 shutdown_connections 2024-09-13T19:00:50.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.175+0000 7f1eebe00640 1 -- 172.21.15.33:0/1660944438 wait complete. 2024-09-13T19:00:50.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.348+0000 7fdb08600640 1 Processor -- start 2024-09-13T19:00:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.348+0000 7fdb08600640 1 -- start start 2024-09-13T19:00:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.349+0000 7fdb08600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.349+0000 7fdb08600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 0x7fdb000acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.349+0000 7fdb08600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0013fbc0 con 0x7fdb00160370 2024-09-13T19:00:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.349+0000 7fdb08600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0006cca0 con 0x7fdb000ac870 2024-09-13T19:00:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.349+0000 7fdb08600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000ad220 con 0x7fdb000b3a40 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb06600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 0x7fdb000acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:55000/0 (socket says 172.21.15.33:55000) 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 -- 172.21.15.33:0/749653677 learned_addr learned my addr 172.21.15.33:0/749653677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 -- 172.21.15.33:0/749653677 >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 msgr2=0x7fdb000acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 --2- 172.21.15.33:0/749653677 >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 0x7fdb000acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 -- 172.21.15.33:0/749653677 >> v1:172.21.15.103:6789/0 conn(0x7fdb00160370 legacy=0x7fdb000b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb05c00640 1 -- 172.21.15.33:0/749653677 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0015ce80 con 0x7fdb000b3a40 2024-09-13T19:00:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.350+0000 7fdb06600640 1 --2- 172.21.15.33:0/749653677 >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 0x7fdb000acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:50.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.351+0000 7fdb05c00640 1 --2- 172.21.15.33:0/749653677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009870 tx=0x7fdaf402a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4650ed7b3cebe547 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdaffe00640 1 -- 172.21.15.33:0/749653677 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032440 con 0x7fdb000b3a40 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdaffe00640 1 -- 172.21.15.33:0/749653677 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40325a0 con 0x7fdb000b3a40 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdaffe00640 1 -- 172.21.15.33:0/749653677 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032930 con 0x7fdb000b3a40 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 -- 172.21.15.33:0/749653677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 msgr2=0x7fdb001428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 --2- 172.21.15.33:0/749653677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009870 tx=0x7fdaf402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 -- 172.21.15.33:0/749653677 shutdown_connections 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 --2- 172.21.15.33:0/749653677 >> v2:172.21.15.103:3300/0 conn(0x7fdb000ac870 0x7fdb000acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 --2- 172.21.15.33:0/749653677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001428a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 -- 172.21.15.33:0/749653677 >> 172.21.15.33:0/749653677 conn(0x7fdb000b0510 msgr2=0x7fdb000b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:50.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 -- 172.21.15.33:0/749653677 shutdown_connections 2024-09-13T19:00:50.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.352+0000 7fdb08600640 1 -- 172.21.15.33:0/749653677 wait complete. 2024-09-13T19:00:50.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.354+0000 7fdb08600640 1 Processor -- start 2024-09-13T19:00:50.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.354+0000 7fdb08600640 1 -- start start 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb000ac870 0x7fdb001f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb001f2c40 con 0x7fdb00160370 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00144160 con 0x7fdb000ac870 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb08600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb00144400 con 0x7fdb000b3a40 2024-09-13T19:00:50.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb06600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb06600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47250/0 (socket says 172.21.15.33:47250) 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb05c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb000ac870 0x7fdb001f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb06600640 1 -- 172.21.15.33:0/2541530253 learned_addr learned my addr 172.21.15.33:0/2541530253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.355+0000 7fdb05200640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 -- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 msgr2=0x7fdb001e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 -- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb000ac870 msgr2=0x7fdb001f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb000ac870 0x7fdb001f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 -- 172.21.15.33:0/2541530253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009a70 con 0x7fdb00160370 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb06600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800efc0 tx=0x7fdaf8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8009d70 con 0x7fdb00160370 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800f040 con 0x7fdb00160370 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8003990 con 0x7fdb00160370 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40094d0 con 0x7fdb00160370 2024-09-13T19:00:50.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.356+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb001449c0 con 0x7fdb00160370 2024-09-13T19:00:50.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.357+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb001611b0 con 0x7fdb00160370 2024-09-13T19:00:50.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.358+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdaf80144a0 con 0x7fdb00160370 2024-09-13T19:00:50.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.360+0000 7fdafd600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 0x7fdae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.360+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf8089f20 con 0x7fdb00160370 2024-09-13T19:00:50.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.360+0000 7fdb05c00640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 0x7fdae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.361+0000 7fdb05c00640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 0x7fdae006d0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009870 tx=0x7fdaf402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.364+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdaf8055110 con 0x7fdb00160370 2024-09-13T19:00:50.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.578+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb000ce4d0 con 0x7fdb00160370 2024-09-13T19:00:50.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.579+0000 7fdafd600640 1 -- 172.21.15.33:0/2541530253 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4730 (secure 0 0 0) 0x7fdaf8018090 con 0x7fdb00160370 2024-09-13T19:00:50.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:50.581 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:00:28.783151+0000","modified":"2024-09-13T19:00:31.806100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6735},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6735":{"gid":6735,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/198206524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":198206524},{"type":"v1","addr":"172.21.15.33:6834","nonce":198206524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T19:00:50.582 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 47 2024-09-13T19:00:50.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 msgr2=0x7fdae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 0x7fdae006d0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009870 tx=0x7fdaf402e000 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 msgr2=0x7fdb0013e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800efc0 tx=0x7fdaf8009f90 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 shutdown_connections 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdae006ac00 0x7fdae006d0c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb00160370 0x7fdb0013e760 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdb000b3a40 0x7fdb001e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 --2- 172.21.15.33:0/2541530253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb000ac870 0x7fdb001f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 >> 172.21.15.33:0/2541530253 conn(0x7fdb000b0510 msgr2=0x7fdb000aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 shutdown_connections 2024-09-13T19:00:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.581+0000 7fdb08600640 1 -- 172.21.15.33:0/2541530253 wait complete. 2024-09-13T19:00:50.600 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:50.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.752+0000 7fec12600640 1 Processor -- start 2024-09-13T19:00:50.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.752+0000 7fec12600640 1 -- start start 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.753+0000 7fec12600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec0c0b1e40 0x7fec0c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec12600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c15a430 con 0x7fec0c0b2220 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec12600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c1598b0 con 0x7fec0c0b32d0 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec12600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c159b90 con 0x7fec0c0b1e40 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec0c0b1e40 0x7fec0c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fec0c0b2220 0x7fec0c0b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51038/0 (socket says 172.21.15.33:51038) 2024-09-13T19:00:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0aa00640 1 -- 172.21.15.33:0/2559482731 learned_addr learned my addr 172.21.15.33:0/2559482731 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0b400640 1 -- 172.21.15.33:0/2559482731 >> v1:172.21.15.103:6789/0 conn(0x7fec0c0b32d0 legacy=0x7fec0c070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0a000640 1 -- 172.21.15.33:0/2559482731 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246836022 0 0) 0x7fec0c15a430 con 0x7fec0c0b2220 2024-09-13T19:00:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0b400640 1 -- 172.21.15.33:0/2559482731 >> v1:172.21.15.33:6789/0 conn(0x7fec0c0b2220 legacy=0x7fec0c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.754+0000 7fec0b400640 1 -- 172.21.15.33:0/2559482731 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c159e70 con 0x7fec0c0b1e40 2024-09-13T19:00:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.755+0000 7fec0b400640 1 --2- 172.21.15.33:0/2559482731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b1e40 0x7fec0c159210 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7febfc0097a0 tx=0x7febfc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942edb18cfab83c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec0a000640 1 -- 172.21.15.33:0/2559482731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc032440 con 0x7fec0c0b1e40 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec0a000640 1 -- 172.21.15.33:0/2559482731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc0325a0 con 0x7fec0c0b1e40 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec0a000640 1 -- 172.21.15.33:0/2559482731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc032930 con 0x7fec0c0b1e40 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 -- 172.21.15.33:0/2559482731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b1e40 msgr2=0x7fec0c159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 --2- 172.21.15.33:0/2559482731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b1e40 0x7fec0c159210 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7febfc0097a0 tx=0x7febfc02a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 -- 172.21.15.33:0/2559482731 shutdown_connections 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 --2- 172.21.15.33:0/2559482731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b1e40 0x7fec0c159210 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 -- 172.21.15.33:0/2559482731 >> 172.21.15.33:0/2559482731 conn(0x7fec0c0b0510 msgr2=0x7fec0c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 -- 172.21.15.33:0/2559482731 shutdown_connections 2024-09-13T19:00:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.756+0000 7fec12600640 1 -- 172.21.15.33:0/2559482731 wait complete. 2024-09-13T19:00:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.758+0000 7fec12600640 1 Processor -- start 2024-09-13T19:00:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.758+0000 7fec12600640 1 -- start start 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec0c0b1e40 0x7fec0c13ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0c0b32d0 0x7fec0c13df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13cf50 con 0x7fec0c0b2220 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13d1a0 con 0x7fec0c0b32d0 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec12600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13d480 con 0x7fec0c0b1e40 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec0aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec0aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47256/0 (socket says 172.21.15.33:47256) 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec0aa00640 1 -- 172.21.15.33:0/115589032 learned_addr learned my addr 172.21.15.33:0/115589032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec0b400640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec0c0b1e40 0x7fec0c13ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.759+0000 7fec0be00640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0c0b32d0 0x7fec0c13df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 -- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec0c0b1e40 msgr2=0x7fec0c13ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec0c0b1e40 0x7fec0c13ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 -- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0c0b32d0 msgr2=0x7fec0c13df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0c0b32d0 0x7fec0c13df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 -- 172.21.15.33:0/115589032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009400 con 0x7fec0c0b2220 2024-09-13T19:00:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec0aa00640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7febf800c4a0 tx=0x7febf800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80074e0 con 0x7fec0c0b2220 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8007640 con 0x7fec0c0b2220 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8004a00 con 0x7fec0c0b2220 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c13d760 con 0x7fec0c0b2220 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.760+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0adcb0 con 0x7fec0c0b2220 2024-09-13T19:00:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.761+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c0cc620 con 0x7fec0c0b2220 2024-09-13T19:00:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.762+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febf8004b60 con 0x7fec0c0b2220 2024-09-13T19:00:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.763+0000 7fec03400640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 0x7febec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.763+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febf8088460 con 0x7fec0c0b2220 2024-09-13T19:00:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.764+0000 7fec0b400640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 0x7febec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.764+0000 7fec0b400640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 0x7febec06d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7febfc034000 tx=0x7febfc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:50.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.768+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7febf80536f0 con 0x7fec0c0b2220 2024-09-13T19:00:50.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.949+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec0c0adea0 con 0x7fec0c0b2220 2024-09-13T19:00:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.950+0000 7fec03400640 1 -- 172.21.15.33:0/115589032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16560 (secure 0 0 0) 0x7febf8056d10 con 0x7fec0c0b2220 2024-09-13T19:00:50.953 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:50.953 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:29.785802+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:00:26.699583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T19:00:27.780305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 msgr2=0x7febec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 0x7febec06d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7febfc034000 tx=0x7febfc02e000 comp rx=0 tx=0).stop 2024-09-13T19:00:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 msgr2=0x7fec0c140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7febf800c4a0 tx=0x7febf800c960 comp rx=0 tx=0).stop 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 shutdown_connections 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7febec06ac00 0x7febec06d0c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec0c0b32d0 0x7fec0c13df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec0c0b2220 0x7fec0c140500 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 --2- 172.21.15.33:0/115589032 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec0c0b1e40 0x7fec0c13ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 >> 172.21.15.33:0/115589032 conn(0x7fec0c0b0510 msgr2=0x7fec0c0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 shutdown_connections 2024-09-13T19:00:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:50.952+0000 7fec12600640 1 -- 172.21.15.33:0/115589032 wait complete. 2024-09-13T19:00:50.973 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T19:00:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.127+0000 7f82f6a00640 1 Processor -- start 2024-09-13T19:00:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.127+0000 7f82f6a00640 1 -- start start 2024-09-13T19:00:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.128+0000 7f82f6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.128+0000 7f82f6a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82f006a410 0x7f82f0070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.128+0000 7f82f6a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f00cb8d0 con 0x7f82f015dc30 2024-09-13T19:00:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.128+0000 7f82f6a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f006a8c0 con 0x7f82f006a410 2024-09-13T19:00:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.128+0000 7f82f6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f015e010 con 0x7f82f00cb3d0 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82f006a410 0x7f82f0070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82f006a410 0x7f82f0070430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47258/0 (socket says 172.21.15.33:47258) 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 -- 172.21.15.33:0/3295695134 learned_addr learned my addr 172.21.15.33:0/3295695134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f4c00640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 -- 172.21.15.33:0/3295695134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 msgr2=0x7f82f0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 -- 172.21.15.33:0/3295695134 >> v1:172.21.15.103:6789/0 conn(0x7f82f015dc30 legacy=0x7f82f00cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.129+0000 7f82f6000640 1 -- 172.21.15.33:0/3295695134 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00cbbb0 con 0x7f82f006a410 2024-09-13T19:00:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.130+0000 7f82f6000640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f006a410 0x7f82f0070430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009e80 tx=0x7f82e802a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33f590dfae55139 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.130+0000 7f82efe00640 1 -- 172.21.15.33:0/3295695134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8031600 con 0x7f82f006a410 2024-09-13T19:00:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.130+0000 7f82efe00640 1 -- 172.21.15.33:0/3295695134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e802d050 con 0x7f82f006a410 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.130+0000 7f82efe00640 1 -- 172.21.15.33:0/3295695134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8031980 con 0x7f82f006a410 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 -- 172.21.15.33:0/3295695134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f006a410 msgr2=0x7f82f0070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f006a410 0x7f82f0070430 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009e80 tx=0x7f82e802a740 comp rx=0 tx=0).stop 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 -- 172.21.15.33:0/3295695134 shutdown_connections 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f006a410 0x7f82f0070430 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 --2- 172.21.15.33:0/3295695134 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 -- 172.21.15.33:0/3295695134 >> 172.21.15.33:0/3295695134 conn(0x7f82f00affd0 msgr2=0x7f82f00b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 -- 172.21.15.33:0/3295695134 shutdown_connections 2024-09-13T19:00:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.131+0000 7f82f6a00640 1 -- 172.21.15.33:0/3295695134 wait complete. 2024-09-13T19:00:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.133+0000 7f82f6a00640 1 Processor -- start 2024-09-13T19:00:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.133+0000 7f82f6a00640 1 -- start start 2024-09-13T19:00:51.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82f006a410 0x7f82f01f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00aa700 con 0x7f82f015dc30 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00abac0 con 0x7f82f006a410 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c76f0 con 0x7f82f00cb3d0 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47270/0 (socket says 172.21.15.33:47270) 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 -- 172.21.15.33:0/1778920441 learned_addr learned my addr 172.21.15.33:0/1778920441 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f4c00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f5600640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82f006a410 0x7f82f01f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 -- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 msgr2=0x7f82f0150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 -- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82f006a410 msgr2=0x7f82f01f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82f006a410 0x7f82f01f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.134+0000 7f82f6000640 1 -- 172.21.15.33:0/1778920441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8009b30 con 0x7f82f015dc30 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82f6000640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009fa0 tx=0x7f82e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e803b810 con 0x7f82f015dc30 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e803b990 con 0x7f82f015dc30 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e803bd40 con 0x7f82f015dc30 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00c9df0 con 0x7f82f015dc30 2024-09-13T19:00:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.135+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00ca0b0 con 0x7f82f015dc30 2024-09-13T19:00:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.136+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f0067320 con 0x7f82f015dc30 2024-09-13T19:00:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.137+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82e803a3a0 con 0x7f82f015dc30 2024-09-13T19:00:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.138+0000 7f82ed600640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 0x7f82d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.138+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82e80a9df0 con 0x7f82f015dc30 2024-09-13T19:00:51.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.138+0000 7f82f5600640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 0x7f82d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.139+0000 7f82f5600640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 0x7f82d006d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f82e4000f60 tx=0x7f82e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.142+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f82e8075070 con 0x7f82f015dc30 2024-09-13T19:00:51.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.361+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f82f0070430 con 0x7f82f015dc30 2024-09-13T19:00:51.364 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T19:00:51.362+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T19:00:51.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.373+0000 7f82ed600640 1 -- 172.21.15.33:0/1778920441 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f82e8009510 con 0x7f82f015dc30 2024-09-13T19:00:51.376 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T19:00:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 msgr2=0x7f82d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 0x7f82d006d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f82e4000f60 tx=0x7f82e4009040 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 msgr2=0x7f82f00aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009fa0 tx=0x7f82e8004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 shutdown_connections 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f82d006ac00 0x7f82d006d0c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82f015dc30 0x7f82f00aef50 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f82f00cb3d0 0x7f82f0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 --2- 172.21.15.33:0/1778920441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82f006a410 0x7f82f01f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 >> 172.21.15.33:0/1778920441 conn(0x7f82f00affd0 msgr2=0x7f82f00ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 shutdown_connections 2024-09-13T19:00:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.376+0000 7f82f6a00640 1 -- 172.21.15.33:0/1778920441 wait complete. 2024-09-13T19:00:51.384 INFO:tasks.ceph.mds.c.smithi033.stderr: -3169> 2024-09-13T19:00:34.337+0000 7f188a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T19:00:51.394 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T19:00:51.431 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T19:00:51.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.550+0000 7ff2a7400640 1 Processor -- start 2024-09-13T19:00:51.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.550+0000 7ff2a7400640 1 -- start start 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.551+0000 7ff2a7400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 0x7ff2a0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.551+0000 7ff2a7400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2a006f660 0x7ff2a006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.551+0000 7ff2a7400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a0159fc0 con 0x7ff2a0153b20 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.551+0000 7ff2a7400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00b3df0 con 0x7ff2a006f660 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.551+0000 7ff2a7400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00ce600 con 0x7ff2a00b3990 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff2a4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff2a0153b20 0x7ff2a00b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51044/0 (socket says 172.21.15.33:51044) 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff2a4a00640 1 -- 172.21.15.33:0/2258108046 learned_addr learned my addr 172.21.15.33:0/2258108046 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff297e00640 1 --2- 172.21.15.33:0/2258108046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 0x7ff2a0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff2a5400640 1 --2- 172.21.15.33:0/2258108046 >> v2:172.21.15.103:3300/0 conn(0x7ff2a006f660 0x7ff2a006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff29fe00640 1 -- 172.21.15.33:0/2258108046 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496479623 0 0) 0x7ff2a0159fc0 con 0x7ff2a0153b20 2024-09-13T19:00:51.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff29fe00640 1 -- 172.21.15.33:0/2258108046 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff284003520 con 0x7ff2a0153b20 2024-09-13T19:00:51.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff297e00640 1 -- 172.21.15.33:0/2258108046 >> v2:172.21.15.103:3300/0 conn(0x7ff2a006f660 msgr2=0x7ff2a006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:51.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff297e00640 1 --2- 172.21.15.33:0/2258108046 >> v2:172.21.15.103:3300/0 conn(0x7ff2a006f660 0x7ff2a006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff297e00640 1 -- 172.21.15.33:0/2258108046 >> v1:172.21.15.33:6789/0 conn(0x7ff2a0153b20 legacy=0x7ff2a00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.552+0000 7ff297e00640 1 -- 172.21.15.33:0/2258108046 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0153f00 con 0x7ff2a00b3990 2024-09-13T19:00:51.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.553+0000 7ff297e00640 1 --2- 172.21.15.33:0/2258108046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 0x7ff2a0159a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2880097a0 tx=0x7ff28802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e51303aaf44f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff29fe00640 1 -- 172.21.15.33:0/2258108046 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288032440 con 0x7ff2a00b3990 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff29fe00640 1 -- 172.21.15.33:0/2258108046 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2880325a0 con 0x7ff2a00b3990 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff29fe00640 1 -- 172.21.15.33:0/2258108046 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288032930 con 0x7ff2a00b3990 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 -- 172.21.15.33:0/2258108046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 msgr2=0x7ff2a0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2258108046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 0x7ff2a0159a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2880097a0 tx=0x7ff28802a180 comp rx=0 tx=0).stop 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 -- 172.21.15.33:0/2258108046 shutdown_connections 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2258108046 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a00b3990 0x7ff2a0159a80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2258108046 >> v2:172.21.15.103:3300/0 conn(0x7ff2a006f660 0x7ff2a006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 -- 172.21.15.33:0/2258108046 >> 172.21.15.33:0/2258108046 conn(0x7ff2a00b0510 msgr2=0x7ff2a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 -- 172.21.15.33:0/2258108046 shutdown_connections 2024-09-13T19:00:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.554+0000 7ff2a7400640 1 -- 172.21.15.33:0/2258108046 wait complete. 2024-09-13T19:00:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.556+0000 7ff2a7400640 1 Processor -- start 2024-09-13T19:00:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.556+0000 7ff2a7400640 1 -- start start 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a006f660 0x7ff2a015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a0153b20 0x7ff2a014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a014c3d0 con 0x7ff2a00b3990 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a014cc70 con 0x7ff2a006f660 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a7400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a015ca40 con 0x7ff2a0153b20 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff297e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff297e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47308/0 (socket says 172.21.15.33:47308) 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff297e00640 1 -- 172.21.15.33:0/2443441833 learned_addr learned my addr 172.21.15.33:0/2443441833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a4a00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a006f660 0x7ff2a015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.557+0000 7ff2a5400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a0153b20 0x7ff2a014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 -- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a0153b20 msgr2=0x7ff2a014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a0153b20 0x7ff2a014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 -- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a006f660 msgr2=0x7ff2a015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:51.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a006f660 0x7ff2a015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:51.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 -- 172.21.15.33:0/2443441833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009400 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff297e00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff28802a770 tx=0x7ff2880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28803d8f0 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28803da70 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28803de20 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a015b040 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.558+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a014c900 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.559+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a015a7b0 con 0x7ff2a00b3990 2024-09-13T19:00:51.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.560+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff288039040 con 0x7ff2a00b3990 2024-09-13T19:00:51.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.561+0000 7ff29d600640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 0x7ff27c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:51.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.561+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2880a9a90 con 0x7ff2a00b3990 2024-09-13T19:00:51.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.562+0000 7ff2a4a00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 0x7ff27c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:51.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.562+0000 7ff2a4a00640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 0x7ff27c06d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff2900011e0 tx=0x7ff290007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:51.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.565+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff288074c20 con 0x7ff2a00b3990 2024-09-13T19:00:51.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:51.782+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff2a00cdb50 con 0x7ff2a00b3990 2024-09-13T19:00:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.375+0000 7ff29d600640 1 -- 172.21.15.33:0/2443441833 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff288078240 con 0x7ff2a00b3990 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 msgr2=0x7ff27c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 0x7ff27c06d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff2900011e0 tx=0x7ff290007d30 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 msgr2=0x7ff2a0141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff28802a770 tx=0x7ff2880046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 shutdown_connections 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff27c06ac00 0x7ff27c06d0c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2a0153b20 0x7ff2a014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a00b3990 0x7ff2a0141170 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 --2- 172.21.15.33:0/2443441833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a006f660 0x7ff2a015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 >> 172.21.15.33:0/2443441833 conn(0x7ff2a00b0510 msgr2=0x7ff2a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 shutdown_connections 2024-09-13T19:00:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.378+0000 7ff2a7400640 1 -- 172.21.15.33:0/2443441833 wait complete. 2024-09-13T19:00:52.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T19:00:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.595+0000 7f44b5e00640 1 Processor -- start 2024-09-13T19:00:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.596+0000 7f44b5e00640 1 -- start start 2024-09-13T19:00:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b5e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f44b006f800 0x7f44b00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b5e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00cc940 con 0x7f44b006ffc0 2024-09-13T19:00:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b5e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b015e350 con 0x7f44b00703a0 2024-09-13T19:00:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b5e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b006cc20 con 0x7f44b006f800 2024-09-13T19:00:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f44b006ffc0 0x7f44b015d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51054/0 (socket says 172.21.15.33:51054) 2024-09-13T19:00:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44b4a00640 1 -- 172.21.15.33:0/1345652679 learned_addr learned my addr 172.21.15.33:0/1345652679 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.597+0000 7f44a7e00640 1 --2- 172.21.15.33:0/1345652679 >> v2:172.21.15.103:3300/0 conn(0x7f44b006f800 0x7f44b00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466654021 0 0) 0x7f44b00cc940 con 0x7f44b006ffc0 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494003520 con 0x7f44b006ffc0 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687657204 0 0) 0x7f4494003520 con 0x7f44b006ffc0 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 >> v2:172.21.15.103:3300/0 conn(0x7f44b006f800 msgr2=0x7f44b00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 --2- 172.21.15.33:0/1345652679 >> v2:172.21.15.103:3300/0 conn(0x7f44b006f800 0x7f44b00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 >> v1:172.21.15.103:6789/0 conn(0x7f44b00703a0 legacy=0x7f44b015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b006cf00 con 0x7f44b006ffc0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f44a0001670 con 0x7f44b006ffc0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 >> v1:172.21.15.33:6789/0 conn(0x7f44b006ffc0 legacy=0x7f44b015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44940039c0 0x7f4494003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 0x7f4494004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940051d0 0x7f449400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b006cc20 con 0x7f44940047c0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449400c120 con 0x7f44940039c0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449400c2e0 con 0x7f44940051d0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.598+0000 7f44a7e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 0x7f4494004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44b4a00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44940039c0 0x7f4494003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44b5400640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940051d0 0x7f449400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44a7e00640 1 -- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940051d0 msgr2=0x7f449400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44a7e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940051d0 0x7f449400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44a7e00640 1 -- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44940039c0 msgr2=0x7f4494003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44a7e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44940039c0 0x7f4494003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44a7e00640 1 -- 172.21.15.33:0/1345652679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494003520 con 0x7f44940047c0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44b5400640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940051d0 0x7f449400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.599+0000 7f44b5400640 1 -- 172.21.15.33:0/1345652679 reap_dead start 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.600+0000 7f44a7e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 0x7f4494004c40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4498009a90 tx=0x7f44940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e912f73393fe9099 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.600+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498031400 con 0x7f44940047c0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.600+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449802d050 con 0x7f44940047c0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.600+0000 7f44afe00640 1 -- 172.21.15.33:0/1345652679 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498031780 con 0x7f44940047c0 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 -- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 msgr2=0x7f4494004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 0x7f4494004c40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4498009a90 tx=0x7f44940057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 -- 172.21.15.33:0/1345652679 shutdown_connections 2024-09-13T19:00:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 --2- 172.21.15.33:0/1345652679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44940047c0 0x7f4494004c40 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 -- 172.21.15.33:0/1345652679 >> 172.21.15.33:0/1345652679 conn(0x7f44b00b0300 msgr2=0x7f44b00b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 -- 172.21.15.33:0/1345652679 shutdown_connections 2024-09-13T19:00:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.601+0000 7f44b5e00640 1 -- 172.21.15.33:0/1345652679 wait complete. 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.602+0000 7f44b5e00640 1 Processor -- start 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.603+0000 7f44b5e00640 1 -- start start 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.603+0000 7f44b5e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940047c0 0x7f44b01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.603+0000 7f44b5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 0x7f44b01f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b01f1d90 con 0x7f44b015c4b0 2024-09-13T19:00:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b015d350 con 0x7f44b0159ca0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b015cd90 con 0x7f44940047c0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47316/0 (socket says 172.21.15.33:47316) 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 -- 172.21.15.33:0/3842207675 learned_addr learned my addr 172.21.15.33:0/3842207675 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44a7e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 0x7f44b01f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b4a00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940047c0 0x7f44b01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 -- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940047c0 msgr2=0x7f44b01516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940047c0 0x7f44b01516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 -- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 msgr2=0x7f44b01f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 0x7f44b01f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44b5400640 1 -- 172.21.15.33:0/3842207675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b015d070 con 0x7f44b015c4b0 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.604+0000 7f44a7e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 0x7f44b01f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44b5400640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f44b0070780 tx=0x7f44a800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800eed0 con 0x7f44b015c4b0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8003970 con 0x7f44b015c4b0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b01f1fa0 con 0x7f44b015c4b0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8003d20 con 0x7f44b015c4b0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.605+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b01f2ce0 con 0x7f44b015c4b0 2024-09-13T19:00:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.606+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b01f24c0 con 0x7f44b015c4b0 2024-09-13T19:00:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.607+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44a80050d0 con 0x7f44b015c4b0 2024-09-13T19:00:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.608+0000 7f44ad600640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 0x7f448c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.608+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f44a8088ec0 con 0x7f44b015c4b0 2024-09-13T19:00:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.608+0000 7f44b4a00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 0x7f448c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:52.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.609+0000 7f44b4a00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 0x7f448c06d0c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44a0001050 tx=0x7f44a0000f80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.612+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f44b01f24c0 con 0x7f44b015c4b0 2024-09-13T19:00:52.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:52.789+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44b01f24c0 con 0x7f44b015c4b0 2024-09-13T19:00:53.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.380+0000 7f44ad600640 1 -- 172.21.15.33:0/3842207675 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44b01f24c0 con 0x7f44b015c4b0 2024-09-13T19:00:53.384 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T19:00:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 msgr2=0x7f448c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 0x7f448c06d0c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44a0001050 tx=0x7f44a0000f80 comp rx=0 tx=0).stop 2024-09-13T19:00:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 msgr2=0x7f44b015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f44b0070780 tx=0x7f44a800eb90 comp rx=0 tx=0).stop 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 shutdown_connections 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f448c06ac00 0x7f448c06d0c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b015c4b0 0x7f44b015a590 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44b0159ca0 0x7f44b01f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 --2- 172.21.15.33:0/3842207675 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44940047c0 0x7f44b01516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 >> 172.21.15.33:0/3842207675 conn(0x7f44b00b0300 msgr2=0x7f44b00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 shutdown_connections 2024-09-13T19:00:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.384+0000 7f44b5e00640 1 -- 172.21.15.33:0/3842207675 wait complete. 2024-09-13T19:00:53.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T19:00:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.563+0000 7f6d38200640 1 Processor -- start 2024-09-13T19:00:53.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.563+0000 7f6d38200640 1 -- start start 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.564+0000 7f6d38200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6d3006cd60 0x7f6d300b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d38200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d30151a20 con 0x7f6d300cd870 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d38200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300cc430 con 0x7f6d3015b770 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d38200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d300b1bb0 con 0x7f6d3006cd60 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d36200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6d300cd870 0x7f6d300cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57086/0 (socket says 172.21.15.33:57086) 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d36200640 1 -- 172.21.15.33:0/4290936796 learned_addr learned my addr 172.21.15.33:0/4290936796 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:53.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d35800640 1 --2- 172.21.15.33:0/4290936796 >> v2:172.21.15.103:3300/0 conn(0x7f6d3006cd60 0x7f6d300b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:53.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d2fe00640 1 -- 172.21.15.33:0/4290936796 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278876028 0 0) 0x7f6d30151a20 con 0x7f6d300cd870 2024-09-13T19:00:53.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.565+0000 7f6d2fe00640 1 -- 172.21.15.33:0/4290936796 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d18003520 con 0x7f6d300cd870 2024-09-13T19:00:53.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.566+0000 7f6d35800640 1 -- 172.21.15.33:0/4290936796 >> v1:172.21.15.103:6789/0 conn(0x7f6d3015b770 legacy=0x7f6d300cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.566+0000 7f6d35800640 1 -- 172.21.15.33:0/4290936796 >> v1:172.21.15.33:6789/0 conn(0x7f6d300cd870 legacy=0x7f6d300cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.566+0000 7f6d35800640 1 -- 172.21.15.33:0/4290936796 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300b1e70 con 0x7f6d3006cd60 2024-09-13T19:00:53.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.567+0000 7f6d35800640 1 --2- 172.21.15.33:0/4290936796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3006cd60 0x7f6d300b2950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097a0 tx=0x7f6d2402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4edae430ce0c60a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:53.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.567+0000 7f6d2fe00640 1 -- 172.21.15.33:0/4290936796 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24032440 con 0x7f6d3006cd60 2024-09-13T19:00:53.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.567+0000 7f6d2fe00640 1 -- 172.21.15.33:0/4290936796 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d240325a0 con 0x7f6d3006cd60 2024-09-13T19:00:53.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.567+0000 7f6d2fe00640 1 -- 172.21.15.33:0/4290936796 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24032910 con 0x7f6d3006cd60 2024-09-13T19:00:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 -- 172.21.15.33:0/4290936796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3006cd60 msgr2=0x7f6d300b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 --2- 172.21.15.33:0/4290936796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3006cd60 0x7f6d300b2950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097a0 tx=0x7f6d2402a230 comp rx=0 tx=0).stop 2024-09-13T19:00:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 -- 172.21.15.33:0/4290936796 shutdown_connections 2024-09-13T19:00:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 --2- 172.21.15.33:0/4290936796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3006cd60 0x7f6d300b2950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 -- 172.21.15.33:0/4290936796 >> 172.21.15.33:0/4290936796 conn(0x7f6d300b0510 msgr2=0x7f6d300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 -- 172.21.15.33:0/4290936796 shutdown_connections 2024-09-13T19:00:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.568+0000 7f6d38200640 1 -- 172.21.15.33:0/4290936796 wait complete. 2024-09-13T19:00:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.569+0000 7f6d38200640 1 Processor -- start 2024-09-13T19:00:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.569+0000 7f6d38200640 1 -- start start 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3006cd60 0x7f6d3014b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3015b770 0x7f6d300706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3014bd30 con 0x7f6d300cd870 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d301e4190 con 0x7f6d3015b770 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.570+0000 7f6d38200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d301f1f60 con 0x7f6d3006cd60 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46168/0 (socket says 172.21.15.33:46168) 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 -- 172.21.15.33:0/2513454401 learned_addr learned my addr 172.21.15.33:0/2513454401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d35800640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3006cd60 0x7f6d3014b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d36200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3015b770 0x7f6d300706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 -- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3006cd60 msgr2=0x7f6d3014b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3006cd60 0x7f6d3014b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 -- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3015b770 msgr2=0x7f6d300706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3015b770 0x7f6d300706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 -- 172.21.15.33:0/2513454401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009400 con 0x7f6d300cd870 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.571+0000 7f6d34e00640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c3c0 tx=0x7f6d1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.572+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0052d0 con 0x7f6d300cd870 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.572+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c005450 con 0x7f6d300cd870 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.572+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c007260 con 0x7f6d300cd870 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.572+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301f2240 con 0x7f6d300cd870 2024-09-13T19:00:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.572+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d301f2800 con 0x7f6d300cd870 2024-09-13T19:00:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.573+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d300b2950 con 0x7f6d300cd870 2024-09-13T19:00:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.574+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d1c0073c0 con 0x7f6d300cd870 2024-09-13T19:00:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.575+0000 7f6d2d600640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 0x7f6d1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.575+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6d1c088660 con 0x7f6d300cd870 2024-09-13T19:00:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.575+0000 7f6d35800640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 0x7f6d1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.576+0000 7f6d35800640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 0x7f6d1006d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6d24034000 tx=0x7f6d2402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.579+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d1c053900 con 0x7f6d300cd870 2024-09-13T19:00:53.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:53.756+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d300b02d0 con 0x7f6d300cd870 2024-09-13T19:00:54.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.382+0000 7f6d2d600640 1 -- 172.21.15.33:0/2513454401 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6d1c056f20 con 0x7f6d300cd870 2024-09-13T19:00:54.385 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T19:00:54.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.385+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 msgr2=0x7f6d1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.385+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 0x7f6d1006d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6d24034000 tx=0x7f6d2402e000 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.385+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 msgr2=0x7f6d301e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.385+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c3c0 tx=0x7f6d1c00c880 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 shutdown_connections 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1006ac00 0x7f6d1006d0c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3015b770 0x7f6d300706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d300cd870 0x7f6d301e3760 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 --2- 172.21.15.33:0/2513454401 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3006cd60 0x7f6d3014b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 >> 172.21.15.33:0/2513454401 conn(0x7f6d300b0510 msgr2=0x7f6d300b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 shutdown_connections 2024-09-13T19:00:54.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.386+0000 7f6d38200640 1 -- 172.21.15.33:0/2513454401 wait complete. 2024-09-13T19:00:54.407 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T19:00:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.563+0000 7fd874800640 1 Processor -- start 2024-09-13T19:00:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.563+0000 7fd874800640 1 -- start start 2024-09-13T19:00:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd874800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd86c15a520 0x7fd86c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd874800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd86c0b1b00 0x7fd86c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd874800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86c06bc00 con 0x7fd86c0cde50 2024-09-13T19:00:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd874800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c06bea0 con 0x7fd86c0b1b00 2024-09-13T19:00:54.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd874800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c06c180 con 0x7fd86c15a520 2024-09-13T19:00:54.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd871400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd86c0b1b00 0x7fd86c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd871400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd86c0b1b00 0x7fd86c0cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46182/0 (socket says 172.21.15.33:46182) 2024-09-13T19:00:54.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.564+0000 7fd871400640 1 -- 172.21.15.33:0/1238804803 learned_addr learned my addr 172.21.15.33:0/1238804803 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:54.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.565+0000 7fd871400640 1 -- 172.21.15.33:0/1238804803 >> v2:172.21.15.103:3300/0 conn(0x7fd86c15a520 msgr2=0x7fd86c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:54.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.565+0000 7fd871400640 1 --2- 172.21.15.33:0/1238804803 >> v2:172.21.15.103:3300/0 conn(0x7fd86c15a520 0x7fd86c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.565+0000 7fd871400640 1 -- 172.21.15.33:0/1238804803 >> v1:172.21.15.103:6789/0 conn(0x7fd86c0cde50 legacy=0x7fd86c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.565+0000 7fd871400640 1 -- 172.21.15.33:0/1238804803 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c06c460 con 0x7fd86c0b1b00 2024-09-13T19:00:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.566+0000 7fd871400640 1 --2- 172.21.15.33:0/1238804803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0b1b00 0x7fd86c0cd910 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0b14f0 tx=0x7fd85c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375a5e673e6efc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.566+0000 7fd870a00640 1 -- 172.21.15.33:0/1238804803 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c032440 con 0x7fd86c0b1b00 2024-09-13T19:00:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.566+0000 7fd870a00640 1 -- 172.21.15.33:0/1238804803 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0325a0 con 0x7fd86c0b1b00 2024-09-13T19:00:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.566+0000 7fd870a00640 1 -- 172.21.15.33:0/1238804803 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c032930 con 0x7fd86c0b1b00 2024-09-13T19:00:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 -- 172.21.15.33:0/1238804803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0b1b00 msgr2=0x7fd86c0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 --2- 172.21.15.33:0/1238804803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0b1b00 0x7fd86c0cd910 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0b14f0 tx=0x7fd85c02a230 comp rx=0 tx=0).stop 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 -- 172.21.15.33:0/1238804803 shutdown_connections 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 --2- 172.21.15.33:0/1238804803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0b1b00 0x7fd86c0cd910 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 --2- 172.21.15.33:0/1238804803 >> v2:172.21.15.103:3300/0 conn(0x7fd86c15a520 0x7fd86c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 -- 172.21.15.33:0/1238804803 >> 172.21.15.33:0/1238804803 conn(0x7fd86c0b0510 msgr2=0x7fd86c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 -- 172.21.15.33:0/1238804803 shutdown_connections 2024-09-13T19:00:54.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.567+0000 7fd874800640 1 -- 172.21.15.33:0/1238804803 wait complete. 2024-09-13T19:00:54.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.569+0000 7fd874800640 1 Processor -- start 2024-09-13T19:00:54.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.569+0000 7fd874800640 1 -- start start 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd86c0b1b00 0x7fd86c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd86c0cde50 0x7fd86c143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c145490 con 0x7fd86c15a520 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c157600 con 0x7fd86c0b1b00 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd874800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c144810 con 0x7fd86c0cde50 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd872800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd871e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd86c0b1b00 0x7fd86c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd872800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46198/0 (socket says 172.21.15.33:46198) 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd872800640 1 -- 172.21.15.33:0/1662018624 learned_addr learned my addr 172.21.15.33:0/1662018624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.570+0000 7fd871400640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd86c0cde50 0x7fd86c143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 -- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd86c0cde50 msgr2=0x7fd86c143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd86c0cde50 0x7fd86c143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 -- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd86c0b1b00 msgr2=0x7fd86c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd86c0b1b00 0x7fd86c149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 -- 172.21.15.33:0/1662018624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0094d0 con 0x7fd86c15a520 2024-09-13T19:00:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd872800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c780 tx=0x7fd86800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868003d80 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800ce90 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c144af0 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680052b0 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.571+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c1450b0 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.572+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c1455d0 con 0x7fd86c15a520 2024-09-13T19:00:54.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.573+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd868005410 con 0x7fd86c15a520 2024-09-13T19:00:54.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.574+0000 7fd866000640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 0x7fd85006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.574+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd868088800 con 0x7fd86c15a520 2024-09-13T19:00:54.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.575+0000 7fd871e00640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 0x7fd85006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.575+0000 7fd871e00640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 0x7fd85006d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd86c14a310 tx=0x7fd860009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.579+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd86c1455d0 con 0x7fd86c15a520 2024-09-13T19:00:54.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.760+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd86c1455d0 con 0x7fd86c15a520 2024-09-13T19:00:54.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.764+0000 7fd866000640 1 -- 172.21.15.33:0/1662018624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd86c1455d0 con 0x7fd86c15a520 2024-09-13T19:00:54.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.766+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 msgr2=0x7fd85006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.766+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 0x7fd85006d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd86c14a310 tx=0x7fd860009060 comp rx=0 tx=0).stop 2024-09-13T19:00:54.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.766+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 msgr2=0x7fd86c144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.766+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd86800c780 tx=0x7fd86800cc40 comp rx=0 tx=0).stop 2024-09-13T19:00:54.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 shutdown_connections 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd85006ac00 0x7fd85006d0c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c15a520 0x7fd86c144140 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd86c0cde50 0x7fd86c143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 --2- 172.21.15.33:0/1662018624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd86c0b1b00 0x7fd86c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 >> 172.21.15.33:0/1662018624 conn(0x7fd86c0b0510 msgr2=0x7fd86c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 shutdown_connections 2024-09-13T19:00:54.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.767+0000 7fd874800640 1 -- 172.21.15.33:0/1662018624 wait complete. 2024-09-13T19:00:54.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-13T19:00:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.936+0000 7f9b7ce00640 1 Processor -- start 2024-09-13T19:00:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.937+0000 7f9b7ce00640 1 -- start start 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b7ce00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b7815a520 0x7f9b7806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b7ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b7815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b7ce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7806bc00 con 0x7f9b780b1b00 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b7ce00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7806bea0 con 0x7f9b7815a520 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b7ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7806c180 con 0x7f9b780ce020 2024-09-13T19:00:54.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b75e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b7815a520 0x7f9b7806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b75e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b7815a520 0x7f9b7806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46204/0 (socket says 172.21.15.33:46204) 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b75e00640 1 -- 172.21.15.33:0/731038239 learned_addr learned my addr 172.21.15.33:0/731038239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b76800640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b7815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b75e00640 1 -- 172.21.15.33:0/731038239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 msgr2=0x7f9b7815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.938+0000 7f9b75e00640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b7815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.939+0000 7f9b75e00640 1 -- 172.21.15.33:0/731038239 >> v1:172.21.15.103:6789/0 conn(0x7f9b780b1b00 legacy=0x7f9b780cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.939+0000 7f9b75e00640 1 -- 172.21.15.33:0/731038239 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7806c460 con 0x7f9b7815a520 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b75e00640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7815a520 0x7f9b7806b6c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009870 tx=0x7f9b6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3615c132c7c3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b75400640 1 -- 172.21.15.33:0/731038239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68032440 con 0x7f9b7815a520 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b75400640 1 -- 172.21.15.33:0/731038239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680325a0 con 0x7f9b7815a520 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b75400640 1 -- 172.21.15.33:0/731038239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68032930 con 0x7f9b7815a520 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b7ce00640 1 -- 172.21.15.33:0/731038239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7815a520 msgr2=0x7f9b7806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.940+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7815a520 0x7f9b7806b6c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009870 tx=0x7f9b6802a1c0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 -- 172.21.15.33:0/731038239 shutdown_connections 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b7815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/731038239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7815a520 0x7f9b7806b6c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 -- 172.21.15.33:0/731038239 >> 172.21.15.33:0/731038239 conn(0x7f9b780b0510 msgr2=0x7f9b780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 -- 172.21.15.33:0/731038239 shutdown_connections 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.941+0000 7f9b7ce00640 1 -- 172.21.15.33:0/731038239 wait complete. 2024-09-13T19:00:54.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.942+0000 7f9b7ce00640 1 Processor -- start 2024-09-13T19:00:54.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.942+0000 7f9b7ce00640 1 -- start start 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b78158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b7815a520 0x7f9b78158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78147c40 con 0x7f9b780b1b00 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78147960 con 0x7f9b7815a520 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b7ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78144d40 con 0x7f9b780ce020 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.943+0000 7f9b75e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46218/0 (socket says 172.21.15.33:46218) 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 -- 172.21.15.33:0/4228723085 learned_addr learned my addr 172.21.15.33:0/4228723085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 -- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 msgr2=0x7f9b78158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b78158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 -- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b7815a520 msgr2=0x7f9b78158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b7815a520 0x7f9b78158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 -- 172.21.15.33:0/4228723085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680094d0 con 0x7f9b780b1b00 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b75e00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b68000c00 tx=0x7f9b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68032440 con 0x7f9b780b1b00 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68030b80 con 0x7f9b780b1b00 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6803d440 con 0x7f9b780b1b00 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.944+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78145020 con 0x7f9b780b1b00 2024-09-13T19:00:54.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.945+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b78146ca0 con 0x7f9b780b1b00 2024-09-13T19:00:54.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.946+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b781454e0 con 0x7f9b780b1b00 2024-09-13T19:00:54.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.946+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b68039040 con 0x7f9b780b1b00 2024-09-13T19:00:54.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.947+0000 7f9b6ea00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 0x7f9b5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:54.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.947+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b680a9ba0 con 0x7f9b780b1b00 2024-09-13T19:00:54.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.948+0000 7f9b6d400640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 0x7f9b5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:54.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.949+0000 7f9b6d400640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 0x7f9b5406d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000f60 tx=0x7f9b600079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:54.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:54.951+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9b68075070 con 0x7f9b780b1b00 2024-09-13T19:00:55.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.195+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) v1 -- 0x7f9b7815a900 con 0x7f9b780b1b00 2024-09-13T19:00:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.384+0000 7f9b6ea00640 1 -- 172.21.15.33:0/4228723085 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v227) v1 ==== 140+0+0 (secure 0 0 0) 0x7f9b68078690 con 0x7f9b780b1b00 2024-09-13T19:00:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 msgr2=0x7f9b5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 0x7f9b5406d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000f60 tx=0x7f9b600079b0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 msgr2=0x7f9b78144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b68000c00 tx=0x7f9b680046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 shutdown_connections 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9b5406ac00 0x7f9b5406d0c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b7815a520 0x7f9b78158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b780ce020 0x7f9b78158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 --2- 172.21.15.33:0/4228723085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b780b1b00 0x7f9b78144580 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.386+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 >> 172.21.15.33:0/4228723085 conn(0x7f9b780b0510 msgr2=0x7f9b780cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.387+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 shutdown_connections 2024-09-13T19:00:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.387+0000 7f9b7ce00640 1 -- 172.21.15.33:0/4228723085 wait complete. 2024-09-13T19:00:55.405 INFO:tasks.cephfs_test_runner:That quota changes made from one client are visible to another ... ok 2024-09-13T19:00:55.405 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_write (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-13T19:00:55.406 INFO:tasks.cephfs_test_runner:test_remote_update_write (tasks.cephfs.test_quota.TestQuota) 2024-09-13T19:00:55.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:00:55.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.559+0000 7f5396a00640 1 Processor -- start 2024-09-13T19:00:55.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.560+0000 7f5396a00640 1 -- start start 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5396a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53900b1b00 0x7f53900cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5396a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53900cde50 0x7f539015a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5396a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539006bea0 con 0x7f539015a520 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5396a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539006c180 con 0x7f53900cde50 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5396a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539006c460 con 0x7f53900b1b00 2024-09-13T19:00:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5394a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53900cde50 0x7f539015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5394a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53900cde50 0x7f539015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46226/0 (socket says 172.21.15.33:46226) 2024-09-13T19:00:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5394a00640 1 -- 172.21.15.33:0/3024595720 learned_addr learned my addr 172.21.15.33:0/3024595720 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5387400640 1 --2- 172.21.15.33:0/3024595720 >> v2:172.21.15.103:3300/0 conn(0x7f53900b1b00 0x7f53900cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5394a00640 1 -- 172.21.15.33:0/3024595720 >> v2:172.21.15.103:3300/0 conn(0x7f53900b1b00 msgr2=0x7f53900cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.561+0000 7f5394a00640 1 --2- 172.21.15.33:0/3024595720 >> v2:172.21.15.103:3300/0 conn(0x7f53900b1b00 0x7f53900cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.562+0000 7f5394a00640 1 -- 172.21.15.33:0/3024595720 >> v1:172.21.15.103:6789/0 conn(0x7f539015a520 legacy=0x7f539006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.562+0000 7f5394a00640 1 -- 172.21.15.33:0/3024595720 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539006c740 con 0x7f53900cde50 2024-09-13T19:00:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.562+0000 7f5394a00640 1 --2- 172.21.15.33:0/3024595720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900cde50 0x7f539015a900 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f539006bdd0 tx=0x7f538802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b4e9ba59e65754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f538f400640 1 -- 172.21.15.33:0/3024595720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388031600 con 0x7f53900cde50 2024-09-13T19:00:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f538f400640 1 -- 172.21.15.33:0/3024595720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538802d050 con 0x7f53900cde50 2024-09-13T19:00:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f538f400640 1 -- 172.21.15.33:0/3024595720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388031980 con 0x7f53900cde50 2024-09-13T19:00:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 -- 172.21.15.33:0/3024595720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900cde50 msgr2=0x7f539015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 --2- 172.21.15.33:0/3024595720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900cde50 0x7f539015a900 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f539006bdd0 tx=0x7f538802a6f0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 -- 172.21.15.33:0/3024595720 shutdown_connections 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 --2- 172.21.15.33:0/3024595720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900cde50 0x7f539015a900 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 --2- 172.21.15.33:0/3024595720 >> v2:172.21.15.103:3300/0 conn(0x7f53900b1b00 0x7f53900cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.563+0000 7f5396a00640 1 -- 172.21.15.33:0/3024595720 >> 172.21.15.33:0/3024595720 conn(0x7f53900b0510 msgr2=0x7f53900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.564+0000 7f5396a00640 1 -- 172.21.15.33:0/3024595720 shutdown_connections 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.564+0000 7f5396a00640 1 -- 172.21.15.33:0/3024595720 wait complete. 2024-09-13T19:00:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.565+0000 7f5396a00640 1 Processor -- start 2024-09-13T19:00:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.565+0000 7f5396a00640 1 -- start start 2024-09-13T19:00:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 0x7f539014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f539015a520 0x7f53901f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539015bae0 con 0x7f53900b1b00 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539014f820 con 0x7f539015a520 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f5396a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53901f2980 con 0x7f53900cde50 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f538fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f538fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46232/0 (socket says 172.21.15.33:46232) 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.566+0000 7f538fe00640 1 -- 172.21.15.33:0/4218227584 learned_addr learned my addr 172.21.15.33:0/4218227584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f5387400640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 0x7f539014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f5394a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f539015a520 0x7f53901f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 -- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 msgr2=0x7f539014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 0x7f539014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 -- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f539015a520 msgr2=0x7f53901f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f539015a520 0x7f53901f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 -- 172.21.15.33:0/4218227584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009b30 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f5387400640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 0x7f539014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.567+0000 7f538fe00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f538000b3f0 tx=0x7f538000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.568+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380011830 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.568+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380011990 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.568+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380011d40 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.568+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53901f2c60 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.568+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539015bfd0 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.569+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53901f2e50 con 0x7f53900b1b00 2024-09-13T19:00:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.570+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f538001a400 con 0x7f53900b1b00 2024-09-13T19:00:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.570+0000 7f538cc00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 0x7f536c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.570+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5380088e70 con 0x7f53900b1b00 2024-09-13T19:00:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.571+0000 7f5387400640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 0x7f536c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.572+0000 7f5387400640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 0x7f536c06d0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f53900cc080 tx=0x7f5378008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.575+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53901f2e50 con 0x7f53900b1b00 2024-09-13T19:00:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.755+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53901f2e50 con 0x7f53900b1b00 2024-09-13T19:00:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.755+0000 7f538cc00640 1 -- 172.21.15.33:0/4218227584 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+12985 (secure 0 0 0) 0x7f53901f2e50 con 0x7f53900b1b00 2024-09-13T19:00:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:55.758 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:54.379259+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6834/198206524":"2024-09-14T19:00:51.362061+0000","172.21.15.33:6832/198206524":"2024-09-14T19:00:51.362061+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:00:55.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.757+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 msgr2=0x7f536c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.757+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 0x7f536c06d0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f53900cc080 tx=0x7f5378008040 comp rx=0 tx=0).stop 2024-09-13T19:00:55.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.757+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 msgr2=0x7f53901f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.757+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f538000b3f0 tx=0x7f538000b8b0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 shutdown_connections 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f536c06ac00 0x7f536c06d0c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f539015a520 0x7f53901f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f53900cde50 0x7f539014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 --2- 172.21.15.33:0/4218227584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53900b1b00 0x7f53901f3010 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 >> 172.21.15.33:0/4218227584 conn(0x7f53900b0510 msgr2=0x7f539006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:55.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 shutdown_connections 2024-09-13T19:00:55.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.758+0000 7f5396a00640 1 -- 172.21.15.33:0/4218227584 wait complete. 2024-09-13T19:00:55.777 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:00:55.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:00:55.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.934+0000 7f08e7200640 1 Processor -- start 2024-09-13T19:00:55.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.935+0000 7f08e7200640 1 -- start start 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e7200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08e815a6d0 0x7f08e80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e7200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e80cb640 0x7f08e80cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e7200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80b23e0 con 0x7f08e80b0d20 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e7200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e806d260 con 0x7f08e80cb640 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e7200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e80cc010 con 0x7f08e815a6d0 2024-09-13T19:00:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e6800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e80cb640 0x7f08e80cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e6800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e80cb640 0x7f08e80cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46236/0 (socket says 172.21.15.33:46236) 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e6800640 1 -- 172.21.15.33:0/287052543 learned_addr learned my addr 172.21.15.33:0/287052543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.936+0000 7f08e5e00640 1 --2- 172.21.15.33:0/287052543 >> v2:172.21.15.103:3300/0 conn(0x7f08e815a6d0 0x7f08e80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.937+0000 7f08e6800640 1 -- 172.21.15.33:0/287052543 >> v2:172.21.15.103:3300/0 conn(0x7f08e815a6d0 msgr2=0x7f08e80b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.937+0000 7f08e6800640 1 --2- 172.21.15.33:0/287052543 >> v2:172.21.15.103:3300/0 conn(0x7f08e815a6d0 0x7f08e80b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.937+0000 7f08e6800640 1 -- 172.21.15.33:0/287052543 >> v1:172.21.15.103:6789/0 conn(0x7f08e80b0d20 legacy=0x7f08e806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.937+0000 7f08e6800640 1 -- 172.21.15.33:0/287052543 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e806cca0 con 0x7f08e80cb640 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.937+0000 7f08e6800640 1 --2- 172.21.15.33:0/287052543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e80cb640 0x7f08e80cbad0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08e8061c10 tx=0x7f08e002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b292dee8c6a089b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e4a00640 1 -- 172.21.15.33:0/287052543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031600 con 0x7f08e80cb640 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e4a00640 1 -- 172.21.15.33:0/287052543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e002d050 con 0x7f08e80cb640 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e4a00640 1 -- 172.21.15.33:0/287052543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031980 con 0x7f08e80cb640 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 -- 172.21.15.33:0/287052543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e80cb640 msgr2=0x7f08e80cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 --2- 172.21.15.33:0/287052543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e80cb640 0x7f08e80cbad0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08e8061c10 tx=0x7f08e002a660 comp rx=0 tx=0).stop 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 -- 172.21.15.33:0/287052543 shutdown_connections 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 --2- 172.21.15.33:0/287052543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e80cb640 0x7f08e80cbad0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 --2- 172.21.15.33:0/287052543 >> v2:172.21.15.103:3300/0 conn(0x7f08e815a6d0 0x7f08e80b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.938+0000 7f08e7200640 1 -- 172.21.15.33:0/287052543 >> 172.21.15.33:0/287052543 conn(0x7f08e80b0200 msgr2=0x7f08e80b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.939+0000 7f08e7200640 1 -- 172.21.15.33:0/287052543 shutdown_connections 2024-09-13T19:00:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.939+0000 7f08e7200640 1 -- 172.21.15.33:0/287052543 wait complete. 2024-09-13T19:00:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.940+0000 7f08e7200640 1 Processor -- start 2024-09-13T19:00:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.940+0000 7f08e7200640 1 -- start start 2024-09-13T19:00:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08e80b0d20 0x7f08e81f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 0x7f08e815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815b430 con 0x7f08e815a6d0 2024-09-13T19:00:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f5960 con 0x7f08e80cb640 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e7200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815b680 con 0x7f08e80b0d20 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46240/0 (socket says 172.21.15.33:46240) 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.941+0000 7f08e6800640 1 -- 172.21.15.33:0/3044164251 learned_addr learned my addr 172.21.15.33:0/3044164251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e5e00640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08e80b0d20 0x7f08e81f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e5400640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 0x7f08e815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 -- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08e80b0d20 msgr2=0x7f08e81f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08e80b0d20 0x7f08e81f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 -- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 msgr2=0x7f08e815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 0x7f08e815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 -- 172.21.15.33:0/3044164251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0009b30 con 0x7f08e815a6d0 2024-09-13T19:00:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e5400640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 0x7f08e815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08e6800640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009f40 tx=0x7f08e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.942+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e003b810 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.943+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e003b990 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.943+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e003bd40 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.943+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e815b960 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.943+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e81f5e90 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.944+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e815bb50 con 0x7f08e815a6d0 2024-09-13T19:00:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.945+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08e003a3a0 con 0x7f08e815a6d0 2024-09-13T19:00:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.946+0000 7f08de000640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 0x7f08c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.946+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08e002ae40 con 0x7f08e815a6d0 2024-09-13T19:00:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.946+0000 7f08e5e00640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 0x7f08c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.947+0000 7f08e5e00640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 0x7f08c806d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f08d8006fd0 tx=0x7f08d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:55.950+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f08e0074e90 con 0x7f08e815a6d0 2024-09-13T19:00:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.139+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08e80b27f0 con 0x7f08e815a6d0 2024-09-13T19:00:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.140+0000 7f08de000640 1 -- 172.21.15.33:0/3044164251 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08e0009510 con 0x7f08e815a6d0 2024-09-13T19:00:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:00:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 msgr2=0x7f08c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 0x7f08c806d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f08d8006fd0 tx=0x7f08d8008040 comp rx=0 tx=0).stop 2024-09-13T19:00:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 msgr2=0x7f08e8145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009f40 tx=0x7f08e0004a40 comp rx=0 tx=0).stop 2024-09-13T19:00:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 shutdown_connections 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f08c806ac00 0x7f08c806d0c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e815a6d0 0x7f08e8145d20 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08e80cb640 0x7f08e815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 --2- 172.21.15.33:0/3044164251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08e80b0d20 0x7f08e81f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.142+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 >> 172.21.15.33:0/3044164251 conn(0x7f08e80b0200 msgr2=0x7f08e806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.143+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 shutdown_connections 2024-09-13T19:00:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.143+0000 7f08e7200640 1 -- 172.21.15.33:0/3044164251 wait complete. 2024-09-13T19:00:56.160 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-13T19:00:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.312+0000 7f8875200640 1 Processor -- start 2024-09-13T19:00:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.312+0000 7f8875200640 1 -- start start 2024-09-13T19:00:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8875200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f887015a520 0x7f887006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8875200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f88700b1b00 0x7f88700cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8875200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006bc00 con 0x7f88700cde50 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8875200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006bea0 con 0x7f88700b1b00 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8875200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006c180 con 0x7f887015a520 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f88700b1b00 0x7f88700cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f88700b1b00 0x7f88700cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46248/0 (socket says 172.21.15.33:46248) 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 -- 172.21.15.33:0/1768647557 learned_addr learned my addr 172.21.15.33:0/1768647557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f886de00640 1 --2- 172.21.15.33:0/1768647557 >> v2:172.21.15.103:3300/0 conn(0x7f887015a520 0x7f887006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 -- 172.21.15.33:0/1768647557 >> v2:172.21.15.103:3300/0 conn(0x7f887015a520 msgr2=0x7f887006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 --2- 172.21.15.33:0/1768647557 >> v2:172.21.15.103:3300/0 conn(0x7f887015a520 0x7f887006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 -- 172.21.15.33:0/1768647557 >> v1:172.21.15.103:6789/0 conn(0x7f88700cde50 legacy=0x7f88700b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.314+0000 7f8865400640 1 -- 172.21.15.33:0/1768647557 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887006c460 con 0x7f88700b1b00 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.315+0000 7f8865400640 1 --2- 172.21.15.33:0/1768647557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700b1b00 0x7f88700cd910 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f88700b14f0 tx=0x7f885802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cad8ddf19c6cd5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f886d400640 1 -- 172.21.15.33:0/1768647557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858032440 con 0x7f88700b1b00 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f886d400640 1 -- 172.21.15.33:0/1768647557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580325a0 con 0x7f88700b1b00 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f886d400640 1 -- 172.21.15.33:0/1768647557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858032930 con 0x7f88700b1b00 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 -- 172.21.15.33:0/1768647557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700b1b00 msgr2=0x7f88700cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 --2- 172.21.15.33:0/1768647557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700b1b00 0x7f88700cd910 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f88700b14f0 tx=0x7f885802a270 comp rx=0 tx=0).stop 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 -- 172.21.15.33:0/1768647557 shutdown_connections 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 --2- 172.21.15.33:0/1768647557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700b1b00 0x7f88700cd910 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 --2- 172.21.15.33:0/1768647557 >> v2:172.21.15.103:3300/0 conn(0x7f887015a520 0x7f887006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 -- 172.21.15.33:0/1768647557 >> 172.21.15.33:0/1768647557 conn(0x7f88700b0510 msgr2=0x7f88700b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 -- 172.21.15.33:0/1768647557 shutdown_connections 2024-09-13T19:00:56.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.316+0000 7f8875200640 1 -- 172.21.15.33:0/1768647557 wait complete. 2024-09-13T19:00:56.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.318+0000 7f8875200640 1 Processor -- start 2024-09-13T19:00:56.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.318+0000 7f8875200640 1 -- start start 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88700b1b00 0x7f88700acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f887015a520 0x7f8870151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88701f2070 con 0x7f88700cde50 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88701f22d0 con 0x7f887015a520 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8875200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88701f25b0 con 0x7f88700b1b00 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8865400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8865400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46264/0 (socket says 172.21.15.33:46264) 2024-09-13T19:00:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.319+0000 7f8865400640 1 -- 172.21.15.33:0/2911978165 learned_addr learned my addr 172.21.15.33:0/2911978165 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f886e800640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f887015a520 0x7f8870151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f886de00640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88700b1b00 0x7f88700acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 -- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88700b1b00 msgr2=0x7f88700acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88700b1b00 0x7f88700acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 -- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f887015a520 msgr2=0x7f8870151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f887015a520 0x7f8870151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 -- 172.21.15.33:0/2911978165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094d0 con 0x7f88700cde50 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8865400640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f885802a2b0 tx=0x7f88580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858032440 con 0x7f88700cde50 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8858030980 con 0x7f88700cde50 2024-09-13T19:00:56.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.320+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858030d10 con 0x7f88700cde50 2024-09-13T19:00:56.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.321+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88701f2890 con 0x7f88700cde50 2024-09-13T19:00:56.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.321+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88701f2e50 con 0x7f88700cde50 2024-09-13T19:00:56.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.322+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88701f2fe0 con 0x7f88700cde50 2024-09-13T19:00:56.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.322+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8858039040 con 0x7f88700cde50 2024-09-13T19:00:56.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.323+0000 7f8866a00640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 0x7f884c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:56.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.323+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88580a99f0 con 0x7f88700cde50 2024-09-13T19:00:56.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.324+0000 7f886de00640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 0x7f884c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:56.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.324+0000 7f886de00640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 0x7f884c06d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8860009a30 tx=0x7f8860008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:56.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.327+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8858074ec0 con 0x7f88700cde50 2024-09-13T19:00:56.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:56.571+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7f88700cd910 con 0x7f88700cde50 2024-09-13T19:00:57.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.392+0000 7f8866a00640 1 -- 172.21.15.33:0/2911978165 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v229) v1 ==== 140+0+0 (secure 0 0 0) 0x7f88580410d0 con 0x7f88700cde50 2024-09-13T19:00:57.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 msgr2=0x7f884c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 0x7f884c06d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8860009a30 tx=0x7f8860008040 comp rx=0 tx=0).stop 2024-09-13T19:00:57.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 msgr2=0x7f8870150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f885802a2b0 tx=0x7f88580046c0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 shutdown_connections 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f884c06ac00 0x7f884c06d0c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f887015a520 0x7f8870151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88700cde50 0x7f8870150df0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 --2- 172.21.15.33:0/2911978165 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88700b1b00 0x7f88700acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.394+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 >> 172.21.15.33:0/2911978165 conn(0x7f88700b0510 msgr2=0x7f88700afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.395+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 shutdown_connections 2024-09-13T19:00:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.395+0000 7f8875200640 1 -- 172.21.15.33:0/2911978165 wait complete. 2024-09-13T19:00:57.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T19:00:57.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.576+0000 7f8da6c00640 1 Processor -- start 2024-09-13T19:00:57.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.577+0000 7f8da6c00640 1 -- start start 2024-09-13T19:00:57.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 0x7f8da00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:57.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00b5860 con 0x7f8da00cfe40 2024-09-13T19:00:57.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da015cca0 con 0x7f8da00cd8e0 2024-09-13T19:00:57.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da00d0980 con 0x7f8da015c8c0 2024-09-13T19:00:57.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8da00cfe40 0x7f8da00b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57092/0 (socket says 172.21.15.33:57092) 2024-09-13T19:00:57.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da6200640 1 -- 172.21.15.33:0/1852218100 learned_addr learned my addr 172.21.15.33:0/1852218100 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:57.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8da5800640 1 --2- 172.21.15.33:0/1852218100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 0x7f8da00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897473393 0 0) 0x7f8da00b5860 con 0x7f8da00cfe40 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.578+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d88003520 con 0x7f8da00cfe40 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.579+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957976719 0 0) 0x7f8da015cca0 con 0x7f8da00cd8e0 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.579+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da00b5860 con 0x7f8da00cd8e0 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.579+0000 7f8da5800640 1 -- 172.21.15.33:0/1852218100 >> v1:172.21.15.103:6789/0 conn(0x7f8da00cd8e0 legacy=0x7f8da00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.579+0000 7f8da5800640 1 -- 172.21.15.33:0/1852218100 >> v1:172.21.15.33:6789/0 conn(0x7f8da00cfe40 legacy=0x7f8da00b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.579+0000 7f8da5800640 1 -- 172.21.15.33:0/1852218100 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da00d0c60 con 0x7f8da015c8c0 2024-09-13T19:00:57.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8da5800640 1 --2- 172.21.15.33:0/1852218100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 0x7f8da00d03a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d940097d0 tx=0x7f8d9402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec8b841fc50607d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94032440 con 0x7f8da015c8c0 2024-09-13T19:00:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940325a0 con 0x7f8da015c8c0 2024-09-13T19:00:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8d9fe00640 1 -- 172.21.15.33:0/1852218100 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94032930 con 0x7f8da015c8c0 2024-09-13T19:00:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8da6c00640 1 -- 172.21.15.33:0/1852218100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 msgr2=0x7f8da00d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.580+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1852218100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 0x7f8da00d03a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d940097d0 tx=0x7f8d9402a200 comp rx=0 tx=0).stop 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.581+0000 7f8da6c00640 1 -- 172.21.15.33:0/1852218100 shutdown_connections 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.581+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1852218100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da015c8c0 0x7f8da00d03a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.581+0000 7f8da6c00640 1 -- 172.21.15.33:0/1852218100 >> 172.21.15.33:0/1852218100 conn(0x7f8da006a7c0 msgr2=0x7f8da006abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.581+0000 7f8da6c00640 1 -- 172.21.15.33:0/1852218100 shutdown_connections 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.581+0000 7f8da6c00640 1 -- 172.21.15.33:0/1852218100 wait complete. 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.582+0000 7f8da6c00640 1 Processor -- start 2024-09-13T19:00:57.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.582+0000 7f8da6c00640 1 -- start start 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da00cd8e0 0x7f8da014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da00cfe40 0x7f8da01f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da015e8d0 con 0x7f8da015c8c0 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da015ebb0 con 0x7f8da00cd8e0 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da015ee90 con 0x7f8da00cfe40 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.583+0000 7f8da6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46274/0 (socket says 172.21.15.33:46274) 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 -- 172.21.15.33:0/1438640223 learned_addr learned my addr 172.21.15.33:0/1438640223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da4e00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da00cfe40 0x7f8da01f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:57.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da5800640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da00cd8e0 0x7f8da014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 -- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da00cfe40 msgr2=0x7f8da01f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da00cfe40 0x7f8da01f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 -- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da00cd8e0 msgr2=0x7f8da014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da00cd8e0 0x7f8da014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 -- 172.21.15.33:0/1438640223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009400 con 0x7f8da015c8c0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.584+0000 7f8da6200640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800cae0 tx=0x7f8d9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.585+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800ac40 con 0x7f8da015c8c0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.585+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800ada0 con 0x7f8da015c8c0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.585+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98012640 con 0x7f8da015c8c0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.585+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da015f170 con 0x7f8da015c8c0 2024-09-13T19:00:57.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.585+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da015e510 con 0x7f8da015c8c0 2024-09-13T19:00:57.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.586+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da0067360 con 0x7f8da015c8c0 2024-09-13T19:00:57.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.587+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d98007070 con 0x7f8da015c8c0 2024-09-13T19:00:57.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.588+0000 7f8d9d600640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 0x7f8d8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:57.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.588+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d980890a0 con 0x7f8da015c8c0 2024-09-13T19:00:57.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.589+0000 7f8da5800640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 0x7f8d8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:57.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.589+0000 7f8da5800640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 0x7f8d8006d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d94034000 tx=0x7f8d9402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:57.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.592+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d98054500 con 0x7f8da015c8c0 2024-09-13T19:00:57.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.770+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8da00c7d60 con 0x7f8da015c8c0 2024-09-13T19:00:57.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.774+0000 7f8d9d600640 1 -- 172.21.15.33:0/1438640223 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d98017020 con 0x7f8da015c8c0 2024-09-13T19:00:57.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.776+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 msgr2=0x7f8d8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.776+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 0x7f8d8006d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d94034000 tx=0x7f8d9402e000 comp rx=0 tx=0).stop 2024-09-13T19:00:57.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.776+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 msgr2=0x7f8da015afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:57.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.776+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800cae0 tx=0x7f8d9800a060 comp rx=0 tx=0).stop 2024-09-13T19:00:57.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 shutdown_connections 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d8006ac00 0x7f8d8006d0c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8da015c8c0 0x7f8da015afa0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8da00cfe40 0x7f8da01f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 --2- 172.21.15.33:0/1438640223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da00cd8e0 0x7f8da014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 >> 172.21.15.33:0/1438640223 conn(0x7f8da006a7c0 msgr2=0x7f8da00cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 shutdown_connections 2024-09-13T19:00:57.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:57.777+0000 7f8da6c00640 1 -- 172.21.15.33:0/1438640223 wait complete. 2024-09-13T19:00:57.796 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T19:00:57.797 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:57.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:00:57.959 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T19:00:57.960 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:57.960 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:57.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:57.996 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:57.996 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:58.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:58.032 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:00:58.033 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:58.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:00:58.071 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:00:58.071 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:00:58.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:00:58.108 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T19:00:58.109 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:00:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.264+0000 7ff395200640 1 Processor -- start 2024-09-13T19:00:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.264+0000 7ff395200640 1 -- start start 2024-09-13T19:00:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff395200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff390153b20 0x7ff3900b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff395200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff39006f660 0x7ff39006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff395200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff390153f00 con 0x7ff390159a80 2024-09-13T19:00:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff395200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3900ce600 con 0x7ff39006f660 2024-09-13T19:00:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff395200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390070f90 con 0x7ff390153b20 2024-09-13T19:00:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff38de00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff390153b20 0x7ff3900b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff38e800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff39006f660 0x7ff39006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff385400640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff390159a80 0x7ff3900b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:50674/0 (socket says 172.21.15.33:50674) 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.265+0000 7ff385400640 1 -- 172.21.15.33:0/2639824728 learned_addr learned my addr 172.21.15.33:0/2639824728 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.266+0000 7ff38de00640 1 -- 172.21.15.33:0/2639824728 >> v2:172.21.15.33:3300/0 conn(0x7ff39006f660 msgr2=0x7ff39006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.266+0000 7ff38de00640 1 --2- 172.21.15.33:0/2639824728 >> v2:172.21.15.33:3300/0 conn(0x7ff39006f660 0x7ff39006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.266+0000 7ff38de00640 1 -- 172.21.15.33:0/2639824728 >> v1:172.21.15.103:6789/0 conn(0x7ff390159a80 legacy=0x7ff3900b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.266+0000 7ff38de00640 1 -- 172.21.15.33:0/2639824728 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900b1a40 con 0x7ff390153b20 2024-09-13T19:00:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.266+0000 7ff38d400640 1 -- 172.21.15.33:0/2639824728 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918539310 0 0) 0x7ff390153f00 con 0x7ff390159a80 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.267+0000 7ff38de00640 1 --2- 172.21.15.33:0/2639824728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff390153b20 0x7ff3900b3990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff3900b14f0 tx=0x7ff38002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f189269302bae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.267+0000 7ff38d400640 1 -- 172.21.15.33:0/2639824728 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380032440 con 0x7ff390153b20 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.267+0000 7ff38d400640 1 -- 172.21.15.33:0/2639824728 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3800325a0 con 0x7ff390153b20 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.267+0000 7ff38d400640 1 -- 172.21.15.33:0/2639824728 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380032930 con 0x7ff390153b20 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 -- 172.21.15.33:0/2639824728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff390153b20 msgr2=0x7ff3900b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 --2- 172.21.15.33:0/2639824728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff390153b20 0x7ff3900b3990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff3900b14f0 tx=0x7ff38002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 -- 172.21.15.33:0/2639824728 shutdown_connections 2024-09-13T19:00:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 --2- 172.21.15.33:0/2639824728 >> v2:172.21.15.33:3300/0 conn(0x7ff39006f660 0x7ff39006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 --2- 172.21.15.33:0/2639824728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff390153b20 0x7ff3900b3990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 -- 172.21.15.33:0/2639824728 >> 172.21.15.33:0/2639824728 conn(0x7ff3900b0510 msgr2=0x7ff3900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 -- 172.21.15.33:0/2639824728 shutdown_connections 2024-09-13T19:00:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.268+0000 7ff395200640 1 -- 172.21.15.33:0/2639824728 wait complete. 2024-09-13T19:00:58.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.269+0000 7ff395200640 1 Processor -- start 2024-09-13T19:00:58.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.270+0000 7ff395200640 1 -- start start 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.270+0000 7ff395200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 0x7ff390157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff395200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff390153b20 0x7ff39015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff395200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff395200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390158b00 con 0x7ff390159a80 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff395200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390157ef0 con 0x7ff39006f660 2024-09-13T19:00:58.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff395200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3901581d0 con 0x7ff390153b20 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46282/0 (socket says 172.21.15.33:46282) 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 -- 172.21.15.33:0/3447192340 learned_addr learned my addr 172.21.15.33:0/3447192340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38de00640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 0x7ff390157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff385400640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff390153b20 0x7ff39015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 -- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff390153b20 msgr2=0x7ff39015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff390153b20 0x7ff39015c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 -- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 msgr2=0x7ff390157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 0x7ff390157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38e800640 1 -- 172.21.15.33:0/3447192340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009400 con 0x7ff390159a80 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.271+0000 7ff38de00640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 0x7ff390157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff38e800640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff38800efc0 tx=0x7ff38800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388009ba0 con 0x7ff390159a80 2024-09-13T19:00:58.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800f040 con 0x7ff390159a80 2024-09-13T19:00:58.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3901584b0 con 0x7ff390159a80 2024-09-13T19:00:58.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3880146c0 con 0x7ff390159a80 2024-09-13T19:00:58.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.272+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff390158f90 con 0x7ff390159a80 2024-09-13T19:00:58.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.273+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff390158cb0 con 0x7ff390159a80 2024-09-13T19:00:58.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.274+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff388014820 con 0x7ff390159a80 2024-09-13T19:00:58.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.275+0000 7ff386a00640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 0x7ff36c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.275+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff388089d00 con 0x7ff390159a80 2024-09-13T19:00:58.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.275+0000 7ff38de00640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 0x7ff36c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.276+0000 7ff38de00640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 0x7ff36c06d0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3900b14f0 tx=0x7ff38002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.279+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff388055280 con 0x7ff390159a80 2024-09-13T19:00:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.495+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3900b3990 con 0x7ff390159a80 2024-09-13T19:00:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.495+0000 7ff386a00640 1 -- 172.21.15.33:0/3447192340 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3523 (secure 0 0 0) 0x7ff388018de0 con 0x7ff390159a80 2024-09-13T19:00:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:00:58.499 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/43126686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":43126686},{"type":"v1","addr":"172.21.15.103:6836","nonce":43126686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1787194708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1787194708},{"type":"v1","addr":"172.21.15.103:6837","nonce":1787194708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6499,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/825787465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":825787465},{"type":"v1","addr":"172.21.15.33:6835","nonce":825787465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7059,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/823926581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":823926581},{"type":"v1","addr":"172.21.15.33:6834","nonce":823926581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2024-09-13T19:00:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 49 2024-09-13T19:00:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 msgr2=0x7ff36c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 0x7ff36c06d0f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3900b14f0 tx=0x7ff38002e000 comp rx=0 tx=0).stop 2024-09-13T19:00:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 msgr2=0x7ff3900a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff38800efc0 tx=0x7ff38800c490 comp rx=0 tx=0).stop 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 shutdown_connections 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff36c06ac30 0x7ff36c06d0f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff390159a80 0x7ff3900a8ce0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff390153b20 0x7ff39015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 --2- 172.21.15.33:0/3447192340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff39006f660 0x7ff390157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 >> 172.21.15.33:0/3447192340 conn(0x7ff3900b0510 msgr2=0x7ff3900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 shutdown_connections 2024-09-13T19:00:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.498+0000 7ff395200640 1 -- 172.21.15.33:0/3447192340 wait complete. 2024-09-13T19:00:58.518 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T19:00:58.518 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T19:00:58.518 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T19:00:58.518 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:58.519 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T19:00:58.519 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T19:00:58.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T19:00:58.519 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:58.519 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T19:00:58.519 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T19:00:58.519 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T19:00:58.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:58.520 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T19:00:58.520 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T19:00:58.520 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T19:00:58.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:00:58.535 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T19:00:58.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T19:00:58.537 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T19:00:58.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T19:00:58.538 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T19:00:58.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T19:00:58.539 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T19:00:58.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T19:00:58.580 INFO:tasks.ceph.mds.b:Started 2024-09-13T19:00:58.580 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:58.583 INFO:tasks.ceph.mds.a:Started 2024-09-13T19:00:58.583 INFO:tasks.ceph.mds.d:Started 2024-09-13T19:00:58.583 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:58.583 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:58.584 INFO:tasks.ceph.mds.c:Started 2024-09-13T19:00:58.585 DEBUG:teuthology.parallel:result is None 2024-09-13T19:00:58.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T19:00:58.709 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2024-09-13T19:00:58.709 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2024-09-13T19:00:58.714 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T19:00:58.715 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-09-13T19:00:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.746+0000 7f50d5e00640 1 Processor -- start 2024-09-13T19:00:58.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.747+0000 7f50d5e00640 1 -- start start 2024-09-13T19:00:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d5e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50d00cda80 0x7f50d0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d5e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d0161190 con 0x7f50d015b420 2024-09-13T19:00:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d5e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d00cdf30 con 0x7f50d0161ef0 2024-09-13T19:00:58.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d5e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d0161410 con 0x7f50d00cda80 2024-09-13T19:00:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d4a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f50d015b420 0x7f50d00cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57102/0 (socket says 172.21.15.33:57102) 2024-09-13T19:00:58.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.748+0000 7f50d4a00640 1 -- 172.21.15.33:0/3775221700 learned_addr learned my addr 172.21.15.33:0/3775221700 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169928209 0 0) 0x7f50d0161190 con 0x7f50d015b420 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8003520 con 0x7f50d015b420 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cfe00640 1 --2- 172.21.15.33:0/3775221700 >> v2:172.21.15.103:3300/0 conn(0x7f50d00cda80 0x7f50d0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803158178 0 0) 0x7f50b8003520 con 0x7f50d015b420 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 >> v2:172.21.15.103:3300/0 conn(0x7f50d00cda80 msgr2=0x7f50d0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 --2- 172.21.15.33:0/3775221700 >> v2:172.21.15.103:3300/0 conn(0x7f50d00cda80 0x7f50d0069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 >> v1:172.21.15.103:6789/0 conn(0x7f50d0161ef0 legacy=0x7f50d00b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d01616f0 con 0x7f50d015b420 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f50c4001670 con 0x7f50d015b420 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 >> v1:172.21.15.33:6789/0 conn(0x7f50d015b420 legacy=0x7f50d00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50b8003970 0x7f50b8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 0x7f50b8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8005040 0x7f50b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0161410 con 0x7f50b8005040 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800bfa0 con 0x7f50b8004370 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.749+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800c160 con 0x7f50b8003970 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50d5400640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8005040 0x7f50b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 0x7f50b8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50d4a00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50b8003970 0x7f50b8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 -- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50b8003970 msgr2=0x7f50b8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50b8003970 0x7f50b8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 -- 172.21.15.33:0/3775221700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8005040 msgr2=0x7f50b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8005040 0x7f50b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50cfe00640 1 -- 172.21.15.33:0/3775221700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8003520 con 0x7f50b8004370 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50d5400640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8005040 0x7f50b800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:58.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.750+0000 7f50d5400640 1 -- 172.21.15.33:0/3775221700 reap_dead start 2024-09-13T19:00:58.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.751+0000 7f50cfe00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 0x7f50b8004840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009a90 tx=0x7f50b80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c868a4c1fa924423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.751+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc031400 con 0x7f50b8004370 2024-09-13T19:00:58.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.751+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc02d050 con 0x7f50b8004370 2024-09-13T19:00:58.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.751+0000 7f50cf400640 1 -- 172.21.15.33:0/3775221700 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc031780 con 0x7f50b8004370 2024-09-13T19:00:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 -- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 msgr2=0x7f50b8004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 0x7f50b8004840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009a90 tx=0x7f50b80057f0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 -- 172.21.15.33:0/3775221700 shutdown_connections 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 --2- 172.21.15.33:0/3775221700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50b8004370 0x7f50b8004840 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 -- 172.21.15.33:0/3775221700 >> 172.21.15.33:0/3775221700 conn(0x7f50d00affd0 msgr2=0x7f50d00b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 -- 172.21.15.33:0/3775221700 shutdown_connections 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.752+0000 7f50d5e00640 1 -- 172.21.15.33:0/3775221700 wait complete. 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.754+0000 7f50d5e00640 1 Processor -- start 2024-09-13T19:00:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.754+0000 7f50d5e00640 1 -- start start 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 0x7f50d00704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50d0159580 0x7f50d0159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0159f40 con 0x7f50b8004370 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0157b50 con 0x7f50d0070040 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d0157220 con 0x7f50d0159580 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46318/0 (socket says 172.21.15.33:46318) 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 -- 172.21.15.33:0/4217142035 learned_addr learned my addr 172.21.15.33:0/4217142035 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50cfe00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 0x7f50d00704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d5400640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50d0159580 0x7f50d0159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 -- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50d0159580 msgr2=0x7f50d0159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50d0159580 0x7f50d0159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 -- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 msgr2=0x7f50d00704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.755+0000 7f50d4a00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 0x7f50d00704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50d4a00640 1 -- 172.21.15.33:0/4217142035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0157500 con 0x7f50b8004370 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50cfe00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 0x7f50d00704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50d4a00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f50c400e730 tx=0x7f50c400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400ee40 con 0x7f50b8004370 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c400c7f0 con 0x7f50b8004370 2024-09-13T19:00:58.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400cba0 con 0x7f50b8004370 2024-09-13T19:00:58.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d01577e0 con 0x7f50b8004370 2024-09-13T19:00:58.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.756+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d0157fe0 con 0x7f50b8004370 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.758+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d0157360 con 0x7f50b8004370 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.758+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50c400cd00 con 0x7f50b8004370 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.759+0000 7f50ccc00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 0x7f50b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.759+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50c4088ec0 con 0x7f50b8004370 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.760+0000 7f50cfe00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 0x7f50b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.760+0000 7f50cfe00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 0x7f50b006d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50bc033000 tx=0x7f50bc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.764+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50d0157360 con 0x7f50b8004370 2024-09-13T19:00:58.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:58.959+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f50d0157360 con 0x7f50b8004370 2024-09-13T19:00:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.746+0000 7f50ccc00640 1 -- 172.21.15.33:0/4217142035 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7f50d0157360 con 0x7f50b8004370 2024-09-13T19:00:59.750 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-09-13T19:00:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 msgr2=0x7f50b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 0x7f50b006d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50bc033000 tx=0x7f50bc008030 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 msgr2=0x7f50d014b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f50c400e730 tx=0x7f50c400eb30 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 shutdown_connections 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f50b006ac00 0x7f50b006d0c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50d0159580 0x7f50d0159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d0070040 0x7f50d00704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 --2- 172.21.15.33:0/4217142035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50b8004370 0x7f50d014b620 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 >> 172.21.15.33:0/4217142035 conn(0x7f50d00affd0 msgr2=0x7f50d00aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 shutdown_connections 2024-09-13T19:00:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.749+0000 7f50d5e00640 1 -- 172.21.15.33:0/4217142035 wait complete. 2024-09-13T19:00:59.771 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T19:00:59.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.927+0000 7f8fe2e00640 1 Processor -- start 2024-09-13T19:00:59.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.928+0000 7f8fe2e00640 1 -- start start 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fdc0afe10 0x7f8fdc06f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cce20 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cbfc0 con 0x7f8fdc0afe10 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0707a0 con 0x7f8fdc15a5c0 2024-09-13T19:00:59.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe1000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe1000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46326/0 (socket says 172.21.15.33:46326) 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe1000640 1 -- 172.21.15.33:0/1190996676 learned_addr learned my addr 172.21.15.33:0/1190996676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.929+0000 7f8fe2400640 1 --2- 172.21.15.33:0/1190996676 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc0afe10 0x7f8fdc06f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.930+0000 7f8fe1000640 1 -- 172.21.15.33:0/1190996676 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 msgr2=0x7f8fdc0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.930+0000 7f8fe1000640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.930+0000 7f8fe1000640 1 -- 172.21.15.33:0/1190996676 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc0afe10 msgr2=0x7f8fdc06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.930+0000 7f8fe1000640 1 --2- 172.21.15.33:0/1190996676 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc0afe10 0x7f8fdc06f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.930+0000 7f8fe1000640 1 -- 172.21.15.33:0/1190996676 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc070a80 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe1000640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc06f440 tx=0x7f8fc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a066775accd6196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fdbe00640 1 -- 172.21.15.33:0/1190996676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8032440 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fdbe00640 1 -- 172.21.15.33:0/1190996676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc80325a0 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fdbe00640 1 -- 172.21.15.33:0/1190996676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8032930 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 -- 172.21.15.33:0/1190996676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cbac0 msgr2=0x7f8fdc0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc06f440 tx=0x7f8fc802a1e0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 -- 172.21.15.33:0/1190996676 shutdown_connections 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/1190996676 >> v2:172.21.15.103:3300/0 conn(0x7f8fdc0afe10 0x7f8fdc06f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc0b3ef0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/1190996676 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.931+0000 7f8fe2e00640 1 -- 172.21.15.33:0/1190996676 >> 172.21.15.33:0/1190996676 conn(0x7f8fdc0ae310 msgr2=0x7f8fdc0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:00:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.932+0000 7f8fe2e00640 1 -- 172.21.15.33:0/1190996676 shutdown_connections 2024-09-13T19:00:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.932+0000 7f8fe2e00640 1 -- 172.21.15.33:0/1190996676 wait complete. 2024-09-13T19:00:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.933+0000 7f8fe2e00640 1 Processor -- start 2024-09-13T19:00:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.933+0000 7f8fe2e00640 1 -- start start 2024-09-13T19:00:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc1e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1e4ee0 con 0x7f8fdc0afe10 2024-09-13T19:00:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1e51c0 con 0x7f8fdc0cbac0 2024-09-13T19:00:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe2e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1e54a0 con 0x7f8fdc15a5c0 2024-09-13T19:00:59.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.934+0000 7f8fe1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46342/0 (socket says 172.21.15.33:46342) 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3845144754 learned_addr learned my addr 172.21.15.33:0/3845144754 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe2400640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc1e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1000640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 msgr2=0x7f8fdc1e47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc1e47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cbac0 msgr2=0x7f8fdc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 -- 172.21.15.33:0/3845144754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80094d0 con 0x7f8fdc0afe10 2024-09-13T19:00:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.935+0000 7f8fe1a00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d5f0 tx=0x7f8fd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.936+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00125f0 con 0x7f8fdc0afe10 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.936+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0012750 con 0x7f8fdc0afe10 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.936+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1e5780 con 0x7f8fdc0afe10 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.936+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0012b00 con 0x7f8fdc0afe10 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.936+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc155fe0 con 0x7f8fdc0afe10 2024-09-13T19:00:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.937+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc067360 con 0x7f8fdc0afe10 2024-09-13T19:00:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.938+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd0012c60 con 0x7f8fdc0afe10 2024-09-13T19:00:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.939+0000 7f8fd9600640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:00:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.939+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8fd0089310 con 0x7f8fdc0afe10 2024-09-13T19:00:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.939+0000 7f8fe1000640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:00:59.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.940+0000 7f8fe1000640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:00:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:00:59.943+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8fd0054980 con 0x7f8fdc0afe10 2024-09-13T19:01:00.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.189+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8fdc0b39b0 con 0x7f8fdc0afe10 2024-09-13T19:01:00.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.190+0000 7f8fd9600640 1 -- 172.21.15.33:0/3845144754 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8fd0057fa0 con 0x7f8fdc0afe10 2024-09-13T19:01:00.196 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:00.196 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:00.196 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-09-13T19:01:00.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.196 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmrLc5HRAAY3h6k2x3O0h/EXnUrKFJ9A==", 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.197 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm8xzsMBAA9joQOfPAPFlRO/dluDCcRw==", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm4gMWJxAAqKlsr3gGNRsgYqsBdrBDTw==", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:01:00.198 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmFKCrOhAAsHzWz7MAh9jaDATCb9u8gQ==", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDSiuRmdHW1FhAAotO2CbtsA2V5wWvitF6ETQ==", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDViuRmAexYHBAAUdp3fFRKciFQqRrwpvv0hQ==", 2024-09-13T19:01:00.200 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDYiuRm28d+IBAA5JiLHROFkz7Fn4XF38Zh5A==", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDbiuRmKuPsJhAAWpAqcMi37b7Zj63u7sGxNQ==", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDhiuRmb2ALIBAAkFRzzqmPSVF91fUQJfGbBg==", 2024-09-13T19:01:00.202 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDkiuRmF3qpJxAATPYxKN3EZh5eKjtK7lu/3w==", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDniuRmeUjFLBAAE3gamqqx6mr6EygUS8KaAA==", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDqiuRms/bNMBAAfoR1Wx3hHuLjbwNM9ICXVA==", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-09-13T19:01:00.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm47aWBxAAmeuUfceE+exMJLc620ejog==", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-09-13T19:01:00.205 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmN26EFBAAt5LdVqgLSFgHUVTX/q2SsQ==", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRmnTsLDhAA1ILWdCVvU/df3n1dx82reg==", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:01:00.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDPiuRm+x7eGhAAJ9k4ODOLREKFZYkSPww/pw==", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-09-13T19:01:00.207 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNiuRmMfhTKRAALyecN4g3kNMDyvxo/sHOcA==", 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.208 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRmukihFhAAyPDgvA9mhCbYJPKKnooSIQ==", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDOiuRm1KOEDxAA6Pur9NJFaMjAVyA1OxSMgg==", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-09-13T19:01:00.209 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-09-13T19:01:00.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:00.210 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-13T19:01:00.210 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 msgr2=0x7f8fbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc802e000 comp rx=0 tx=0).stop 2024-09-13T19:01:00.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 msgr2=0x7f8fdc1e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d5f0 tx=0x7f8fd000dab0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 shutdown_connections 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8fdc15a5c0 0x7f8fdc1e47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fdc0cbac0 0x7f8fdc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 --2- 172.21.15.33:0/3845144754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fdc0afe10 0x7f8fdc1e5f80 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.192+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 >> 172.21.15.33:0/3845144754 conn(0x7f8fdc0ae310 msgr2=0x7f8fdc06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.193+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 shutdown_connections 2024-09-13T19:01:00.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.193+0000 7f8fe2e00640 1 -- 172.21.15.33:0/3845144754 wait complete. 2024-09-13T19:01:00.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.366+0000 7fb699000640 1 Processor -- start 2024-09-13T19:01:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.366+0000 7fb699000640 1 -- start start 2024-09-13T19:01:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb699000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb69415c740 0x7fb6940cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb699000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 0x7fb6940b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb699000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940d3080 con 0x7fb6940d2350 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb699000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6940d27e0 con 0x7fb69415c740 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb699000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6940d2ac0 con 0x7fb6940cf720 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb693400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb69415c740 0x7fb6940cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb693400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb69415c740 0x7fb6940cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46346/0 (socket says 172.21.15.33:46346) 2024-09-13T19:01:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.367+0000 7fb693400640 1 -- 172.21.15.33:0/3139735847 learned_addr learned my addr 172.21.15.33:0/3139735847 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:00.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693e00640 1 --2- 172.21.15.33:0/3139735847 >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 0x7fb6940b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693400640 1 -- 172.21.15.33:0/3139735847 >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 msgr2=0x7fb6940b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:00.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693400640 1 --2- 172.21.15.33:0/3139735847 >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 0x7fb6940b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693400640 1 -- 172.21.15.33:0/3139735847 >> v1:172.21.15.103:6789/0 conn(0x7fb6940d2350 legacy=0x7fb6940cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693400640 1 -- 172.21.15.33:0/3139735847 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940d2da0 con 0x7fb69415c740 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.368+0000 7fb693e00640 1 --2- 172.21.15.33:0/3139735847 >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 0x7fb6940b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.369+0000 7fb693400640 1 --2- 172.21.15.33:0/3139735847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb6940cd620 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb69408b450 tx=0x7fb68402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1456e79cd9a4a0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.369+0000 7fb692a00640 1 -- 172.21.15.33:0/3139735847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684032440 con 0x7fb69415c740 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.369+0000 7fb692a00640 1 -- 172.21.15.33:0/3139735847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6840325a0 con 0x7fb69415c740 2024-09-13T19:01:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.369+0000 7fb692a00640 1 -- 172.21.15.33:0/3139735847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684032930 con 0x7fb69415c740 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 -- 172.21.15.33:0/3139735847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 msgr2=0x7fb6940cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 --2- 172.21.15.33:0/3139735847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb6940cd620 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb69408b450 tx=0x7fb68402a2c0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 -- 172.21.15.33:0/3139735847 shutdown_connections 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 --2- 172.21.15.33:0/3139735847 >> v2:172.21.15.103:3300/0 conn(0x7fb6940cf720 0x7fb6940b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 --2- 172.21.15.33:0/3139735847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb6940cd620 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 -- 172.21.15.33:0/3139735847 >> 172.21.15.33:0/3139735847 conn(0x7fb69406a330 msgr2=0x7fb69406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 -- 172.21.15.33:0/3139735847 shutdown_connections 2024-09-13T19:01:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.370+0000 7fb699000640 1 -- 172.21.15.33:0/3139735847 wait complete. 2024-09-13T19:01:00.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.371+0000 7fb699000640 1 Processor -- start 2024-09-13T19:01:00.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 -- start start 2024-09-13T19:01:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6940cf720 0x7fb69414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb69414c0d0 0x7fb694148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694149f60 con 0x7fb69415c740 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414a240 con 0x7fb6940cf720 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.372+0000 7fb699000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69414a520 con 0x7fb69414c0d0 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46358/0 (socket says 172.21.15.33:46358) 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 -- 172.21.15.33:0/2030769462 learned_addr learned my addr 172.21.15.33:0/2030769462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb693400640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6940cf720 0x7fb69414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb693e00640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb69414c0d0 0x7fb694148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 -- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb69414c0d0 msgr2=0x7fb694148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb69414c0d0 0x7fb694148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 -- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6940cf720 msgr2=0x7fb69414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6940cf720 0x7fb69414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 -- 172.21.15.33:0/2030769462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840094d0 con 0x7fb69415c740 2024-09-13T19:01:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.373+0000 7fb68be00640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb67c004640 tx=0x7fb67c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.374+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011790 con 0x7fb69415c740 2024-09-13T19:01:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.374+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0118f0 con 0x7fb69415c740 2024-09-13T19:01:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.374+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011ce0 con 0x7fb69415c740 2024-09-13T19:01:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.374+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69414a800 con 0x7fb69415c740 2024-09-13T19:01:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.374+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69414c550 con 0x7fb69415c740 2024-09-13T19:01:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.375+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69414ad20 con 0x7fb69415c740 2024-09-13T19:01:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.376+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb67c012420 con 0x7fb69415c740 2024-09-13T19:01:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.377+0000 7fb68b400640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 0x7fb67006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.377+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb67c088bc0 con 0x7fb69415c740 2024-09-13T19:01:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.377+0000 7fb693400640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 0x7fb67006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.378+0000 7fb693400640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 0x7fb67006d0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb684034000 tx=0x7fb68402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.381+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb69414ad20 con 0x7fb69415c740 2024-09-13T19:01:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.563+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb69414ad20 con 0x7fb69415c740 2024-09-13T19:01:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.564+0000 7fb68b400640 1 -- 172.21.15.33:0/2030769462 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+12858 (secure 0 0 0) 0x7fb69414ad20 con 0x7fb69415c740 2024-09-13T19:01:00.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:00.567 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":92,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:00:59.736286+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 msgr2=0x7fb67006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 0x7fb67006d0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb684034000 tx=0x7fb68402e000 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 msgr2=0x7fb69414bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb67c004640 tx=0x7fb67c00c8e0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 shutdown_connections 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb67006ac00 0x7fb67006d0c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb69414c0d0 0x7fb694148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb69415c740 0x7fb69414bb90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 --2- 172.21.15.33:0/2030769462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6940cf720 0x7fb69414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 >> 172.21.15.33:0/2030769462 conn(0x7fb69406a330 msgr2=0x7fb6940b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 shutdown_connections 2024-09-13T19:01:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.566+0000 7fb699000640 1 -- 172.21.15.33:0/2030769462 wait complete. 2024-09-13T19:01:00.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:01:00.586 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:01:00.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.740+0000 7f455a800640 1 Processor -- start 2024-09-13T19:01:00.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.741+0000 7f455a800640 1 -- start start 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f455a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f45540b2e20 0x7f45540cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f455a800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f455415d980 0x7f455406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f455a800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45540cc370 con 0x7f45541594a0 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f455a800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4554159880 con 0x7f45540b2e20 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f455a800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45540cd1b0 con 0x7f455415d980 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f4558a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f45540b2e20 0x7f45540cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f4558a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f45540b2e20 0x7f45540cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46360/0 (socket says 172.21.15.33:46360) 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f4558a00640 1 -- 172.21.15.33:0/2237698509 learned_addr learned my addr 172.21.15.33:0/2237698509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f4559400640 1 --1- 172.21.15.33:0/2237698509 >> v1:172.21.15.33:6789/0 conn(0x7f45541594a0 0x7f45540b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57110/0 (socket says 172.21.15.33:57110) 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.742+0000 7f4559e00640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f455415d980 0x7f455406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.743+0000 7f4558a00640 1 -- 172.21.15.33:0/2237698509 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f455415d980 msgr2=0x7f455406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.743+0000 7f4558a00640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f455415d980 0x7f455406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.743+0000 7f4558a00640 1 -- 172.21.15.33:0/2237698509 >> v1:172.21.15.33:6789/0 conn(0x7f45541594a0 legacy=0x7f45540b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.743+0000 7f4558a00640 1 -- 172.21.15.33:0/2237698509 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455415de30 con 0x7f45540b2e20 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f4558a00640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45540b2e20 0x7f45540cdf10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4540009870 tx=0x7f454002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23ff3d5c046c87c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f4553e00640 1 -- 172.21.15.33:0/2237698509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540032440 con 0x7f45540b2e20 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f4553e00640 1 -- 172.21.15.33:0/2237698509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45400325a0 con 0x7f45540b2e20 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f4553e00640 1 -- 172.21.15.33:0/2237698509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540032930 con 0x7f45540b2e20 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 -- 172.21.15.33:0/2237698509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45540b2e20 msgr2=0x7f45540cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45540b2e20 0x7f45540cdf10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4540009870 tx=0x7f454002a250 comp rx=0 tx=0).stop 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 -- 172.21.15.33:0/2237698509 shutdown_connections 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f455415d980 0x7f455406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 --2- 172.21.15.33:0/2237698509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45540b2e20 0x7f45540cdf10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.744+0000 7f455a800640 1 -- 172.21.15.33:0/2237698509 >> 172.21.15.33:0/2237698509 conn(0x7f45540b0200 msgr2=0x7f45540b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.745+0000 7f455a800640 1 -- 172.21.15.33:0/2237698509 shutdown_connections 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.745+0000 7f455a800640 1 -- 172.21.15.33:0/2237698509 wait complete. 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.746+0000 7f455a800640 1 Processor -- start 2024-09-13T19:01:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.746+0000 7f455a800640 1 -- start start 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45540b2e20 0x7f45541577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45541594a0 0x7f45541f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541589a0 con 0x7f455415d980 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541515f0 con 0x7f45541594a0 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f455a800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4554157e20 con 0x7f45540b2e20 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f4559e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f4559e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46370/0 (socket says 172.21.15.33:46370) 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.747+0000 7f4559e00640 1 -- 172.21.15.33:0/2818008024 learned_addr learned my addr 172.21.15.33:0/2818008024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559400640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45540b2e20 0x7f45541577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4558a00640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45541594a0 0x7f45541f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 -- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45540b2e20 msgr2=0x7f45541577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45540b2e20 0x7f45541577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 -- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45541594a0 msgr2=0x7f45541f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45541594a0 0x7f45541f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 -- 172.21.15.33:0/2818008024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400094d0 con 0x7f455415d980 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4559e00640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f454c00efc0 tx=0x7f454c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c014480 con 0x7f455415d980 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.748+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c00f040 con 0x7f455415d980 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.749+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c014820 con 0x7f455415d980 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.749+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4554158100 con 0x7f455415d980 2024-09-13T19:01:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.749+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45541586c0 con 0x7f455415d980 2024-09-13T19:01:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.750+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45540b3620 con 0x7f455415d980 2024-09-13T19:01:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.750+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f454c014980 con 0x7f455415d980 2024-09-13T19:01:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.751+0000 7f4551600640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 0x7f453406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.751+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f454c089ca0 con 0x7f455415d980 2024-09-13T19:01:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.752+0000 7f4559400640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 0x7f453406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.753+0000 7f4559400640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 0x7f453406d0f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4548000f60 tx=0x7f4548001210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.756+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f454c055310 con 0x7f455415d980 2024-09-13T19:01:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.937+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45540cd640 con 0x7f455415d980 2024-09-13T19:01:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.938+0000 7f4551600640 1 -- 172.21.15.33:0/2818008024 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f454c018020 con 0x7f455415d980 2024-09-13T19:01:00.941 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 msgr2=0x7f453406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 0x7f453406d0f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4548000f60 tx=0x7f4548001210 comp rx=0 tx=0).stop 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 msgr2=0x7f45540c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f454c00efc0 tx=0x7f454c00c490 comp rx=0 tx=0).stop 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 shutdown_connections 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f453406ac30 0x7f453406d0f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455415d980 0x7f45540c42f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45541594a0 0x7f45541f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 --2- 172.21.15.33:0/2818008024 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f45540b2e20 0x7f45541577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 >> 172.21.15.33:0/2818008024 conn(0x7f45540b0200 msgr2=0x7f455406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 shutdown_connections 2024-09-13T19:01:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:00.940+0000 7f455a800640 1 -- 172.21.15.33:0/2818008024 wait complete. 2024-09-13T19:01:00.960 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T19:01:01.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.113+0000 7f6d41000640 1 Processor -- start 2024-09-13T19:01:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.113+0000 7f6d41000640 1 -- start start 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.114+0000 7f6d41000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 0x7f6d3c070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.114+0000 7f6d41000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0709e0 con 0x7f6d3c070540 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d41000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c070cc0 con 0x7f6d3c0b3790 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d41000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1599f0 con 0x7f6d3c159610 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d31400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6d3c070540 0x7f6d3c0b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:57126/0 (socket says 172.21.15.33:57126) 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d31400640 1 -- 172.21.15.33:0/3498392213 learned_addr learned my addr 172.21.15.33:0/3498392213 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39e00640 1 --2- 172.21.15.33:0/3498392213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 0x7f6d3c070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39400640 1 -- 172.21.15.33:0/3498392213 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020811133 0 0) 0x7f6d3c0709e0 con 0x7f6d3c070540 2024-09-13T19:01:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39400640 1 -- 172.21.15.33:0/3498392213 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d20003520 con 0x7f6d3c070540 2024-09-13T19:01:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39e00640 1 -- 172.21.15.33:0/3498392213 >> v1:172.21.15.103:6789/0 conn(0x7f6d3c0b3790 legacy=0x7f6d3c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39e00640 1 -- 172.21.15.33:0/3498392213 >> v1:172.21.15.33:6789/0 conn(0x7f6d3c070540 legacy=0x7f6d3c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.115+0000 7f6d39e00640 1 -- 172.21.15.33:0/3498392213 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c070fa0 con 0x7f6d3c159610 2024-09-13T19:01:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.116+0000 7f6d39e00640 1 --2- 172.21.15.33:0/3498392213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 0x7f6d3c070000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097d0 tx=0x7f6d2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5889fb37b371a79b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d39400640 1 -- 172.21.15.33:0/3498392213 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c032440 con 0x7f6d3c159610 2024-09-13T19:01:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d39400640 1 -- 172.21.15.33:0/3498392213 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0325a0 con 0x7f6d3c159610 2024-09-13T19:01:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d39400640 1 -- 172.21.15.33:0/3498392213 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c032930 con 0x7f6d3c159610 2024-09-13T19:01:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d41000640 1 -- 172.21.15.33:0/3498392213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 msgr2=0x7f6d3c070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d41000640 1 --2- 172.21.15.33:0/3498392213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 0x7f6d3c070000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097d0 tx=0x7f6d2c02a210 comp rx=0 tx=0).stop 2024-09-13T19:01:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d41000640 1 -- 172.21.15.33:0/3498392213 shutdown_connections 2024-09-13T19:01:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d41000640 1 --2- 172.21.15.33:0/3498392213 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c159610 0x7f6d3c070000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.117+0000 7f6d41000640 1 -- 172.21.15.33:0/3498392213 >> 172.21.15.33:0/3498392213 conn(0x7f6d3c0b0510 msgr2=0x7f6d3c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.118+0000 7f6d41000640 1 -- 172.21.15.33:0/3498392213 shutdown_connections 2024-09-13T19:01:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.118+0000 7f6d41000640 1 -- 172.21.15.33:0/3498392213 wait complete. 2024-09-13T19:01:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.119+0000 7f6d41000640 1 Processor -- start 2024-09-13T19:01:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.119+0000 7f6d41000640 1 -- start start 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c070540 0x7f6d3c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3c0b3790 0x7f6d3c146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c146c80 con 0x7f6d3c159610 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c146f60 con 0x7f6d3c0b3790 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d41000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c147240 con 0x7f6d3c070540 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.120+0000 7f6d3a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46378/0 (socket says 172.21.15.33:46378) 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 -- 172.21.15.33:0/2151014849 learned_addr learned my addr 172.21.15.33:0/2151014849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d39e00640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c070540 0x7f6d3c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d31400640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3c0b3790 0x7f6d3c146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 -- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c070540 msgr2=0x7f6d3c159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c070540 0x7f6d3c159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 -- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3c0b3790 msgr2=0x7f6d3c146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3c0b3790 0x7f6d3c146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 -- 172.21.15.33:0/2151014849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c009400 con 0x7f6d3c159610 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d3a800640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c730 tx=0x7f6d3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34003b70 con 0x7f6d3c159610 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34003cd0 con 0x7f6d3c159610 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400aa90 con 0x7f6d3c159610 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.121+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c147520 con 0x7f6d3c159610 2024-09-13T19:01:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.122+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c146870 con 0x7f6d3c159610 2024-09-13T19:01:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.123+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c146a00 con 0x7f6d3c159610 2024-09-13T19:01:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.124+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d3400abf0 con 0x7f6d3c159610 2024-09-13T19:01:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.124+0000 7f6d32a00640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 0x7f6d1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.125+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d34088d80 con 0x7f6d3c159610 2024-09-13T19:01:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.125+0000 7f6d39e00640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 0x7f6d1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.125+0000 7f6d39e00640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 0x7f6d1806d0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c034000 tx=0x7f6d2c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.129+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d34054340 con 0x7f6d3c159610 2024-09-13T19:01:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.309+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6d3c070000 con 0x7f6d3c159610 2024-09-13T19:01:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.309+0000 7f6d32a00640 1 -- 172.21.15.33:0/2151014849 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6d34057960 con 0x7f6d3c159610 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-13T19:01:01.313 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 msgr2=0x7f6d1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 0x7f6d1806d0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c034000 tx=0x7f6d2c02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 msgr2=0x7f6d3c14ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c730 tx=0x7f6d3400cbf0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 shutdown_connections 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f6d1806ac00 0x7f6d1806d0c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d3c159610 0x7f6d3c14ce90 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d3c0b3790 0x7f6d3c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 --2- 172.21.15.33:0/2151014849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d3c070540 0x7f6d3c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 >> 172.21.15.33:0/2151014849 conn(0x7f6d3c0b0510 msgr2=0x7f6d3c06c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 shutdown_connections 2024-09-13T19:01:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.311+0000 7f6d41000640 1 -- 172.21.15.33:0/2151014849 wait complete. 2024-09-13T19:01:01.330 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T19:01:01.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T19:01:01.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.487+0000 7fcb2dc00640 1 Processor -- start 2024-09-13T19:01:01.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.488+0000 7fcb2dc00640 1 -- start start 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb2dc00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb281592f0 0x7fcb280b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb2dc00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb281596d0 0x7fcb28070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb2dc00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28070030 con 0x7fcb280adeb0 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb2dc00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb28071110 con 0x7fcb281592f0 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb2dc00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280b1d50 con 0x7fcb281596d0 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb26a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb281592f0 0x7fcb280b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb26a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb281592f0 0x7fcb280b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46380/0 (socket says 172.21.15.33:46380) 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb26a00640 1 -- 172.21.15.33:0/3647636729 learned_addr learned my addr 172.21.15.33:0/3647636729 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb27400640 1 --2- 172.21.15.33:0/3647636729 >> v2:172.21.15.103:3300/0 conn(0x7fcb281596d0 0x7fcb28070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb26a00640 1 -- 172.21.15.33:0/3647636729 >> v2:172.21.15.103:3300/0 conn(0x7fcb281596d0 msgr2=0x7fcb28070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.489+0000 7fcb26a00640 1 --2- 172.21.15.33:0/3647636729 >> v2:172.21.15.103:3300/0 conn(0x7fcb281596d0 0x7fcb28070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.490+0000 7fcb26a00640 1 -- 172.21.15.33:0/3647636729 >> v1:172.21.15.103:6789/0 conn(0x7fcb280adeb0 legacy=0x7fcb280704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.490+0000 7fcb26a00640 1 -- 172.21.15.33:0/3647636729 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28071870 con 0x7fcb281592f0 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb26a00640 1 --2- 172.21.15.33:0/3647636729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb280b1810 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcb280cb410 tx=0x7fcb1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf0f61457966c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb26000640 1 -- 172.21.15.33:0/3647636729 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18032440 con 0x7fcb281592f0 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb26000640 1 -- 172.21.15.33:0/3647636729 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180325a0 con 0x7fcb281592f0 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb26000640 1 -- 172.21.15.33:0/3647636729 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18032930 con 0x7fcb281592f0 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 -- 172.21.15.33:0/3647636729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 msgr2=0x7fcb280b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/3647636729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb280b1810 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcb280cb410 tx=0x7fcb1802a270 comp rx=0 tx=0).stop 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 -- 172.21.15.33:0/3647636729 shutdown_connections 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/3647636729 >> v2:172.21.15.103:3300/0 conn(0x7fcb281596d0 0x7fcb28070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/3647636729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb280b1810 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.491+0000 7fcb2dc00640 1 -- 172.21.15.33:0/3647636729 >> 172.21.15.33:0/3647636729 conn(0x7fcb280b0510 msgr2=0x7fcb280b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.492+0000 7fcb2dc00640 1 -- 172.21.15.33:0/3647636729 shutdown_connections 2024-09-13T19:01:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.492+0000 7fcb2dc00640 1 -- 172.21.15.33:0/3647636729 wait complete. 2024-09-13T19:01:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.493+0000 7fcb2dc00640 1 Processor -- start 2024-09-13T19:01:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.493+0000 7fcb2dc00640 1 -- start start 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb280adeb0 0x7fcb2815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb281596d0 0x7fcb28147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281508c0 con 0x7fcb281592f0 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2815b6d0 con 0x7fcb280adeb0 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb2dc00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28147610 con 0x7fcb281596d0 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb1fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb1fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46390/0 (socket says 172.21.15.33:46390) 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.494+0000 7fcb1fe00640 1 -- 172.21.15.33:0/1668158740 learned_addr learned my addr 172.21.15.33:0/1668158740 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb26a00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb280adeb0 0x7fcb2815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb27400640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb281596d0 0x7fcb28147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 -- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb281596d0 msgr2=0x7fcb28147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb281596d0 0x7fcb28147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 -- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb280adeb0 msgr2=0x7fcb2815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb280adeb0 0x7fcb2815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 -- 172.21.15.33:0/1668158740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180094d0 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1fe00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c3c0 tx=0x7fcb1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.495+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100052d0 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.496+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10005450 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.496+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28154620 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.496+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10003830 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.496+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28154be0 con 0x7fcb281592f0 2024-09-13T19:01:01.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.497+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb280cbd10 con 0x7fcb281592f0 2024-09-13T19:01:01.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.498+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb10003990 con 0x7fcb281592f0 2024-09-13T19:01:01.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.498+0000 7fcb1ea00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 0x7fcb0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:01.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.499+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb10088430 con 0x7fcb281592f0 2024-09-13T19:01:01.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.499+0000 7fcb26a00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 0x7fcb0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:01.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.500+0000 7fcb26a00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 0x7fcb0406d0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb18034000 tx=0x7fcb1802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:01.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.502+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcb10053a00 con 0x7fcb281592f0 2024-09-13T19:01:01.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:01.680+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcb280b1810 con 0x7fcb281592f0 2024-09-13T19:01:02.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.422+0000 7fcb1ea00640 1 -- 172.21.15.33:0/1668158740 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcb10057020 con 0x7fcb281592f0 2024-09-13T19:01:02.426 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-13T19:01:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.426+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 msgr2=0x7fcb0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.426+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 0x7fcb0406d0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb18034000 tx=0x7fcb1802e000 comp rx=0 tx=0).stop 2024-09-13T19:01:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 msgr2=0x7fcb281470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c3c0 tx=0x7fcb1000c880 comp rx=0 tx=0).stop 2024-09-13T19:01:02.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 shutdown_connections 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcb0406ac00 0x7fcb0406d0c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcb281596d0 0x7fcb28147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb281592f0 0x7fcb281470d0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 --2- 172.21.15.33:0/1668158740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb280adeb0 0x7fcb2815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 >> 172.21.15.33:0/1668158740 conn(0x7fcb280b0510 msgr2=0x7fcb280b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 shutdown_connections 2024-09-13T19:01:02.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.427+0000 7fcb2dc00640 1 -- 172.21.15.33:0/1668158740 wait complete. 2024-09-13T19:01:02.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T19:01:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.613+0000 7f2b23600640 1 Processor -- start 2024-09-13T19:01:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.613+0000 7f2b23600640 1 -- start start 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b23600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 0x7f2b1c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b23600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b1c071690 0x7f2b1c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b23600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c06f5f0 con 0x7f2b1c0cafa0 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b23600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c15aa30 con 0x7f2b1c071690 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b23600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c070450 con 0x7f2b1c156f60 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b21600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b1c071690 0x7f2b1c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b21600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b1c071690 0x7f2b1c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46394/0 (socket says 172.21.15.33:46394) 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.614+0000 7f2b21600640 1 -- 172.21.15.33:0/1223903558 learned_addr learned my addr 172.21.15.33:0/1223903558 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b20c00640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 0x7f2b1c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b21600640 1 -- 172.21.15.33:0/1223903558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 msgr2=0x7f2b1c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b21600640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 0x7f2b1c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b21600640 1 -- 172.21.15.33:0/1223903558 >> v1:172.21.15.103:6789/0 conn(0x7f2b1c0cafa0 legacy=0x7f2b1c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b21600640 1 -- 172.21.15.33:0/1223903558 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c06f840 con 0x7f2b1c071690 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.615+0000 7f2b20c00640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 0x7f2b1c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.616+0000 7f2b21600640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c0cc8b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009e50 tx=0x7f2b1402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57e6f9ba9aca366 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.616+0000 7f2b1be00640 1 -- 172.21.15.33:0/1223903558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14031600 con 0x7f2b1c071690 2024-09-13T19:01:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.616+0000 7f2b1be00640 1 -- 172.21.15.33:0/1223903558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1402d050 con 0x7f2b1c071690 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.616+0000 7f2b1be00640 1 -- 172.21.15.33:0/1223903558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14031980 con 0x7f2b1c071690 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 -- 172.21.15.33:0/1223903558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 msgr2=0x7f2b1c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c0cc8b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009e50 tx=0x7f2b1402a730 comp rx=0 tx=0).stop 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 -- 172.21.15.33:0/1223903558 shutdown_connections 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c0cc8b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 --2- 172.21.15.33:0/1223903558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c156f60 0x7f2b1c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 -- 172.21.15.33:0/1223903558 >> 172.21.15.33:0/1223903558 conn(0x7f2b1c0b0580 msgr2=0x7f2b1c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 -- 172.21.15.33:0/1223903558 shutdown_connections 2024-09-13T19:01:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.617+0000 7f2b23600640 1 -- 172.21.15.33:0/1223903558 wait complete. 2024-09-13T19:01:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.618+0000 7f2b23600640 1 Processor -- start 2024-09-13T19:01:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 -- start start 2024-09-13T19:01:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c0cafa0 0x7f2b1c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1c156f60 0x7f2b1c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1489f0 con 0x7f2b1c071690 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c148cd0 con 0x7f2b1c156f60 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.619+0000 7f2b23600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c148fb0 con 0x7f2b1c0cafa0 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46398/0 (socket says 172.21.15.33:46398) 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 -- 172.21.15.33:0/1416650915 learned_addr learned my addr 172.21.15.33:0/1416650915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b13e00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c0cafa0 0x7f2b1c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b21600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1c156f60 0x7f2b1c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 -- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c0cafa0 msgr2=0x7f2b1c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c0cafa0 0x7f2b1c1466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 -- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1c156f60 msgr2=0x7f2b1c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1c156f60 0x7f2b1c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 -- 172.21.15.33:0/1416650915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14009b30 con 0x7f2b1c071690 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.620+0000 7f2b20c00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d7d0 tx=0x7f2b0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.621+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004030 con 0x7f2b1c071690 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.621+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c004190 con 0x7f2b1c071690 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.621+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004520 con 0x7f2b1c071690 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.621+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c149290 con 0x7f2b1c071690 2024-09-13T19:01:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.621+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c1485c0 con 0x7f2b1c071690 2024-09-13T19:01:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.622+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c157340 con 0x7f2b1c071690 2024-09-13T19:01:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.623+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b0c0096a0 con 0x7f2b1c071690 2024-09-13T19:01:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.624+0000 7f2b19600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 0x7f2af806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.624+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2b0c089d50 con 0x7f2b1c071690 2024-09-13T19:01:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.625+0000 7f2b13e00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 0x7f2af806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.625+0000 7f2b13e00640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 0x7f2af806d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c1f3930 tx=0x7f2b04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.628+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b0c0551a0 con 0x7f2b1c071690 2024-09-13T19:01:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:02.809+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2b1c0cdc50 con 0x7f2b1c071690 2024-09-13T19:01:03.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.432+0000 7f2b19600640 1 -- 172.21.15.33:0/1416650915 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2b0c0587c0 con 0x7f2b1c071690 2024-09-13T19:01:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-13T19:01:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 msgr2=0x7f2af806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 0x7f2af806d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c1f3930 tx=0x7f2b04009040 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 msgr2=0x7f2b1c148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d7d0 tx=0x7f2b0c00dc90 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 shutdown_connections 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2af806ac00 0x7f2af806d0c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1c156f60 0x7f2b1c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b1c0cafa0 0x7f2b1c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 --2- 172.21.15.33:0/1416650915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1c071690 0x7f2b1c148080 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.437+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 >> 172.21.15.33:0/1416650915 conn(0x7f2b1c0b0580 msgr2=0x7f2b1c15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.440+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 shutdown_connections 2024-09-13T19:01:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.440+0000 7f2b23600640 1 -- 172.21.15.33:0/1416650915 wait complete. 2024-09-13T19:01:03.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T19:01:03.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.629+0000 7fec5f200640 1 Processor -- start 2024-09-13T19:01:03.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.629+0000 7fec5f200640 1 -- start start 2024-09-13T19:01:03.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.630+0000 7fec5f200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec5806f830 0x7fec5806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.630+0000 7fec5f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58070420 0x7fec580cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.630+0000 7fec5f200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec580ce490 con 0x7fec58154ad0 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.630+0000 7fec5f200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5806b5b0 con 0x7fec5806f830 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.630+0000 7fec5f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5806b7c0 con 0x7fec58070420 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec5806f830 0x7fec5806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fec5806f830 0x7fec5806fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53154/0 (socket says 172.21.15.33:53154) 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 -- 172.21.15.33:0/3714262673 learned_addr learned my addr 172.21.15.33:0/3714262673 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec5d200640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58070420 0x7fec580cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 -- 172.21.15.33:0/3714262673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58070420 msgr2=0x7fec580cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58070420 0x7fec580cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 -- 172.21.15.33:0/3714262673 >> v1:172.21.15.33:6789/0 conn(0x7fec58154ad0 legacy=0x7fec580cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec4f400640 1 -- 172.21.15.33:0/3714262673 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5806baa0 con 0x7fec5806f830 2024-09-13T19:01:03.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.631+0000 7fec57400640 1 -- 172.21.15.33:0/3714262673 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681018379 0 0) 0x7fec580ce490 con 0x7fec58154ad0 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.632+0000 7fec4f400640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5806f830 0x7fec5806fee0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fec40009870 tx=0x7fec4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc8c0f30ac5da26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.632+0000 7fec57400640 1 -- 172.21.15.33:0/3714262673 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40032440 con 0x7fec5806f830 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec57400640 1 -- 172.21.15.33:0/3714262673 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec400325a0 con 0x7fec5806f830 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec57400640 1 -- 172.21.15.33:0/3714262673 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40032930 con 0x7fec5806f830 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 -- 172.21.15.33:0/3714262673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5806f830 msgr2=0x7fec5806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5806f830 0x7fec5806fee0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fec40009870 tx=0x7fec4002a1c0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 -- 172.21.15.33:0/3714262673 shutdown_connections 2024-09-13T19:01:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58070420 0x7fec580cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 --2- 172.21.15.33:0/3714262673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5806f830 0x7fec5806fee0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 -- 172.21.15.33:0/3714262673 >> 172.21.15.33:0/3714262673 conn(0x7fec580b0580 msgr2=0x7fec580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 -- 172.21.15.33:0/3714262673 shutdown_connections 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.633+0000 7fec5f200640 1 -- 172.21.15.33:0/3714262673 wait complete. 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.635+0000 7fec5f200640 1 Processor -- start 2024-09-13T19:01:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.635+0000 7fec5f200640 1 -- start start 2024-09-13T19:01:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec58070420 0x7fec58145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58154ad0 0x7fec5815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58145fd0 con 0x7fec5815ab30 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5815b5f0 con 0x7fec58070420 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5f200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5815b8d0 con 0x7fec58154ad0 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53170/0 (socket says 172.21.15.33:53170) 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec5d200640 1 -- 172.21.15.33:0/3038840791 learned_addr learned my addr 172.21.15.33:0/3038840791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec4f400640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58154ad0 0x7fec5815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.636+0000 7fec57e00640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec58070420 0x7fec58145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 -- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58154ad0 msgr2=0x7fec5815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58154ad0 0x7fec5815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 -- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec58070420 msgr2=0x7fec58145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec58070420 0x7fec58145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 -- 172.21.15.33:0/3038840791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec400094d0 con 0x7fec5815ab30 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5d200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fec5000efc0 tx=0x7fec5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50014480 con 0x7fec5815ab30 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000f040 con 0x7fec5815ab30 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50014820 con 0x7fec5815ab30 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58146250 con 0x7fec5815ab30 2024-09-13T19:01:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.637+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5815bbb0 con 0x7fec5815ab30 2024-09-13T19:01:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.638+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58146770 con 0x7fec5815ab30 2024-09-13T19:01:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.639+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec50014980 con 0x7fec5815ab30 2024-09-13T19:01:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.640+0000 7fec54c00640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 0x7fec3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.640+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fec50089e40 con 0x7fec5815ab30 2024-09-13T19:01:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.641+0000 7fec57e00640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 0x7fec3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.641+0000 7fec57e00640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 0x7fec3406d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fec48000f60 tx=0x7fec48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:03.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.645+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec58146770 con 0x7fec5815ab30 2024-09-13T19:01:03.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.859+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec58146770 con 0x7fec5815ab30 2024-09-13T19:01:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 14 and data pool 15 2024-09-13T19:01:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.865+0000 7fec54c00640 1 -- 172.21.15.33:0/3038840791 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7fec58146770 con 0x7fec5815ab30 2024-09-13T19:01:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.869+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 msgr2=0x7fec3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.869+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 0x7fec3406d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fec48000f60 tx=0x7fec48009040 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.869+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 msgr2=0x7fec5815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.869+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fec5000efc0 tx=0x7fec5000c490 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 shutdown_connections 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fec3406ac00 0x7fec3406d0c0 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fec48000f60 tx=0x7fec48009040 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec5815ab30 0x7fec5815afc0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec58154ad0 0x7fec5815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 --2- 172.21.15.33:0/3038840791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec58070420 0x7fec58145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.871+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 >> 172.21.15.33:0/3038840791 conn(0x7fec580b0580 msgr2=0x7fec580cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.872+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 shutdown_connections 2024-09-13T19:01:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:03.872+0000 7fec5f200640 1 -- 172.21.15.33:0/3038840791 wait complete. 2024-09-13T19:01:03.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.058+0000 7fcc31200640 1 Processor -- start 2024-09-13T19:01:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.058+0000 7fcc31200640 1 -- start start 2024-09-13T19:01:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.059+0000 7fcc31200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.059+0000 7fcc31200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc2c06f660 0x7fcc2c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.059+0000 7fcc31200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c153f00 con 0x7fcc2c159a80 2024-09-13T19:01:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.059+0000 7fcc31200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0ce600 con 0x7fcc2c06f660 2024-09-13T19:01:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.059+0000 7fcc31200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c070f90 con 0x7fcc2c153b20 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc2a800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc2c06f660 0x7fcc2c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc29400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcc2c159a80 0x7fcc2c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50810/0 (socket says 172.21.15.33:50810) 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc29400640 1 -- 172.21.15.33:0/3845315186 learned_addr learned my addr 172.21.15.33:0/3845315186 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc29e00640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc28a00640 1 -- 172.21.15.33:0/3845315186 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502743580 0 0) 0x7fcc2c153f00 con 0x7fcc2c159a80 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc28a00640 1 -- 172.21.15.33:0/3845315186 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc10003520 con 0x7fcc2c159a80 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc2a800640 1 -- 172.21.15.33:0/3845315186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 msgr2=0x7fcc2c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc2a800640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc2a800640 1 -- 172.21.15.33:0/3845315186 >> v1:172.21.15.33:6789/0 conn(0x7fcc2c159a80 legacy=0x7fcc2c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.060+0000 7fcc2a800640 1 -- 172.21.15.33:0/3845315186 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0b1a40 con 0x7fcc2c06f660 2024-09-13T19:01:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.061+0000 7fcc2a800640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c06f660 0x7fcc2c06faf0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009dc0 tx=0x7fcc2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8732c4f20fafc68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.061+0000 7fcc28a00640 1 -- 172.21.15.33:0/3845315186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24007740 con 0x7fcc2c06f660 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.061+0000 7fcc28a00640 1 -- 172.21.15.33:0/3845315186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2402d050 con 0x7fcc2c06f660 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.061+0000 7fcc28a00640 1 -- 172.21.15.33:0/3845315186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24007ac0 con 0x7fcc2c06f660 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 -- 172.21.15.33:0/3845315186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c06f660 msgr2=0x7fcc2c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c06f660 0x7fcc2c06faf0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009dc0 tx=0x7fcc2402a680 comp rx=0 tx=0).stop 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 -- 172.21.15.33:0/3845315186 shutdown_connections 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c06f660 0x7fcc2c06faf0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 --2- 172.21.15.33:0/3845315186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 -- 172.21.15.33:0/3845315186 >> 172.21.15.33:0/3845315186 conn(0x7fcc2c0b0510 msgr2=0x7fcc2c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 -- 172.21.15.33:0/3845315186 shutdown_connections 2024-09-13T19:01:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.062+0000 7fcc31200640 1 -- 172.21.15.33:0/3845315186 wait complete. 2024-09-13T19:01:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.064+0000 7fcc31200640 1 Processor -- start 2024-09-13T19:01:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.064+0000 7fcc31200640 1 -- start start 2024-09-13T19:01:04.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 0x7fcc2c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1541e0 con 0x7fcc2c159a80 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c14cda0 con 0x7fcc2c06f660 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc31200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c14d080 con 0x7fcc2c153b20 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53190/0 (socket says 172.21.15.33:53190) 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 -- 172.21.15.33:0/4277186686 learned_addr learned my addr 172.21.15.33:0/4277186686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc29e00640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 0x7fcc2c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc29400640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 -- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 msgr2=0x7fcc2c14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 -- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 msgr2=0x7fcc2c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 0x7fcc2c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc2a800640 1 -- 172.21.15.33:0/4277186686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24009a70 con 0x7fcc2c159a80 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.065+0000 7fcc29e00640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 0x7fcc2c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc2a800640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ee0 tx=0x7fcc24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2403b820 con 0x7fcc2c159a80 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2403b980 con 0x7fcc2c159a80 2024-09-13T19:01:04.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c14d360 con 0x7fcc2c159a80 2024-09-13T19:01:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2403bd10 con 0x7fcc2c159a80 2024-09-13T19:01:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.066+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c14b5c0 con 0x7fcc2c159a80 2024-09-13T19:01:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.067+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c154350 con 0x7fcc2c159a80 2024-09-13T19:01:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.068+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc24031400 con 0x7fcc2c159a80 2024-09-13T19:01:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.069+0000 7fcc22000640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 0x7fcc0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.070+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc240aa910 con 0x7fcc2c159a80 2024-09-13T19:01:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.070+0000 7fcc29e00640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 0x7fcc0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.071+0000 7fcc29e00640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 0x7fcc0c06d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009af0 tx=0x7fcc1c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.074+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc2c154350 con 0x7fcc2c159a80 2024-09-13T19:01:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.252+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc2c154320 con 0x7fcc2c159a80 2024-09-13T19:01:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.253+0000 7fcc22000640 1 -- 172.21.15.33:0/4277186686 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fcc24075ae0 con 0x7fcc2c159a80 2024-09-13T19:01:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:04.257 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:03.861356+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 msgr2=0x7fcc0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 0x7fcc0c06d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009af0 tx=0x7fcc1c008040 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 msgr2=0x7fcc2c15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ee0 tx=0x7fcc24004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 shutdown_connections 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcc0c06ac00 0x7fcc0c06d0c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc2c159a80 0x7fcc2c15d000 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc2c153b20 0x7fcc2c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 --2- 172.21.15.33:0/4277186686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2c06f660 0x7fcc2c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 >> 172.21.15.33:0/4277186686 conn(0x7fcc2c0b0510 msgr2=0x7fcc2c0cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 shutdown_connections 2024-09-13T19:01:04.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.255+0000 7fcc31200640 1 -- 172.21.15.33:0/4277186686 wait complete. 2024-09-13T19:01:04.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.427+0000 7fd9f0000640 1 Processor -- start 2024-09-13T19:01:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.427+0000 7fd9f0000640 1 -- start start 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9f0000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9e815a520 0x7fd9e806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80b1b00 0x7fd9e80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9f0000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e806bc00 con 0x7fd9e80cde50 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9f0000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e806bea0 con 0x7fd9e815a520 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9f0000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e806c180 con 0x7fd9e80b1b00 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9ed600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9e815a520 0x7fd9e806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9ed600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9e815a520 0x7fd9e806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53194/0 (socket says 172.21.15.33:53194) 2024-09-13T19:01:04.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9ed600640 1 -- 172.21.15.33:0/1128076254 learned_addr learned my addr 172.21.15.33:0/1128076254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.428+0000 7fd9ecc00640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80b1b00 0x7fd9e80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.429+0000 7fd9ed600640 1 -- 172.21.15.33:0/1128076254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80b1b00 msgr2=0x7fd9e80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.429+0000 7fd9ed600640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80b1b00 0x7fd9e80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.429+0000 7fd9ed600640 1 -- 172.21.15.33:0/1128076254 >> v1:172.21.15.103:6789/0 conn(0x7fd9e80cde50 legacy=0x7fd9e80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.429+0000 7fd9ed600640 1 -- 172.21.15.33:0/1128076254 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e806c460 con 0x7fd9e815a520 2024-09-13T19:01:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.430+0000 7fd9ed600640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e815a520 0x7fd9e806b6c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098a0 tx=0x7fd9dc02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccde9d7f231ef4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.430+0000 7fd9e7e00640 1 -- 172.21.15.33:0/1128076254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc032440 con 0x7fd9e815a520 2024-09-13T19:01:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.430+0000 7fd9e7e00640 1 -- 172.21.15.33:0/1128076254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0325a0 con 0x7fd9e815a520 2024-09-13T19:01:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.430+0000 7fd9e7e00640 1 -- 172.21.15.33:0/1128076254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc032930 con 0x7fd9e815a520 2024-09-13T19:01:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 -- 172.21.15.33:0/1128076254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e815a520 msgr2=0x7fd9e806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e815a520 0x7fd9e806b6c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098a0 tx=0x7fd9dc02a290 comp rx=0 tx=0).stop 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 -- 172.21.15.33:0/1128076254 shutdown_connections 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80b1b00 0x7fd9e80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 --2- 172.21.15.33:0/1128076254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e815a520 0x7fd9e806b6c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 -- 172.21.15.33:0/1128076254 >> 172.21.15.33:0/1128076254 conn(0x7fd9e80b0510 msgr2=0x7fd9e80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 -- 172.21.15.33:0/1128076254 shutdown_connections 2024-09-13T19:01:04.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.431+0000 7fd9f0000640 1 -- 172.21.15.33:0/1128076254 wait complete. 2024-09-13T19:01:04.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.433+0000 7fd9f0000640 1 Processor -- start 2024-09-13T19:01:04.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.433+0000 7fd9f0000640 1 -- start start 2024-09-13T19:01:04.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80cde50 0x7fd9e815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e815a520 0x7fd9e8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8151720 con 0x7fd9e80b1b00 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e815da90 con 0x7fd9e815a520 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9f0000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e815c4b0 con 0x7fd9e80cde50 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53208/0 (socket says 172.21.15.33:53208) 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 -- 172.21.15.33:0/3834893900 learned_addr learned my addr 172.21.15.33:0/3834893900 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ee000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e815a520 0x7fd9e8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ecc00640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80cde50 0x7fd9e815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 -- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80cde50 msgr2=0x7fd9e815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80cde50 0x7fd9e815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 -- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e815a520 msgr2=0x7fd9e8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e815a520 0x7fd9e8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.434+0000 7fd9ed600640 1 -- 172.21.15.33:0/3834893900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0094d0 con 0x7fd9e80b1b00 2024-09-13T19:01:04.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9ed600640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc032440 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc030980 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc030d30 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e815c790 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.435+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e815cd50 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.436+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e80cd910 con 0x7fd9e80b1b00 2024-09-13T19:01:04.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.437+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9dc039040 con 0x7fd9e80b1b00 2024-09-13T19:01:04.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.438+0000 7fd9e5600640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 0x7fd9c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.438+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9dc0a9a60 con 0x7fd9e80b1b00 2024-09-13T19:01:04.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.439+0000 7fd9ecc00640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 0x7fd9c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.439+0000 7fd9ecc00640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 0x7fd9c806d0f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9e815ba30 tx=0x7fd9d4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.442+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9dc074d80 con 0x7fd9e80b1b00 2024-09-13T19:01:04.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.622+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e80ae010 con 0x7fd9e80b1b00 2024-09-13T19:01:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.623+0000 7fd9e5600640 1 -- 172.21.15.33:0/3834893900 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fd9dc0783a0 con 0x7fd9e80b1b00 2024-09-13T19:01:04.627 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:04.627 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:03.861356+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:04.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 msgr2=0x7fd9c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 0x7fd9c806d0f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd9e815ba30 tx=0x7fd9d4009190 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 msgr2=0x7fd9e81511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 shutdown_connections 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd9c806ac30 0x7fd9c806d0f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9e815a520 0x7fd9e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9e80cde50 0x7fd9e815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 --2- 172.21.15.33:0/3834893900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9e80b1b00 0x7fd9e81511e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 >> 172.21.15.33:0/3834893900 conn(0x7fd9e80b0510 msgr2=0x7fd9e80ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 shutdown_connections 2024-09-13T19:01:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.626+0000 7fd9f0000640 1 -- 172.21.15.33:0/3834893900 wait complete. 2024-09-13T19:01:04.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T19:01:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.800+0000 7f7a7e000640 1 Processor -- start 2024-09-13T19:01:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.801+0000 7f7a7e000640 1 -- start start 2024-09-13T19:01:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a780b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7e000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7815a070 con 0x7f7a78152f90 2024-09-13T19:01:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7e000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a78153370 con 0x7f7a7806c4b0 2024-09-13T19:01:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780b2900 con 0x7f7a7815b530 2024-09-13T19:01:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7cc00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7a78152f90 0x7f7a7806bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50820/0 (socket says 172.21.15.33:50820) 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7cc00640 1 -- 172.21.15.33:0/1271654868 learned_addr learned my addr 172.21.15.33:0/1271654868 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.802+0000 7f7a7d600640 1 --2- 172.21.15.33:0/1271654868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a780b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044065742 0 0) 0x7f7a7815a070 con 0x7f7a78152f90 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a60003520 con 0x7f7a78152f90 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404256754 0 0) 0x7f7a78153370 con 0x7f7a7806c4b0 2024-09-13T19:01:04.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a7815a070 con 0x7f7a7806c4b0 2024-09-13T19:01:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a7d600640 1 -- 172.21.15.33:0/1271654868 >> v1:172.21.15.103:6789/0 conn(0x7f7a7806c4b0 legacy=0x7f7a780b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187312305 0 0) 0x7f7a60003520 con 0x7f7a78152f90 2024-09-13T19:01:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a7d600640 1 -- 172.21.15.33:0/1271654868 >> v1:172.21.15.33:6789/0 conn(0x7f7a78152f90 legacy=0x7f7a7806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.803+0000 7f7a7d600640 1 -- 172.21.15.33:0/1271654868 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780b2be0 con 0x7f7a7815b530 2024-09-13T19:01:04.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.804+0000 7f7a7d600640 1 --2- 172.21.15.33:0/1271654868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a780b22c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000aed0 tx=0x7f7a7002b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903427b8df6985f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.804+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c001670 con 0x7f7a7815b530 2024-09-13T19:01:04.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.804+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7002e050 con 0x7f7a7815b530 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.804+0000 7f7a77400640 1 -- 172.21.15.33:0/1271654868 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70008660 con 0x7f7a7815b530 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 -- 172.21.15.33:0/1271654868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 msgr2=0x7f7a780b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 --2- 172.21.15.33:0/1271654868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a780b22c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000aed0 tx=0x7f7a7002b720 comp rx=0 tx=0).stop 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 -- 172.21.15.33:0/1271654868 shutdown_connections 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 --2- 172.21.15.33:0/1271654868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a780b22c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 -- 172.21.15.33:0/1271654868 >> 172.21.15.33:0/1271654868 conn(0x7f7a78069ed0 msgr2=0x7f7a7806a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 -- 172.21.15.33:0/1271654868 shutdown_connections 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.805+0000 7f7a7e000640 1 -- 172.21.15.33:0/1271654868 wait complete. 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.807+0000 7f7a7e000640 1 Processor -- start 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.807+0000 7f7a7e000640 1 -- start start 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 0x7f7a781f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a781f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781f2500 con 0x7f7a7806c4b0 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7813f720 con 0x7f7a78152f90 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a78155090 con 0x7f7a7815b530 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53214/0 (socket says 172.21.15.33:53214) 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 -- 172.21.15.33:0/4223639047 learned_addr learned my addr 172.21.15.33:0/4223639047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:04.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a77e00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 0x7f7a781f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7d600640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a781f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 -- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 msgr2=0x7f7a781f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a781f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 -- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 msgr2=0x7f7a781f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 0x7f7a781f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7cc00640 1 -- 172.21.15.33:0/4223639047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7000ab80 con 0x7f7a7806c4b0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a77e00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 0x7f7a781f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.808+0000 7f7a7d600640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a781f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a7cc00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c750 tx=0x7f7a6c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c005ad0 con 0x7f7a7806c4b0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c005c50 con 0x7f7a7806c4b0 2024-09-13T19:01:04.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007070 con 0x7f7a7806c4b0 2024-09-13T19:01:04.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780ade80 con 0x7f7a7806c4b0 2024-09-13T19:01:04.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.809+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a78155330 con 0x7f7a7806c4b0 2024-09-13T19:01:04.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.810+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7806ba60 con 0x7f7a7806c4b0 2024-09-13T19:01:04.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.811+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a6c0071d0 con 0x7f7a7806c4b0 2024-09-13T19:01:04.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.812+0000 7f7a74c00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 0x7f7a5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:04.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.812+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a6c088ab0 con 0x7f7a7806c4b0 2024-09-13T19:01:04.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.813+0000 7f7a77e00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 0x7f7a5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:04.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.813+0000 7f7a77e00640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 0x7f7a5806d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a780ca9b0 tx=0x7f7a64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:04.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:04.816+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7a6c053bf0 con 0x7f7a7806c4b0 2024-09-13T19:01:05.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.035+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a78067ec0 con 0x7f7a7806c4b0 2024-09-13T19:01:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.874+0000 7f7a74c00640 1 -- 172.21.15.33:0/4223639047 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a6c017020 con 0x7f7a7806c4b0 2024-09-13T19:01:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 msgr2=0x7f7a5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 0x7f7a5806d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a780ca9b0 tx=0x7f7a64009040 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 msgr2=0x7f7a78155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c750 tx=0x7f7a6c00cc10 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 shutdown_connections 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7a5806ac00 0x7f7a5806d0c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7a7815b530 0x7f7a781f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a78152f90 0x7f7a781f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 --2- 172.21.15.33:0/4223639047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7806c4b0 0x7f7a78155850 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 >> 172.21.15.33:0/4223639047 conn(0x7f7a78069ed0 msgr2=0x7f7a780b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 shutdown_connections 2024-09-13T19:01:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:05.877+0000 7f7a7e000640 1 -- 172.21.15.33:0/4223639047 wait complete. 2024-09-13T19:01:05.899 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T19:01:05.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T19:01:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.060+0000 7f4c11000640 1 Processor -- start 2024-09-13T19:01:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.060+0000 7f4c11000640 1 -- start start 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c11000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c11000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 0x7f4c0c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c11000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c06b7c0 con 0x7f4c0c06f830 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c11000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c06b5b0 con 0x7f4c0c154ad0 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c11000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c06baa0 con 0x7f4c0c0ce2c0 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c09e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c09e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53218/0 (socket says 172.21.15.33:53218) 2024-09-13T19:01:06.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.061+0000 7f4c09e00640 1 -- 172.21.15.33:0/385899988 learned_addr learned my addr 172.21.15.33:0/385899988 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c0a800640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 0x7f4c0c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c09e00640 1 -- 172.21.15.33:0/385899988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 msgr2=0x7f4c0c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:06.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c09e00640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 0x7f4c0c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c09e00640 1 -- 172.21.15.33:0/385899988 >> v1:172.21.15.33:6789/0 conn(0x7f4c0c06f830 legacy=0x7f4c0c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c09400640 1 -- 172.21.15.33:0/385899988 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439032643 0 0) 0x7f4c0c06b7c0 con 0x7f4c0c06f830 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c09e00640 1 -- 172.21.15.33:0/385899988 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c06bd80 con 0x7f4c0c154ad0 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.062+0000 7f4c0a800640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 0x7f4c0c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.063+0000 7f4c09e00640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009870 tx=0x7f4bfc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766bdd736d82e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.063+0000 7f4c09400640 1 -- 172.21.15.33:0/385899988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc032440 con 0x7f4c0c154ad0 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.063+0000 7f4c09400640 1 -- 172.21.15.33:0/385899988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc0325a0 con 0x7f4c0c154ad0 2024-09-13T19:01:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.063+0000 7f4c09400640 1 -- 172.21.15.33:0/385899988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc032930 con 0x7f4c0c154ad0 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 -- 172.21.15.33:0/385899988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c154ad0 msgr2=0x7f4c0c0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009870 tx=0x7f4bfc02a1c0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 -- 172.21.15.33:0/385899988 shutdown_connections 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c0ce2c0 0x7f4c0c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 --2- 172.21.15.33:0/385899988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c154ad0 0x7f4c0c0cdd80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 -- 172.21.15.33:0/385899988 >> 172.21.15.33:0/385899988 conn(0x7f4c0c0b0580 msgr2=0x7f4c0c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 -- 172.21.15.33:0/385899988 shutdown_connections 2024-09-13T19:01:06.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.064+0000 7f4c11000640 1 -- 172.21.15.33:0/385899988 wait complete. 2024-09-13T19:01:06.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.065+0000 7f4c11000640 1 Processor -- start 2024-09-13T19:01:06.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.066+0000 7f4c11000640 1 -- start start 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.066+0000 7f4c11000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 0x7f4c0c14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.066+0000 7f4c11000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.066+0000 7f4c11000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c0c15d230 0x7f4c0c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.066+0000 7f4c11000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c14cd10 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c11000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c14ca30 con 0x7f4c0c15d230 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c11000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1f3390 con 0x7f4c0c154ad0 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53228/0 (socket says 172.21.15.33:53228) 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 -- 172.21.15.33:0/2029222299 learned_addr learned my addr 172.21.15.33:0/2029222299 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c09e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 0x7f4c0c14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c0a800640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c0c15d230 0x7f4c0c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 -- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 msgr2=0x7f4c0c14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 0x7f4c0c14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 -- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c0c15d230 msgr2=0x7f4c0c1f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c0c15d230 0x7f4c0c1f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 -- 172.21.15.33:0/2029222299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094d0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c09e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 0x7f4c0c14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.067+0000 7f4c03e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4b0 tx=0x7f4bf400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.068+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4005480 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.068+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf40035f0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.068+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40039e0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.068+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c1f3670 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.068+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c14c620 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.069+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c1f31f0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.070+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4bf4003b40 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.070+0000 7f4c02000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 0x7f4be806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.071+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bf40889e0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.071+0000 7f4c09e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 0x7f4be806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:06.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.072+0000 7f4c09e00640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 0x7f4be806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc034000 tx=0x7f4bfc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:06.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.075+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4c0c1f31f0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.291+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4c0c1f31f0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.876+0000 7f4c02000640 1 -- 172.21.15.33:0/2029222299 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c0c1f31f0 con 0x7f4c0c15cdb0 2024-09-13T19:01:06.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.878+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 msgr2=0x7f4be806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 0x7f4be806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc034000 tx=0x7f4bfc02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:06.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 msgr2=0x7f4c0c1f2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:06.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4b0 tx=0x7f4bf400c970 comp rx=0 tx=0).stop 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 shutdown_connections 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4be806ac00 0x7f4be806d0c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c0c15d230 0x7f4c0c1f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c0c15cdb0 0x7f4c0c1f2230 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 --2- 172.21.15.33:0/2029222299 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c0c154ad0 0x7f4c0c14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 >> 172.21.15.33:0/2029222299 conn(0x7f4c0c0b0580 msgr2=0x7f4c0c0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 shutdown_connections 2024-09-13T19:01:06.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:06.879+0000 7f4c11000640 1 -- 172.21.15.33:0/2029222299 wait complete. 2024-09-13T19:01:06.900 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T19:01:06.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.054+0000 7eff24e00640 1 Processor -- start 2024-09-13T19:01:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.054+0000 7eff24e00640 1 -- start start 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff24e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff20159a80 0x7eff2006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff24e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff20153f00 con 0x7eff200b3990 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff24e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200b1a40 con 0x7eff20153b20 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff24e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200ce600 con 0x7eff20159a80 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff17e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7eff200b3990 0x7eff2006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50828/0 (socket says 172.21.15.33:50828) 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff17e00640 1 -- 172.21.15.33:0/2619568975 learned_addr learned my addr 172.21.15.33:0/2619568975 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.055+0000 7eff1e800640 1 --2- 172.21.15.33:0/2619568975 >> v2:172.21.15.33:3300/0 conn(0x7eff20159a80 0x7eff2006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.056+0000 7eff1d400640 1 -- 172.21.15.33:0/2619568975 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189923023 0 0) 0x7eff20153f00 con 0x7eff200b3990 2024-09-13T19:01:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.056+0000 7eff1e800640 1 -- 172.21.15.33:0/2619568975 >> v1:172.21.15.103:6789/0 conn(0x7eff20153b20 legacy=0x7eff200b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.056+0000 7eff1e800640 1 -- 172.21.15.33:0/2619568975 >> v1:172.21.15.33:6789/0 conn(0x7eff200b3990 legacy=0x7eff2006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.056+0000 7eff1e800640 1 -- 172.21.15.33:0/2619568975 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2015a1f0 con 0x7eff20159a80 2024-09-13T19:01:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.057+0000 7eff1e800640 1 --2- 172.21.15.33:0/2619568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20159a80 0x7eff2006d060 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696c1b7b4b5196ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.057+0000 7eff1d400640 1 -- 172.21.15.33:0/2619568975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18007740 con 0x7eff20159a80 2024-09-13T19:01:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.057+0000 7eff1d400640 1 -- 172.21.15.33:0/2619568975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1802d050 con 0x7eff20159a80 2024-09-13T19:01:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.057+0000 7eff1d400640 1 -- 172.21.15.33:0/2619568975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18007ac0 con 0x7eff20159a80 2024-09-13T19:01:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 -- 172.21.15.33:0/2619568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20159a80 msgr2=0x7eff2006d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 --2- 172.21.15.33:0/2619568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20159a80 0x7eff2006d060 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1802a6f0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 -- 172.21.15.33:0/2619568975 shutdown_connections 2024-09-13T19:01:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 --2- 172.21.15.33:0/2619568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20159a80 0x7eff2006d060 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 -- 172.21.15.33:0/2619568975 >> 172.21.15.33:0/2619568975 conn(0x7eff200b0510 msgr2=0x7eff200b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 -- 172.21.15.33:0/2619568975 shutdown_connections 2024-09-13T19:01:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.058+0000 7eff24e00640 1 -- 172.21.15.33:0/2619568975 wait complete. 2024-09-13T19:01:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.059+0000 7eff24e00640 1 Processor -- start 2024-09-13T19:01:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 -- start start 2024-09-13T19:01:07.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff200b3990 0x7eff20156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff20159a80 0x7eff20156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff201540b0 con 0x7eff20153b20 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20154390 con 0x7eff200b3990 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.060+0000 7eff24e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2013ae00 con 0x7eff20159a80 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53238/0 (socket says 172.21.15.33:53238) 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 -- 172.21.15.33:0/3056032593 learned_addr learned my addr 172.21.15.33:0/3056032593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff1de00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff200b3990 0x7eff20156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff1e800640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff20159a80 0x7eff20156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 -- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff20159a80 msgr2=0x7eff20156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff20159a80 0x7eff20156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 -- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff200b3990 msgr2=0x7eff20156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff200b3990 0x7eff20156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.061+0000 7eff17e00640 1 -- 172.21.15.33:0/3056032593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009a70 con 0x7eff20153b20 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff17e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c3f0 tx=0x7eff0800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080074e0 con 0x7eff20153b20 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08007640 con 0x7eff20153b20 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08004a20 con 0x7eff20153b20 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2013ab70 con 0x7eff20153b20 2024-09-13T19:01:07.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.062+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff20157050 con 0x7eff20153b20 2024-09-13T19:01:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.063+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff201544d0 con 0x7eff20153b20 2024-09-13T19:01:07.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.064+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff08004b80 con 0x7eff20153b20 2024-09-13T19:01:07.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.065+0000 7eff16000640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 0x7efefc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.065+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff08089290 con 0x7eff20153b20 2024-09-13T19:01:07.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.065+0000 7eff1de00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 0x7efefc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.066+0000 7eff1de00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 0x7efefc06d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff10000f60 tx=0x7eff10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.069+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7eff201544d0 con 0x7eff20153b20 2024-09-13T19:01:07.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.284+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff201544d0 con 0x7eff20153b20 2024-09-13T19:01:07.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.284+0000 7eff16000640 1 -- 172.21.15.33:0/3056032593 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7eff201544d0 con 0x7eff20153b20 2024-09-13T19:01:07.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:07.288 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:07.288 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 msgr2=0x7efefc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 0x7efefc06d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff10000f60 tx=0x7eff10009040 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 msgr2=0x7eff201565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c3f0 tx=0x7eff0800c8b0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 shutdown_connections 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7efefc06ac00 0x7efefc06d0c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7eff20159a80 0x7eff20156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff20153b20 0x7eff201565d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 --2- 172.21.15.33:0/3056032593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff200b3990 0x7eff20156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 >> 172.21.15.33:0/3056032593 conn(0x7eff200b0510 msgr2=0x7eff2006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:07.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 shutdown_connections 2024-09-13T19:01:07.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.287+0000 7eff24e00640 1 -- 172.21.15.33:0/3056032593 wait complete. 2024-09-13T19:01:07.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:07.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.458+0000 7fd248a00640 1 Processor -- start 2024-09-13T19:01:07.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.459+0000 7fd248a00640 1 -- start start 2024-09-13T19:01:07.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd248a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd248a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd24415b9b0 0x7fd2440b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd248a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440cbfc0 con 0x7fd2440cbac0 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd248a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440cce20 con 0x7fd24415b9b0 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd248a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440707a0 con 0x7fd24415a5c0 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd23aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd2440cbac0 0x7fd24406f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50836/0 (socket says 172.21.15.33:50836) 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd23aa00640 1 -- 172.21.15.33:0/3579747802 learned_addr learned my addr 172.21.15.33:0/3579747802 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd243400640 1 --2- 172.21.15.33:0/3579747802 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.460+0000 7fd243e00640 1 --2- 172.21.15.33:0/3579747802 >> v2:172.21.15.103:3300/0 conn(0x7fd24415b9b0 0x7fd2440b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075838095 0 0) 0x7fd2440cbfc0 con 0x7fd2440cbac0 2024-09-13T19:01:07.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd228003520 con 0x7fd2440cbac0 2024-09-13T19:01:07.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd243400640 1 -- 172.21.15.33:0/3579747802 >> v2:172.21.15.103:3300/0 conn(0x7fd24415b9b0 msgr2=0x7fd2440b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:07.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd243400640 1 --2- 172.21.15.33:0/3579747802 >> v2:172.21.15.103:3300/0 conn(0x7fd24415b9b0 0x7fd2440b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd243400640 1 -- 172.21.15.33:0/3579747802 >> v1:172.21.15.33:6789/0 conn(0x7fd2440cbac0 legacy=0x7fd24406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828454557 0 0) 0x7fd228003520 con 0x7fd2440cbac0 2024-09-13T19:01:07.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.461+0000 7fd243400640 1 -- 172.21.15.33:0/3579747802 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244070a80 con 0x7fd24415a5c0 2024-09-13T19:01:07.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.462+0000 7fd243400640 1 --2- 172.21.15.33:0/3579747802 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b39b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2340097a0 tx=0x7fd23402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69afa8ce702a2bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.462+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c001670 con 0x7fd24415a5c0 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23402ab10 con 0x7fd24415a5c0 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd242a00640 1 -- 172.21.15.33:0/3579747802 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23402ae80 con 0x7fd24415a5c0 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 -- 172.21.15.33:0/3579747802 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 msgr2=0x7fd2440b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 --2- 172.21.15.33:0/3579747802 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b39b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2340097a0 tx=0x7fd23402a080 comp rx=0 tx=0).stop 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 -- 172.21.15.33:0/3579747802 shutdown_connections 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 --2- 172.21.15.33:0/3579747802 >> v2:172.21.15.103:3300/0 conn(0x7fd24415b9b0 0x7fd2440b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 --2- 172.21.15.33:0/3579747802 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b39b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 -- 172.21.15.33:0/3579747802 >> 172.21.15.33:0/3579747802 conn(0x7fd2440ae310 msgr2=0x7fd2440ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:07.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 -- 172.21.15.33:0/3579747802 shutdown_connections 2024-09-13T19:01:07.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.463+0000 7fd248a00640 1 -- 172.21.15.33:0/3579747802 wait complete. 2024-09-13T19:01:07.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.465+0000 7fd248a00640 1 Processor -- start 2024-09-13T19:01:07.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.465+0000 7fd248a00640 1 -- start start 2024-09-13T19:01:07.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 0x7fd2441561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441f2f30 con 0x7fd24415b9b0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b2000 con 0x7fd2440cbac0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd248a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244156730 con 0x7fd24415a5c0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53252/0 (socket says 172.21.15.33:53252) 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 -- 172.21.15.33:0/3760498969 learned_addr learned my addr 172.21.15.33:0/3760498969 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243400640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 0x7fd2441561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd23aa00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 -- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 msgr2=0x7fd2440b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 -- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 msgr2=0x7fd2441561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 0x7fd2441561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243e00640 1 -- 172.21.15.33:0/3760498969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009400 con 0x7fd24415b9b0 2024-09-13T19:01:07.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd243400640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 0x7fd2441561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.466+0000 7fd23aa00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd243e00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ebe0 tx=0x7fd23c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00cd20 con 0x7fd24415b9b0 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00f040 con 0x7fd24415b9b0 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00cea0 con 0x7fd24415b9b0 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2441f2c50 con 0x7fd24415b9b0 2024-09-13T19:01:07.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.467+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440b1c20 con 0x7fd24415b9b0 2024-09-13T19:01:07.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.468+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244067360 con 0x7fd24415b9b0 2024-09-13T19:01:07.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.469+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd23c0146c0 con 0x7fd24415b9b0 2024-09-13T19:01:07.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.470+0000 7fd23be00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 0x7fd22006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.470+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd23c08a0f0 con 0x7fd24415b9b0 2024-09-13T19:01:07.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.470+0000 7fd243400640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 0x7fd22006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.471+0000 7fd243400640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 0x7fd22006d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd234034000 tx=0x7fd23402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.474+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd23c0552c0 con 0x7fd24415b9b0 2024-09-13T19:01:07.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.655+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2440b17a0 con 0x7fd24415b9b0 2024-09-13T19:01:07.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.656+0000 7fd23be00640 1 -- 172.21.15.33:0/3760498969 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7fd2440b17a0 con 0x7fd24415b9b0 2024-09-13T19:01:07.660 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:07.660 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 msgr2=0x7fd22006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 0x7fd22006d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd234034000 tx=0x7fd23402e000 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 msgr2=0x7fd2440acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ebe0 tx=0x7fd23c00c490 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 shutdown_connections 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd22006ac00 0x7fd22006d0c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd24415b9b0 0x7fd2440acf30 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd24415a5c0 0x7fd2440b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 --2- 172.21.15.33:0/3760498969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2440cbac0 0x7fd2441561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 >> 172.21.15.33:0/3760498969 conn(0x7fd2440ae310 msgr2=0x7fd24406f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 shutdown_connections 2024-09-13T19:01:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.659+0000 7fd248a00640 1 -- 172.21.15.33:0/3760498969 wait complete. 2024-09-13T19:01:07.679 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T19:01:07.679 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:07.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.831+0000 7f7b09200640 1 Processor -- start 2024-09-13T19:01:07.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.831+0000 7f7b09200640 1 -- start start 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.832+0000 7f7b09200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b04153b20 0x7f7b040b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b09200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b04159a80 0x7f7b040b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b09200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04153f00 con 0x7f7b040b2410 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b09200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040ce600 con 0x7f7b04153b20 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b09200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b04070f90 con 0x7f7b04159a80 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b04153b20 0x7f7b040b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b04153b20 0x7f7b040b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53256/0 (socket says 172.21.15.33:53256) 2024-09-13T19:01:07.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 -- 172.21.15.33:0/2868422144 learned_addr learned my addr 172.21.15.33:0/2868422144 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:07.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b02800640 1 --1- 172.21.15.33:0/2868422144 >> v1:172.21.15.33:6789/0 conn(0x7f7b040b2410 0x7f7b0406f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50840/0 (socket says 172.21.15.33:50840) 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7af9400640 1 --2- 172.21.15.33:0/2868422144 >> v2:172.21.15.103:3300/0 conn(0x7f7b04159a80 0x7f7b040b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 -- 172.21.15.33:0/2868422144 >> v2:172.21.15.103:3300/0 conn(0x7f7b04159a80 msgr2=0x7f7b040b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 --2- 172.21.15.33:0/2868422144 >> v2:172.21.15.103:3300/0 conn(0x7f7b04159a80 0x7f7b040b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 -- 172.21.15.33:0/2868422144 >> v1:172.21.15.33:6789/0 conn(0x7f7b040b2410 legacy=0x7f7b0406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01400640 1 -- 172.21.15.33:0/2868422144 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611165468 0 0) 0x7f7b04153f00 con 0x7f7b040b2410 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.833+0000 7f7b01e00640 1 -- 172.21.15.33:0/2868422144 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040b1a40 con 0x7f7b04153b20 2024-09-13T19:01:07.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b01e00640 1 --2- 172.21.15.33:0/2868422144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b04153b20 0x7f7b040b3990 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7b040707d0 tx=0x7f7af402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab28bff0d4028b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b01400640 1 -- 172.21.15.33:0/2868422144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4032440 con 0x7f7b04153b20 2024-09-13T19:01:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b01400640 1 -- 172.21.15.33:0/2868422144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40325a0 con 0x7f7b04153b20 2024-09-13T19:01:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b01400640 1 -- 172.21.15.33:0/2868422144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4032930 con 0x7f7b04153b20 2024-09-13T19:01:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 -- 172.21.15.33:0/2868422144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b04153b20 msgr2=0x7f7b040b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 --2- 172.21.15.33:0/2868422144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b04153b20 0x7f7b040b3990 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7b040707d0 tx=0x7f7af402a2a0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 -- 172.21.15.33:0/2868422144 shutdown_connections 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 --2- 172.21.15.33:0/2868422144 >> v2:172.21.15.103:3300/0 conn(0x7f7b04159a80 0x7f7b040b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 --2- 172.21.15.33:0/2868422144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b04153b20 0x7f7b040b3990 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.835+0000 7f7b09200640 1 -- 172.21.15.33:0/2868422144 >> 172.21.15.33:0/2868422144 conn(0x7f7b040b0510 msgr2=0x7f7b040b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.836+0000 7f7b09200640 1 -- 172.21.15.33:0/2868422144 shutdown_connections 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.836+0000 7f7b09200640 1 -- 172.21.15.33:0/2868422144 wait complete. 2024-09-13T19:01:07.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.837+0000 7f7b09200640 1 Processor -- start 2024-09-13T19:01:07.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.837+0000 7f7b09200640 1 -- start start 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04153b20 0x7f7b0415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 0x7f7b0414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04156040 con 0x7f7b040b2410 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04141480 con 0x7f7b04153b20 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b09200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04154fa0 con 0x7f7b04159a80 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b01e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b01e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53260/0 (socket says 172.21.15.33:53260) 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.838+0000 7f7b01e00640 1 -- 172.21.15.33:0/1567692026 learned_addr learned my addr 172.21.15.33:0/1567692026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b02800640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 0x7f7b0414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7af9400640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04153b20 0x7f7b0415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 -- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 msgr2=0x7f7b0414eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 0x7f7b0414eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 -- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04153b20 msgr2=0x7f7b0415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04153b20 0x7f7b0415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 -- 172.21.15.33:0/1567692026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40094d0 con 0x7f7b040b2410 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b02800640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 0x7f7b0414eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7b01e00640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4032440 con 0x7f7b040b2410 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af4030b80 con 0x7f7b040b2410 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.839+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af403d440 con 0x7f7b040b2410 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.840+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b04155280 con 0x7f7b040b2410 2024-09-13T19:01:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.840+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b04155840 con 0x7f7b040b2410 2024-09-13T19:01:07.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.841+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040cabb0 con 0x7f7b040b2410 2024-09-13T19:01:07.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.841+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7af4039040 con 0x7f7b040b2410 2024-09-13T19:01:07.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.842+0000 7f7afaa00640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 0x7f7ae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:07.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.842+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7af40a9fb0 con 0x7f7b040b2410 2024-09-13T19:01:07.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.843+0000 7f7af9400640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 0x7f7ae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:07.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.844+0000 7f7af9400640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 0x7f7ae006d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b04071a80 tx=0x7f7aec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:07.846+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7af40750f0 con 0x7f7b040b2410 2024-09-13T19:01:08.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.023+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b0415a7b0 con 0x7f7ae006ac00 2024-09-13T19:01:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.032+0000 7f7afaa00640 1 -- 172.21.15.33:0/1567692026 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278623 (secure 0 0 0) 0x7f7aec009d60 con 0x7f7ae006ac00 2024-09-13T19:01:08.040 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 msgr2=0x7f7ae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 0x7f7ae006d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b04071a80 tx=0x7f7aec008040 comp rx=0 tx=0).stop 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 msgr2=0x7f7b04140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af40046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 shutdown_connections 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7ae006ac00 0x7f7ae006d0c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b04159a80 0x7f7b0414eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04153b20 0x7f7b0415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 --2- 172.21.15.33:0/1567692026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b040b2410 0x7f7b04140f40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 >> 172.21.15.33:0/1567692026 conn(0x7f7b040b0510 msgr2=0x7f7b040ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 shutdown_connections 2024-09-13T19:01:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.036+0000 7f7b09200640 1 -- 172.21.15.33:0/1567692026 wait complete. 2024-09-13T19:01:08.055 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T19:01:07.148852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254952,"kb_used_data":10116,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754719768,"statfs":{"total":773094113280,"available":772833042432,"internally_reserved":0,"allocated":10358784,"data_stored":5061317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.727400"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429564+0000","last_change":"2024-09-13T19:01:02.429564+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429564+0000","last_undegraded":"2024-09-13T19:01:02.429564+0000","last_fullsized":"2024-09-13T19:01:02.429564+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422259+0000","last_change":"2024-09-13T19:01:02.422259+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422259+0000","last_undegraded":"2024-09-13T19:01:02.422259+0000","last_fullsized":"2024-09-13T19:01:02.422259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429495+0000","last_change":"2024-09-13T19:01:02.429495+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429495+0000","last_undegraded":"2024-09-13T19:01:02.429495+0000","last_fullsized":"2024-09-13T19:01:02.429495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430887+0000","last_change":"2024-09-13T19:01:02.430887+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430887+0000","last_undegraded":"2024-09-13T19:01:02.430887+0000","last_fullsized":"2024-09-13T19:01:02.430887+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425690+0000","last_change":"2024-09-13T19:01:02.425690+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425690+0000","last_undegraded":"2024-09-13T19:01:02.425690+0000","last_fullsized":"2024-09-13T19:01:02.425690+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429475+0000","last_change":"2024-09-13T19:01:02.429475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429475+0000","last_undegraded":"2024-09-13T19:01:02.429475+0000","last_fullsized":"2024-09-13T19:01:02.429475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425467+0000","last_change":"2024-09-13T19:01:02.425467+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425467+0000","last_undegraded":"2024-09-13T19:01:02.425467+0000","last_fullsized":"2024-09-13T19:01:02.425467+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426477+0000","last_change":"2024-09-13T19:01:02.426477+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426477+0000","last_undegraded":"2024-09-13T19:01:02.426477+0000","last_fullsized":"2024-09-13T19:01:02.426477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425772+0000","last_change":"2024-09-13T19:01:02.425772+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425772+0000","last_undegraded":"2024-09-13T19:01:02.425772+0000","last_fullsized":"2024-09-13T19:01:02.425772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.424993+0000","last_change":"2024-09-13T19:01:02.424993+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.424993+0000","last_undegraded":"2024-09-13T19:01:02.424993+0000","last_fullsized":"2024-09-13T19:01:02.424993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422277+0000","last_change":"2024-09-13T19:01:02.422277+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422277+0000","last_undegraded":"2024-09-13T19:01:02.422277+0000","last_fullsized":"2024-09-13T19:01:02.422277+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422124+0000","last_change":"2024-09-13T19:01:02.422124+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422124+0000","last_undegraded":"2024-09-13T19:01:02.422124+0000","last_fullsized":"2024-09-13T19:01:02.422124+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426501+0000","last_change":"2024-09-13T19:01:02.426501+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426501+0000","last_undegraded":"2024-09-13T19:01:02.426501+0000","last_fullsized":"2024-09-13T19:01:02.426501+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426492+0000","last_change":"2024-09-13T19:01:02.426492+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426492+0000","last_undegraded":"2024-09-13T19:01:02.426492+0000","last_fullsized":"2024-09-13T19:01:02.426492+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422091+0000","last_change":"2024-09-13T19:01:02.422091+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422091+0000","last_undegraded":"2024-09-13T19:01:02.422091+0000","last_fullsized":"2024-09-13T19:01:02.422091+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425623+0000","last_change":"2024-09-13T19:01:02.425623+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425623+0000","last_undegraded":"2024-09-13T19:01:02.425623+0000","last_fullsized":"2024-09-13T19:01:02.425623+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422116+0000","last_change":"2024-09-13T19:01:02.422116+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422116+0000","last_undegraded":"2024-09-13T19:01:02.422116+0000","last_fullsized":"2024-09-13T19:01:02.422116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425379+0000","last_change":"2024-09-13T19:01:02.425379+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425379+0000","last_undegraded":"2024-09-13T19:01:02.425379+0000","last_fullsized":"2024-09-13T19:01:02.425379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429438+0000","last_change":"2024-09-13T19:01:02.429438+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429438+0000","last_undegraded":"2024-09-13T19:01:02.429438+0000","last_fullsized":"2024-09-13T19:01:02.429438+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430305+0000","last_change":"2024-09-13T19:01:02.430305+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430305+0000","last_undegraded":"2024-09-13T19:01:02.430305+0000","last_fullsized":"2024-09-13T19:01:02.430305+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430367+0000","last_change":"2024-09-13T19:01:02.430367+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430367+0000","last_undegraded":"2024-09-13T19:01:02.430367+0000","last_fullsized":"2024-09-13T19:01:02.430367+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430365+0000","last_change":"2024-09-13T19:01:02.430365+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430365+0000","last_undegraded":"2024-09-13T19:01:02.430365+0000","last_fullsized":"2024-09-13T19:01:02.430365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429454+0000","last_change":"2024-09-13T19:01:02.429454+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429454+0000","last_undegraded":"2024-09-13T19:01:02.429454+0000","last_fullsized":"2024-09-13T19:01:02.429454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.435441+0000","last_change":"2024-09-13T19:01:02.435441+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.435441+0000","last_undegraded":"2024-09-13T19:01:02.435441+0000","last_fullsized":"2024-09-13T19:01:02.435441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430199+0000","last_change":"2024-09-13T19:01:02.430199+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430199+0000","last_undegraded":"2024-09-13T19:01:02.430199+0000","last_fullsized":"2024-09-13T19:01:02.430199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430269+0000","last_change":"2024-09-13T19:01:02.430269+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430269+0000","last_undegraded":"2024-09-13T19:01:02.430269+0000","last_fullsized":"2024-09-13T19:01:02.430269+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425398+0000","last_change":"2024-09-13T19:01:02.425398+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425398+0000","last_undegraded":"2024-09-13T19:01:02.425398+0000","last_fullsized":"2024-09-13T19:01:02.425398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429576+0000","last_change":"2024-09-13T19:01:02.429576+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429576+0000","last_undegraded":"2024-09-13T19:01:02.429576+0000","last_fullsized":"2024-09-13T19:01:02.429576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425475+0000","last_change":"2024-09-13T19:01:02.425475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425475+0000","last_undegraded":"2024-09-13T19:01:02.425475+0000","last_fullsized":"2024-09-13T19:01:02.425475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425505+0000","last_change":"2024-09-13T19:01:02.425505+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425505+0000","last_undegraded":"2024-09-13T19:01:02.425505+0000","last_fullsized":"2024-09-13T19:01:02.425505+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426494+0000","last_change":"2024-09-13T19:01:02.426494+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426494+0000","last_undegraded":"2024-09-13T19:01:02.426494+0000","last_fullsized":"2024-09-13T19:01:02.426494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422244+0000","last_change":"2024-09-13T19:01:02.422244+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422244+0000","last_undegraded":"2024-09-13T19:01:02.422244+0000","last_fullsized":"2024-09-13T19:01:02.422244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T19:00:59.746786+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:59.746786+0000","last_peered":"2024-09-13T19:00:59.746786+0000","last_clean":"2024-09-13T19:00:59.746786+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:59.746786+0000","last_undegraded":"2024-09-13T19:00:59.746786+0000","last_fullsized":"2024-09-13T19:00:59.746786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.84799999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.876}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.433},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.499}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.622},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.79100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:08.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:08.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.248+0000 7f8f5b400640 1 Processor -- start 2024-09-13T19:01:08.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.248+0000 7f8f5b400640 1 -- start start 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.249+0000 7f8f5b400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8f540b1e40 0x7f8f54159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f540b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f5b400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f540b2660 0x7f8f540b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f5b400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5415a430 con 0x7f8f540b2660 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f5b400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f541598b0 con 0x7f8f540b1e40 2024-09-13T19:01:08.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f5b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54159b90 con 0x7f8f540b2220 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f540b2660 0x7f8f540b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f540b2660 0x7f8f540b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53266/0 (socket says 172.21.15.33:53266) 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 -- 172.21.15.33:0/1815813992 learned_addr learned my addr 172.21.15.33:0/1815813992 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f53e00640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f540b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f58a00640 1 --2- 172.21.15.33:0/1815813992 >> v2:172.21.15.103:3300/0 conn(0x7f8f540b1e40 0x7f8f54159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 -- 172.21.15.33:0/1815813992 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 msgr2=0x7f8f540b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f540b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 -- 172.21.15.33:0/1815813992 >> v2:172.21.15.103:3300/0 conn(0x7f8f540b1e40 msgr2=0x7f8f54159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 --2- 172.21.15.33:0/1815813992 >> v2:172.21.15.103:3300/0 conn(0x7f8f540b1e40 0x7f8f54159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.250+0000 7f8f59400640 1 -- 172.21.15.33:0/1815813992 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54159e70 con 0x7f8f540b2660 2024-09-13T19:01:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.251+0000 7f8f59400640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b2660 0x7f8f540b3100 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8f5406daf0 tx=0x7f8f4c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338a16ab8f85083d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f53400640 1 -- 172.21.15.33:0/1815813992 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c031600 con 0x7f8f540b2660 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f53400640 1 -- 172.21.15.33:0/1815813992 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c02d050 con 0x7f8f540b2660 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f53400640 1 -- 172.21.15.33:0/1815813992 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c031980 con 0x7f8f540b2660 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 -- 172.21.15.33:0/1815813992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b2660 msgr2=0x7f8f540b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b2660 0x7f8f540b3100 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8f5406daf0 tx=0x7f8f4c02a610 comp rx=0 tx=0).stop 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 -- 172.21.15.33:0/1815813992 shutdown_connections 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f540b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 --2- 172.21.15.33:0/1815813992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b2660 0x7f8f540b3100 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 --2- 172.21.15.33:0/1815813992 >> v2:172.21.15.103:3300/0 conn(0x7f8f540b1e40 0x7f8f54159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 -- 172.21.15.33:0/1815813992 >> 172.21.15.33:0/1815813992 conn(0x7f8f540b0510 msgr2=0x7f8f540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 -- 172.21.15.33:0/1815813992 shutdown_connections 2024-09-13T19:01:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.252+0000 7f8f5b400640 1 -- 172.21.15.33:0/1815813992 wait complete. 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.254+0000 7f8f5b400640 1 Processor -- start 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.254+0000 7f8f5b400640 1 -- start start 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f5415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f540b2660 0x7f8f5415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5413e7e0 con 0x7f8f540b1e40 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5406ce50 con 0x7f8f540b2660 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f5b400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54158a40 con 0x7f8f540b2220 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f58a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f58a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53280/0 (socket says 172.21.15.33:53280) 2024-09-13T19:01:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f58a00640 1 -- 172.21.15.33:0/2442396843 learned_addr learned my addr 172.21.15.33:0/2442396843 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f53e00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f5415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.255+0000 7f8f59400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f540b2660 0x7f8f5415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 -- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 msgr2=0x7f8f5415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f5415c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 -- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f540b2660 msgr2=0x7f8f5415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f540b2660 0x7f8f5415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 -- 172.21.15.33:0/2442396843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c009b30 con 0x7f8f540b1e40 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f58a00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800d800 tx=0x7f8f4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800b6c0 con 0x7f8f540b1e40 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4800b820 con 0x7f8f540b1e40 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800bbb0 con 0x7f8f540b1e40 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5413deb0 con 0x7f8f540b1e40 2024-09-13T19:01:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.256+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5413e470 con 0x7f8f540b1e40 2024-09-13T19:01:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.258+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5406bdf0 con 0x7f8f540b1e40 2024-09-13T19:01:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.258+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f4800bd10 con 0x7f8f540b1e40 2024-09-13T19:01:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.259+0000 7f8f50c00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 0x7f8f3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.259+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f48089780 con 0x7f8f540b1e40 2024-09-13T19:01:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.260+0000 7f8f53e00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 0x7f8f3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.261+0000 7f8f53e00640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 0x7f8f3406d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8f541f5720 tx=0x7f8f40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.263+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f48054aa0 con 0x7f8f540b1e40 2024-09-13T19:01:08.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.440+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f541421b0 con 0x7f8f3406ac00 2024-09-13T19:01:08.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.448+0000 7f8f50c00640 1 -- 172.21.15.33:0/2442396843 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278623 (secure 0 0 0) 0x7f8f541421b0 con 0x7f8f3406ac00 2024-09-13T19:01:08.455 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:08.457 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 msgr2=0x7f8f3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 0x7f8f3406d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8f541f5720 tx=0x7f8f40008040 comp rx=0 tx=0).stop 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 msgr2=0x7f8f54158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800d800 tx=0x7f8f4800dcc0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 shutdown_connections 2024-09-13T19:01:08.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8f3406ac00 0x7f8f3406d0c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f540b2660 0x7f8f5415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8f540b2220 0x7f8f5415c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 --2- 172.21.15.33:0/2442396843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f540b1e40 0x7f8f54158500 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 >> 172.21.15.33:0/2442396843 conn(0x7f8f540b0510 msgr2=0x7f8f540aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 shutdown_connections 2024-09-13T19:01:08.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.452+0000 7f8f5b400640 1 -- 172.21.15.33:0/2442396843 wait complete. 2024-09-13T19:01:08.472 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T19:01:07.148852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254952,"kb_used_data":10116,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754719768,"statfs":{"total":773094113280,"available":772833042432,"internally_reserved":0,"allocated":10358784,"data_stored":5061317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.727400"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429564+0000","last_change":"2024-09-13T19:01:02.429564+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429564+0000","last_undegraded":"2024-09-13T19:01:02.429564+0000","last_fullsized":"2024-09-13T19:01:02.429564+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422259+0000","last_change":"2024-09-13T19:01:02.422259+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422259+0000","last_undegraded":"2024-09-13T19:01:02.422259+0000","last_fullsized":"2024-09-13T19:01:02.422259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429495+0000","last_change":"2024-09-13T19:01:02.429495+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429495+0000","last_undegraded":"2024-09-13T19:01:02.429495+0000","last_fullsized":"2024-09-13T19:01:02.429495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430887+0000","last_change":"2024-09-13T19:01:02.430887+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430887+0000","last_undegraded":"2024-09-13T19:01:02.430887+0000","last_fullsized":"2024-09-13T19:01:02.430887+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425690+0000","last_change":"2024-09-13T19:01:02.425690+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425690+0000","last_undegraded":"2024-09-13T19:01:02.425690+0000","last_fullsized":"2024-09-13T19:01:02.425690+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429475+0000","last_change":"2024-09-13T19:01:02.429475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429475+0000","last_undegraded":"2024-09-13T19:01:02.429475+0000","last_fullsized":"2024-09-13T19:01:02.429475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425467+0000","last_change":"2024-09-13T19:01:02.425467+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425467+0000","last_undegraded":"2024-09-13T19:01:02.425467+0000","last_fullsized":"2024-09-13T19:01:02.425467+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426477+0000","last_change":"2024-09-13T19:01:02.426477+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426477+0000","last_undegraded":"2024-09-13T19:01:02.426477+0000","last_fullsized":"2024-09-13T19:01:02.426477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425772+0000","last_change":"2024-09-13T19:01:02.425772+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425772+0000","last_undegraded":"2024-09-13T19:01:02.425772+0000","last_fullsized":"2024-09-13T19:01:02.425772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.424993+0000","last_change":"2024-09-13T19:01:02.424993+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.424993+0000","last_undegraded":"2024-09-13T19:01:02.424993+0000","last_fullsized":"2024-09-13T19:01:02.424993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422277+0000","last_change":"2024-09-13T19:01:02.422277+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422277+0000","last_undegraded":"2024-09-13T19:01:02.422277+0000","last_fullsized":"2024-09-13T19:01:02.422277+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422124+0000","last_change":"2024-09-13T19:01:02.422124+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422124+0000","last_undegraded":"2024-09-13T19:01:02.422124+0000","last_fullsized":"2024-09-13T19:01:02.422124+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426501+0000","last_change":"2024-09-13T19:01:02.426501+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426501+0000","last_undegraded":"2024-09-13T19:01:02.426501+0000","last_fullsized":"2024-09-13T19:01:02.426501+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426492+0000","last_change":"2024-09-13T19:01:02.426492+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426492+0000","last_undegraded":"2024-09-13T19:01:02.426492+0000","last_fullsized":"2024-09-13T19:01:02.426492+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422091+0000","last_change":"2024-09-13T19:01:02.422091+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422091+0000","last_undegraded":"2024-09-13T19:01:02.422091+0000","last_fullsized":"2024-09-13T19:01:02.422091+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425623+0000","last_change":"2024-09-13T19:01:02.425623+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425623+0000","last_undegraded":"2024-09-13T19:01:02.425623+0000","last_fullsized":"2024-09-13T19:01:02.425623+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422116+0000","last_change":"2024-09-13T19:01:02.422116+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422116+0000","last_undegraded":"2024-09-13T19:01:02.422116+0000","last_fullsized":"2024-09-13T19:01:02.422116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425379+0000","last_change":"2024-09-13T19:01:02.425379+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425379+0000","last_undegraded":"2024-09-13T19:01:02.425379+0000","last_fullsized":"2024-09-13T19:01:02.425379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429438+0000","last_change":"2024-09-13T19:01:02.429438+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429438+0000","last_undegraded":"2024-09-13T19:01:02.429438+0000","last_fullsized":"2024-09-13T19:01:02.429438+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430305+0000","last_change":"2024-09-13T19:01:02.430305+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430305+0000","last_undegraded":"2024-09-13T19:01:02.430305+0000","last_fullsized":"2024-09-13T19:01:02.430305+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430367+0000","last_change":"2024-09-13T19:01:02.430367+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430367+0000","last_undegraded":"2024-09-13T19:01:02.430367+0000","last_fullsized":"2024-09-13T19:01:02.430367+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430365+0000","last_change":"2024-09-13T19:01:02.430365+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430365+0000","last_undegraded":"2024-09-13T19:01:02.430365+0000","last_fullsized":"2024-09-13T19:01:02.430365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429454+0000","last_change":"2024-09-13T19:01:02.429454+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429454+0000","last_undegraded":"2024-09-13T19:01:02.429454+0000","last_fullsized":"2024-09-13T19:01:02.429454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.435441+0000","last_change":"2024-09-13T19:01:02.435441+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.435441+0000","last_undegraded":"2024-09-13T19:01:02.435441+0000","last_fullsized":"2024-09-13T19:01:02.435441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430199+0000","last_change":"2024-09-13T19:01:02.430199+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430199+0000","last_undegraded":"2024-09-13T19:01:02.430199+0000","last_fullsized":"2024-09-13T19:01:02.430199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430269+0000","last_change":"2024-09-13T19:01:02.430269+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430269+0000","last_undegraded":"2024-09-13T19:01:02.430269+0000","last_fullsized":"2024-09-13T19:01:02.430269+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425398+0000","last_change":"2024-09-13T19:01:02.425398+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425398+0000","last_undegraded":"2024-09-13T19:01:02.425398+0000","last_fullsized":"2024-09-13T19:01:02.425398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429576+0000","last_change":"2024-09-13T19:01:02.429576+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429576+0000","last_undegraded":"2024-09-13T19:01:02.429576+0000","last_fullsized":"2024-09-13T19:01:02.429576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425475+0000","last_change":"2024-09-13T19:01:02.425475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425475+0000","last_undegraded":"2024-09-13T19:01:02.425475+0000","last_fullsized":"2024-09-13T19:01:02.425475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425505+0000","last_change":"2024-09-13T19:01:02.425505+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425505+0000","last_undegraded":"2024-09-13T19:01:02.425505+0000","last_fullsized":"2024-09-13T19:01:02.425505+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426494+0000","last_change":"2024-09-13T19:01:02.426494+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426494+0000","last_undegraded":"2024-09-13T19:01:02.426494+0000","last_fullsized":"2024-09-13T19:01:02.426494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422244+0000","last_change":"2024-09-13T19:01:02.422244+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422244+0000","last_undegraded":"2024-09-13T19:01:02.422244+0000","last_fullsized":"2024-09-13T19:01:02.422244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T19:00:59.746786+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:59.746786+0000","last_peered":"2024-09-13T19:00:59.746786+0000","last_clean":"2024-09-13T19:00:59.746786+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:59.746786+0000","last_undegraded":"2024-09-13T19:00:59.746786+0000","last_fullsized":"2024-09-13T19:00:59.746786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.84799999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.876}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.433},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.499}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.622},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.79100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:08.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:08.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.664+0000 7f7731e00640 1 Processor -- start 2024-09-13T19:01:08.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.664+0000 7f7731e00640 1 -- start start 2024-09-13T19:01:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f7731e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f7731e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f772c159a80 0x7f772c0b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f7731e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c153f00 con 0x7f772c0b2410 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f7731e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0ce600 con 0x7f772c159a80 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f7731e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c070f90 con 0x7f772c153b20 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f772a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f772c159a80 0x7f772c0b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f772b400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f772c0b2410 0x7f772c06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50844/0 (socket says 172.21.15.33:50844) 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.665+0000 7f772b400640 1 -- 172.21.15.33:0/22678243 learned_addr learned my addr 172.21.15.33:0/22678243 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772aa00640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772a000640 1 -- 172.21.15.33:0/22678243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 msgr2=0x7f772c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772a000640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772a000640 1 -- 172.21.15.33:0/22678243 >> v1:172.21.15.33:6789/0 conn(0x7f772c0b2410 legacy=0x7f772c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772a000640 1 -- 172.21.15.33:0/22678243 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0b1a40 con 0x7f772c159a80 2024-09-13T19:01:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f772aa00640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.666+0000 7f7729600640 1 -- 172.21.15.33:0/22678243 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892673215 0 0) 0x7f772c153f00 con 0x7f772c0b2410 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.667+0000 7f772a000640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c0b1ed0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f77180097d0 tx=0x7f771802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368928adf3778789 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.667+0000 7f7729600640 1 -- 172.21.15.33:0/22678243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718032440 con 0x7f772c159a80 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.667+0000 7f7729600640 1 -- 172.21.15.33:0/22678243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180325a0 con 0x7f772c159a80 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.667+0000 7f7729600640 1 -- 172.21.15.33:0/22678243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718032930 con 0x7f772c159a80 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 -- 172.21.15.33:0/22678243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 msgr2=0x7f772c0b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c0b1ed0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f77180097d0 tx=0x7f771802a1c0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 -- 172.21.15.33:0/22678243 shutdown_connections 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c0b1ed0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 --2- 172.21.15.33:0/22678243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 -- 172.21.15.33:0/22678243 >> 172.21.15.33:0/22678243 conn(0x7f772c0b0510 msgr2=0x7f772c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 -- 172.21.15.33:0/22678243 shutdown_connections 2024-09-13T19:01:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.668+0000 7f7731e00640 1 -- 172.21.15.33:0/22678243 wait complete. 2024-09-13T19:01:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.669+0000 7f7731e00640 1 Processor -- start 2024-09-13T19:01:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 -- start start 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f772c0b2410 0x7f772c153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1661f0 con 0x7f772c159a80 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c153570 con 0x7f772c0b2410 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.670+0000 7f7731e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c166440 con 0x7f772c153b20 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53296/0 (socket says 172.21.15.33:53296) 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 -- 172.21.15.33:0/448041707 learned_addr learned my addr 172.21.15.33:0/448041707 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772aa00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f772c0b2410 0x7f772c153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772a000640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 -- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 msgr2=0x7f772c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 -- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f772c0b2410 msgr2=0x7f772c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f772c0b2410 0x7f772c153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 -- 172.21.15.33:0/448041707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009400 con 0x7f772c159a80 2024-09-13T19:01:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.671+0000 7f772b400640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f772400c700 tx=0x7f772400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.672+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ce10 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.672+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400a640 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.672+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400aa70 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.672+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c166720 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.672+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c166ce0 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.673+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c166ed0 con 0x7f772c159a80 2024-09-13T19:01:08.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.674+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f772400abd0 con 0x7f772c159a80 2024-09-13T19:01:08.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.675+0000 7f7723400640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 0x7f770c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:08.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.675+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77240887e0 con 0x7f772c159a80 2024-09-13T19:01:08.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.675+0000 7f772aa00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 0x7f770c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:08.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.676+0000 7f772aa00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 0x7f770c06d0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f771c00aac0 tx=0x7f771c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.679+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7724053a70 con 0x7f772c159a80 2024-09-13T19:01:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.855+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f772c0cdae0 con 0x7f770c06ac00 2024-09-13T19:01:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.862+0000 7f7723400640 1 -- 172.21.15.33:0/448041707 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278623 (secure 0 0 0) 0x7f772c0cdae0 con 0x7f770c06ac00 2024-09-13T19:01:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 msgr2=0x7f770c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 0x7f770c06d0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f771c00aac0 tx=0x7f771c008040 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 msgr2=0x7f772c06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f772400c700 tx=0x7f772400cbc0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 shutdown_connections 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f770c06ac00 0x7f770c06d0c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c159a80 0x7f772c06fba0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f772c153b20 0x7f772c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 --2- 172.21.15.33:0/448041707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f772c0b2410 0x7f772c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.866+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 >> 172.21.15.33:0/448041707 conn(0x7f772c0b0510 msgr2=0x7f772c0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.867+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 shutdown_connections 2024-09-13T19:01:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:08.867+0000 7f7731e00640 1 -- 172.21.15.33:0/448041707 wait complete. 2024-09-13T19:01:08.886 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T19:01:07.148852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254952,"kb_used_data":10116,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754719768,"statfs":{"total":773094113280,"available":772833042432,"internally_reserved":0,"allocated":10358784,"data_stored":5061317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.727400"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429564+0000","last_change":"2024-09-13T19:01:02.429564+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429564+0000","last_undegraded":"2024-09-13T19:01:02.429564+0000","last_fullsized":"2024-09-13T19:01:02.429564+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422259+0000","last_change":"2024-09-13T19:01:02.422259+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422259+0000","last_undegraded":"2024-09-13T19:01:02.422259+0000","last_fullsized":"2024-09-13T19:01:02.422259+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429495+0000","last_change":"2024-09-13T19:01:02.429495+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429495+0000","last_undegraded":"2024-09-13T19:01:02.429495+0000","last_fullsized":"2024-09-13T19:01:02.429495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430887+0000","last_change":"2024-09-13T19:01:02.430887+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430887+0000","last_undegraded":"2024-09-13T19:01:02.430887+0000","last_fullsized":"2024-09-13T19:01:02.430887+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425690+0000","last_change":"2024-09-13T19:01:02.425690+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425690+0000","last_undegraded":"2024-09-13T19:01:02.425690+0000","last_fullsized":"2024-09-13T19:01:02.425690+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429475+0000","last_change":"2024-09-13T19:01:02.429475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429475+0000","last_undegraded":"2024-09-13T19:01:02.429475+0000","last_fullsized":"2024-09-13T19:01:02.429475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425467+0000","last_change":"2024-09-13T19:01:02.425467+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425467+0000","last_undegraded":"2024-09-13T19:01:02.425467+0000","last_fullsized":"2024-09-13T19:01:02.425467+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426477+0000","last_change":"2024-09-13T19:01:02.426477+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426477+0000","last_undegraded":"2024-09-13T19:01:02.426477+0000","last_fullsized":"2024-09-13T19:01:02.426477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425772+0000","last_change":"2024-09-13T19:01:02.425772+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425772+0000","last_undegraded":"2024-09-13T19:01:02.425772+0000","last_fullsized":"2024-09-13T19:01:02.425772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.424993+0000","last_change":"2024-09-13T19:01:02.424993+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.424993+0000","last_undegraded":"2024-09-13T19:01:02.424993+0000","last_fullsized":"2024-09-13T19:01:02.424993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422277+0000","last_change":"2024-09-13T19:01:02.422277+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422277+0000","last_undegraded":"2024-09-13T19:01:02.422277+0000","last_fullsized":"2024-09-13T19:01:02.422277+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422124+0000","last_change":"2024-09-13T19:01:02.422124+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422124+0000","last_undegraded":"2024-09-13T19:01:02.422124+0000","last_fullsized":"2024-09-13T19:01:02.422124+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426501+0000","last_change":"2024-09-13T19:01:02.426501+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426501+0000","last_undegraded":"2024-09-13T19:01:02.426501+0000","last_fullsized":"2024-09-13T19:01:02.426501+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426492+0000","last_change":"2024-09-13T19:01:02.426492+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426492+0000","last_undegraded":"2024-09-13T19:01:02.426492+0000","last_fullsized":"2024-09-13T19:01:02.426492+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422091+0000","last_change":"2024-09-13T19:01:02.422091+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422091+0000","last_undegraded":"2024-09-13T19:01:02.422091+0000","last_fullsized":"2024-09-13T19:01:02.422091+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425623+0000","last_change":"2024-09-13T19:01:02.425623+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425623+0000","last_undegraded":"2024-09-13T19:01:02.425623+0000","last_fullsized":"2024-09-13T19:01:02.425623+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422116+0000","last_change":"2024-09-13T19:01:02.422116+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422116+0000","last_undegraded":"2024-09-13T19:01:02.422116+0000","last_fullsized":"2024-09-13T19:01:02.422116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425379+0000","last_change":"2024-09-13T19:01:02.425379+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425379+0000","last_undegraded":"2024-09-13T19:01:02.425379+0000","last_fullsized":"2024-09-13T19:01:02.425379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429438+0000","last_change":"2024-09-13T19:01:02.429438+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429438+0000","last_undegraded":"2024-09-13T19:01:02.429438+0000","last_fullsized":"2024-09-13T19:01:02.429438+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430305+0000","last_change":"2024-09-13T19:01:02.430305+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430305+0000","last_undegraded":"2024-09-13T19:01:02.430305+0000","last_fullsized":"2024-09-13T19:01:02.430305+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430367+0000","last_change":"2024-09-13T19:01:02.430367+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430367+0000","last_undegraded":"2024-09-13T19:01:02.430367+0000","last_fullsized":"2024-09-13T19:01:02.430367+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430365+0000","last_change":"2024-09-13T19:01:02.430365+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430365+0000","last_undegraded":"2024-09-13T19:01:02.430365+0000","last_fullsized":"2024-09-13T19:01:02.430365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429454+0000","last_change":"2024-09-13T19:01:02.429454+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429454+0000","last_undegraded":"2024-09-13T19:01:02.429454+0000","last_fullsized":"2024-09-13T19:01:02.429454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.435441+0000","last_change":"2024-09-13T19:01:02.435441+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.435441+0000","last_undegraded":"2024-09-13T19:01:02.435441+0000","last_fullsized":"2024-09-13T19:01:02.435441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430199+0000","last_change":"2024-09-13T19:01:02.430199+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430199+0000","last_undegraded":"2024-09-13T19:01:02.430199+0000","last_fullsized":"2024-09-13T19:01:02.430199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.430269+0000","last_change":"2024-09-13T19:01:02.430269+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.430269+0000","last_undegraded":"2024-09-13T19:01:02.430269+0000","last_fullsized":"2024-09-13T19:01:02.430269+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425398+0000","last_change":"2024-09-13T19:01:02.425398+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425398+0000","last_undegraded":"2024-09-13T19:01:02.425398+0000","last_fullsized":"2024-09-13T19:01:02.425398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.429576+0000","last_change":"2024-09-13T19:01:02.429576+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.429576+0000","last_undegraded":"2024-09-13T19:01:02.429576+0000","last_fullsized":"2024-09-13T19:01:02.429576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425475+0000","last_change":"2024-09-13T19:01:02.425475+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425475+0000","last_undegraded":"2024-09-13T19:01:02.425475+0000","last_fullsized":"2024-09-13T19:01:02.425475+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.425505+0000","last_change":"2024-09-13T19:01:02.425505+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.425505+0000","last_undegraded":"2024-09-13T19:01:02.425505+0000","last_fullsized":"2024-09-13T19:01:02.425505+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.426494+0000","last_change":"2024-09-13T19:01:02.426494+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.426494+0000","last_undegraded":"2024-09-13T19:01:02.426494+0000","last_fullsized":"2024-09-13T19:01:02.426494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T19:01:03.419197+0000","last_change":"2024-09-13T19:01:03.419197+0000","last_active":"2024-09-13T19:01:03.419197+0000","last_peered":"2024-09-13T19:01:03.419197+0000","last_clean":"2024-09-13T19:01:03.419197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:03.419197+0000","last_undegraded":"2024-09-13T19:01:03.419197+0000","last_fullsized":"2024-09-13T19:01:03.419197+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T19:01:02.422244+0000","last_change":"2024-09-13T19:01:02.422244+0000","last_active":"2024-09-13T19:01:02.409989+0000","last_peered":"2024-09-13T19:01:02.409989+0000","last_clean":"2024-09-13T19:01:02.409989+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T19:01:02.422244+0000","last_undegraded":"2024-09-13T19:01:02.422244+0000","last_fullsized":"2024-09-13T19:01:02.422244+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T19:00:59.746786+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:00:59.746786+0000","last_peered":"2024-09-13T19:00:59.746786+0000","last_clean":"2024-09-13T19:00:59.746786+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:00:59.746786+0000","last_undegraded":"2024-09-13T19:00:59.746786+0000","last_fullsized":"2024-09-13T19:00:59.746786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59299999999999997,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.53500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82499999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48299999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51600000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.84799999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.876}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.433},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.499}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":487254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.294,"15min":1.294},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98599999999999999,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94399999999999995,"5min":1.075,"15min":1.075},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92700000000000005,"5min":1.474,"15min":1.474},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":1.232,"15min":1.232},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82299999999999995,"5min":1.117,"15min":1.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92000000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86099999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.44},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.622},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":481437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.621}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.79100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1744896,"data_stored":1077622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:08.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-09-13T19:01:08.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2024-09-13T19:01:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2024-09-13T19:01:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2024-09-13T19:01:08.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429564+0000', 'last_change': '2024-09-13T19:01:02.429564+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429564+0000', 'last_undegraded': '2024-09-13T19:01:02.429564+0000', 'last_fullsized': '2024-09-13T19:01:02.429564+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422259+0000', 'last_change': '2024-09-13T19:01:02.422259+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422259+0000', 'last_undegraded': '2024-09-13T19:01:02.422259+0000', 'last_fullsized': '2024-09-13T19:01:02.422259+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-09-13T19:01:08.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429495+0000', 'last_change': '2024-09-13T19:01:02.429495+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429495+0000', 'last_undegraded': '2024-09-13T19:01:02.429495+0000', 'last_fullsized': '2024-09-13T19:01:02.429495+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430887+0000', 'last_change': '2024-09-13T19:01:02.430887+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430887+0000', 'last_undegraded': '2024-09-13T19:01:02.430887+0000', 'last_fullsized': '2024-09-13T19:01:02.430887+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425690+0000', 'last_change': '2024-09-13T19:01:02.425690+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425690+0000', 'last_undegraded': '2024-09-13T19:01:02.425690+0000', 'last_fullsized': '2024-09-13T19:01:02.425690+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429475+0000', 'last_change': '2024-09-13T19:01:02.429475+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429475+0000', 'last_undegraded': '2024-09-13T19:01:02.429475+0000', 'last_fullsized': '2024-09-13T19:01:02.429475+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2024-09-13T19:01:08.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425467+0000', 'last_change': '2024-09-13T19:01:02.425467+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425467+0000', 'last_undegraded': '2024-09-13T19:01:02.425467+0000', 'last_fullsized': '2024-09-13T19:01:02.425467+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.426477+0000', 'last_change': '2024-09-13T19:01:02.426477+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.426477+0000', 'last_undegraded': '2024-09-13T19:01:02.426477+0000', 'last_fullsized': '2024-09-13T19:01:02.426477+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425772+0000', 'last_change': '2024-09-13T19:01:02.425772+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425772+0000', 'last_undegraded': '2024-09-13T19:01:02.425772+0000', 'last_fullsized': '2024-09-13T19:01:02.425772+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.424993+0000', 'last_change': '2024-09-13T19:01:02.424993+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.424993+0000', 'last_undegraded': '2024-09-13T19:01:02.424993+0000', 'last_fullsized': '2024-09-13T19:01:02.424993+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422277+0000', 'last_change': '2024-09-13T19:01:02.422277+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422277+0000', 'last_undegraded': '2024-09-13T19:01:02.422277+0000', 'last_fullsized': '2024-09-13T19:01:02.422277+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422124+0000', 'last_change': '2024-09-13T19:01:02.422124+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422124+0000', 'last_undegraded': '2024-09-13T19:01:02.422124+0000', 'last_fullsized': '2024-09-13T19:01:02.422124+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T19:01:08.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.426501+0000', 'last_change': '2024-09-13T19:01:02.426501+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.426501+0000', 'last_undegraded': '2024-09-13T19:01:02.426501+0000', 'last_fullsized': '2024-09-13T19:01:02.426501+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.426492+0000', 'last_change': '2024-09-13T19:01:02.426492+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.426492+0000', 'last_undegraded': '2024-09-13T19:01:02.426492+0000', 'last_fullsized': '2024-09-13T19:01:02.426492+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2024-09-13T19:01:08.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422091+0000', 'last_change': '2024-09-13T19:01:02.422091+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422091+0000', 'last_undegraded': '2024-09-13T19:01:02.422091+0000', 'last_fullsized': '2024-09-13T19:01:02.422091+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425623+0000', 'last_change': '2024-09-13T19:01:02.425623+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425623+0000', 'last_undegraded': '2024-09-13T19:01:02.425623+0000', 'last_fullsized': '2024-09-13T19:01:02.425623+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422116+0000', 'last_change': '2024-09-13T19:01:02.422116+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422116+0000', 'last_undegraded': '2024-09-13T19:01:02.422116+0000', 'last_fullsized': '2024-09-13T19:01:02.422116+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425379+0000', 'last_change': '2024-09-13T19:01:02.425379+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425379+0000', 'last_undegraded': '2024-09-13T19:01:02.425379+0000', 'last_fullsized': '2024-09-13T19:01:02.425379+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429438+0000', 'last_change': '2024-09-13T19:01:02.429438+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429438+0000', 'last_undegraded': '2024-09-13T19:01:02.429438+0000', 'last_fullsized': '2024-09-13T19:01:02.429438+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430305+0000', 'last_change': '2024-09-13T19:01:02.430305+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430305+0000', 'last_undegraded': '2024-09-13T19:01:02.430305+0000', 'last_fullsized': '2024-09-13T19:01:02.430305+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430367+0000', 'last_change': '2024-09-13T19:01:02.430367+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430367+0000', 'last_undegraded': '2024-09-13T19:01:02.430367+0000', 'last_fullsized': '2024-09-13T19:01:02.430367+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430365+0000', 'last_change': '2024-09-13T19:01:02.430365+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430365+0000', 'last_undegraded': '2024-09-13T19:01:02.430365+0000', 'last_fullsized': '2024-09-13T19:01:02.430365+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429454+0000', 'last_change': '2024-09-13T19:01:02.429454+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429454+0000', 'last_undegraded': '2024-09-13T19:01:02.429454+0000', 'last_fullsized': '2024-09-13T19:01:02.429454+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.435441+0000', 'last_change': '2024-09-13T19:01:02.435441+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.435441+0000', 'last_undegraded': '2024-09-13T19:01:02.435441+0000', 'last_fullsized': '2024-09-13T19:01:02.435441+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430199+0000', 'last_change': '2024-09-13T19:01:02.430199+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430199+0000', 'last_undegraded': '2024-09-13T19:01:02.430199+0000', 'last_fullsized': '2024-09-13T19:01:02.430199+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.430269+0000', 'last_change': '2024-09-13T19:01:02.430269+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.430269+0000', 'last_undegraded': '2024-09-13T19:01:02.430269+0000', 'last_fullsized': '2024-09-13T19:01:02.430269+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425398+0000', 'last_change': '2024-09-13T19:01:02.425398+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425398+0000', 'last_undegraded': '2024-09-13T19:01:02.425398+0000', 'last_fullsized': '2024-09-13T19:01:02.425398+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2024-09-13T19:01:08.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.429576+0000', 'last_change': '2024-09-13T19:01:02.429576+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.429576+0000', 'last_undegraded': '2024-09-13T19:01:02.429576+0000', 'last_fullsized': '2024-09-13T19:01:02.429576+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425475+0000', 'last_change': '2024-09-13T19:01:02.425475+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425475+0000', 'last_undegraded': '2024-09-13T19:01:02.425475+0000', 'last_fullsized': '2024-09-13T19:01:02.425475+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.425505+0000', 'last_change': '2024-09-13T19:01:02.425505+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.425505+0000', 'last_undegraded': '2024-09-13T19:01:02.425505+0000', 'last_fullsized': '2024-09-13T19:01:02.425505+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-09-13T19:01:08.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.426494+0000', 'last_change': '2024-09-13T19:01:02.426494+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.426494+0000', 'last_undegraded': '2024-09-13T19:01:02.426494+0000', 'last_fullsized': '2024-09-13T19:01:02.426494+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T19:01:03.419197+0000', 'last_change': '2024-09-13T19:01:03.419197+0000', 'last_active': '2024-09-13T19:01:03.419197+0000', 'last_peered': '2024-09-13T19:01:03.419197+0000', 'last_clean': '2024-09-13T19:01:03.419197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:03.419197+0000', 'last_undegraded': '2024-09-13T19:01:03.419197+0000', 'last_fullsized': '2024-09-13T19:01:03.419197+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:03.419197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2024-09-13T19:01:08.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T19:01:02.422244+0000', 'last_change': '2024-09-13T19:01:02.422244+0000', 'last_active': '2024-09-13T19:01:02.409989+0000', 'last_peered': '2024-09-13T19:01:02.409989+0000', 'last_clean': '2024-09-13T19:01:02.409989+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T19:01:02.422244+0000', 'last_undegraded': '2024-09-13T19:01:02.422244+0000', 'last_fullsized': '2024-09-13T19:01:02.422244+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'last_clean_scrub_stamp': '2024-09-13T19:01:02.409989+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T19:01:08.909 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T19:01:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.077+0000 7fa500a00640 1 Processor -- start 2024-09-13T19:01:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.077+0000 7fa500a00640 1 -- start start 2024-09-13T19:01:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa500a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 0x7fa4fc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa500a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc153f00 con 0x7fa4fc06f660 2024-09-13T19:01:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa500a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0b1a40 con 0x7fa4fc159a80 2024-09-13T19:01:09.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa500a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0ce600 con 0x7fa4fc153b20 2024-09-13T19:01:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa4fa800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa4fc06f660 0x7fa4fc06d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50850/0 (socket says 172.21.15.33:50850) 2024-09-13T19:01:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa4fa800640 1 -- 172.21.15.33:0/3268137748 learned_addr learned my addr 172.21.15.33:0/3268137748 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:09.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.079+0000 7fa4f9e00640 1 --2- 172.21.15.33:0/3268137748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 0x7fa4fc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70605299 0 0) 0x7fa4fc153f00 con 0x7fa4fc06f660 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e0003520 con 0x7fa4fc06f660 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846299865 0 0) 0x7fa4fc0b1a40 con 0x7fa4fc159a80 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4fc153f00 con 0x7fa4fc159a80 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9e00640 1 -- 172.21.15.33:0/3268137748 >> v1:172.21.15.103:6789/0 conn(0x7fa4fc159a80 legacy=0x7fa4fc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9e00640 1 -- 172.21.15.33:0/3268137748 >> v1:172.21.15.33:6789/0 conn(0x7fa4fc06f660 legacy=0x7fa4fc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.080+0000 7fa4f9e00640 1 -- 172.21.15.33:0/3268137748 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc15a1f0 con 0x7fa4fc153b20 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.081+0000 7fa4f9e00640 1 --2- 172.21.15.33:0/3268137748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 0x7fa4fc0b3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097d0 tx=0x7fa4ec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f408367ebe4855c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.081+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec032440 con 0x7fa4fc153b20 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.081+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec0325a0 con 0x7fa4fc153b20 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.081+0000 7fa4f9400640 1 -- 172.21.15.33:0/3268137748 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec032930 con 0x7fa4fc153b20 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 -- 172.21.15.33:0/3268137748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 msgr2=0x7fa4fc0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 --2- 172.21.15.33:0/3268137748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 0x7fa4fc0b3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097d0 tx=0x7fa4ec02a210 comp rx=0 tx=0).stop 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 -- 172.21.15.33:0/3268137748 shutdown_connections 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 --2- 172.21.15.33:0/3268137748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc153b20 0x7fa4fc0b3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 -- 172.21.15.33:0/3268137748 >> 172.21.15.33:0/3268137748 conn(0x7fa4fc0b0510 msgr2=0x7fa4fc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 -- 172.21.15.33:0/3268137748 shutdown_connections 2024-09-13T19:01:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.082+0000 7fa500a00640 1 -- 172.21.15.33:0/3268137748 wait complete. 2024-09-13T19:01:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.084+0000 7fa500a00640 1 Processor -- start 2024-09-13T19:01:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.084+0000 7fa500a00640 1 -- start start 2024-09-13T19:01:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc06f660 0x7fa4fc0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 0x7fa4fc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc15b8a0 con 0x7fa4fc153b20 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc15a9f0 con 0x7fa4fc159a80 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa500a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc15ac90 con 0x7fa4fc06f660 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53310/0 (socket says 172.21.15.33:53310) 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 -- 172.21.15.33:0/1596937054 learned_addr learned my addr 172.21.15.33:0/1596937054 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f9e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc06f660 0x7fa4fc0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4fa800640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 0x7fa4fc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 -- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc06f660 msgr2=0x7fa4fc0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc06f660 0x7fa4fc0b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 -- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 msgr2=0x7fa4fc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 0x7fa4fc0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4f3e00640 1 -- 172.21.15.33:0/1596937054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009400 con 0x7fa4fc153b20 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.085+0000 7fa4fa800640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 0x7fa4fc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa4f3e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c450 tx=0x7fa4e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40052d0 con 0x7fa4fc153b20 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4005430 con 0x7fa4fc153b20 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4012870 con 0x7fa4fc153b20 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc15af70 con 0x7fa4fc153b20 2024-09-13T19:01:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.086+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc15b530 con 0x7fa4fc153b20 2024-09-13T19:01:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.087+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc15ba10 con 0x7fa4fc153b20 2024-09-13T19:01:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.088+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4e40129d0 con 0x7fa4fc153b20 2024-09-13T19:01:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.089+0000 7fa4f2000640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 0x7fa4d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.089+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e4088ee0 con 0x7fa4fc153b20 2024-09-13T19:01:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.089+0000 7fa4f9e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 0x7fa4d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.090+0000 7fa4f9e00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 0x7fa4d806d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec034000 tx=0x7fa4ec02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.093+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa4e4054180 con 0x7fa4fc153b20 2024-09-13T19:01:09.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.338+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa4fc0b3990 con 0x7fa4fc153b20 2024-09-13T19:01:09.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.339+0000 7fa4f2000640 1 -- 172.21.15.33:0/1596937054 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7fa4e40577a0 con 0x7fa4fc153b20 2024-09-13T19:01:09.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:09.342 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":259,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":96,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253822,"num_in_osds":8,"osd_in_since":1726253813,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":261070848,"bytes_avail":772833042432,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":55,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7140}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-13T19:00:17.137750+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T19:01:09.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 msgr2=0x7fa4d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 0x7fa4d806d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec034000 tx=0x7fa4ec02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 msgr2=0x7fa4fc1f27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400c450 tx=0x7fa4e400c910 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 shutdown_connections 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4d806ac00 0x7fa4d806d0c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4fc159a80 0x7fa4fc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4fc153b20 0x7fa4fc1f27d0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 --2- 172.21.15.33:0/1596937054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4fc06f660 0x7fa4fc0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 >> 172.21.15.33:0/1596937054 conn(0x7fa4fc0b0510 msgr2=0x7fa4fc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 shutdown_connections 2024-09-13T19:01:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.341+0000 7fa500a00640 1 -- 172.21.15.33:0/1596937054 wait complete. 2024-09-13T19:01:09.360 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T19:01:09.360 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:09.407 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-09-13T19:01:09.403+0000 7fa4a1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T19:01:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.512+0000 7fe91ce00640 1 Processor -- start 2024-09-13T19:01:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.512+0000 7fe91ce00640 1 -- start start 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe91ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe918159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe91ce00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe91806f660 0x7fe91806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe91ce00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918159fc0 con 0x7fe918153b20 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe91ce00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180b3df0 con 0x7fe91806f660 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe91ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180ce600 con 0x7fe9180b3990 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe90fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe918159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe916800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe91806f660 0x7fe91806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe915e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe918153b20 0x7fe9180b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:60070/0 (socket says 172.21.15.33:60070) 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe915e00640 1 -- 172.21.15.33:0/323427037 learned_addr learned my addr 172.21.15.33:0/323427037 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.514+0000 7fe90fe00640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe918159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:57184/0 (socket says 172.21.15.33:57184) 2024-09-13T19:01:09.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.515+0000 7fe916800640 1 -- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 msgr2=0x7fe918159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.515+0000 7fe916800640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe918159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.515+0000 7fe916800640 1 -- 172.21.15.33:0/323427037 >> v1:172.21.15.103:6789/0 conn(0x7fe918153b20 legacy=0x7fe9180b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.515+0000 7fe916800640 1 -- 172.21.15.33:0/323427037 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918153f00 con 0x7fe91806f660 2024-09-13T19:01:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe916800640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe91806faf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315f0bd86889ec06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe915400640 1 -- 172.21.15.33:0/323427037 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910007740 con 0x7fe91806f660 2024-09-13T19:01:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe915400640 1 -- 172.21.15.33:0/323427037 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91002d050 con 0x7fe91806f660 2024-09-13T19:01:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe915400640 1 -- 172.21.15.33:0/323427037 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910007ac0 con 0x7fe91806f660 2024-09-13T19:01:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe91ce00640 1 -- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 msgr2=0x7fe91806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.516+0000 7fe91ce00640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe91806faf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe910009d90 tx=0x7fe91002a660 comp rx=0 tx=0).stop 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 -- 172.21.15.33:0/323427037 shutdown_connections 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe91806faf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 --2- 172.21.15.33:0/323427037 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe918159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 -- 172.21.15.33:0/323427037 >> 172.21.15.33:0/323427037 conn(0x7fe9180b0510 msgr2=0x7fe9180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 -- 172.21.15.33:0/323427037 shutdown_connections 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.517+0000 7fe91ce00640 1 -- 172.21.15.33:0/323427037 wait complete. 2024-09-13T19:01:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.518+0000 7fe91ce00640 1 Processor -- start 2024-09-13T19:01:09.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.518+0000 7fe91ce00640 1 -- start start 2024-09-13T19:01:09.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe9181f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe91815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815be30 con 0x7fe918153b20 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815caf0 con 0x7fe91806f660 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.519+0000 7fe91ce00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815b220 con 0x7fe9180b3990 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53326/0 (socket says 172.21.15.33:53326) 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 -- 172.21.15.33:0/2121196922 learned_addr learned my addr 172.21.15.33:0/2121196922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe90fe00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe91815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe915e00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe9181f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 -- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 msgr2=0x7fe91815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe91815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 -- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 msgr2=0x7fe9181f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe9181f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe916800640 1 -- 172.21.15.33:0/2121196922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009a70 con 0x7fe918153b20 2024-09-13T19:01:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.520+0000 7fe915e00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe9181f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe916800640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fe91002ac50 tx=0x7fe910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91003b820 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91003b980 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91815b500 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91003bcf0 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.521+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91815bac0 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.522+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91815bfe0 con 0x7fe918153b20 2024-09-13T19:01:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.523+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe910031400 con 0x7fe918153b20 2024-09-13T19:01:09.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.524+0000 7fe90e000640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 0x7fe8f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:09.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.524+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9100aac00 con 0x7fe918153b20 2024-09-13T19:01:09.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.524+0000 7fe915e00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 0x7fe8f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.525+0000 7fe915e00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 0x7fe8f406d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe908005880 tx=0x7fe908009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.528+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe91815bfe0 con 0x7fe918153b20 2024-09-13T19:01:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.703+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9180cd270 con 0x7fe8f406ac00 2024-09-13T19:01:09.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.711+0000 7fe90e000640 1 -- 172.21.15.33:0/2121196922 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289328 (secure 0 0 0) 0x7fe9180cd270 con 0x7fe8f406ac00 2024-09-13T19:01:09.717 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 msgr2=0x7fe8f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 0x7fe8f406d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe908005880 tx=0x7fe908009040 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 msgr2=0x7fe9181ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fe91002ac50 tx=0x7fe910004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 shutdown_connections 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe8f406ac00 0x7fe8f406d0c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe918153b20 0x7fe9181ef580 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe9180b3990 0x7fe91815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 --2- 172.21.15.33:0/2121196922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe91806f660 0x7fe9181f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.715+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 >> 172.21.15.33:0/2121196922 conn(0x7fe9180b0510 msgr2=0x7fe9180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:09.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.716+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 shutdown_connections 2024-09-13T19:01:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:09.716+0000 7fe91ce00640 1 -- 172.21.15.33:0/2121196922 wait complete. 2024-09-13T19:01:09.734 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-13T19:01:09.149309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255336,"kb_used_data":10504,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754719384,"statfs":{"total":773094113280,"available":772832649216,"internally_reserved":0,"allocated":10756096,"data_stored":5238292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001472"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918214+0000","last_change":"2024-09-13T19:01:03.883863+0000","last_active":"2024-09-13T19:01:04.918214+0000","last_peered":"2024-09-13T19:01:04.918214+0000","last_clean":"2024-09-13T19:01:04.918214+0000","last_became_active":"2024-09-13T19:01:03.883610+0000","last_became_peered":"2024-09-13T19:01:03.883610+0000","last_unstale":"2024-09-13T19:01:04.918214+0000","last_undegraded":"2024-09-13T19:01:04.918214+0000","last_fullsized":"2024-09-13T19:01:04.918214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.744220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881589+0000","last_change":"2024-09-13T19:01:03.890279+0000","last_active":"2024-09-13T19:01:04.881589+0000","last_peered":"2024-09-13T19:01:04.881589+0000","last_clean":"2024-09-13T19:01:04.881589+0000","last_became_active":"2024-09-13T19:01:03.890044+0000","last_became_peered":"2024-09-13T19:01:03.890044+0000","last_unstale":"2024-09-13T19:01:04.881589+0000","last_undegraded":"2024-09-13T19:01:04.881589+0000","last_fullsized":"2024-09-13T19:01:04.881589+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:12.950015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918012+0000","last_change":"2024-09-13T19:01:03.883130+0000","last_active":"2024-09-13T19:01:04.918012+0000","last_peered":"2024-09-13T19:01:04.918012+0000","last_clean":"2024-09-13T19:01:04.918012+0000","last_became_active":"2024-09-13T19:01:03.882883+0000","last_became_peered":"2024-09-13T19:01:03.882883+0000","last_unstale":"2024-09-13T19:01:04.918012+0000","last_undegraded":"2024-09-13T19:01:04.918012+0000","last_fullsized":"2024-09-13T19:01:04.918012+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:35.849669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916464+0000","last_change":"2024-09-13T19:01:03.878010+0000","last_active":"2024-09-13T19:01:04.916464+0000","last_peered":"2024-09-13T19:01:04.916464+0000","last_clean":"2024-09-13T19:01:04.916464+0000","last_became_active":"2024-09-13T19:01:03.877749+0000","last_became_peered":"2024-09-13T19:01:03.877749+0000","last_unstale":"2024-09-13T19:01:04.916464+0000","last_undegraded":"2024-09-13T19:01:04.916464+0000","last_fullsized":"2024-09-13T19:01:04.916464+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872565+0000","last_change":"2024-09-13T19:01:03.894778+0000","last_active":"2024-09-13T19:01:04.872565+0000","last_peered":"2024-09-13T19:01:04.872565+0000","last_clean":"2024-09-13T19:01:04.872565+0000","last_became_active":"2024-09-13T19:01:03.894389+0000","last_became_peered":"2024-09-13T19:01:03.894389+0000","last_unstale":"2024-09-13T19:01:04.872565+0000","last_undegraded":"2024-09-13T19:01:04.872565+0000","last_fullsized":"2024-09-13T19:01:04.872565+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874170+0000","last_change":"2024-09-13T19:01:03.884212+0000","last_active":"2024-09-13T19:01:04.874170+0000","last_peered":"2024-09-13T19:01:04.874170+0000","last_clean":"2024-09-13T19:01:04.874170+0000","last_became_active":"2024-09-13T19:01:03.883843+0000","last_became_peered":"2024-09-13T19:01:03.883843+0000","last_unstale":"2024-09-13T19:01:04.874170+0000","last_undegraded":"2024-09-13T19:01:04.874170+0000","last_fullsized":"2024-09-13T19:01:04.874170+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873281+0000","last_change":"2024-09-13T19:01:03.881920+0000","last_active":"2024-09-13T19:01:04.873281+0000","last_peered":"2024-09-13T19:01:04.873281+0000","last_clean":"2024-09-13T19:01:04.873281+0000","last_became_active":"2024-09-13T19:01:03.881340+0000","last_became_peered":"2024-09-13T19:01:03.881340+0000","last_unstale":"2024-09-13T19:01:04.873281+0000","last_undegraded":"2024-09-13T19:01:04.873281+0000","last_fullsized":"2024-09-13T19:01:04.873281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881348+0000","last_change":"2024-09-13T19:01:03.879072+0000","last_active":"2024-09-13T19:01:04.881348+0000","last_peered":"2024-09-13T19:01:04.881348+0000","last_clean":"2024-09-13T19:01:04.881348+0000","last_became_active":"2024-09-13T19:01:03.878728+0000","last_became_peered":"2024-09-13T19:01:03.878728+0000","last_unstale":"2024-09-13T19:01:04.881348+0000","last_undegraded":"2024-09-13T19:01:04.881348+0000","last_fullsized":"2024-09-13T19:01:04.881348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:07.051001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874103+0000","last_change":"2024-09-13T19:01:03.897047+0000","last_active":"2024-09-13T19:01:04.874103+0000","last_peered":"2024-09-13T19:01:04.874103+0000","last_clean":"2024-09-13T19:01:04.874103+0000","last_became_active":"2024-09-13T19:01:03.896701+0000","last_became_peered":"2024-09-13T19:01:03.896701+0000","last_unstale":"2024-09-13T19:01:04.874103+0000","last_undegraded":"2024-09-13T19:01:04.874103+0000","last_fullsized":"2024-09-13T19:01:04.874103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872406+0000","last_change":"2024-09-13T19:01:03.887712+0000","last_active":"2024-09-13T19:01:04.872406+0000","last_peered":"2024-09-13T19:01:04.872406+0000","last_clean":"2024-09-13T19:01:04.872406+0000","last_became_active":"2024-09-13T19:01:03.887413+0000","last_became_peered":"2024-09-13T19:01:03.887413+0000","last_unstale":"2024-09-13T19:01:04.872406+0000","last_undegraded":"2024-09-13T19:01:04.872406+0000","last_fullsized":"2024-09-13T19:01:04.872406+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:39.286318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874072+0000","last_change":"2024-09-13T19:01:03.888810+0000","last_active":"2024-09-13T19:01:04.874072+0000","last_peered":"2024-09-13T19:01:04.874072+0000","last_clean":"2024-09-13T19:01:04.874072+0000","last_became_active":"2024-09-13T19:01:03.888546+0000","last_became_peered":"2024-09-13T19:01:03.888546+0000","last_unstale":"2024-09-13T19:01:04.874072+0000","last_undegraded":"2024-09-13T19:01:04.874072+0000","last_fullsized":"2024-09-13T19:01:04.874072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:53.019080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873670+0000","last_change":"2024-09-13T19:01:03.888667+0000","last_active":"2024-09-13T19:01:04.873670+0000","last_peered":"2024-09-13T19:01:04.873670+0000","last_clean":"2024-09-13T19:01:04.873670+0000","last_became_active":"2024-09-13T19:01:03.888360+0000","last_became_peered":"2024-09-13T19:01:03.888360+0000","last_unstale":"2024-09-13T19:01:04.873670+0000","last_undegraded":"2024-09-13T19:01:04.873670+0000","last_fullsized":"2024-09-13T19:01:04.873670+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916375+0000","last_change":"2024-09-13T19:01:03.896225+0000","last_active":"2024-09-13T19:01:04.916375+0000","last_peered":"2024-09-13T19:01:04.916375+0000","last_clean":"2024-09-13T19:01:04.916375+0000","last_became_active":"2024-09-13T19:01:03.895853+0000","last_became_peered":"2024-09-13T19:01:03.895853+0000","last_unstale":"2024-09-13T19:01:04.916375+0000","last_undegraded":"2024-09-13T19:01:04.916375+0000","last_fullsized":"2024-09-13T19:01:04.916375+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916659+0000","last_change":"2024-09-13T19:01:03.889483+0000","last_active":"2024-09-13T19:01:04.916659+0000","last_peered":"2024-09-13T19:01:04.916659+0000","last_clean":"2024-09-13T19:01:04.916659+0000","last_became_active":"2024-09-13T19:01:03.889147+0000","last_became_peered":"2024-09-13T19:01:03.889147+0000","last_unstale":"2024-09-13T19:01:04.916659+0000","last_undegraded":"2024-09-13T19:01:04.916659+0000","last_fullsized":"2024-09-13T19:01:04.916659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.093589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916403+0000","last_change":"2024-09-13T19:01:03.893831+0000","last_active":"2024-09-13T19:01:04.916403+0000","last_peered":"2024-09-13T19:01:04.916403+0000","last_clean":"2024-09-13T19:01:04.916403+0000","last_became_active":"2024-09-13T19:01:03.893593+0000","last_became_peered":"2024-09-13T19:01:03.893593+0000","last_unstale":"2024-09-13T19:01:04.916403+0000","last_undegraded":"2024-09-13T19:01:04.916403+0000","last_fullsized":"2024-09-13T19:01:04.916403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873588+0000","last_change":"2024-09-13T19:01:03.879632+0000","last_active":"2024-09-13T19:01:04.873588+0000","last_peered":"2024-09-13T19:01:04.873588+0000","last_clean":"2024-09-13T19:01:04.873588+0000","last_became_active":"2024-09-13T19:01:03.879301+0000","last_became_peered":"2024-09-13T19:01:03.879301+0000","last_unstale":"2024-09-13T19:01:04.873588+0000","last_undegraded":"2024-09-13T19:01:04.873588+0000","last_fullsized":"2024-09-13T19:01:04.873588+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881731+0000","last_change":"2024-09-13T19:01:03.894459+0000","last_active":"2024-09-13T19:01:04.881731+0000","last_peered":"2024-09-13T19:01:04.881731+0000","last_clean":"2024-09-13T19:01:04.881731+0000","last_became_active":"2024-09-13T19:01:03.894165+0000","last_became_peered":"2024-09-13T19:01:03.894165+0000","last_unstale":"2024-09-13T19:01:04.881731+0000","last_undegraded":"2024-09-13T19:01:04.881731+0000","last_fullsized":"2024-09-13T19:01:04.881731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:51.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916318+0000","last_change":"2024-09-13T19:01:03.885044+0000","last_active":"2024-09-13T19:01:04.916318+0000","last_peered":"2024-09-13T19:01:04.916318+0000","last_clean":"2024-09-13T19:01:04.916318+0000","last_became_active":"2024-09-13T19:01:03.884409+0000","last_became_peered":"2024-09-13T19:01:03.884409+0000","last_unstale":"2024-09-13T19:01:04.916318+0000","last_undegraded":"2024-09-13T19:01:04.916318+0000","last_fullsized":"2024-09-13T19:01:04.916318+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917566+0000","last_change":"2024-09-13T19:01:03.885048+0000","last_active":"2024-09-13T19:01:04.917566+0000","last_peered":"2024-09-13T19:01:04.917566+0000","last_clean":"2024-09-13T19:01:04.917566+0000","last_became_active":"2024-09-13T19:01:03.884796+0000","last_became_peered":"2024-09-13T19:01:03.884796+0000","last_unstale":"2024-09-13T19:01:04.917566+0000","last_undegraded":"2024-09-13T19:01:04.917566+0000","last_fullsized":"2024-09-13T19:01:04.917566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:12.088451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873775+0000","last_change":"2024-09-13T19:01:03.892141+0000","last_active":"2024-09-13T19:01:04.873775+0000","last_peered":"2024-09-13T19:01:04.873775+0000","last_clean":"2024-09-13T19:01:04.873775+0000","last_became_active":"2024-09-13T19:01:03.891828+0000","last_became_peered":"2024-09-13T19:01:03.891828+0000","last_unstale":"2024-09-13T19:01:04.873775+0000","last_undegraded":"2024-09-13T19:01:04.873775+0000","last_fullsized":"2024-09-13T19:01:04.873775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916679+0000","last_change":"2024-09-13T19:01:03.884363+0000","last_active":"2024-09-13T19:01:04.916679+0000","last_peered":"2024-09-13T19:01:04.916679+0000","last_clean":"2024-09-13T19:01:04.916679+0000","last_became_active":"2024-09-13T19:01:03.883783+0000","last_became_peered":"2024-09-13T19:01:03.883783+0000","last_unstale":"2024-09-13T19:01:04.916679+0000","last_undegraded":"2024-09-13T19:01:04.916679+0000","last_fullsized":"2024-09-13T19:01:04.916679+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:12.794509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881266+0000","last_change":"2024-09-13T19:01:03.890398+0000","last_active":"2024-09-13T19:01:04.881266+0000","last_peered":"2024-09-13T19:01:04.881266+0000","last_clean":"2024-09-13T19:01:04.881266+0000","last_became_active":"2024-09-13T19:01:03.890126+0000","last_became_peered":"2024-09-13T19:01:03.890126+0000","last_unstale":"2024-09-13T19:01:04.881266+0000","last_undegraded":"2024-09-13T19:01:04.881266+0000","last_fullsized":"2024-09-13T19:01:04.881266+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:20.700281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881274+0000","last_change":"2024-09-13T19:01:03.882897+0000","last_active":"2024-09-13T19:01:04.881274+0000","last_peered":"2024-09-13T19:01:04.881274+0000","last_clean":"2024-09-13T19:01:04.881274+0000","last_became_active":"2024-09-13T19:01:03.882609+0000","last_became_peered":"2024-09-13T19:01:03.882609+0000","last_unstale":"2024-09-13T19:01:04.881274+0000","last_undegraded":"2024-09-13T19:01:04.881274+0000","last_fullsized":"2024-09-13T19:01:04.881274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:34.377064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873688+0000","last_change":"2024-09-13T19:01:03.887651+0000","last_active":"2024-09-13T19:01:04.873688+0000","last_peered":"2024-09-13T19:01:04.873688+0000","last_clean":"2024-09-13T19:01:04.873688+0000","last_became_active":"2024-09-13T19:01:03.887123+0000","last_became_peered":"2024-09-13T19:01:03.887123+0000","last_unstale":"2024-09-13T19:01:04.873688+0000","last_undegraded":"2024-09-13T19:01:04.873688+0000","last_fullsized":"2024-09-13T19:01:04.873688+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873425+0000","last_change":"2024-09-13T19:01:03.886926+0000","last_active":"2024-09-13T19:01:04.873425+0000","last_peered":"2024-09-13T19:01:04.873425+0000","last_clean":"2024-09-13T19:01:04.873425+0000","last_became_active":"2024-09-13T19:01:03.886484+0000","last_became_peered":"2024-09-13T19:01:03.886484+0000","last_unstale":"2024-09-13T19:01:04.873425+0000","last_undegraded":"2024-09-13T19:01:04.873425+0000","last_fullsized":"2024-09-13T19:01:04.873425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881632+0000","last_change":"2024-09-13T19:01:03.886962+0000","last_active":"2024-09-13T19:01:04.881632+0000","last_peered":"2024-09-13T19:01:04.881632+0000","last_clean":"2024-09-13T19:01:04.881632+0000","last_became_active":"2024-09-13T19:01:03.886693+0000","last_became_peered":"2024-09-13T19:01:03.886693+0000","last_unstale":"2024-09-13T19:01:04.881632+0000","last_undegraded":"2024-09-13T19:01:04.881632+0000","last_fullsized":"2024-09-13T19:01:04.881632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:42.748530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874218+0000","last_change":"2024-09-13T19:01:03.880910+0000","last_active":"2024-09-13T19:01:04.874218+0000","last_peered":"2024-09-13T19:01:04.874218+0000","last_clean":"2024-09-13T19:01:04.874218+0000","last_became_active":"2024-09-13T19:01:03.880563+0000","last_became_peered":"2024-09-13T19:01:03.880563+0000","last_unstale":"2024-09-13T19:01:04.874218+0000","last_undegraded":"2024-09-13T19:01:04.874218+0000","last_fullsized":"2024-09-13T19:01:04.874218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:56.238246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872820+0000","last_change":"2024-09-13T19:01:03.894659+0000","last_active":"2024-09-13T19:01:04.872820+0000","last_peered":"2024-09-13T19:01:04.872820+0000","last_clean":"2024-09-13T19:01:04.872820+0000","last_became_active":"2024-09-13T19:01:03.894408+0000","last_became_peered":"2024-09-13T19:01:03.894408+0000","last_unstale":"2024-09-13T19:01:04.872820+0000","last_undegraded":"2024-09-13T19:01:04.872820+0000","last_fullsized":"2024-09-13T19:01:04.872820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881636+0000","last_change":"2024-09-13T19:01:03.886370+0000","last_active":"2024-09-13T19:01:04.881636+0000","last_peered":"2024-09-13T19:01:04.881636+0000","last_clean":"2024-09-13T19:01:04.881636+0000","last_became_active":"2024-09-13T19:01:03.886080+0000","last_became_peered":"2024-09-13T19:01:03.886080+0000","last_unstale":"2024-09-13T19:01:04.881636+0000","last_undegraded":"2024-09-13T19:01:04.881636+0000","last_fullsized":"2024-09-13T19:01:04.881636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:45.368989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916757+0000","last_change":"2024-09-13T19:01:03.885028+0000","last_active":"2024-09-13T19:01:04.916757+0000","last_peered":"2024-09-13T19:01:04.916757+0000","last_clean":"2024-09-13T19:01:04.916757+0000","last_became_active":"2024-09-13T19:01:03.884773+0000","last_became_peered":"2024-09-13T19:01:03.884773+0000","last_unstale":"2024-09-13T19:01:04.916757+0000","last_undegraded":"2024-09-13T19:01:04.916757+0000","last_fullsized":"2024-09-13T19:01:04.916757+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.744220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916573+0000","last_change":"2024-09-13T19:01:03.894884+0000","last_active":"2024-09-13T19:01:04.916573+0000","last_peered":"2024-09-13T19:01:04.916573+0000","last_clean":"2024-09-13T19:01:04.916573+0000","last_became_active":"2024-09-13T19:01:03.894625+0000","last_became_peered":"2024-09-13T19:01:03.894625+0000","last_unstale":"2024-09-13T19:01:04.916573+0000","last_undegraded":"2024-09-13T19:01:04.916573+0000","last_fullsized":"2024-09-13T19:01:04.916573+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917470+0000","last_change":"2024-09-13T19:01:03.881208+0000","last_active":"2024-09-13T19:01:04.917470+0000","last_peered":"2024-09-13T19:01:04.917470+0000","last_clean":"2024-09-13T19:01:04.917470+0000","last_became_active":"2024-09-13T19:01:03.880941+0000","last_became_peered":"2024-09-13T19:01:03.880941+0000","last_unstale":"2024-09-13T19:01:04.917470+0000","last_undegraded":"2024-09-13T19:01:04.917470+0000","last_fullsized":"2024-09-13T19:01:04.917470+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:12.088451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917744+0000","last_change":"2024-09-13T19:01:03.879431+0000","last_active":"2024-09-13T19:01:04.917744+0000","last_peered":"2024-09-13T19:01:04.917744+0000","last_clean":"2024-09-13T19:01:04.917744+0000","last_became_active":"2024-09-13T19:01:03.879152+0000","last_became_peered":"2024-09-13T19:01:03.879152+0000","last_unstale":"2024-09-13T19:01:04.917744+0000","last_undegraded":"2024-09-13T19:01:04.917744+0000","last_fullsized":"2024-09-13T19:01:04.917744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:12.794294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.903989+0000","last_change":"2024-09-13T19:01:03.454699+0000","last_active":"2024-09-13T19:01:03.903989+0000","last_peered":"2024-09-13T19:01:03.903989+0000","last_clean":"2024-09-13T19:01:03.903989+0000","last_became_active":"2024-09-13T19:01:03.454374+0000","last_became_peered":"2024-09-13T19:01:03.454374+0000","last_unstale":"2024-09-13T19:01:03.903989+0000","last_undegraded":"2024-09-13T19:01:03.903989+0000","last_fullsized":"2024-09-13T19:01:03.903989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916718+0000","last_change":"2024-09-13T19:01:03.887066+0000","last_active":"2024-09-13T19:01:04.916718+0000","last_peered":"2024-09-13T19:01:04.916718+0000","last_clean":"2024-09-13T19:01:04.916718+0000","last_became_active":"2024-09-13T19:01:03.886830+0000","last_became_peered":"2024-09-13T19:01:03.886830+0000","last_unstale":"2024-09-13T19:01:04.916718+0000","last_undegraded":"2024-09-13T19:01:04.916718+0000","last_fullsized":"2024-09-13T19:01:04.916718+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905897+0000","last_change":"2024-09-13T19:01:03.450855+0000","last_active":"2024-09-13T19:01:03.905897+0000","last_peered":"2024-09-13T19:01:03.905897+0000","last_clean":"2024-09-13T19:01:03.905897+0000","last_became_active":"2024-09-13T19:01:03.450616+0000","last_became_peered":"2024-09-13T19:01:03.450616+0000","last_unstale":"2024-09-13T19:01:03.905897+0000","last_undegraded":"2024-09-13T19:01:03.905897+0000","last_fullsized":"2024-09-13T19:01:03.905897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918011+0000","last_change":"2024-09-13T19:01:03.895230+0000","last_active":"2024-09-13T19:01:04.918011+0000","last_peered":"2024-09-13T19:01:04.918011+0000","last_clean":"2024-09-13T19:01:04.918011+0000","last_became_active":"2024-09-13T19:01:03.894769+0000","last_became_peered":"2024-09-13T19:01:03.894769+0000","last_unstale":"2024-09-13T19:01:04.918011+0000","last_undegraded":"2024-09-13T19:01:04.918011+0000","last_fullsized":"2024-09-13T19:01:04.918011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:18.549012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905038+0000","last_change":"2024-09-13T19:01:03.456812+0000","last_active":"2024-09-13T19:01:03.905038+0000","last_peered":"2024-09-13T19:01:03.905038+0000","last_clean":"2024-09-13T19:01:03.905038+0000","last_became_active":"2024-09-13T19:01:03.456504+0000","last_became_peered":"2024-09-13T19:01:03.456504+0000","last_unstale":"2024-09-13T19:01:03.905038+0000","last_undegraded":"2024-09-13T19:01:03.905038+0000","last_fullsized":"2024-09-13T19:01:03.905038+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873747+0000","last_change":"2024-09-13T19:01:03.886668+0000","last_active":"2024-09-13T19:01:04.873747+0000","last_peered":"2024-09-13T19:01:04.873747+0000","last_clean":"2024-09-13T19:01:04.873747+0000","last_became_active":"2024-09-13T19:01:03.881803+0000","last_became_peered":"2024-09-13T19:01:03.881803+0000","last_unstale":"2024-09-13T19:01:04.873747+0000","last_undegraded":"2024-09-13T19:01:04.873747+0000","last_fullsized":"2024-09-13T19:01:04.873747+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904595+0000","last_change":"2024-09-13T19:01:03.455254+0000","last_active":"2024-09-13T19:01:03.904595+0000","last_peered":"2024-09-13T19:01:03.904595+0000","last_clean":"2024-09-13T19:01:03.904595+0000","last_became_active":"2024-09-13T19:01:03.454722+0000","last_became_peered":"2024-09-13T19:01:03.454722+0000","last_unstale":"2024-09-13T19:01:03.904595+0000","last_undegraded":"2024-09-13T19:01:03.904595+0000","last_fullsized":"2024-09-13T19:01:03.904595+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916511+0000","last_change":"2024-09-13T19:01:03.891669+0000","last_active":"2024-09-13T19:01:04.916511+0000","last_peered":"2024-09-13T19:01:04.916511+0000","last_clean":"2024-09-13T19:01:04.916511+0000","last_became_active":"2024-09-13T19:01:03.890377+0000","last_became_peered":"2024-09-13T19:01:03.890377+0000","last_unstale":"2024-09-13T19:01:04.916511+0000","last_undegraded":"2024-09-13T19:01:04.916511+0000","last_fullsized":"2024-09-13T19:01:04.916511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:36.104141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.903122+0000","last_change":"2024-09-13T19:01:03.450682+0000","last_active":"2024-09-13T19:01:03.903122+0000","last_peered":"2024-09-13T19:01:03.903122+0000","last_clean":"2024-09-13T19:01:03.903122+0000","last_became_active":"2024-09-13T19:01:03.450433+0000","last_became_peered":"2024-09-13T19:01:03.450433+0000","last_unstale":"2024-09-13T19:01:03.903122+0000","last_undegraded":"2024-09-13T19:01:03.903122+0000","last_fullsized":"2024-09-13T19:01:03.903122+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873872+0000","last_change":"2024-09-13T19:01:03.884190+0000","last_active":"2024-09-13T19:01:04.873872+0000","last_peered":"2024-09-13T19:01:04.873872+0000","last_clean":"2024-09-13T19:01:04.873872+0000","last_became_active":"2024-09-13T19:01:03.883908+0000","last_became_peered":"2024-09-13T19:01:03.883908+0000","last_unstale":"2024-09-13T19:01:04.873872+0000","last_undegraded":"2024-09-13T19:01:04.873872+0000","last_fullsized":"2024-09-13T19:01:04.873872+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:54.763783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905882+0000","last_change":"2024-09-13T19:01:03.453035+0000","last_active":"2024-09-13T19:01:03.905882+0000","last_peered":"2024-09-13T19:01:03.905882+0000","last_clean":"2024-09-13T19:01:03.905882+0000","last_became_active":"2024-09-13T19:01:03.452766+0000","last_became_peered":"2024-09-13T19:01:03.452766+0000","last_unstale":"2024-09-13T19:01:03.905882+0000","last_undegraded":"2024-09-13T19:01:03.905882+0000","last_fullsized":"2024-09-13T19:01:03.905882+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916375+0000","last_change":"2024-09-13T19:01:03.892825+0000","last_active":"2024-09-13T19:01:04.916375+0000","last_peered":"2024-09-13T19:01:04.916375+0000","last_clean":"2024-09-13T19:01:04.916375+0000","last_became_active":"2024-09-13T19:01:03.892541+0000","last_became_peered":"2024-09-13T19:01:03.892541+0000","last_unstale":"2024-09-13T19:01:04.916375+0000","last_undegraded":"2024-09-13T19:01:04.916375+0000","last_fullsized":"2024-09-13T19:01:04.916375+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868973+0000","last_change":"2024-09-13T19:01:03.454572+0000","last_active":"2024-09-13T19:01:03.868973+0000","last_peered":"2024-09-13T19:01:03.868973+0000","last_clean":"2024-09-13T19:01:03.868973+0000","last_became_active":"2024-09-13T19:01:03.454262+0000","last_became_peered":"2024-09-13T19:01:03.454262+0000","last_unstale":"2024-09-13T19:01:03.868973+0000","last_undegraded":"2024-09-13T19:01:03.868973+0000","last_fullsized":"2024-09-13T19:01:03.868973+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873973+0000","last_change":"2024-09-13T19:01:03.887243+0000","last_active":"2024-09-13T19:01:04.873973+0000","last_peered":"2024-09-13T19:01:04.873973+0000","last_clean":"2024-09-13T19:01:04.873973+0000","last_became_active":"2024-09-13T19:01:03.883434+0000","last_became_peered":"2024-09-13T19:01:03.883434+0000","last_unstale":"2024-09-13T19:01:04.873973+0000","last_undegraded":"2024-09-13T19:01:04.873973+0000","last_fullsized":"2024-09-13T19:01:04.873973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868685+0000","last_change":"2024-09-13T19:01:03.458043+0000","last_active":"2024-09-13T19:01:03.868685+0000","last_peered":"2024-09-13T19:01:03.868685+0000","last_clean":"2024-09-13T19:01:03.868685+0000","last_became_active":"2024-09-13T19:01:03.457785+0000","last_became_peered":"2024-09-13T19:01:03.457785+0000","last_unstale":"2024-09-13T19:01:03.868685+0000","last_undegraded":"2024-09-13T19:01:03.868685+0000","last_fullsized":"2024-09-13T19:01:03.868685+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881690+0000","last_change":"2024-09-13T19:01:03.889550+0000","last_active":"2024-09-13T19:01:04.881690+0000","last_peered":"2024-09-13T19:01:04.881690+0000","last_clean":"2024-09-13T19:01:04.881690+0000","last_became_active":"2024-09-13T19:01:03.889213+0000","last_became_peered":"2024-09-13T19:01:03.889213+0000","last_unstale":"2024-09-13T19:01:04.881690+0000","last_undegraded":"2024-09-13T19:01:04.881690+0000","last_fullsized":"2024-09-13T19:01:04.881690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:26.772236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871172+0000","last_change":"2024-09-13T19:01:03.456698+0000","last_active":"2024-09-13T19:01:03.871172+0000","last_peered":"2024-09-13T19:01:03.871172+0000","last_clean":"2024-09-13T19:01:03.871172+0000","last_became_active":"2024-09-13T19:01:03.456353+0000","last_became_peered":"2024-09-13T19:01:03.456353+0000","last_unstale":"2024-09-13T19:01:03.871172+0000","last_undegraded":"2024-09-13T19:01:03.871172+0000","last_fullsized":"2024-09-13T19:01:03.871172+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874187+0000","last_change":"2024-09-13T19:01:03.886989+0000","last_active":"2024-09-13T19:01:04.874187+0000","last_peered":"2024-09-13T19:01:04.874187+0000","last_clean":"2024-09-13T19:01:04.874187+0000","last_became_active":"2024-09-13T19:01:03.882709+0000","last_became_peered":"2024-09-13T19:01:03.882709+0000","last_unstale":"2024-09-13T19:01:04.874187+0000","last_undegraded":"2024-09-13T19:01:04.874187+0000","last_fullsized":"2024-09-13T19:01:04.874187+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871424+0000","last_change":"2024-09-13T19:01:03.457910+0000","last_active":"2024-09-13T19:01:03.871424+0000","last_peered":"2024-09-13T19:01:03.871424+0000","last_clean":"2024-09-13T19:01:03.871424+0000","last_became_active":"2024-09-13T19:01:03.457403+0000","last_became_peered":"2024-09-13T19:01:03.457403+0000","last_unstale":"2024-09-13T19:01:03.871424+0000","last_undegraded":"2024-09-13T19:01:03.871424+0000","last_fullsized":"2024-09-13T19:01:03.871424+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872914+0000","last_change":"2024-09-13T19:01:03.888061+0000","last_active":"2024-09-13T19:01:04.872914+0000","last_peered":"2024-09-13T19:01:04.872914+0000","last_clean":"2024-09-13T19:01:04.872914+0000","last_became_active":"2024-09-13T19:01:03.887343+0000","last_became_peered":"2024-09-13T19:01:03.887343+0000","last_unstale":"2024-09-13T19:01:04.872914+0000","last_undegraded":"2024-09-13T19:01:04.872914+0000","last_fullsized":"2024-09-13T19:01:04.872914+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"95'3","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905773+0000","last_change":"2024-09-13T19:01:03.447604+0000","last_active":"2024-09-13T19:01:03.905773+0000","last_peered":"2024-09-13T19:01:03.905773+0000","last_clean":"2024-09-13T19:01:03.905773+0000","last_became_active":"2024-09-13T19:01:03.447233+0000","last_became_peered":"2024-09-13T19:01:03.447233+0000","last_unstale":"2024-09-13T19:01:03.905773+0000","last_undegraded":"2024-09-13T19:01:03.905773+0000","last_fullsized":"2024-09-13T19:01:03.905773+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874277+0000","last_change":"2024-09-13T19:01:03.880873+0000","last_active":"2024-09-13T19:01:04.874277+0000","last_peered":"2024-09-13T19:01:04.874277+0000","last_clean":"2024-09-13T19:01:04.874277+0000","last_became_active":"2024-09-13T19:01:03.880218+0000","last_became_peered":"2024-09-13T19:01:03.880218+0000","last_unstale":"2024-09-13T19:01:04.874277+0000","last_undegraded":"2024-09-13T19:01:04.874277+0000","last_fullsized":"2024-09-13T19:01:04.874277+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.970118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"95'6","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.907385+0000","last_change":"2024-09-13T19:01:03.454191+0000","last_active":"2024-09-13T19:01:03.907385+0000","last_peered":"2024-09-13T19:01:03.907385+0000","last_clean":"2024-09-13T19:01:03.907385+0000","last_became_active":"2024-09-13T19:01:03.453883+0000","last_became_peered":"2024-09-13T19:01:03.453883+0000","last_unstale":"2024-09-13T19:01:03.907385+0000","last_undegraded":"2024-09-13T19:01:03.907385+0000","last_fullsized":"2024-09-13T19:01:03.907385+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916231+0000","last_change":"2024-09-13T19:01:03.886595+0000","last_active":"2024-09-13T19:01:04.916231+0000","last_peered":"2024-09-13T19:01:04.916231+0000","last_clean":"2024-09-13T19:01:04.916231+0000","last_became_active":"2024-09-13T19:01:03.885979+0000","last_became_peered":"2024-09-13T19:01:03.885979+0000","last_unstale":"2024-09-13T19:01:04.916231+0000","last_undegraded":"2024-09-13T19:01:04.916231+0000","last_fullsized":"2024-09-13T19:01:04.916231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905531+0000","last_change":"2024-09-13T19:01:03.450633+0000","last_active":"2024-09-13T19:01:03.905531+0000","last_peered":"2024-09-13T19:01:03.905531+0000","last_clean":"2024-09-13T19:01:03.905531+0000","last_became_active":"2024-09-13T19:01:03.450285+0000","last_became_peered":"2024-09-13T19:01:03.450285+0000","last_unstale":"2024-09-13T19:01:03.905531+0000","last_undegraded":"2024-09-13T19:01:03.905531+0000","last_fullsized":"2024-09-13T19:01:03.905531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917898+0000","last_change":"2024-09-13T19:01:03.882153+0000","last_active":"2024-09-13T19:01:04.917898+0000","last_peered":"2024-09-13T19:01:04.917898+0000","last_clean":"2024-09-13T19:01:04.917898+0000","last_became_active":"2024-09-13T19:01:03.881664+0000","last_became_peered":"2024-09-13T19:01:03.881664+0000","last_unstale":"2024-09-13T19:01:04.917898+0000","last_undegraded":"2024-09-13T19:01:04.917898+0000","last_fullsized":"2024-09-13T19:01:04.917898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:55.742717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.870822+0000","last_change":"2024-09-13T19:01:03.458987+0000","last_active":"2024-09-13T19:01:03.870822+0000","last_peered":"2024-09-13T19:01:03.870822+0000","last_clean":"2024-09-13T19:01:03.870822+0000","last_became_active":"2024-09-13T19:01:03.458747+0000","last_became_peered":"2024-09-13T19:01:03.458747+0000","last_unstale":"2024-09-13T19:01:03.870822+0000","last_undegraded":"2024-09-13T19:01:03.870822+0000","last_fullsized":"2024-09-13T19:01:03.870822+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873185+0000","last_change":"2024-09-13T19:01:03.877371+0000","last_active":"2024-09-13T19:01:04.873185+0000","last_peered":"2024-09-13T19:01:04.873185+0000","last_clean":"2024-09-13T19:01:04.873185+0000","last_became_active":"2024-09-13T19:01:03.877100+0000","last_became_peered":"2024-09-13T19:01:03.877100+0000","last_unstale":"2024-09-13T19:01:04.873185+0000","last_undegraded":"2024-09-13T19:01:04.873185+0000","last_fullsized":"2024-09-13T19:01:04.873185+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.876585+0000","last_change":"2024-09-13T19:01:03.442350+0000","last_active":"2024-09-13T19:01:03.876585+0000","last_peered":"2024-09-13T19:01:03.876585+0000","last_clean":"2024-09-13T19:01:03.876585+0000","last_became_active":"2024-09-13T19:01:03.442071+0000","last_became_peered":"2024-09-13T19:01:03.442071+0000","last_unstale":"2024-09-13T19:01:03.876585+0000","last_undegraded":"2024-09-13T19:01:03.876585+0000","last_fullsized":"2024-09-13T19:01:03.876585+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917269+0000","last_change":"2024-09-13T19:01:03.888885+0000","last_active":"2024-09-13T19:01:04.917269+0000","last_peered":"2024-09-13T19:01:04.917269+0000","last_clean":"2024-09-13T19:01:04.917269+0000","last_became_active":"2024-09-13T19:01:03.888569+0000","last_became_peered":"2024-09-13T19:01:03.888569+0000","last_unstale":"2024-09-13T19:01:04.917269+0000","last_undegraded":"2024-09-13T19:01:04.917269+0000","last_fullsized":"2024-09-13T19:01:04.917269+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.364910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.906107+0000","last_change":"2024-09-13T19:01:03.446962+0000","last_active":"2024-09-13T19:01:03.906107+0000","last_peered":"2024-09-13T19:01:03.906107+0000","last_clean":"2024-09-13T19:01:03.906107+0000","last_became_active":"2024-09-13T19:01:03.446658+0000","last_became_peered":"2024-09-13T19:01:03.446658+0000","last_unstale":"2024-09-13T19:01:03.906107+0000","last_undegraded":"2024-09-13T19:01:03.906107+0000","last_fullsized":"2024-09-13T19:01:03.906107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873477+0000","last_change":"2024-09-13T19:01:03.888116+0000","last_active":"2024-09-13T19:01:04.873477+0000","last_peered":"2024-09-13T19:01:04.873477+0000","last_clean":"2024-09-13T19:01:04.873477+0000","last_became_active":"2024-09-13T19:01:03.887696+0000","last_became_peered":"2024-09-13T19:01:03.887696+0000","last_unstale":"2024-09-13T19:01:04.873477+0000","last_undegraded":"2024-09-13T19:01:04.873477+0000","last_fullsized":"2024-09-13T19:01:04.873477+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:07.311717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905423+0000","last_change":"2024-09-13T19:01:03.451923+0000","last_active":"2024-09-13T19:01:03.905423+0000","last_peered":"2024-09-13T19:01:03.905423+0000","last_clean":"2024-09-13T19:01:03.905423+0000","last_became_active":"2024-09-13T19:01:03.451577+0000","last_became_peered":"2024-09-13T19:01:03.451577+0000","last_unstale":"2024-09-13T19:01:03.905423+0000","last_undegraded":"2024-09-13T19:01:03.905423+0000","last_fullsized":"2024-09-13T19:01:03.905423+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916595+0000","last_change":"2024-09-13T19:01:03.891394+0000","last_active":"2024-09-13T19:01:04.916595+0000","last_peered":"2024-09-13T19:01:04.916595+0000","last_clean":"2024-09-13T19:01:04.916595+0000","last_became_active":"2024-09-13T19:01:03.890417+0000","last_became_peered":"2024-09-13T19:01:03.890417+0000","last_unstale":"2024-09-13T19:01:04.916595+0000","last_undegraded":"2024-09-13T19:01:04.916595+0000","last_fullsized":"2024-09-13T19:01:04.916595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:05.648507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.902588+0000","last_change":"2024-09-13T19:01:03.445468+0000","last_active":"2024-09-13T19:01:03.902588+0000","last_peered":"2024-09-13T19:01:03.902588+0000","last_clean":"2024-09-13T19:01:03.902588+0000","last_became_active":"2024-09-13T19:01:03.445132+0000","last_became_peered":"2024-09-13T19:01:03.445132+0000","last_unstale":"2024-09-13T19:01:03.902588+0000","last_undegraded":"2024-09-13T19:01:03.902588+0000","last_fullsized":"2024-09-13T19:01:03.902588+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874288+0000","last_change":"2024-09-13T19:01:03.890873+0000","last_active":"2024-09-13T19:01:04.874288+0000","last_peered":"2024-09-13T19:01:04.874288+0000","last_clean":"2024-09-13T19:01:04.874288+0000","last_became_active":"2024-09-13T19:01:03.890515+0000","last_became_peered":"2024-09-13T19:01:03.890515+0000","last_unstale":"2024-09-13T19:01:04.874288+0000","last_undegraded":"2024-09-13T19:01:04.874288+0000","last_fullsized":"2024-09-13T19:01:04.874288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.872789+0000","last_change":"2024-09-13T19:01:03.455027+0000","last_active":"2024-09-13T19:01:03.872789+0000","last_peered":"2024-09-13T19:01:03.872789+0000","last_clean":"2024-09-13T19:01:03.872789+0000","last_became_active":"2024-09-13T19:01:03.454439+0000","last_became_peered":"2024-09-13T19:01:03.454439+0000","last_unstale":"2024-09-13T19:01:03.872789+0000","last_undegraded":"2024-09-13T19:01:03.872789+0000","last_fullsized":"2024-09-13T19:01:03.872789+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916846+0000","last_change":"2024-09-13T19:01:03.890967+0000","last_active":"2024-09-13T19:01:04.916846+0000","last_peered":"2024-09-13T19:01:04.916846+0000","last_clean":"2024-09-13T19:01:04.916846+0000","last_became_active":"2024-09-13T19:01:03.890704+0000","last_became_peered":"2024-09-13T19:01:03.890704+0000","last_unstale":"2024-09-13T19:01:04.916846+0000","last_undegraded":"2024-09-13T19:01:04.916846+0000","last_fullsized":"2024-09-13T19:01:04.916846+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:22.948036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904970+0000","last_change":"2024-09-13T19:01:03.453615+0000","last_active":"2024-09-13T19:01:03.904970+0000","last_peered":"2024-09-13T19:01:03.904970+0000","last_clean":"2024-09-13T19:01:03.904970+0000","last_became_active":"2024-09-13T19:01:03.453323+0000","last_became_peered":"2024-09-13T19:01:03.453323+0000","last_unstale":"2024-09-13T19:01:03.904970+0000","last_undegraded":"2024-09-13T19:01:03.904970+0000","last_fullsized":"2024-09-13T19:01:03.904970+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916784+0000","last_change":"2024-09-13T19:01:03.884621+0000","last_active":"2024-09-13T19:01:04.916784+0000","last_peered":"2024-09-13T19:01:04.916784+0000","last_clean":"2024-09-13T19:01:04.916784+0000","last_became_active":"2024-09-13T19:01:03.884128+0000","last_became_peered":"2024-09-13T19:01:03.884128+0000","last_unstale":"2024-09-13T19:01:04.916784+0000","last_undegraded":"2024-09-13T19:01:04.916784+0000","last_fullsized":"2024-09-13T19:01:04.916784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:14.531972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.877136+0000","last_change":"2024-09-13T19:01:03.456642+0000","last_active":"2024-09-13T19:01:03.877136+0000","last_peered":"2024-09-13T19:01:03.877136+0000","last_clean":"2024-09-13T19:01:03.877136+0000","last_became_active":"2024-09-13T19:01:03.456361+0000","last_became_peered":"2024-09-13T19:01:03.456361+0000","last_unstale":"2024-09-13T19:01:03.877136+0000","last_undegraded":"2024-09-13T19:01:03.877136+0000","last_fullsized":"2024-09-13T19:01:03.877136+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916202+0000","last_change":"2024-09-13T19:01:03.878187+0000","last_active":"2024-09-13T19:01:04.916202+0000","last_peered":"2024-09-13T19:01:04.916202+0000","last_clean":"2024-09-13T19:01:04.916202+0000","last_became_active":"2024-09-13T19:01:03.877946+0000","last_became_peered":"2024-09-13T19:01:03.877946+0000","last_unstale":"2024-09-13T19:01:04.916202+0000","last_undegraded":"2024-09-13T19:01:04.916202+0000","last_fullsized":"2024-09-13T19:01:04.916202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:54.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.877938+0000","last_change":"2024-09-13T19:01:03.454291+0000","last_active":"2024-09-13T19:01:03.877938+0000","last_peered":"2024-09-13T19:01:03.877938+0000","last_clean":"2024-09-13T19:01:03.877938+0000","last_became_active":"2024-09-13T19:01:03.453839+0000","last_became_peered":"2024-09-13T19:01:03.453839+0000","last_unstale":"2024-09-13T19:01:03.877938+0000","last_undegraded":"2024-09-13T19:01:03.877938+0000","last_fullsized":"2024-09-13T19:01:03.877938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872260+0000","last_change":"2024-09-13T19:01:03.887500+0000","last_active":"2024-09-13T19:01:04.872260+0000","last_peered":"2024-09-13T19:01:04.872260+0000","last_clean":"2024-09-13T19:01:04.872260+0000","last_became_active":"2024-09-13T19:01:03.887187+0000","last_became_peered":"2024-09-13T19:01:03.887187+0000","last_unstale":"2024-09-13T19:01:04.872260+0000","last_undegraded":"2024-09-13T19:01:04.872260+0000","last_fullsized":"2024-09-13T19:01:04.872260+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.866935+0000","last_change":"2024-09-13T19:01:03.451958+0000","last_active":"2024-09-13T19:01:03.866935+0000","last_peered":"2024-09-13T19:01:03.866935+0000","last_clean":"2024-09-13T19:01:03.866935+0000","last_became_active":"2024-09-13T19:01:03.451088+0000","last_became_peered":"2024-09-13T19:01:03.451088+0000","last_unstale":"2024-09-13T19:01:03.866935+0000","last_undegraded":"2024-09-13T19:01:03.866935+0000","last_fullsized":"2024-09-13T19:01:03.866935+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881723+0000","last_change":"2024-09-13T19:01:03.881760+0000","last_active":"2024-09-13T19:01:04.881723+0000","last_peered":"2024-09-13T19:01:04.881723+0000","last_clean":"2024-09-13T19:01:04.881723+0000","last_became_active":"2024-09-13T19:01:03.881346+0000","last_became_peered":"2024-09-13T19:01:03.881346+0000","last_unstale":"2024-09-13T19:01:04.881723+0000","last_undegraded":"2024-09-13T19:01:04.881723+0000","last_fullsized":"2024-09-13T19:01:04.881723+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:43.365695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904827+0000","last_change":"2024-09-13T19:01:03.452135+0000","last_active":"2024-09-13T19:01:03.904827+0000","last_peered":"2024-09-13T19:01:03.904827+0000","last_clean":"2024-09-13T19:01:03.904827+0000","last_became_active":"2024-09-13T19:01:03.451819+0000","last_became_peered":"2024-09-13T19:01:03.451819+0000","last_unstale":"2024-09-13T19:01:03.904827+0000","last_undegraded":"2024-09-13T19:01:03.904827+0000","last_fullsized":"2024-09-13T19:01:03.904827+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918208+0000","last_change":"2024-09-13T19:01:03.881870+0000","last_active":"2024-09-13T19:01:04.918208+0000","last_peered":"2024-09-13T19:01:04.918208+0000","last_clean":"2024-09-13T19:01:04.918208+0000","last_became_active":"2024-09-13T19:01:03.880968+0000","last_became_peered":"2024-09-13T19:01:03.880968+0000","last_unstale":"2024-09-13T19:01:04.918208+0000","last_undegraded":"2024-09-13T19:01:04.918208+0000","last_fullsized":"2024-09-13T19:01:04.918208+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:59.017584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.870958+0000","last_change":"2024-09-13T19:01:03.455042+0000","last_active":"2024-09-13T19:01:03.870958+0000","last_peered":"2024-09-13T19:01:03.870958+0000","last_clean":"2024-09-13T19:01:03.870958+0000","last_became_active":"2024-09-13T19:01:03.454769+0000","last_became_peered":"2024-09-13T19:01:03.454769+0000","last_unstale":"2024-09-13T19:01:03.870958+0000","last_undegraded":"2024-09-13T19:01:03.870958+0000","last_fullsized":"2024-09-13T19:01:03.870958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918072+0000","last_change":"2024-09-13T19:01:03.881627+0000","last_active":"2024-09-13T19:01:04.918072+0000","last_peered":"2024-09-13T19:01:04.918072+0000","last_clean":"2024-09-13T19:01:04.918072+0000","last_became_active":"2024-09-13T19:01:03.881338+0000","last_became_peered":"2024-09-13T19:01:03.881338+0000","last_unstale":"2024-09-13T19:01:04.918072+0000","last_undegraded":"2024-09-13T19:01:04.918072+0000","last_fullsized":"2024-09-13T19:01:04.918072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:06.638362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868377+0000","last_change":"2024-09-13T19:01:03.453368+0000","last_active":"2024-09-13T19:01:03.868377+0000","last_peered":"2024-09-13T19:01:03.868377+0000","last_clean":"2024-09-13T19:01:03.868377+0000","last_became_active":"2024-09-13T19:01:03.453099+0000","last_became_peered":"2024-09-13T19:01:03.453099+0000","last_unstale":"2024-09-13T19:01:03.868377+0000","last_undegraded":"2024-09-13T19:01:03.868377+0000","last_fullsized":"2024-09-13T19:01:03.868377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873337+0000","last_change":"2024-09-13T19:01:03.892662+0000","last_active":"2024-09-13T19:01:04.873337+0000","last_peered":"2024-09-13T19:01:04.873337+0000","last_clean":"2024-09-13T19:01:04.873337+0000","last_became_active":"2024-09-13T19:01:03.892386+0000","last_became_peered":"2024-09-13T19:01:03.892386+0000","last_unstale":"2024-09-13T19:01:04.873337+0000","last_undegraded":"2024-09-13T19:01:04.873337+0000","last_fullsized":"2024-09-13T19:01:04.873337+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:15.445713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.869374+0000","last_change":"2024-09-13T19:01:03.444077+0000","last_active":"2024-09-13T19:01:03.869374+0000","last_peered":"2024-09-13T19:01:03.869374+0000","last_clean":"2024-09-13T19:01:03.869374+0000","last_became_active":"2024-09-13T19:01:03.443736+0000","last_became_peered":"2024-09-13T19:01:03.443736+0000","last_unstale":"2024-09-13T19:01:03.869374+0000","last_undegraded":"2024-09-13T19:01:03.869374+0000","last_fullsized":"2024-09-13T19:01:03.869374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916928+0000","last_change":"2024-09-13T19:01:03.890794+0000","last_active":"2024-09-13T19:01:04.916928+0000","last_peered":"2024-09-13T19:01:04.916928+0000","last_clean":"2024-09-13T19:01:04.916928+0000","last_became_active":"2024-09-13T19:01:03.890534+0000","last_became_peered":"2024-09-13T19:01:03.890534+0000","last_unstale":"2024-09-13T19:01:04.916928+0000","last_undegraded":"2024-09-13T19:01:04.916928+0000","last_fullsized":"2024-09-13T19:01:04.916928+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:31.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.872790+0000","last_change":"2024-09-13T19:01:03.454076+0000","last_active":"2024-09-13T19:01:03.872790+0000","last_peered":"2024-09-13T19:01:03.872790+0000","last_clean":"2024-09-13T19:01:03.872790+0000","last_became_active":"2024-09-13T19:01:03.453822+0000","last_became_peered":"2024-09-13T19:01:03.453822+0000","last_unstale":"2024-09-13T19:01:03.872790+0000","last_undegraded":"2024-09-13T19:01:03.872790+0000","last_fullsized":"2024-09-13T19:01:03.872790+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873972+0000","last_change":"2024-09-13T19:01:03.894057+0000","last_active":"2024-09-13T19:01:04.873972+0000","last_peered":"2024-09-13T19:01:04.873972+0000","last_clean":"2024-09-13T19:01:04.873972+0000","last_became_active":"2024-09-13T19:01:03.888979+0000","last_became_peered":"2024-09-13T19:01:03.888979+0000","last_unstale":"2024-09-13T19:01:04.873972+0000","last_undegraded":"2024-09-13T19:01:04.873972+0000","last_fullsized":"2024-09-13T19:01:04.873972+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868514+0000","last_change":"2024-09-13T19:01:03.444861+0000","last_active":"2024-09-13T19:01:03.868514+0000","last_peered":"2024-09-13T19:01:03.868514+0000","last_clean":"2024-09-13T19:01:03.868514+0000","last_became_active":"2024-09-13T19:01:03.444538+0000","last_became_peered":"2024-09-13T19:01:03.444538+0000","last_unstale":"2024-09-13T19:01:03.868514+0000","last_undegraded":"2024-09-13T19:01:03.868514+0000","last_fullsized":"2024-09-13T19:01:03.868514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916296+0000","last_change":"2024-09-13T19:01:03.887752+0000","last_active":"2024-09-13T19:01:04.916296+0000","last_peered":"2024-09-13T19:01:04.916296+0000","last_clean":"2024-09-13T19:01:04.916296+0000","last_became_active":"2024-09-13T19:01:03.887476+0000","last_became_peered":"2024-09-13T19:01:03.887476+0000","last_unstale":"2024-09-13T19:01:04.916296+0000","last_undegraded":"2024-09-13T19:01:04.916296+0000","last_fullsized":"2024-09-13T19:01:04.916296+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:18.420472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871447+0000","last_change":"2024-09-13T19:01:03.460001+0000","last_active":"2024-09-13T19:01:03.871447+0000","last_peered":"2024-09-13T19:01:03.871447+0000","last_clean":"2024-09-13T19:01:03.871447+0000","last_became_active":"2024-09-13T19:01:03.459733+0000","last_became_peered":"2024-09-13T19:01:03.459733+0000","last_unstale":"2024-09-13T19:01:03.871447+0000","last_undegraded":"2024-09-13T19:01:03.871447+0000","last_fullsized":"2024-09-13T19:01:03.871447+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872370+0000","last_change":"2024-09-13T19:01:03.887193+0000","last_active":"2024-09-13T19:01:04.872370+0000","last_peered":"2024-09-13T19:01:04.872370+0000","last_clean":"2024-09-13T19:01:04.872370+0000","last_became_active":"2024-09-13T19:01:03.886551+0000","last_became_peered":"2024-09-13T19:01:03.886551+0000","last_unstale":"2024-09-13T19:01:04.872370+0000","last_undegraded":"2024-09-13T19:01:04.872370+0000","last_fullsized":"2024-09-13T19:01:04.872370+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871494+0000","last_change":"2024-09-13T19:01:03.461323+0000","last_active":"2024-09-13T19:01:03.871494+0000","last_peered":"2024-09-13T19:01:03.871494+0000","last_clean":"2024-09-13T19:01:03.871494+0000","last_became_active":"2024-09-13T19:01:03.461021+0000","last_became_peered":"2024-09-13T19:01:03.461021+0000","last_unstale":"2024-09-13T19:01:03.871494+0000","last_undegraded":"2024-09-13T19:01:03.871494+0000","last_fullsized":"2024-09-13T19:01:03.871494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917837+0000","last_change":"2024-09-13T19:01:03.891197+0000","last_active":"2024-09-13T19:01:04.917837+0000","last_peered":"2024-09-13T19:01:04.917837+0000","last_clean":"2024-09-13T19:01:04.917837+0000","last_became_active":"2024-09-13T19:01:03.890821+0000","last_became_peered":"2024-09-13T19:01:03.890821+0000","last_unstale":"2024-09-13T19:01:04.917837+0000","last_undegraded":"2024-09-13T19:01:04.917837+0000","last_fullsized":"2024-09-13T19:01:04.917837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:10.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904086+0000","last_change":"2024-09-13T19:01:03.455304+0000","last_active":"2024-09-13T19:01:03.904086+0000","last_peered":"2024-09-13T19:01:03.904086+0000","last_clean":"2024-09-13T19:01:03.904086+0000","last_became_active":"2024-09-13T19:01:03.454364+0000","last_became_peered":"2024-09-13T19:01:03.454364+0000","last_unstale":"2024-09-13T19:01:03.904086+0000","last_undegraded":"2024-09-13T19:01:03.904086+0000","last_fullsized":"2024-09-13T19:01:03.904086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":242,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873694+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:04.873694+0000","last_peered":"2024-09-13T19:01:04.873694+0000","last_clean":"2024-09-13T19:01:04.873694+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:04.873694+0000","last_undegraded":"2024-09-13T19:01:04.873694+0000","last_fullsized":"2024-09-13T19:01:04.873694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1789952,"data_stored":1097084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.754},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1196032,"data_stored":507256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.748},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1191936,"data_stored":506674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":508292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.75},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1204224,"data_stored":508190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.55900000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.745},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1191936,"data_stored":506638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.754}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1187840,"data_stored":506604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.496}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1785856,"data_stored":1097554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.377},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":1.0700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:12.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:01:12.245 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:01:12.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.903+0000 7fb229400640 1 Processor -- start 2024-09-13T19:01:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.903+0000 7fb229400640 1 -- start start 2024-09-13T19:01:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.904+0000 7fb229400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb224153b20 0x7fb2240b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.904+0000 7fb229400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb22406f660 0x7fb22406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.904+0000 7fb229400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb224153f00 con 0x7fb224159a80 2024-09-13T19:01:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.904+0000 7fb229400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240ce600 con 0x7fb22406f660 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.904+0000 7fb229400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224070f90 con 0x7fb224153b20 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb22406f660 0x7fb22406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb22406f660 0x7fb22406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47232/0 (socket says 172.21.15.33:47232) 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 -- 172.21.15.33:0/3221861915 learned_addr learned my addr 172.21.15.33:0/3221861915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb222800640 1 --2- 172.21.15.33:0/3221861915 >> v2:172.21.15.103:3300/0 conn(0x7fb224153b20 0x7fb2240b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 -- 172.21.15.33:0/3221861915 >> v2:172.21.15.103:3300/0 conn(0x7fb224153b20 msgr2=0x7fb2240b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 --2- 172.21.15.33:0/3221861915 >> v2:172.21.15.103:3300/0 conn(0x7fb224153b20 0x7fb2240b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 -- 172.21.15.33:0/3221861915 >> v1:172.21.15.103:6789/0 conn(0x7fb224159a80 legacy=0x7fb2240b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.905+0000 7fb223200640 1 -- 172.21.15.33:0/3221861915 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240b1a40 con 0x7fb22406f660 2024-09-13T19:01:12.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.906+0000 7fb223200640 1 --2- 172.21.15.33:0/3221861915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb22406f660 0x7fb22406fa90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fb2240b14f0 tx=0x7fb21c02c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0dfa488d1f1a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:12.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb221400640 1 -- 172.21.15.33:0/3221861915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c009600 con 0x7fb22406f660 2024-09-13T19:01:12.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb221400640 1 -- 172.21.15.33:0/3221861915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c009760 con 0x7fb22406f660 2024-09-13T19:01:12.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb221400640 1 -- 172.21.15.33:0/3221861915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c009af0 con 0x7fb22406f660 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 -- 172.21.15.33:0/3221861915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb22406f660 msgr2=0x7fb22406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 --2- 172.21.15.33:0/3221861915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb22406f660 0x7fb22406fa90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fb2240b14f0 tx=0x7fb21c02c930 comp rx=0 tx=0).stop 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 -- 172.21.15.33:0/3221861915 shutdown_connections 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 --2- 172.21.15.33:0/3221861915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb22406f660 0x7fb22406fa90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 --2- 172.21.15.33:0/3221861915 >> v2:172.21.15.103:3300/0 conn(0x7fb224153b20 0x7fb2240b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 -- 172.21.15.33:0/3221861915 >> 172.21.15.33:0/3221861915 conn(0x7fb2240b0510 msgr2=0x7fb2240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:12.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 -- 172.21.15.33:0/3221861915 shutdown_connections 2024-09-13T19:01:12.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.907+0000 7fb229400640 1 -- 172.21.15.33:0/3221861915 wait complete. 2024-09-13T19:01:12.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.909+0000 7fb229400640 1 Processor -- start 2024-09-13T19:01:12.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.909+0000 7fb229400640 1 -- start start 2024-09-13T19:01:12.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb22406f660 0x7fb2241519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb224153b20 0x7fb2240af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22414d0b0 con 0x7fb224159a80 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22414d300 con 0x7fb224153b20 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb229400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b2d50 con 0x7fb22406f660 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb223200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb221e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb224153b20 0x7fb2240af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb222800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb22406f660 0x7fb2241519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb223200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47248/0 (socket says 172.21.15.33:47248) 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.910+0000 7fb223200640 1 -- 172.21.15.33:0/658502629 learned_addr learned my addr 172.21.15.33:0/658502629 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 -- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb22406f660 msgr2=0x7fb2241519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:12.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb22406f660 0x7fb2241519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 -- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb224153b20 msgr2=0x7fb2240af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb224153b20 0x7fb2240af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 -- 172.21.15.33:0/658502629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c00bd40 con 0x7fb224159a80 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb223200640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00d150 tx=0x7fb21c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.911+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c009600 con 0x7fb224159a80 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.912+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c034b90 con 0x7fb224159a80 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.912+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00b720 con 0x7fb224159a80 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.912+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240b3030 con 0x7fb224159a80 2024-09-13T19:01:12.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.912+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240b0d70 con 0x7fb224159a80 2024-09-13T19:01:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.913+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224151320 con 0x7fb224159a80 2024-09-13T19:01:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.914+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb21c03d440 con 0x7fb224159a80 2024-09-13T19:01:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.915+0000 7fb21aa00640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 0x7fb20406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.915+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb21c0ac9d0 con 0x7fb224159a80 2024-09-13T19:01:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.916+0000 7fb222800640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 0x7fb20406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:12.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.916+0000 7fb222800640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 0x7fb20406d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb2140079a0 tx=0x7fb214008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:12.920+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb224151320 con 0x7fb224159a80 2024-09-13T19:01:13.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.096+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb22415a7b0 con 0x7fb20406ac00 2024-09-13T19:01:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.104+0000 7fb21aa00640 1 -- 172.21.15.33:0/658502629 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289328 (secure 0 0 0) 0x7fb2140108d0 con 0x7fb20406ac00 2024-09-13T19:01:13.111 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:13.113 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 msgr2=0x7fb20406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 0x7fb20406d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb2140079a0 tx=0x7fb214008040 comp rx=0 tx=0).stop 2024-09-13T19:01:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 msgr2=0x7fb2240af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00d150 tx=0x7fb21c004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 shutdown_connections 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb20406ac00 0x7fb20406d0c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb224159a80 0x7fb2240af910 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb224153b20 0x7fb2240af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 --2- 172.21.15.33:0/658502629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb22406f660 0x7fb2241519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 >> 172.21.15.33:0/658502629 conn(0x7fb2240b0510 msgr2=0x7fb2240b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 shutdown_connections 2024-09-13T19:01:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.108+0000 7fb229400640 1 -- 172.21.15.33:0/658502629 wait complete. 2024-09-13T19:01:13.130 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-09-13T19:01:11.150002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255336,"kb_used_data":10504,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754719384,"statfs":{"total":773094113280,"available":772832649216,"internally_reserved":0,"allocated":10756096,"data_stored":5238292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.720594"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918214+0000","last_change":"2024-09-13T19:01:03.883863+0000","last_active":"2024-09-13T19:01:04.918214+0000","last_peered":"2024-09-13T19:01:04.918214+0000","last_clean":"2024-09-13T19:01:04.918214+0000","last_became_active":"2024-09-13T19:01:03.883610+0000","last_became_peered":"2024-09-13T19:01:03.883610+0000","last_unstale":"2024-09-13T19:01:04.918214+0000","last_undegraded":"2024-09-13T19:01:04.918214+0000","last_fullsized":"2024-09-13T19:01:04.918214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.744220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881589+0000","last_change":"2024-09-13T19:01:03.890279+0000","last_active":"2024-09-13T19:01:04.881589+0000","last_peered":"2024-09-13T19:01:04.881589+0000","last_clean":"2024-09-13T19:01:04.881589+0000","last_became_active":"2024-09-13T19:01:03.890044+0000","last_became_peered":"2024-09-13T19:01:03.890044+0000","last_unstale":"2024-09-13T19:01:04.881589+0000","last_undegraded":"2024-09-13T19:01:04.881589+0000","last_fullsized":"2024-09-13T19:01:04.881589+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:12.950015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918012+0000","last_change":"2024-09-13T19:01:03.883130+0000","last_active":"2024-09-13T19:01:04.918012+0000","last_peered":"2024-09-13T19:01:04.918012+0000","last_clean":"2024-09-13T19:01:04.918012+0000","last_became_active":"2024-09-13T19:01:03.882883+0000","last_became_peered":"2024-09-13T19:01:03.882883+0000","last_unstale":"2024-09-13T19:01:04.918012+0000","last_undegraded":"2024-09-13T19:01:04.918012+0000","last_fullsized":"2024-09-13T19:01:04.918012+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:35.849669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916464+0000","last_change":"2024-09-13T19:01:03.878010+0000","last_active":"2024-09-13T19:01:04.916464+0000","last_peered":"2024-09-13T19:01:04.916464+0000","last_clean":"2024-09-13T19:01:04.916464+0000","last_became_active":"2024-09-13T19:01:03.877749+0000","last_became_peered":"2024-09-13T19:01:03.877749+0000","last_unstale":"2024-09-13T19:01:04.916464+0000","last_undegraded":"2024-09-13T19:01:04.916464+0000","last_fullsized":"2024-09-13T19:01:04.916464+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872565+0000","last_change":"2024-09-13T19:01:03.894778+0000","last_active":"2024-09-13T19:01:04.872565+0000","last_peered":"2024-09-13T19:01:04.872565+0000","last_clean":"2024-09-13T19:01:04.872565+0000","last_became_active":"2024-09-13T19:01:03.894389+0000","last_became_peered":"2024-09-13T19:01:03.894389+0000","last_unstale":"2024-09-13T19:01:04.872565+0000","last_undegraded":"2024-09-13T19:01:04.872565+0000","last_fullsized":"2024-09-13T19:01:04.872565+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874170+0000","last_change":"2024-09-13T19:01:03.884212+0000","last_active":"2024-09-13T19:01:04.874170+0000","last_peered":"2024-09-13T19:01:04.874170+0000","last_clean":"2024-09-13T19:01:04.874170+0000","last_became_active":"2024-09-13T19:01:03.883843+0000","last_became_peered":"2024-09-13T19:01:03.883843+0000","last_unstale":"2024-09-13T19:01:04.874170+0000","last_undegraded":"2024-09-13T19:01:04.874170+0000","last_fullsized":"2024-09-13T19:01:04.874170+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873281+0000","last_change":"2024-09-13T19:01:03.881920+0000","last_active":"2024-09-13T19:01:04.873281+0000","last_peered":"2024-09-13T19:01:04.873281+0000","last_clean":"2024-09-13T19:01:04.873281+0000","last_became_active":"2024-09-13T19:01:03.881340+0000","last_became_peered":"2024-09-13T19:01:03.881340+0000","last_unstale":"2024-09-13T19:01:04.873281+0000","last_undegraded":"2024-09-13T19:01:04.873281+0000","last_fullsized":"2024-09-13T19:01:04.873281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881348+0000","last_change":"2024-09-13T19:01:03.879072+0000","last_active":"2024-09-13T19:01:04.881348+0000","last_peered":"2024-09-13T19:01:04.881348+0000","last_clean":"2024-09-13T19:01:04.881348+0000","last_became_active":"2024-09-13T19:01:03.878728+0000","last_became_peered":"2024-09-13T19:01:03.878728+0000","last_unstale":"2024-09-13T19:01:04.881348+0000","last_undegraded":"2024-09-13T19:01:04.881348+0000","last_fullsized":"2024-09-13T19:01:04.881348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:07.051001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874103+0000","last_change":"2024-09-13T19:01:03.897047+0000","last_active":"2024-09-13T19:01:04.874103+0000","last_peered":"2024-09-13T19:01:04.874103+0000","last_clean":"2024-09-13T19:01:04.874103+0000","last_became_active":"2024-09-13T19:01:03.896701+0000","last_became_peered":"2024-09-13T19:01:03.896701+0000","last_unstale":"2024-09-13T19:01:04.874103+0000","last_undegraded":"2024-09-13T19:01:04.874103+0000","last_fullsized":"2024-09-13T19:01:04.874103+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872406+0000","last_change":"2024-09-13T19:01:03.887712+0000","last_active":"2024-09-13T19:01:04.872406+0000","last_peered":"2024-09-13T19:01:04.872406+0000","last_clean":"2024-09-13T19:01:04.872406+0000","last_became_active":"2024-09-13T19:01:03.887413+0000","last_became_peered":"2024-09-13T19:01:03.887413+0000","last_unstale":"2024-09-13T19:01:04.872406+0000","last_undegraded":"2024-09-13T19:01:04.872406+0000","last_fullsized":"2024-09-13T19:01:04.872406+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:39.286318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874072+0000","last_change":"2024-09-13T19:01:03.888810+0000","last_active":"2024-09-13T19:01:04.874072+0000","last_peered":"2024-09-13T19:01:04.874072+0000","last_clean":"2024-09-13T19:01:04.874072+0000","last_became_active":"2024-09-13T19:01:03.888546+0000","last_became_peered":"2024-09-13T19:01:03.888546+0000","last_unstale":"2024-09-13T19:01:04.874072+0000","last_undegraded":"2024-09-13T19:01:04.874072+0000","last_fullsized":"2024-09-13T19:01:04.874072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:53.019080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873670+0000","last_change":"2024-09-13T19:01:03.888667+0000","last_active":"2024-09-13T19:01:04.873670+0000","last_peered":"2024-09-13T19:01:04.873670+0000","last_clean":"2024-09-13T19:01:04.873670+0000","last_became_active":"2024-09-13T19:01:03.888360+0000","last_became_peered":"2024-09-13T19:01:03.888360+0000","last_unstale":"2024-09-13T19:01:04.873670+0000","last_undegraded":"2024-09-13T19:01:04.873670+0000","last_fullsized":"2024-09-13T19:01:04.873670+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916375+0000","last_change":"2024-09-13T19:01:03.896225+0000","last_active":"2024-09-13T19:01:04.916375+0000","last_peered":"2024-09-13T19:01:04.916375+0000","last_clean":"2024-09-13T19:01:04.916375+0000","last_became_active":"2024-09-13T19:01:03.895853+0000","last_became_peered":"2024-09-13T19:01:03.895853+0000","last_unstale":"2024-09-13T19:01:04.916375+0000","last_undegraded":"2024-09-13T19:01:04.916375+0000","last_fullsized":"2024-09-13T19:01:04.916375+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916659+0000","last_change":"2024-09-13T19:01:03.889483+0000","last_active":"2024-09-13T19:01:04.916659+0000","last_peered":"2024-09-13T19:01:04.916659+0000","last_clean":"2024-09-13T19:01:04.916659+0000","last_became_active":"2024-09-13T19:01:03.889147+0000","last_became_peered":"2024-09-13T19:01:03.889147+0000","last_unstale":"2024-09-13T19:01:04.916659+0000","last_undegraded":"2024-09-13T19:01:04.916659+0000","last_fullsized":"2024-09-13T19:01:04.916659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.093589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916403+0000","last_change":"2024-09-13T19:01:03.893831+0000","last_active":"2024-09-13T19:01:04.916403+0000","last_peered":"2024-09-13T19:01:04.916403+0000","last_clean":"2024-09-13T19:01:04.916403+0000","last_became_active":"2024-09-13T19:01:03.893593+0000","last_became_peered":"2024-09-13T19:01:03.893593+0000","last_unstale":"2024-09-13T19:01:04.916403+0000","last_undegraded":"2024-09-13T19:01:04.916403+0000","last_fullsized":"2024-09-13T19:01:04.916403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873588+0000","last_change":"2024-09-13T19:01:03.879632+0000","last_active":"2024-09-13T19:01:04.873588+0000","last_peered":"2024-09-13T19:01:04.873588+0000","last_clean":"2024-09-13T19:01:04.873588+0000","last_became_active":"2024-09-13T19:01:03.879301+0000","last_became_peered":"2024-09-13T19:01:03.879301+0000","last_unstale":"2024-09-13T19:01:04.873588+0000","last_undegraded":"2024-09-13T19:01:04.873588+0000","last_fullsized":"2024-09-13T19:01:04.873588+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881731+0000","last_change":"2024-09-13T19:01:03.894459+0000","last_active":"2024-09-13T19:01:04.881731+0000","last_peered":"2024-09-13T19:01:04.881731+0000","last_clean":"2024-09-13T19:01:04.881731+0000","last_became_active":"2024-09-13T19:01:03.894165+0000","last_became_peered":"2024-09-13T19:01:03.894165+0000","last_unstale":"2024-09-13T19:01:04.881731+0000","last_undegraded":"2024-09-13T19:01:04.881731+0000","last_fullsized":"2024-09-13T19:01:04.881731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:51.323586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916318+0000","last_change":"2024-09-13T19:01:03.885044+0000","last_active":"2024-09-13T19:01:04.916318+0000","last_peered":"2024-09-13T19:01:04.916318+0000","last_clean":"2024-09-13T19:01:04.916318+0000","last_became_active":"2024-09-13T19:01:03.884409+0000","last_became_peered":"2024-09-13T19:01:03.884409+0000","last_unstale":"2024-09-13T19:01:04.916318+0000","last_undegraded":"2024-09-13T19:01:04.916318+0000","last_fullsized":"2024-09-13T19:01:04.916318+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917566+0000","last_change":"2024-09-13T19:01:03.885048+0000","last_active":"2024-09-13T19:01:04.917566+0000","last_peered":"2024-09-13T19:01:04.917566+0000","last_clean":"2024-09-13T19:01:04.917566+0000","last_became_active":"2024-09-13T19:01:03.884796+0000","last_became_peered":"2024-09-13T19:01:03.884796+0000","last_unstale":"2024-09-13T19:01:04.917566+0000","last_undegraded":"2024-09-13T19:01:04.917566+0000","last_fullsized":"2024-09-13T19:01:04.917566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:12.088451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873775+0000","last_change":"2024-09-13T19:01:03.892141+0000","last_active":"2024-09-13T19:01:04.873775+0000","last_peered":"2024-09-13T19:01:04.873775+0000","last_clean":"2024-09-13T19:01:04.873775+0000","last_became_active":"2024-09-13T19:01:03.891828+0000","last_became_peered":"2024-09-13T19:01:03.891828+0000","last_unstale":"2024-09-13T19:01:04.873775+0000","last_undegraded":"2024-09-13T19:01:04.873775+0000","last_fullsized":"2024-09-13T19:01:04.873775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916679+0000","last_change":"2024-09-13T19:01:03.884363+0000","last_active":"2024-09-13T19:01:04.916679+0000","last_peered":"2024-09-13T19:01:04.916679+0000","last_clean":"2024-09-13T19:01:04.916679+0000","last_became_active":"2024-09-13T19:01:03.883783+0000","last_became_peered":"2024-09-13T19:01:03.883783+0000","last_unstale":"2024-09-13T19:01:04.916679+0000","last_undegraded":"2024-09-13T19:01:04.916679+0000","last_fullsized":"2024-09-13T19:01:04.916679+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:12.794509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881266+0000","last_change":"2024-09-13T19:01:03.890398+0000","last_active":"2024-09-13T19:01:04.881266+0000","last_peered":"2024-09-13T19:01:04.881266+0000","last_clean":"2024-09-13T19:01:04.881266+0000","last_became_active":"2024-09-13T19:01:03.890126+0000","last_became_peered":"2024-09-13T19:01:03.890126+0000","last_unstale":"2024-09-13T19:01:04.881266+0000","last_undegraded":"2024-09-13T19:01:04.881266+0000","last_fullsized":"2024-09-13T19:01:04.881266+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:20.700281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881274+0000","last_change":"2024-09-13T19:01:03.882897+0000","last_active":"2024-09-13T19:01:04.881274+0000","last_peered":"2024-09-13T19:01:04.881274+0000","last_clean":"2024-09-13T19:01:04.881274+0000","last_became_active":"2024-09-13T19:01:03.882609+0000","last_became_peered":"2024-09-13T19:01:03.882609+0000","last_unstale":"2024-09-13T19:01:04.881274+0000","last_undegraded":"2024-09-13T19:01:04.881274+0000","last_fullsized":"2024-09-13T19:01:04.881274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:34.377064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873688+0000","last_change":"2024-09-13T19:01:03.887651+0000","last_active":"2024-09-13T19:01:04.873688+0000","last_peered":"2024-09-13T19:01:04.873688+0000","last_clean":"2024-09-13T19:01:04.873688+0000","last_became_active":"2024-09-13T19:01:03.887123+0000","last_became_peered":"2024-09-13T19:01:03.887123+0000","last_unstale":"2024-09-13T19:01:04.873688+0000","last_undegraded":"2024-09-13T19:01:04.873688+0000","last_fullsized":"2024-09-13T19:01:04.873688+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873425+0000","last_change":"2024-09-13T19:01:03.886926+0000","last_active":"2024-09-13T19:01:04.873425+0000","last_peered":"2024-09-13T19:01:04.873425+0000","last_clean":"2024-09-13T19:01:04.873425+0000","last_became_active":"2024-09-13T19:01:03.886484+0000","last_became_peered":"2024-09-13T19:01:03.886484+0000","last_unstale":"2024-09-13T19:01:04.873425+0000","last_undegraded":"2024-09-13T19:01:04.873425+0000","last_fullsized":"2024-09-13T19:01:04.873425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881632+0000","last_change":"2024-09-13T19:01:03.886962+0000","last_active":"2024-09-13T19:01:04.881632+0000","last_peered":"2024-09-13T19:01:04.881632+0000","last_clean":"2024-09-13T19:01:04.881632+0000","last_became_active":"2024-09-13T19:01:03.886693+0000","last_became_peered":"2024-09-13T19:01:03.886693+0000","last_unstale":"2024-09-13T19:01:04.881632+0000","last_undegraded":"2024-09-13T19:01:04.881632+0000","last_fullsized":"2024-09-13T19:01:04.881632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:42.748530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874218+0000","last_change":"2024-09-13T19:01:03.880910+0000","last_active":"2024-09-13T19:01:04.874218+0000","last_peered":"2024-09-13T19:01:04.874218+0000","last_clean":"2024-09-13T19:01:04.874218+0000","last_became_active":"2024-09-13T19:01:03.880563+0000","last_became_peered":"2024-09-13T19:01:03.880563+0000","last_unstale":"2024-09-13T19:01:04.874218+0000","last_undegraded":"2024-09-13T19:01:04.874218+0000","last_fullsized":"2024-09-13T19:01:04.874218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:56.238246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872820+0000","last_change":"2024-09-13T19:01:03.894659+0000","last_active":"2024-09-13T19:01:04.872820+0000","last_peered":"2024-09-13T19:01:04.872820+0000","last_clean":"2024-09-13T19:01:04.872820+0000","last_became_active":"2024-09-13T19:01:03.894408+0000","last_became_peered":"2024-09-13T19:01:03.894408+0000","last_unstale":"2024-09-13T19:01:04.872820+0000","last_undegraded":"2024-09-13T19:01:04.872820+0000","last_fullsized":"2024-09-13T19:01:04.872820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881636+0000","last_change":"2024-09-13T19:01:03.886370+0000","last_active":"2024-09-13T19:01:04.881636+0000","last_peered":"2024-09-13T19:01:04.881636+0000","last_clean":"2024-09-13T19:01:04.881636+0000","last_became_active":"2024-09-13T19:01:03.886080+0000","last_became_peered":"2024-09-13T19:01:03.886080+0000","last_unstale":"2024-09-13T19:01:04.881636+0000","last_undegraded":"2024-09-13T19:01:04.881636+0000","last_fullsized":"2024-09-13T19:01:04.881636+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:45.368989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916757+0000","last_change":"2024-09-13T19:01:03.885028+0000","last_active":"2024-09-13T19:01:04.916757+0000","last_peered":"2024-09-13T19:01:04.916757+0000","last_clean":"2024-09-13T19:01:04.916757+0000","last_became_active":"2024-09-13T19:01:03.884773+0000","last_became_peered":"2024-09-13T19:01:03.884773+0000","last_unstale":"2024-09-13T19:01:04.916757+0000","last_undegraded":"2024-09-13T19:01:04.916757+0000","last_fullsized":"2024-09-13T19:01:04.916757+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.744220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916573+0000","last_change":"2024-09-13T19:01:03.894884+0000","last_active":"2024-09-13T19:01:04.916573+0000","last_peered":"2024-09-13T19:01:04.916573+0000","last_clean":"2024-09-13T19:01:04.916573+0000","last_became_active":"2024-09-13T19:01:03.894625+0000","last_became_peered":"2024-09-13T19:01:03.894625+0000","last_unstale":"2024-09-13T19:01:04.916573+0000","last_undegraded":"2024-09-13T19:01:04.916573+0000","last_fullsized":"2024-09-13T19:01:04.916573+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917470+0000","last_change":"2024-09-13T19:01:03.881208+0000","last_active":"2024-09-13T19:01:04.917470+0000","last_peered":"2024-09-13T19:01:04.917470+0000","last_clean":"2024-09-13T19:01:04.917470+0000","last_became_active":"2024-09-13T19:01:03.880941+0000","last_became_peered":"2024-09-13T19:01:03.880941+0000","last_unstale":"2024-09-13T19:01:04.917470+0000","last_undegraded":"2024-09-13T19:01:04.917470+0000","last_fullsized":"2024-09-13T19:01:04.917470+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:12.088451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917744+0000","last_change":"2024-09-13T19:01:03.879431+0000","last_active":"2024-09-13T19:01:04.917744+0000","last_peered":"2024-09-13T19:01:04.917744+0000","last_clean":"2024-09-13T19:01:04.917744+0000","last_became_active":"2024-09-13T19:01:03.879152+0000","last_became_peered":"2024-09-13T19:01:03.879152+0000","last_unstale":"2024-09-13T19:01:04.917744+0000","last_undegraded":"2024-09-13T19:01:04.917744+0000","last_fullsized":"2024-09-13T19:01:04.917744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:12.794294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.903989+0000","last_change":"2024-09-13T19:01:03.454699+0000","last_active":"2024-09-13T19:01:03.903989+0000","last_peered":"2024-09-13T19:01:03.903989+0000","last_clean":"2024-09-13T19:01:03.903989+0000","last_became_active":"2024-09-13T19:01:03.454374+0000","last_became_peered":"2024-09-13T19:01:03.454374+0000","last_unstale":"2024-09-13T19:01:03.903989+0000","last_undegraded":"2024-09-13T19:01:03.903989+0000","last_fullsized":"2024-09-13T19:01:03.903989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:06.302510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916718+0000","last_change":"2024-09-13T19:01:03.887066+0000","last_active":"2024-09-13T19:01:04.916718+0000","last_peered":"2024-09-13T19:01:04.916718+0000","last_clean":"2024-09-13T19:01:04.916718+0000","last_became_active":"2024-09-13T19:01:03.886830+0000","last_became_peered":"2024-09-13T19:01:03.886830+0000","last_unstale":"2024-09-13T19:01:04.916718+0000","last_undegraded":"2024-09-13T19:01:04.916718+0000","last_fullsized":"2024-09-13T19:01:04.916718+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905897+0000","last_change":"2024-09-13T19:01:03.450855+0000","last_active":"2024-09-13T19:01:03.905897+0000","last_peered":"2024-09-13T19:01:03.905897+0000","last_clean":"2024-09-13T19:01:03.905897+0000","last_became_active":"2024-09-13T19:01:03.450616+0000","last_became_peered":"2024-09-13T19:01:03.450616+0000","last_unstale":"2024-09-13T19:01:03.905897+0000","last_undegraded":"2024-09-13T19:01:03.905897+0000","last_fullsized":"2024-09-13T19:01:03.905897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:34.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918011+0000","last_change":"2024-09-13T19:01:03.895230+0000","last_active":"2024-09-13T19:01:04.918011+0000","last_peered":"2024-09-13T19:01:04.918011+0000","last_clean":"2024-09-13T19:01:04.918011+0000","last_became_active":"2024-09-13T19:01:03.894769+0000","last_became_peered":"2024-09-13T19:01:03.894769+0000","last_unstale":"2024-09-13T19:01:04.918011+0000","last_undegraded":"2024-09-13T19:01:04.918011+0000","last_fullsized":"2024-09-13T19:01:04.918011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:18.549012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905038+0000","last_change":"2024-09-13T19:01:03.456812+0000","last_active":"2024-09-13T19:01:03.905038+0000","last_peered":"2024-09-13T19:01:03.905038+0000","last_clean":"2024-09-13T19:01:03.905038+0000","last_became_active":"2024-09-13T19:01:03.456504+0000","last_became_peered":"2024-09-13T19:01:03.456504+0000","last_unstale":"2024-09-13T19:01:03.905038+0000","last_undegraded":"2024-09-13T19:01:03.905038+0000","last_fullsized":"2024-09-13T19:01:03.905038+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:38.277110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873747+0000","last_change":"2024-09-13T19:01:03.886668+0000","last_active":"2024-09-13T19:01:04.873747+0000","last_peered":"2024-09-13T19:01:04.873747+0000","last_clean":"2024-09-13T19:01:04.873747+0000","last_became_active":"2024-09-13T19:01:03.881803+0000","last_became_peered":"2024-09-13T19:01:03.881803+0000","last_unstale":"2024-09-13T19:01:04.873747+0000","last_undegraded":"2024-09-13T19:01:04.873747+0000","last_fullsized":"2024-09-13T19:01:04.873747+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:12.308944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904595+0000","last_change":"2024-09-13T19:01:03.455254+0000","last_active":"2024-09-13T19:01:03.904595+0000","last_peered":"2024-09-13T19:01:03.904595+0000","last_clean":"2024-09-13T19:01:03.904595+0000","last_became_active":"2024-09-13T19:01:03.454722+0000","last_became_peered":"2024-09-13T19:01:03.454722+0000","last_unstale":"2024-09-13T19:01:03.904595+0000","last_undegraded":"2024-09-13T19:01:03.904595+0000","last_fullsized":"2024-09-13T19:01:03.904595+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:26.790382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916511+0000","last_change":"2024-09-13T19:01:03.891669+0000","last_active":"2024-09-13T19:01:04.916511+0000","last_peered":"2024-09-13T19:01:04.916511+0000","last_clean":"2024-09-13T19:01:04.916511+0000","last_became_active":"2024-09-13T19:01:03.890377+0000","last_became_peered":"2024-09-13T19:01:03.890377+0000","last_unstale":"2024-09-13T19:01:04.916511+0000","last_undegraded":"2024-09-13T19:01:04.916511+0000","last_fullsized":"2024-09-13T19:01:04.916511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:36.104141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.903122+0000","last_change":"2024-09-13T19:01:03.450682+0000","last_active":"2024-09-13T19:01:03.903122+0000","last_peered":"2024-09-13T19:01:03.903122+0000","last_clean":"2024-09-13T19:01:03.903122+0000","last_became_active":"2024-09-13T19:01:03.450433+0000","last_became_peered":"2024-09-13T19:01:03.450433+0000","last_unstale":"2024-09-13T19:01:03.903122+0000","last_undegraded":"2024-09-13T19:01:03.903122+0000","last_fullsized":"2024-09-13T19:01:03.903122+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:42.488708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873872+0000","last_change":"2024-09-13T19:01:03.884190+0000","last_active":"2024-09-13T19:01:04.873872+0000","last_peered":"2024-09-13T19:01:04.873872+0000","last_clean":"2024-09-13T19:01:04.873872+0000","last_became_active":"2024-09-13T19:01:03.883908+0000","last_became_peered":"2024-09-13T19:01:03.883908+0000","last_unstale":"2024-09-13T19:01:04.873872+0000","last_undegraded":"2024-09-13T19:01:04.873872+0000","last_fullsized":"2024-09-13T19:01:04.873872+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:54.763783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905882+0000","last_change":"2024-09-13T19:01:03.453035+0000","last_active":"2024-09-13T19:01:03.905882+0000","last_peered":"2024-09-13T19:01:03.905882+0000","last_clean":"2024-09-13T19:01:03.905882+0000","last_became_active":"2024-09-13T19:01:03.452766+0000","last_became_peered":"2024-09-13T19:01:03.452766+0000","last_unstale":"2024-09-13T19:01:03.905882+0000","last_undegraded":"2024-09-13T19:01:03.905882+0000","last_fullsized":"2024-09-13T19:01:03.905882+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:19.951482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916375+0000","last_change":"2024-09-13T19:01:03.892825+0000","last_active":"2024-09-13T19:01:04.916375+0000","last_peered":"2024-09-13T19:01:04.916375+0000","last_clean":"2024-09-13T19:01:04.916375+0000","last_became_active":"2024-09-13T19:01:03.892541+0000","last_became_peered":"2024-09-13T19:01:03.892541+0000","last_unstale":"2024-09-13T19:01:04.916375+0000","last_undegraded":"2024-09-13T19:01:04.916375+0000","last_fullsized":"2024-09-13T19:01:04.916375+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868973+0000","last_change":"2024-09-13T19:01:03.454572+0000","last_active":"2024-09-13T19:01:03.868973+0000","last_peered":"2024-09-13T19:01:03.868973+0000","last_clean":"2024-09-13T19:01:03.868973+0000","last_became_active":"2024-09-13T19:01:03.454262+0000","last_became_peered":"2024-09-13T19:01:03.454262+0000","last_unstale":"2024-09-13T19:01:03.868973+0000","last_undegraded":"2024-09-13T19:01:03.868973+0000","last_fullsized":"2024-09-13T19:01:03.868973+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:27.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873973+0000","last_change":"2024-09-13T19:01:03.887243+0000","last_active":"2024-09-13T19:01:04.873973+0000","last_peered":"2024-09-13T19:01:04.873973+0000","last_clean":"2024-09-13T19:01:04.873973+0000","last_became_active":"2024-09-13T19:01:03.883434+0000","last_became_peered":"2024-09-13T19:01:03.883434+0000","last_unstale":"2024-09-13T19:01:04.873973+0000","last_undegraded":"2024-09-13T19:01:04.873973+0000","last_fullsized":"2024-09-13T19:01:04.873973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:34.539646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868685+0000","last_change":"2024-09-13T19:01:03.458043+0000","last_active":"2024-09-13T19:01:03.868685+0000","last_peered":"2024-09-13T19:01:03.868685+0000","last_clean":"2024-09-13T19:01:03.868685+0000","last_became_active":"2024-09-13T19:01:03.457785+0000","last_became_peered":"2024-09-13T19:01:03.457785+0000","last_unstale":"2024-09-13T19:01:03.868685+0000","last_undegraded":"2024-09-13T19:01:03.868685+0000","last_fullsized":"2024-09-13T19:01:03.868685+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:30.605001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881690+0000","last_change":"2024-09-13T19:01:03.889550+0000","last_active":"2024-09-13T19:01:04.881690+0000","last_peered":"2024-09-13T19:01:04.881690+0000","last_clean":"2024-09-13T19:01:04.881690+0000","last_became_active":"2024-09-13T19:01:03.889213+0000","last_became_peered":"2024-09-13T19:01:03.889213+0000","last_unstale":"2024-09-13T19:01:04.881690+0000","last_undegraded":"2024-09-13T19:01:04.881690+0000","last_fullsized":"2024-09-13T19:01:04.881690+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:26.772236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871172+0000","last_change":"2024-09-13T19:01:03.456698+0000","last_active":"2024-09-13T19:01:03.871172+0000","last_peered":"2024-09-13T19:01:03.871172+0000","last_clean":"2024-09-13T19:01:03.871172+0000","last_became_active":"2024-09-13T19:01:03.456353+0000","last_became_peered":"2024-09-13T19:01:03.456353+0000","last_unstale":"2024-09-13T19:01:03.871172+0000","last_undegraded":"2024-09-13T19:01:03.871172+0000","last_fullsized":"2024-09-13T19:01:03.871172+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:59.355702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874187+0000","last_change":"2024-09-13T19:01:03.886989+0000","last_active":"2024-09-13T19:01:04.874187+0000","last_peered":"2024-09-13T19:01:04.874187+0000","last_clean":"2024-09-13T19:01:04.874187+0000","last_became_active":"2024-09-13T19:01:03.882709+0000","last_became_peered":"2024-09-13T19:01:03.882709+0000","last_unstale":"2024-09-13T19:01:04.874187+0000","last_undegraded":"2024-09-13T19:01:04.874187+0000","last_fullsized":"2024-09-13T19:01:04.874187+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:39.633947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871424+0000","last_change":"2024-09-13T19:01:03.457910+0000","last_active":"2024-09-13T19:01:03.871424+0000","last_peered":"2024-09-13T19:01:03.871424+0000","last_clean":"2024-09-13T19:01:03.871424+0000","last_became_active":"2024-09-13T19:01:03.457403+0000","last_became_peered":"2024-09-13T19:01:03.457403+0000","last_unstale":"2024-09-13T19:01:03.871424+0000","last_undegraded":"2024-09-13T19:01:03.871424+0000","last_fullsized":"2024-09-13T19:01:03.871424+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872914+0000","last_change":"2024-09-13T19:01:03.888061+0000","last_active":"2024-09-13T19:01:04.872914+0000","last_peered":"2024-09-13T19:01:04.872914+0000","last_clean":"2024-09-13T19:01:04.872914+0000","last_became_active":"2024-09-13T19:01:03.887343+0000","last_became_peered":"2024-09-13T19:01:03.887343+0000","last_unstale":"2024-09-13T19:01:04.872914+0000","last_undegraded":"2024-09-13T19:01:04.872914+0000","last_fullsized":"2024-09-13T19:01:04.872914+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"95'3","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905773+0000","last_change":"2024-09-13T19:01:03.447604+0000","last_active":"2024-09-13T19:01:03.905773+0000","last_peered":"2024-09-13T19:01:03.905773+0000","last_clean":"2024-09-13T19:01:03.905773+0000","last_became_active":"2024-09-13T19:01:03.447233+0000","last_became_peered":"2024-09-13T19:01:03.447233+0000","last_unstale":"2024-09-13T19:01:03.905773+0000","last_undegraded":"2024-09-13T19:01:03.905773+0000","last_fullsized":"2024-09-13T19:01:03.905773+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874277+0000","last_change":"2024-09-13T19:01:03.880873+0000","last_active":"2024-09-13T19:01:04.874277+0000","last_peered":"2024-09-13T19:01:04.874277+0000","last_clean":"2024-09-13T19:01:04.874277+0000","last_became_active":"2024-09-13T19:01:03.880218+0000","last_became_peered":"2024-09-13T19:01:03.880218+0000","last_unstale":"2024-09-13T19:01:04.874277+0000","last_undegraded":"2024-09-13T19:01:04.874277+0000","last_fullsized":"2024-09-13T19:01:04.874277+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.970118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"95'6","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.907385+0000","last_change":"2024-09-13T19:01:03.454191+0000","last_active":"2024-09-13T19:01:03.907385+0000","last_peered":"2024-09-13T19:01:03.907385+0000","last_clean":"2024-09-13T19:01:03.907385+0000","last_became_active":"2024-09-13T19:01:03.453883+0000","last_became_peered":"2024-09-13T19:01:03.453883+0000","last_unstale":"2024-09-13T19:01:03.907385+0000","last_undegraded":"2024-09-13T19:01:03.907385+0000","last_fullsized":"2024-09-13T19:01:03.907385+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:37.383415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916231+0000","last_change":"2024-09-13T19:01:03.886595+0000","last_active":"2024-09-13T19:01:04.916231+0000","last_peered":"2024-09-13T19:01:04.916231+0000","last_clean":"2024-09-13T19:01:04.916231+0000","last_became_active":"2024-09-13T19:01:03.885979+0000","last_became_peered":"2024-09-13T19:01:03.885979+0000","last_unstale":"2024-09-13T19:01:04.916231+0000","last_undegraded":"2024-09-13T19:01:04.916231+0000","last_fullsized":"2024-09-13T19:01:04.916231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:20.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905531+0000","last_change":"2024-09-13T19:01:03.450633+0000","last_active":"2024-09-13T19:01:03.905531+0000","last_peered":"2024-09-13T19:01:03.905531+0000","last_clean":"2024-09-13T19:01:03.905531+0000","last_became_active":"2024-09-13T19:01:03.450285+0000","last_became_peered":"2024-09-13T19:01:03.450285+0000","last_unstale":"2024-09-13T19:01:03.905531+0000","last_undegraded":"2024-09-13T19:01:03.905531+0000","last_fullsized":"2024-09-13T19:01:03.905531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:42.878581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917898+0000","last_change":"2024-09-13T19:01:03.882153+0000","last_active":"2024-09-13T19:01:04.917898+0000","last_peered":"2024-09-13T19:01:04.917898+0000","last_clean":"2024-09-13T19:01:04.917898+0000","last_became_active":"2024-09-13T19:01:03.881664+0000","last_became_peered":"2024-09-13T19:01:03.881664+0000","last_unstale":"2024-09-13T19:01:04.917898+0000","last_undegraded":"2024-09-13T19:01:04.917898+0000","last_fullsized":"2024-09-13T19:01:04.917898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:55.742717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.870822+0000","last_change":"2024-09-13T19:01:03.458987+0000","last_active":"2024-09-13T19:01:03.870822+0000","last_peered":"2024-09-13T19:01:03.870822+0000","last_clean":"2024-09-13T19:01:03.870822+0000","last_became_active":"2024-09-13T19:01:03.458747+0000","last_became_peered":"2024-09-13T19:01:03.458747+0000","last_unstale":"2024-09-13T19:01:03.870822+0000","last_undegraded":"2024-09-13T19:01:03.870822+0000","last_fullsized":"2024-09-13T19:01:03.870822+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:50.967933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873185+0000","last_change":"2024-09-13T19:01:03.877371+0000","last_active":"2024-09-13T19:01:04.873185+0000","last_peered":"2024-09-13T19:01:04.873185+0000","last_clean":"2024-09-13T19:01:04.873185+0000","last_became_active":"2024-09-13T19:01:03.877100+0000","last_became_peered":"2024-09-13T19:01:03.877100+0000","last_unstale":"2024-09-13T19:01:04.873185+0000","last_undegraded":"2024-09-13T19:01:04.873185+0000","last_fullsized":"2024-09-13T19:01:04.873185+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:44.349846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.876585+0000","last_change":"2024-09-13T19:01:03.442350+0000","last_active":"2024-09-13T19:01:03.876585+0000","last_peered":"2024-09-13T19:01:03.876585+0000","last_clean":"2024-09-13T19:01:03.876585+0000","last_became_active":"2024-09-13T19:01:03.442071+0000","last_became_peered":"2024-09-13T19:01:03.442071+0000","last_unstale":"2024-09-13T19:01:03.876585+0000","last_undegraded":"2024-09-13T19:01:03.876585+0000","last_fullsized":"2024-09-13T19:01:03.876585+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917269+0000","last_change":"2024-09-13T19:01:03.888885+0000","last_active":"2024-09-13T19:01:04.917269+0000","last_peered":"2024-09-13T19:01:04.917269+0000","last_clean":"2024-09-13T19:01:04.917269+0000","last_became_active":"2024-09-13T19:01:03.888569+0000","last_became_peered":"2024-09-13T19:01:03.888569+0000","last_unstale":"2024-09-13T19:01:04.917269+0000","last_undegraded":"2024-09-13T19:01:04.917269+0000","last_fullsized":"2024-09-13T19:01:04.917269+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.364910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.906107+0000","last_change":"2024-09-13T19:01:03.446962+0000","last_active":"2024-09-13T19:01:03.906107+0000","last_peered":"2024-09-13T19:01:03.906107+0000","last_clean":"2024-09-13T19:01:03.906107+0000","last_became_active":"2024-09-13T19:01:03.446658+0000","last_became_peered":"2024-09-13T19:01:03.446658+0000","last_unstale":"2024-09-13T19:01:03.906107+0000","last_undegraded":"2024-09-13T19:01:03.906107+0000","last_fullsized":"2024-09-13T19:01:03.906107+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.912422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873477+0000","last_change":"2024-09-13T19:01:03.888116+0000","last_active":"2024-09-13T19:01:04.873477+0000","last_peered":"2024-09-13T19:01:04.873477+0000","last_clean":"2024-09-13T19:01:04.873477+0000","last_became_active":"2024-09-13T19:01:03.887696+0000","last_became_peered":"2024-09-13T19:01:03.887696+0000","last_unstale":"2024-09-13T19:01:04.873477+0000","last_undegraded":"2024-09-13T19:01:04.873477+0000","last_fullsized":"2024-09-13T19:01:04.873477+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:07.311717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.905423+0000","last_change":"2024-09-13T19:01:03.451923+0000","last_active":"2024-09-13T19:01:03.905423+0000","last_peered":"2024-09-13T19:01:03.905423+0000","last_clean":"2024-09-13T19:01:03.905423+0000","last_became_active":"2024-09-13T19:01:03.451577+0000","last_became_peered":"2024-09-13T19:01:03.451577+0000","last_unstale":"2024-09-13T19:01:03.905423+0000","last_undegraded":"2024-09-13T19:01:03.905423+0000","last_fullsized":"2024-09-13T19:01:03.905423+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:10.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916595+0000","last_change":"2024-09-13T19:01:03.891394+0000","last_active":"2024-09-13T19:01:04.916595+0000","last_peered":"2024-09-13T19:01:04.916595+0000","last_clean":"2024-09-13T19:01:04.916595+0000","last_became_active":"2024-09-13T19:01:03.890417+0000","last_became_peered":"2024-09-13T19:01:03.890417+0000","last_unstale":"2024-09-13T19:01:04.916595+0000","last_undegraded":"2024-09-13T19:01:04.916595+0000","last_fullsized":"2024-09-13T19:01:04.916595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:05.648507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.902588+0000","last_change":"2024-09-13T19:01:03.445468+0000","last_active":"2024-09-13T19:01:03.902588+0000","last_peered":"2024-09-13T19:01:03.902588+0000","last_clean":"2024-09-13T19:01:03.902588+0000","last_became_active":"2024-09-13T19:01:03.445132+0000","last_became_peered":"2024-09-13T19:01:03.445132+0000","last_unstale":"2024-09-13T19:01:03.902588+0000","last_undegraded":"2024-09-13T19:01:03.902588+0000","last_fullsized":"2024-09-13T19:01:03.902588+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:20.440107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.874288+0000","last_change":"2024-09-13T19:01:03.890873+0000","last_active":"2024-09-13T19:01:04.874288+0000","last_peered":"2024-09-13T19:01:04.874288+0000","last_clean":"2024-09-13T19:01:04.874288+0000","last_became_active":"2024-09-13T19:01:03.890515+0000","last_became_peered":"2024-09-13T19:01:03.890515+0000","last_unstale":"2024-09-13T19:01:04.874288+0000","last_undegraded":"2024-09-13T19:01:04.874288+0000","last_fullsized":"2024-09-13T19:01:04.874288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.872789+0000","last_change":"2024-09-13T19:01:03.455027+0000","last_active":"2024-09-13T19:01:03.872789+0000","last_peered":"2024-09-13T19:01:03.872789+0000","last_clean":"2024-09-13T19:01:03.872789+0000","last_became_active":"2024-09-13T19:01:03.454439+0000","last_became_peered":"2024-09-13T19:01:03.454439+0000","last_unstale":"2024-09-13T19:01:03.872789+0000","last_undegraded":"2024-09-13T19:01:03.872789+0000","last_fullsized":"2024-09-13T19:01:03.872789+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:14.436505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916846+0000","last_change":"2024-09-13T19:01:03.890967+0000","last_active":"2024-09-13T19:01:04.916846+0000","last_peered":"2024-09-13T19:01:04.916846+0000","last_clean":"2024-09-13T19:01:04.916846+0000","last_became_active":"2024-09-13T19:01:03.890704+0000","last_became_peered":"2024-09-13T19:01:03.890704+0000","last_unstale":"2024-09-13T19:01:04.916846+0000","last_undegraded":"2024-09-13T19:01:04.916846+0000","last_fullsized":"2024-09-13T19:01:04.916846+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:22.948036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904970+0000","last_change":"2024-09-13T19:01:03.453615+0000","last_active":"2024-09-13T19:01:03.904970+0000","last_peered":"2024-09-13T19:01:03.904970+0000","last_clean":"2024-09-13T19:01:03.904970+0000","last_became_active":"2024-09-13T19:01:03.453323+0000","last_became_peered":"2024-09-13T19:01:03.453323+0000","last_unstale":"2024-09-13T19:01:03.904970+0000","last_undegraded":"2024-09-13T19:01:03.904970+0000","last_fullsized":"2024-09-13T19:01:03.904970+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916784+0000","last_change":"2024-09-13T19:01:03.884621+0000","last_active":"2024-09-13T19:01:04.916784+0000","last_peered":"2024-09-13T19:01:04.916784+0000","last_clean":"2024-09-13T19:01:04.916784+0000","last_became_active":"2024-09-13T19:01:03.884128+0000","last_became_peered":"2024-09-13T19:01:03.884128+0000","last_unstale":"2024-09-13T19:01:04.916784+0000","last_undegraded":"2024-09-13T19:01:04.916784+0000","last_fullsized":"2024-09-13T19:01:04.916784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:14.531972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.877136+0000","last_change":"2024-09-13T19:01:03.456642+0000","last_active":"2024-09-13T19:01:03.877136+0000","last_peered":"2024-09-13T19:01:03.877136+0000","last_clean":"2024-09-13T19:01:03.877136+0000","last_became_active":"2024-09-13T19:01:03.456361+0000","last_became_peered":"2024-09-13T19:01:03.456361+0000","last_unstale":"2024-09-13T19:01:03.877136+0000","last_undegraded":"2024-09-13T19:01:03.877136+0000","last_fullsized":"2024-09-13T19:01:03.877136+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:05.629155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916202+0000","last_change":"2024-09-13T19:01:03.878187+0000","last_active":"2024-09-13T19:01:04.916202+0000","last_peered":"2024-09-13T19:01:04.916202+0000","last_clean":"2024-09-13T19:01:04.916202+0000","last_became_active":"2024-09-13T19:01:03.877946+0000","last_became_peered":"2024-09-13T19:01:03.877946+0000","last_unstale":"2024-09-13T19:01:04.916202+0000","last_undegraded":"2024-09-13T19:01:04.916202+0000","last_fullsized":"2024-09-13T19:01:04.916202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:54.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.877938+0000","last_change":"2024-09-13T19:01:03.454291+0000","last_active":"2024-09-13T19:01:03.877938+0000","last_peered":"2024-09-13T19:01:03.877938+0000","last_clean":"2024-09-13T19:01:03.877938+0000","last_became_active":"2024-09-13T19:01:03.453839+0000","last_became_peered":"2024-09-13T19:01:03.453839+0000","last_unstale":"2024-09-13T19:01:03.877938+0000","last_undegraded":"2024-09-13T19:01:03.877938+0000","last_fullsized":"2024-09-13T19:01:03.877938+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:54.733509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872260+0000","last_change":"2024-09-13T19:01:03.887500+0000","last_active":"2024-09-13T19:01:04.872260+0000","last_peered":"2024-09-13T19:01:04.872260+0000","last_clean":"2024-09-13T19:01:04.872260+0000","last_became_active":"2024-09-13T19:01:03.887187+0000","last_became_peered":"2024-09-13T19:01:03.887187+0000","last_unstale":"2024-09-13T19:01:04.872260+0000","last_undegraded":"2024-09-13T19:01:04.872260+0000","last_fullsized":"2024-09-13T19:01:04.872260+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:24.821026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.866935+0000","last_change":"2024-09-13T19:01:03.451958+0000","last_active":"2024-09-13T19:01:03.866935+0000","last_peered":"2024-09-13T19:01:03.866935+0000","last_clean":"2024-09-13T19:01:03.866935+0000","last_became_active":"2024-09-13T19:01:03.451088+0000","last_became_peered":"2024-09-13T19:01:03.451088+0000","last_unstale":"2024-09-13T19:01:03.866935+0000","last_undegraded":"2024-09-13T19:01:03.866935+0000","last_fullsized":"2024-09-13T19:01:03.866935+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.811818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.881723+0000","last_change":"2024-09-13T19:01:03.881760+0000","last_active":"2024-09-13T19:01:04.881723+0000","last_peered":"2024-09-13T19:01:04.881723+0000","last_clean":"2024-09-13T19:01:04.881723+0000","last_became_active":"2024-09-13T19:01:03.881346+0000","last_became_peered":"2024-09-13T19:01:03.881346+0000","last_unstale":"2024-09-13T19:01:04.881723+0000","last_undegraded":"2024-09-13T19:01:04.881723+0000","last_fullsized":"2024-09-13T19:01:04.881723+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:43.365695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904827+0000","last_change":"2024-09-13T19:01:03.452135+0000","last_active":"2024-09-13T19:01:03.904827+0000","last_peered":"2024-09-13T19:01:03.904827+0000","last_clean":"2024-09-13T19:01:03.904827+0000","last_became_active":"2024-09-13T19:01:03.451819+0000","last_became_peered":"2024-09-13T19:01:03.451819+0000","last_unstale":"2024-09-13T19:01:03.904827+0000","last_undegraded":"2024-09-13T19:01:03.904827+0000","last_fullsized":"2024-09-13T19:01:03.904827+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918208+0000","last_change":"2024-09-13T19:01:03.881870+0000","last_active":"2024-09-13T19:01:04.918208+0000","last_peered":"2024-09-13T19:01:04.918208+0000","last_clean":"2024-09-13T19:01:04.918208+0000","last_became_active":"2024-09-13T19:01:03.880968+0000","last_became_peered":"2024-09-13T19:01:03.880968+0000","last_unstale":"2024-09-13T19:01:04.918208+0000","last_undegraded":"2024-09-13T19:01:04.918208+0000","last_fullsized":"2024-09-13T19:01:04.918208+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:59.017584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.870958+0000","last_change":"2024-09-13T19:01:03.455042+0000","last_active":"2024-09-13T19:01:03.870958+0000","last_peered":"2024-09-13T19:01:03.870958+0000","last_clean":"2024-09-13T19:01:03.870958+0000","last_became_active":"2024-09-13T19:01:03.454769+0000","last_became_peered":"2024-09-13T19:01:03.454769+0000","last_unstale":"2024-09-13T19:01:03.870958+0000","last_undegraded":"2024-09-13T19:01:03.870958+0000","last_fullsized":"2024-09-13T19:01:03.870958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:43.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.918072+0000","last_change":"2024-09-13T19:01:03.881627+0000","last_active":"2024-09-13T19:01:04.918072+0000","last_peered":"2024-09-13T19:01:04.918072+0000","last_clean":"2024-09-13T19:01:04.918072+0000","last_became_active":"2024-09-13T19:01:03.881338+0000","last_became_peered":"2024-09-13T19:01:03.881338+0000","last_unstale":"2024-09-13T19:01:04.918072+0000","last_undegraded":"2024-09-13T19:01:04.918072+0000","last_fullsized":"2024-09-13T19:01:04.918072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:06.638362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868377+0000","last_change":"2024-09-13T19:01:03.453368+0000","last_active":"2024-09-13T19:01:03.868377+0000","last_peered":"2024-09-13T19:01:03.868377+0000","last_clean":"2024-09-13T19:01:03.868377+0000","last_became_active":"2024-09-13T19:01:03.453099+0000","last_became_peered":"2024-09-13T19:01:03.453099+0000","last_unstale":"2024-09-13T19:01:03.868377+0000","last_undegraded":"2024-09-13T19:01:03.868377+0000","last_fullsized":"2024-09-13T19:01:03.868377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:11.299736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873337+0000","last_change":"2024-09-13T19:01:03.892662+0000","last_active":"2024-09-13T19:01:04.873337+0000","last_peered":"2024-09-13T19:01:04.873337+0000","last_clean":"2024-09-13T19:01:04.873337+0000","last_became_active":"2024-09-13T19:01:03.892386+0000","last_became_peered":"2024-09-13T19:01:03.892386+0000","last_unstale":"2024-09-13T19:01:04.873337+0000","last_undegraded":"2024-09-13T19:01:04.873337+0000","last_fullsized":"2024-09-13T19:01:04.873337+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:15.445713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.869374+0000","last_change":"2024-09-13T19:01:03.444077+0000","last_active":"2024-09-13T19:01:03.869374+0000","last_peered":"2024-09-13T19:01:03.869374+0000","last_clean":"2024-09-13T19:01:03.869374+0000","last_became_active":"2024-09-13T19:01:03.443736+0000","last_became_peered":"2024-09-13T19:01:03.443736+0000","last_unstale":"2024-09-13T19:01:03.869374+0000","last_undegraded":"2024-09-13T19:01:03.869374+0000","last_fullsized":"2024-09-13T19:01:03.869374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:54.187099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916928+0000","last_change":"2024-09-13T19:01:03.890794+0000","last_active":"2024-09-13T19:01:04.916928+0000","last_peered":"2024-09-13T19:01:04.916928+0000","last_clean":"2024-09-13T19:01:04.916928+0000","last_became_active":"2024-09-13T19:01:03.890534+0000","last_became_peered":"2024-09-13T19:01:03.890534+0000","last_unstale":"2024-09-13T19:01:04.916928+0000","last_undegraded":"2024-09-13T19:01:04.916928+0000","last_fullsized":"2024-09-13T19:01:04.916928+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:31.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.872790+0000","last_change":"2024-09-13T19:01:03.454076+0000","last_active":"2024-09-13T19:01:03.872790+0000","last_peered":"2024-09-13T19:01:03.872790+0000","last_clean":"2024-09-13T19:01:03.872790+0000","last_became_active":"2024-09-13T19:01:03.453822+0000","last_became_peered":"2024-09-13T19:01:03.453822+0000","last_unstale":"2024-09-13T19:01:03.872790+0000","last_undegraded":"2024-09-13T19:01:03.872790+0000","last_fullsized":"2024-09-13T19:01:03.872790+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:15.677627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873972+0000","last_change":"2024-09-13T19:01:03.894057+0000","last_active":"2024-09-13T19:01:04.873972+0000","last_peered":"2024-09-13T19:01:04.873972+0000","last_clean":"2024-09-13T19:01:04.873972+0000","last_became_active":"2024-09-13T19:01:03.888979+0000","last_became_peered":"2024-09-13T19:01:03.888979+0000","last_unstale":"2024-09-13T19:01:04.873972+0000","last_undegraded":"2024-09-13T19:01:04.873972+0000","last_fullsized":"2024-09-13T19:01:04.873972+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.686835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.868514+0000","last_change":"2024-09-13T19:01:03.444861+0000","last_active":"2024-09-13T19:01:03.868514+0000","last_peered":"2024-09-13T19:01:03.868514+0000","last_clean":"2024-09-13T19:01:03.868514+0000","last_became_active":"2024-09-13T19:01:03.444538+0000","last_became_peered":"2024-09-13T19:01:03.444538+0000","last_unstale":"2024-09-13T19:01:03.868514+0000","last_undegraded":"2024-09-13T19:01:03.868514+0000","last_fullsized":"2024-09-13T19:01:03.868514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:58.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.916296+0000","last_change":"2024-09-13T19:01:03.887752+0000","last_active":"2024-09-13T19:01:04.916296+0000","last_peered":"2024-09-13T19:01:04.916296+0000","last_clean":"2024-09-13T19:01:04.916296+0000","last_became_active":"2024-09-13T19:01:03.887476+0000","last_became_peered":"2024-09-13T19:01:03.887476+0000","last_unstale":"2024-09-13T19:01:04.916296+0000","last_undegraded":"2024-09-13T19:01:04.916296+0000","last_fullsized":"2024-09-13T19:01:04.916296+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:18.420472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871447+0000","last_change":"2024-09-13T19:01:03.460001+0000","last_active":"2024-09-13T19:01:03.871447+0000","last_peered":"2024-09-13T19:01:03.871447+0000","last_clean":"2024-09-13T19:01:03.871447+0000","last_became_active":"2024-09-13T19:01:03.459733+0000","last_became_peered":"2024-09-13T19:01:03.459733+0000","last_unstale":"2024-09-13T19:01:03.871447+0000","last_undegraded":"2024-09-13T19:01:03.871447+0000","last_fullsized":"2024-09-13T19:01:03.871447+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:54.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.872370+0000","last_change":"2024-09-13T19:01:03.887193+0000","last_active":"2024-09-13T19:01:04.872370+0000","last_peered":"2024-09-13T19:01:04.872370+0000","last_clean":"2024-09-13T19:01:04.872370+0000","last_became_active":"2024-09-13T19:01:03.886551+0000","last_became_peered":"2024-09-13T19:01:03.886551+0000","last_unstale":"2024-09-13T19:01:04.872370+0000","last_undegraded":"2024-09-13T19:01:04.872370+0000","last_fullsized":"2024-09-13T19:01:04.872370+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.799590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.871494+0000","last_change":"2024-09-13T19:01:03.461323+0000","last_active":"2024-09-13T19:01:03.871494+0000","last_peered":"2024-09-13T19:01:03.871494+0000","last_clean":"2024-09-13T19:01:03.871494+0000","last_became_active":"2024-09-13T19:01:03.461021+0000","last_became_peered":"2024-09-13T19:01:03.461021+0000","last_unstale":"2024-09-13T19:01:03.871494+0000","last_undegraded":"2024-09-13T19:01:03.871494+0000","last_fullsized":"2024-09-13T19:01:03.871494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:35.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.917837+0000","last_change":"2024-09-13T19:01:03.891197+0000","last_active":"2024-09-13T19:01:04.917837+0000","last_peered":"2024-09-13T19:01:04.917837+0000","last_clean":"2024-09-13T19:01:04.917837+0000","last_became_active":"2024-09-13T19:01:03.890821+0000","last_became_peered":"2024-09-13T19:01:03.890821+0000","last_unstale":"2024-09-13T19:01:04.917837+0000","last_undegraded":"2024-09-13T19:01:04.917837+0000","last_fullsized":"2024-09-13T19:01:04.917837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:03.419197+0000","last_clean_scrub_stamp":"2024-09-13T19:01:03.419197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:10.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-13T19:01:03.904086+0000","last_change":"2024-09-13T19:01:03.455304+0000","last_active":"2024-09-13T19:01:03.904086+0000","last_peered":"2024-09-13T19:01:03.904086+0000","last_clean":"2024-09-13T19:01:03.904086+0000","last_became_active":"2024-09-13T19:01:03.454364+0000","last_became_peered":"2024-09-13T19:01:03.454364+0000","last_unstale":"2024-09-13T19:01:03.904086+0000","last_undegraded":"2024-09-13T19:01:03.904086+0000","last_fullsized":"2024-09-13T19:01:03.904086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:01:02.409989+0000","last_clean_scrub_stamp":"2024-09-13T19:01:02.409989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:26.095295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":242,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-13T19:01:04.873694+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:04.873694+0000","last_peered":"2024-09-13T19:01:04.873694+0000","last_clean":"2024-09-13T19:01:04.873694+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:04.873694+0000","last_undegraded":"2024-09-13T19:01:04.873694+0000","last_fullsized":"2024-09-13T19:01:04.873694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1789952,"data_stored":1097084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.754},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1196032,"data_stored":507256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.62},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80700000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.57699999999999996,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.748},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.877,"5min":1.105,"15min":1.105},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.492,"15min":1.492},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.97099999999999997,"5min":1.121,"15min":1.121},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1191936,"data_stored":506674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.54300000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91800000000000004,"5min":1.204,"15min":1.204},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79600000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89800000000000002,"5min":1.25,"15min":1.25},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":1.337,"15min":1.337},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.871,"5min":1.391,"15min":1.391},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66700000000000004},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.82499999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0069999999999999,"5min":1.792,"15min":1.792},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.077,"5min":1.49,"15min":1.49},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":508292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.75},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1204224,"data_stored":508190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.435,"15min":0.45200000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65000000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.55700000000000005,"15min":0.61299999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":3.339,"15min":3.339},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69099999999999995,"5min":1.095,"15min":1.095},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63200000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.82099999999999995,"15min":0.88400000000000001},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.91100000000000003,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.91100000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":3.383,"15min":3.383},"last":0.55900000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.97199999999999998},"min":{"1min":0.55000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.84399999999999997,"15min":0.91500000000000004},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.85299999999999998,"15min":0.90900000000000003},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.745},{"interface":"front","average":{"1min":0.752,"5min":0.89000000000000001,"15min":0.96099999999999997},"min":{"1min":0.57599999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.1419999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1191936,"data_stored":506638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.47399999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.33300000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.496,"15min":0.501},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375}]},{"osd":3,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.54200000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.58999999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91700000000000004,"5min":0.998,"15min":0.998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.79800000000000004,"5min":1.079,"15min":1.079},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85599999999999998,"5min":1.075,"15min":1.075},"last":0.754}]},{"osd":6,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88500000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.77600000000000002},"min":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 19:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93600000000000005,"5min":1.171,"15min":1.171},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.82999999999999996,"5min":1.077,"15min":1.077},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1187840,"data_stored":506604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.81699999999999995,"5min":1.486,"15min":1.486},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":1.27,"15min":1.27},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.53100000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67700000000000005,"5min":1.228,"15min":1.228},"last":0.496}]},{"osd":4,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78300000000000003,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76100000000000001,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82199999999999995,"5min":1.611,"15min":1.611},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.78200000000000003,"5min":1.236,"15min":1.236},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92600000000000005,"5min":1.137,"15min":1.137},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86599999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91200000000000003,"5min":1.284,"15min":1.284},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Sep 13 19:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.214,"15min":1.214},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94699999999999995,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1785856,"data_stored":1097554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71099999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.377},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.318,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64300000000000002,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0649999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.135,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75600000000000001,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.091,"5min":1.23,"15min":1.23},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.59999999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0229999999999999,"5min":1.246,"15min":1.246},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1899999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:00:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.226,"5min":1.339,"15min":1.339},"last":1.0700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T19:01:13.137 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T19:01:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.329+0000 7f0539800640 1 Processor -- start 2024-09-13T19:01:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.329+0000 7f0539800640 1 -- start start 2024-09-13T19:01:13.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.330+0000 7f0539800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.330+0000 7f0539800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f053406c5b0 0x7f0534070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.330+0000 7f0539800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340b2890 con 0x7f05340b2fe0 2024-09-13T19:01:13.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.330+0000 7f0539800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340b1880 con 0x7f053406c5b0 2024-09-13T19:01:13.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.330+0000 7f0539800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340b3420 con 0x7f05341461c0 2024-09-13T19:01:13.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0532a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0532a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:57816/0 (socket says 172.21.15.33:57816) 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0533400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f053406c5b0 0x7f0534070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0532a00640 1 -- 172.21.15.33:0/369203023 learned_addr learned my addr 172.21.15.33:0/369203023 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0533400640 1 -- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 msgr2=0x7f05340b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0533400640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0533400640 1 -- 172.21.15.33:0/369203023 >> v1:172.21.15.103:6789/0 conn(0x7f05340b2fe0 legacy=0x7f053406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0533400640 1 -- 172.21.15.33:0/369203023 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b1ad0 con 0x7f053406c5b0 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.331+0000 7f0532a00640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:01:13.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.332+0000 7f0533400640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053406c5b0 0x7f0534070450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f052c009d90 tx=0x7f052c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa9e8a1a72a8f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0531600640 1 -- 172.21.15.33:0/369203023 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c031600 con 0x7f053406c5b0 2024-09-13T19:01:13.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0531600640 1 -- 172.21.15.33:0/369203023 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c02d050 con 0x7f053406c5b0 2024-09-13T19:01:13.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0531600640 1 -- 172.21.15.33:0/369203023 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c031980 con 0x7f053406c5b0 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0539800640 1 -- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053406c5b0 msgr2=0x7f0534070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0539800640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053406c5b0 0x7f0534070450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f052c009d90 tx=0x7f052c02a5d0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0539800640 1 -- 172.21.15.33:0/369203023 shutdown_connections 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0539800640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f053406c5b0 0x7f0534070450 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.333+0000 7f0539800640 1 --2- 172.21.15.33:0/369203023 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05341461c0 0x7f05340b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.334+0000 7f0539800640 1 -- 172.21.15.33:0/369203023 >> 172.21.15.33:0/369203023 conn(0x7f05340b0580 msgr2=0x7f05340b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.334+0000 7f0539800640 1 -- 172.21.15.33:0/369203023 shutdown_connections 2024-09-13T19:01:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.334+0000 7f0539800640 1 -- 172.21.15.33:0/369203023 wait complete. 2024-09-13T19:01:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.335+0000 7f0539800640 1 Processor -- start 2024-09-13T19:01:13.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.335+0000 7f0539800640 1 -- start start 2024-09-13T19:01:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f053406c5b0 0x7f0534143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05341461c0 0x7f05341f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534158150 con 0x7f05340b2fe0 2024-09-13T19:01:13.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534158360 con 0x7f05341461c0 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0539800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534158640 con 0x7f053406c5b0 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.336+0000 7f0532000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47260/0 (socket says 172.21.15.33:47260) 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 -- 172.21.15.33:0/3469610583 learned_addr learned my addr 172.21.15.33:0/3469610583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532a00640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f053406c5b0 0x7f0534143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0533400640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05341461c0 0x7f05341f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 -- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f053406c5b0 msgr2=0x7f0534143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f053406c5b0 0x7f0534143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 -- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05341461c0 msgr2=0x7f05341f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05341461c0 0x7f05341f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 -- 172.21.15.33:0/3469610583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240094d0 con 0x7f05340b2fe0 2024-09-13T19:01:13.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.337+0000 7f0532000640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f052000c3c0 tx=0x7f052000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.338+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200052d0 con 0x7f05340b2fe0 2024-09-13T19:01:13.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.338+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520005450 con 0x7f05340b2fe0 2024-09-13T19:01:13.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.338+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520003830 con 0x7f05340b2fe0 2024-09-13T19:01:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.338+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c009a70 con 0x7f05340b2fe0 2024-09-13T19:01:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.338+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0534158c00 con 0x7f05340b2fe0 2024-09-13T19:01:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.339+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0534160f60 con 0x7f05340b2fe0 2024-09-13T19:01:13.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.340+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0520003990 con 0x7f05340b2fe0 2024-09-13T19:01:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.341+0000 7f052aa00640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 0x7f051406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.341+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0520088830 con 0x7f05340b2fe0 2024-09-13T19:01:13.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.341+0000 7f0532a00640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 0x7f051406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.342+0000 7f0532a00640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 0x7f051406d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0524006ca0 tx=0x7f0524009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.345+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0520053a20 con 0x7f05340b2fe0 2024-09-13T19:01:13.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.594+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0534160c80 con 0x7f05340b2fe0 2024-09-13T19:01:13.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.599+0000 7f052aa00640 1 -- 172.21.15.33:0/3469610583 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0520057040 con 0x7f05340b2fe0 2024-09-13T19:01:13.602 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 msgr2=0x7f051406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 0x7f051406d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0524006ca0 tx=0x7f0524009240 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 msgr2=0x7f0534157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f052000c3c0 tx=0x7f052000c880 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 shutdown_connections 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f051406ac00 0x7f051406d0c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05341461c0 0x7f05341f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05340b2fe0 0x7f0534157c10 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 --2- 172.21.15.33:0/3469610583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f053406c5b0 0x7f0534143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 >> 172.21.15.33:0/3469610583 conn(0x7f05340b0580 msgr2=0x7f0534070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:13.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 shutdown_connections 2024-09-13T19:01:13.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.601+0000 7f0539800640 1 -- 172.21.15.33:0/3469610583 wait complete. 2024-09-13T19:01:13.620 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.772+0000 7f731aa00640 1 Processor -- start 2024-09-13T19:01:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.772+0000 7f731aa00640 1 -- start start 2024-09-13T19:01:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f731aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7314153b20 0x7f73140b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f731aa00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7314159a80 0x7f73140b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f731aa00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7314153f00 con 0x7f73140b2410 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f731aa00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140ce600 con 0x7f7314153b20 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f731aa00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7314070f90 con 0x7f7314159a80 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.773+0000 7f7313e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7314153b20 0x7f73140b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7318a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f73140b2410 0x7f731406f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34530/0 (socket says 172.21.15.33:34530) 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7318a00640 1 -- 172.21.15.33:0/323532266 learned_addr learned my addr 172.21.15.33:0/323532266 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7314153b20 0x7f73140b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47262/0 (socket says 172.21.15.33:47262) 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313400640 1 --2- 172.21.15.33:0/323532266 >> v2:172.21.15.103:3300/0 conn(0x7f7314159a80 0x7f73140b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313e00640 1 -- 172.21.15.33:0/323532266 >> v2:172.21.15.103:3300/0 conn(0x7f7314159a80 msgr2=0x7f73140b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313e00640 1 --2- 172.21.15.33:0/323532266 >> v2:172.21.15.103:3300/0 conn(0x7f7314159a80 0x7f73140b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313e00640 1 -- 172.21.15.33:0/323532266 >> v1:172.21.15.33:6789/0 conn(0x7f73140b2410 legacy=0x7f731406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7313e00640 1 -- 172.21.15.33:0/323532266 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140b1a40 con 0x7f7314153b20 2024-09-13T19:01:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.774+0000 7f7312a00640 1 -- 172.21.15.33:0/323532266 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738751218 0 0) 0x7f7314153f00 con 0x7f73140b2410 2024-09-13T19:01:13.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.775+0000 7f7313e00640 1 --2- 172.21.15.33:0/323532266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314153b20 0x7f73140b3990 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f73140707d0 tx=0x7f730402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69225dcb79eff369 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.775+0000 7f7312a00640 1 -- 172.21.15.33:0/323532266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304032440 con 0x7f7314153b20 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.775+0000 7f7312a00640 1 -- 172.21.15.33:0/323532266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040325a0 con 0x7f7314153b20 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.775+0000 7f7312a00640 1 -- 172.21.15.33:0/323532266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304032930 con 0x7f7314153b20 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 -- 172.21.15.33:0/323532266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314153b20 msgr2=0x7f73140b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 --2- 172.21.15.33:0/323532266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314153b20 0x7f73140b3990 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f73140707d0 tx=0x7f730402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 -- 172.21.15.33:0/323532266 shutdown_connections 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 --2- 172.21.15.33:0/323532266 >> v2:172.21.15.103:3300/0 conn(0x7f7314159a80 0x7f73140b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 --2- 172.21.15.33:0/323532266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314153b20 0x7f73140b3990 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 -- 172.21.15.33:0/323532266 >> 172.21.15.33:0/323532266 conn(0x7f73140b0510 msgr2=0x7f73140b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 -- 172.21.15.33:0/323532266 shutdown_connections 2024-09-13T19:01:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.776+0000 7f731aa00640 1 -- 172.21.15.33:0/323532266 wait complete. 2024-09-13T19:01:13.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.778+0000 7f731aa00640 1 Processor -- start 2024-09-13T19:01:13.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.778+0000 7f731aa00640 1 -- start start 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73140b2410 0x7f731414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7314153b20 0x7f73141effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140a8460 con 0x7f7314159a80 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140a8a20 con 0x7f73140b2410 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f731aa00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140aae80 con 0x7f7314153b20 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f7318a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f7318a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47266/0 (socket says 172.21.15.33:47266) 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f7318a00640 1 -- 172.21.15.33:0/2662726020 learned_addr learned my addr 172.21.15.33:0/2662726020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f7313e00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73140b2410 0x7f731414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.779+0000 7f7313400640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7314153b20 0x7f73141effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 -- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7314153b20 msgr2=0x7f73141effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7314153b20 0x7f73141effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 -- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73140b2410 msgr2=0x7f731414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73140b2410 0x7f731414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 -- 172.21.15.33:0/2662726020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304009400 con 0x7f7314159a80 2024-09-13T19:01:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f7318a00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c730 tx=0x7f730c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00ce40 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73140ab160 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00a640 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00aa30 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.780+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731414d990 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.781+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73140ab3a0 con 0x7f7314159a80 2024-09-13T19:01:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.782+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f730c00ab90 con 0x7f7314159a80 2024-09-13T19:01:13.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.783+0000 7f730be00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 0x7f72f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:13.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.783+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f730c088880 con 0x7f7314159a80 2024-09-13T19:01:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.784+0000 7f7313e00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 0x7f72f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.784+0000 7f7313e00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 0x7f72f406d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7304034000 tx=0x7f730402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:13.787+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f730c053a90 con 0x7f7314159a80 2024-09-13T19:01:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.001+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73140b3990 con 0x7f7314159a80 2024-09-13T19:01:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.001+0000 7f730be00640 1 -- 172.21.15.33:0/2662726020 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f730c018090 con 0x7f7314159a80 2024-09-13T19:01:14.005 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:14.005 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 msgr2=0x7f72f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 0x7f72f406d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7304034000 tx=0x7f730402e000 comp rx=0 tx=0).stop 2024-09-13T19:01:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 msgr2=0x7f73140aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c730 tx=0x7f730c00cbf0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 shutdown_connections 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f72f406ac00 0x7f72f406d0c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7314159a80 0x7f73140aa4a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7314153b20 0x7f73141effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 --2- 172.21.15.33:0/2662726020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73140b2410 0x7f731414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 >> 172.21.15.33:0/2662726020 conn(0x7f73140b0510 msgr2=0x7f731415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 shutdown_connections 2024-09-13T19:01:14.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.004+0000 7f731aa00640 1 -- 172.21.15.33:0/2662726020 wait complete. 2024-09-13T19:01:14.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T19:01:03.861712+0000', 'modified': '2024-09-13T19:01:06.874381+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7140}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7140': {'gid': 7140, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6834/1677185776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 1677185776}, {'type': 'v1', 'addr': '172.21.15.33:6834', 'nonce': 1677185776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T19:01:14.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T19:01:14.426 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T19:01:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.581+0000 7ff562400640 1 Processor -- start 2024-09-13T19:01:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.581+0000 7ff562400640 1 -- start start 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.582+0000 7ff562400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff55c0b34c0 0x7ff55c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.582+0000 7ff562400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c070710 con 0x7ff55c0b3080 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.582+0000 7ff562400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0709e0 con 0x7ff55c159610 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.582+0000 7ff562400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c1599f0 con 0x7ff55c0b34c0 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.582+0000 7ff55aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff55c0b3080 0x7ff55c0cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34538/0 (socket says 172.21.15.33:34538) 2024-09-13T19:01:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55aa00640 1 -- 172.21.15.33:0/275093102 learned_addr learned my addr 172.21.15.33:0/275093102 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55be00640 1 --2- 172.21.15.33:0/275093102 >> v2:172.21.15.103:3300/0 conn(0x7ff55c0b34c0 0x7ff55c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362591953 0 0) 0x7ff55c070710 con 0x7ff55c0b3080 2024-09-13T19:01:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff540003520 con 0x7ff55c0b3080 2024-09-13T19:01:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977108085 0 0) 0x7ff540003520 con 0x7ff55c0b3080 2024-09-13T19:01:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 >> v2:172.21.15.103:3300/0 conn(0x7ff55c0b34c0 msgr2=0x7ff55c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 --2- 172.21.15.33:0/275093102 >> v2:172.21.15.103:3300/0 conn(0x7ff55c0b34c0 0x7ff55c0cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 >> v1:172.21.15.103:6789/0 conn(0x7ff55c159610 legacy=0x7ff55c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c070cc0 con 0x7ff55c0b3080 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7ff548001670 con 0x7ff55c0b3080 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 >> v1:172.21.15.33:6789/0 conn(0x7ff55c0b3080 legacy=0x7ff55c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.583+0000 7ff55a000640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff540003970 0x7ff540003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55a000640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 0x7ff540004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55a000640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540005040 0x7ff54000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1599f0 con 0x7ff540004370 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54000e1b0 con 0x7ff540005040 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54000e370 con 0x7ff540003970 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 0x7ff540004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55be00640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540005040 0x7ff54000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55b400640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff540003970 0x7ff540003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 -- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff540003970 msgr2=0x7ff540003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff540003970 0x7ff540003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 -- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540005040 msgr2=0x7ff54000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540005040 0x7ff54000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55aa00640 1 -- 172.21.15.33:0/275093102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540003520 con 0x7ff540004370 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55be00640 1 -- 172.21.15.33:0/275093102 reap_dead start 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.584+0000 7ff55b400640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff540003970 0x7ff540003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.585+0000 7ff55aa00640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 0x7ff540004840 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c190 tx=0x7ff5400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f9360862b20833 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.585+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548005ad0 con 0x7ff540004370 2024-09-13T19:01:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.585+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54802d070 con 0x7ff540004370 2024-09-13T19:01:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.585+0000 7ff55a000640 1 -- 172.21.15.33:0/275093102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548007070 con 0x7ff540004370 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 -- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 msgr2=0x7ff540004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 0x7ff540004840 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c190 tx=0x7ff5400057f0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 -- 172.21.15.33:0/275093102 shutdown_connections 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 --2- 172.21.15.33:0/275093102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff540004370 0x7ff540004840 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 -- 172.21.15.33:0/275093102 >> 172.21.15.33:0/275093102 conn(0x7ff55c0b0510 msgr2=0x7ff55c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 -- 172.21.15.33:0/275093102 shutdown_connections 2024-09-13T19:01:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.586+0000 7ff562400640 1 -- 172.21.15.33:0/275093102 wait complete. 2024-09-13T19:01:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.588+0000 7ff562400640 1 Processor -- start 2024-09-13T19:01:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.588+0000 7ff562400640 1 -- start start 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540004370 0x7ff55c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 0x7ff55c1ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c14e580 con 0x7ff55c1548c0 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c14e790 con 0x7ff540004370 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff562400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c14ea70 con 0x7ff55c1ecc80 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47288/0 (socket says 172.21.15.33:47288) 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff55aa00640 1 -- 172.21.15.33:0/3556258069 learned_addr learned my addr 172.21.15.33:0/3556258069 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.589+0000 7ff55b400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540004370 0x7ff55c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55be00640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 0x7ff55c1ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 -- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 msgr2=0x7ff55c1ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 0x7ff55c1ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 -- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540004370 msgr2=0x7ff55c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540004370 0x7ff55c14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 -- 172.21.15.33:0/3556258069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c14ed50 con 0x7ff55c1548c0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55be00640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 0x7ff55c1ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff55aa00640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff54802ac30 tx=0x7ff548001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff553400640 1 -- 172.21.15.33:0/3556258069 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548004aa0 con 0x7ff55c1548c0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff553400640 1 -- 172.21.15.33:0/3556258069 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548004c00 con 0x7ff55c1548c0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.590+0000 7ff553400640 1 -- 172.21.15.33:0/3556258069 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548007070 con 0x7ff55c1548c0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.591+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c14f030 con 0x7ff55c1548c0 2024-09-13T19:01:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.591+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c154d40 con 0x7ff55c1548c0 2024-09-13T19:01:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.593+0000 7ff553400640 1 -- 172.21.15.33:0/3556258069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff54802f030 con 0x7ff55c1548c0 2024-09-13T19:01:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.594+0000 7ff553400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 0x7ff53c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.594+0000 7ff553400640 1 -- 172.21.15.33:0/3556258069 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5480a8b80 con 0x7ff55c1548c0 2024-09-13T19:01:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.595+0000 7ff55b400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 0x7ff53c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.595+0000 7ff56525b740 1 Processor -- start 2024-09-13T19:01:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.595+0000 7ff56525b740 1 -- start start 2024-09-13T19:01:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.595+0000 7ff55b400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 0x7ff53c06d0f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007fd0 tx=0x7ff54c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e17216fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172196f90 0x55e1721bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1720d4ab0 con 0x55e17216d2a0 2024-09-13T19:01:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1720d2240 con 0x55e17216fae0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1720cdb30 con 0x55e172196f90 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47304/0 (socket says 172.21.15.33:47304) 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff55aa00640 1 -- 172.21.15.33:0/379747795 learned_addr learned my addr 172.21.15.33:0/379747795 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff55be00640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172196f90 0x55e1721bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.596+0000 7ff55b400640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e17216fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 -- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172196f90 msgr2=0x55e1721bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172196f90 0x55e1721bd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 -- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 msgr2=0x55e17216fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e17216fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 -- 172.21.15.33:0/379747795 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e172098bd0 con 0x55e17216d2a0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55b400640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e17216fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff55aa00640 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff548077680 tx=0x7ff5480781c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78197a1440d78add server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff547e00640 1 -- 172.21.15.33:0/379747795 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54807fd70 con 0x55e17216d2a0 2024-09-13T19:01:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff547e00640 1 -- 172.21.15.33:0/379747795 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548075d20 con 0x55e17216d2a0 2024-09-13T19:01:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.597+0000 7ff547e00640 1 -- 172.21.15.33:0/379747795 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548074090 con 0x55e17216d2a0 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- 172.21.15.33:0/379747795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 msgr2=0x55e1721bcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff548077680 tx=0x7ff5480781c0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- 172.21.15.33:0/379747795 shutdown_connections 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172196f90 0x55e1721bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216d2a0 0x55e1721bcfb0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 --2- 172.21.15.33:0/379747795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e17216fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- 172.21.15.33:0/379747795 >> 172.21.15.33:0/379747795 conn(0x55e17216c210 msgr2=0x55e1721b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- 172.21.15.33:0/379747795 shutdown_connections 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- 172.21.15.33:0/379747795 wait complete. 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.598+0000 7ff56525b740 1 -- start start 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.599+0000 7ff56525b740 1 Processor -- start 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e17216fae0 0x55e17218f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e172193a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17206f260 con 0x55e172193fa0 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17206ef00 con 0x55e172196f90 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e171e34f20 con 0x55e17216fae0 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff56525b740 10 client.0 _ll_register_callbacks cb 0x55e1720c71a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55b400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e17216fae0 0x55e17218f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47314/0 (socket says 172.21.15.33:47314) 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 -- 172.21.15.33:0/2659063885 learned_addr learned my addr 172.21.15.33:0/2659063885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55aa00640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e172193a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 -- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e17216fae0 msgr2=0x55e17218f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e17216fae0 0x55e17218f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 -- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 msgr2=0x55e172193a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e172193a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.600+0000 7ff55be00640 1 -- 172.21.15.33:0/2659063885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c154d40 con 0x55e172193fa0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff55be00640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7ff55c06d600 tx=0x7ff5540046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c468e3f47359fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff544c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400e040 con 0x55e172193fa0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff554015c70 con 0x55e172193fa0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1720f7cd0 con 0x55e172193fa0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff554009d20 con 0x55e172193fa0 2024-09-13T19:01:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff56525b740 10 client.7305 fetch_fsmap learned FSMap version 55 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.601+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e1720cc1b0 con 0x55e172193fa0 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1720f7cd0 con 0x55e172193fa0 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff554014040 con 0x55e172193fa0 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 10 client.7305 fetch_fsmap finished waiting for FSMap version 55 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 10 client.7305 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 20 client.7305 populate_metadata read hostname 'smithi033' 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e172199140 0x55e17216d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 4 client.7305 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 --> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e171dc13c0 con 0x55e172199140 2024-09-13T19:01:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.602+0000 7ff55b400640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e172199140 0x55e17216d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.603+0000 7ff55b400640 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e172199140 0x55e17216d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f614530f887cda8 server_cookie=20b896a0ea7050c1 in_seq=0 out_seq=0 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.603+0000 7ff544c00640 10 client.7305 ms_handle_connect on v2:172.21.15.33:6832/1677185776 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.603+0000 7ff544c00640 1 -- 172.21.15.33:0/2659063885 <== mds.0 v2:172.21.15.33:6832/1677185776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e171dc13c0 con 0x55e172199140 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.603+0000 7ff544c00640 10 client.7305 handle_command_reply: tid=0 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.603+0000 7ff56525b740 1 client.7305 shutdown 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 msgr2=0x55e17218dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7ff55c06d600 tx=0x7ff5540046e0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 shutdown_connections 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e172199140 0x55e17216d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172193fa0 0x55e17218dfc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e172193a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 --2- 172.21.15.33:0/2659063885 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e17216fae0 0x55e17218f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff544c00640 0 client.7305 ms_handle_reset on v2:172.21.15.33:6832/1677185776 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 >> 172.21.15.33:0/2659063885 conn(0x55e17216d2a0 msgr2=0x55e1721b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 shutdown_connections 2024-09-13T19:01:14.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 1 -- 172.21.15.33:0/2659063885 wait complete. 2024-09-13T19:01:14.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.604+0000 7ff56525b740 20 client.7305 trim_cache size 0 max 16384 2024-09-13T19:01:14.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.620+0000 7ff56525b740 1 Processor -- start 2024-09-13T19:01:14.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.620+0000 7ff56525b740 1 -- start start 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.620+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e172194420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.620+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e172194960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff56525b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff56525b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17216d7b0 con 0x55e172196f90 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1721b20d0 con 0x55e17216fae0 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1721b39a0 con 0x55e172193fa0 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47328/0 (socket says 172.21.15.33:47328) 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 -- 172.21.15.33:0/3554469216 learned_addr learned my addr 172.21.15.33:0/3554469216 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55aa00640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e172194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55b400640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e172194420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 -- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 msgr2=0x55e172194960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e172194960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 -- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 msgr2=0x55e172194420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e172194420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 -- 172.21.15.33:0/3554469216 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e172101170 con 0x55e172196f90 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55b400640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e172194420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.621+0000 7ff55be00640 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff55400b010 tx=0x7ff554011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6174ad14604ceffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff550c00640 1 -- 172.21.15.33:0/3554469216 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400e040 con 0x55e172196f90 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff550c00640 1 -- 172.21.15.33:0/3554469216 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400f040 con 0x55e172196f90 2024-09-13T19:01:14.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff550c00640 1 -- 172.21.15.33:0/3554469216 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554009de0 con 0x55e172196f90 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 -- 172.21.15.33:0/3554469216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 msgr2=0x55e17218d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff55400b010 tx=0x7ff554011000 comp rx=0 tx=0).stop 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 -- 172.21.15.33:0/3554469216 shutdown_connections 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e172196f90 0x55e17218d840 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e172194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 --2- 172.21.15.33:0/3554469216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e17216fae0 0x55e172194420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 -- 172.21.15.33:0/3554469216 >> 172.21.15.33:0/3554469216 conn(0x55e17216d2a0 msgr2=0x55e1721927d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 -- 172.21.15.33:0/3554469216 shutdown_connections 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.622+0000 7ff56525b740 1 -- 172.21.15.33:0/3554469216 wait complete. 2024-09-13T19:01:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.623+0000 7ff56525b740 1 -- start start 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.623+0000 7ff56525b740 1 Processor -- start 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e17221ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e1721b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17221f4a0 con 0x55e17216fae0 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1721b3430 con 0x55e172196f90 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1721d6990 con 0x55e172193fa0 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff56525b740 10 client.0 _ll_register_callbacks cb 0x7ff554009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T19:01:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff55b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff55b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47342/0 (socket says 172.21.15.33:47342) 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff55b400640 1 -- 172.21.15.33:0/1978243017 learned_addr learned my addr 172.21.15.33:0/1978243017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff55be00640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e1721b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.624+0000 7ff55aa00640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e17221ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 -- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 msgr2=0x55e17221ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e17221ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 -- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 msgr2=0x55e1721b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e1721b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 -- 172.21.15.33:0/1978243017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1720cc1b0 con 0x55e17216fae0 2024-09-13T19:01:14.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff55b400640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x55e172198520 tx=0x7ff54c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3284294cbb570e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff544c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c015e70 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff54c01a040 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.625+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e172165a50 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff54c028d10 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 10 client.7311 fetch_fsmap learned FSMap version 55 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e17206e470 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c037020 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff54c007050 con 0x55e17216fae0 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 10 client.7311 fetch_fsmap finished waiting for FSMap version 55 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 10 client.7311 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 20 client.7311 populate_metadata read hostname 'smithi033' 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e1721cce30 0x55e1721cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 4 client.7311 mds_command: new command op to 7140 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T19:01:14.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 --> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff548075d20 con 0x55e1721cce30 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.626+0000 7ff55aa00640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e1721cce30 0x55e1721cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff544c00640 10 client.7311 ms_handle_connect on v2:172.21.15.33:6832/1677185776 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff55aa00640 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e1721cce30 0x55e1721cd210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7f77c08d21732f server_cookie=d7d815eef7b311fa in_seq=0 out_seq=0 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff544c00640 1 -- 172.21.15.33:0/1978243017 <== mds.0 v2:172.21.15.33:6832/1677185776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7ff548075d20 con 0x55e1721cce30 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff544c00640 10 client.7311 handle_command_reply: tid=0 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 client.7311 shutdown 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 msgr2=0x55e172220170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x55e172198520 tx=0x7ff54c001230 comp rx=0 tx=0).stop 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 shutdown_connections 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:6832/1677185776,v1:172.21.15.33:6834/1677185776] conn(0x55e1721cce30 0x55e1721cd210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e172196f90 0x55e1721b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x55e172193fa0 0x55e17221ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 --2- 172.21.15.33:0/1978243017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e17216fae0 0x55e172220170 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 >> 172.21.15.33:0/1978243017 conn(0x55e17216d2a0 msgr2=0x55e172194420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff544c00640 0 client.7311 ms_handle_reset on v2:172.21.15.33:6832/1677185776 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.627+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 shutdown_connections 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff56525b740 1 -- 172.21.15.33:0/1978243017 wait complete. 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff56525b740 20 client.7311 trim_cache size 0 max 16384 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "6d8de347-8986-4090-a81e-548bd7528fe4", 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 7140, 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-13T19:01:14.635 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.764307544999999, 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 55, 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 96, 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 96, 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 15.910171642 2024-09-13T19:01:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 msgr2=0x7ff53c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 0x7ff53c06d0f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007fd0 tx=0x7ff54c009040 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 msgr2=0x7ff55c158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff54802ac30 tx=0x7ff548001980 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 shutdown_connections 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff53c06ac30 0x7ff53c06d0f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff55c1ecc80 0x7ff55c1ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c1548c0 0x7ff55c158420 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 --2- 172.21.15.33:0/3556258069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff540004370 0x7ff55c14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 >> 172.21.15.33:0/3556258069 conn(0x7ff55c0b0510 msgr2=0x7ff55c06bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 shutdown_connections 2024-09-13T19:01:14.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.628+0000 7ff562400640 1 -- 172.21.15.33:0/3556258069 wait complete. 2024-09-13T19:01:14.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:01:14.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.798+0000 7ff2bd400640 1 Processor -- start 2024-09-13T19:01:14.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.798+0000 7ff2bd400640 1 -- start start 2024-09-13T19:01:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b80b3a40 0x7ff2b81428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2bd400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2b80ac870 0x7ff2b80acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2bd400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b813fbc0 con 0x7ff2b8160370 2024-09-13T19:01:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2bd400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b806cca0 con 0x7ff2b80ac870 2024-09-13T19:01:14.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2bd400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80ad220 con 0x7ff2b80b3a40 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2ade00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff2b8160370 0x7ff2b80b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34544/0 (socket says 172.21.15.33:34544) 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2ade00640 1 -- 172.21.15.33:0/4218969984 learned_addr learned my addr 172.21.15.33:0/4218969984 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.799+0000 7ff2b7200640 1 --2- 172.21.15.33:0/4218969984 >> v2:172.21.15.103:3300/0 conn(0x7ff2b80ac870 0x7ff2b80acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b6800640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b80b3a40 0x7ff2b81428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b5e00640 1 -- 172.21.15.33:0/4218969984 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807132340 0 0) 0x7ff2b813fbc0 con 0x7ff2b8160370 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b5e00640 1 -- 172.21.15.33:0/4218969984 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff29c003520 con 0x7ff2b8160370 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b7200640 1 -- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b80b3a40 msgr2=0x7ff2b81428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:14.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b7200640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b80b3a40 0x7ff2b81428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b7200640 1 -- 172.21.15.33:0/4218969984 >> v1:172.21.15.33:6789/0 conn(0x7ff2b8160370 legacy=0x7ff2b80b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.800+0000 7ff2b7200640 1 -- 172.21.15.33:0/4218969984 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b815ce80 con 0x7ff2b80ac870 2024-09-13T19:01:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.801+0000 7ff2b7200640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80ac870 0x7ff2b80acce0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097d0 tx=0x7ff2b002a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88fe2e052b083482 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.801+0000 7ff2b5e00640 1 -- 172.21.15.33:0/4218969984 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b002ae30 con 0x7ff2b80ac870 2024-09-13T19:01:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.801+0000 7ff2b5e00640 1 -- 172.21.15.33:0/4218969984 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b0032440 con 0x7ff2b80ac870 2024-09-13T19:01:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.801+0000 7ff2b5e00640 1 -- 172.21.15.33:0/4218969984 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00327d0 con 0x7ff2b80ac870 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 -- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80ac870 msgr2=0x7ff2b80acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80ac870 0x7ff2b80acce0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00097d0 tx=0x7ff2b002a120 comp rx=0 tx=0).stop 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 -- 172.21.15.33:0/4218969984 shutdown_connections 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80ac870 0x7ff2b80acce0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 --2- 172.21.15.33:0/4218969984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b80b3a40 0x7ff2b81428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 -- 172.21.15.33:0/4218969984 >> 172.21.15.33:0/4218969984 conn(0x7ff2b80b0510 msgr2=0x7ff2b80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 -- 172.21.15.33:0/4218969984 shutdown_connections 2024-09-13T19:01:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.802+0000 7ff2bd400640 1 -- 172.21.15.33:0/4218969984 wait complete. 2024-09-13T19:01:14.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.804+0000 7ff2bd400640 1 Processor -- start 2024-09-13T19:01:14.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.804+0000 7ff2bd400640 1 -- start start 2024-09-13T19:01:14.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80b3a40 0x7ff2b813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b8160370 0x7ff2b81e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b813e2c0 con 0x7ff2b80ac870 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8155260 con 0x7ff2b80b3a40 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2bd400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b813fba0 con 0x7ff2b8160370 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47346/0 (socket says 172.21.15.33:47346) 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 -- 172.21.15.33:0/3870317287 learned_addr learned my addr 172.21.15.33:0/3870317287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b7200640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b8160370 0x7ff2b81e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2ade00640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80b3a40 0x7ff2b813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 -- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b8160370 msgr2=0x7ff2b81e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b8160370 0x7ff2b81e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 -- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80b3a40 msgr2=0x7ff2b813dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80b3a40 0x7ff2b813dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.805+0000 7ff2b6800640 1 -- 172.21.15.33:0/3870317287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b0009400 con 0x7ff2b80ac870 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2b6800640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800efc0 tx=0x7ff2a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8014480 con 0x7ff2b80ac870 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800f040 con 0x7ff2b80ac870 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8014800 con 0x7ff2b80ac870 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b8142ae0 con 0x7ff2b80ac870 2024-09-13T19:01:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.806+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b8140140 con 0x7ff2b80ac870 2024-09-13T19:01:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.807+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b81611b0 con 0x7ff2b80ac870 2024-09-13T19:01:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.808+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2a8014960 con 0x7ff2b80ac870 2024-09-13T19:01:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.809+0000 7ff2af400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 0x7ff29406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.809+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2a8089cc0 con 0x7ff2b80ac870 2024-09-13T19:01:14.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.810+0000 7ff2ade00640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 0x7ff29406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:14.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.810+0000 7ff2ade00640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 0x7ff29406d110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff2b81e85d0 tx=0x7ff2a0007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:14.813+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2a80550c0 con 0x7ff2b80ac870 2024-09-13T19:01:15.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.026+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2b80ce4d0 con 0x7ff2b80ac870 2024-09-13T19:01:15.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.027+0000 7ff2af400640 1 -- 172.21.15.33:0/3870317287 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2a80586e0 con 0x7ff2b80ac870 2024-09-13T19:01:15.030 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:01:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 msgr2=0x7ff29406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 0x7ff29406d110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff2b81e85d0 tx=0x7ff2a0007d30 comp rx=0 tx=0).stop 2024-09-13T19:01:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 msgr2=0x7ff2b81424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800efc0 tx=0x7ff2a800c490 comp rx=0 tx=0).stop 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 shutdown_connections 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff29406ac50 0x7ff29406d110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff2b8160370 0x7ff2b81e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b80b3a40 0x7ff2b813dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 --2- 172.21.15.33:0/3870317287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2b80ac870 0x7ff2b81424e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 >> 172.21.15.33:0/3870317287 conn(0x7ff2b80b0510 msgr2=0x7ff2b80ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 shutdown_connections 2024-09-13T19:01:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:15.029+0000 7ff2bd400640 1 -- 172.21.15.33:0/3870317287 wait complete. 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:01:15.049 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:01:15.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.050 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:15.086 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42457sec preferred_lft 42457sec 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-13T19:01:15.087 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::7c56:41ff:feae:d131/64 scope link 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 46:c4:86:7f:4c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::44c4:86ff:fe7f:4c83/64 scope link 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:01:15.088 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 86:b2:80:35:52:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T19:01:15.089 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::84b2:80ff:fe35:5210/64 scope link 2024-09-13T19:01:15.089 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:15.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.089 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:01:15.179 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-13T19:01:15.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.183 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-13T19:01:15.219 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-13T19:01:15.219 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:01:15.219 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T19:01:15.219 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T19:01:15.219 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:01:15.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T19:01:15.220 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-13T19:01:15.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.365 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T19:01:15.400 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T19:01:15.401 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T19:01:15.401 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:01:15.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-13T19:01:15.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:01:15.497 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T19:01:15.532 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T19:01:15.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:01:15.533 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:01:15.607 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:01:15.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.607 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:01:15.735 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:01:15.735 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:01:15.735 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:01:15.750 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:01:15.750 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:01:15.750 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:01:15.750 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:01:15.750 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:01:15.773 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:01:15.774 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:01:15.775 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T19:01:15.775 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:01:15.775 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:01:15.775 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:01:15.775 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:01:15.778 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:01:15.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T19:01:15.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:15.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:01:15.880 INFO:teuthology.orchestra.run.smithi033.stdout:client6263 2024-09-13T19:01:15.880 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:15.881 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:15.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T19:01:16.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.147+0000 7f48b1a00640 1 Processor -- start 2024-09-13T19:01:16.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.147+0000 7f48b1a00640 1 -- start start 2024-09-13T19:01:16.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48b1a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ac0b1b00 0x7f48ac0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48b1a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f48ac15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48b1a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac06bea0 con 0x7f48ac15a520 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48b1a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac06c180 con 0x7f48ac0b1b00 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48b1a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac06c460 con 0x7f48ac0cde50 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48aaa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f48ac15a520 0x7f48ac06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34558/0 (socket says 172.21.15.33:34558) 2024-09-13T19:01:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.148+0000 7f48aaa00640 1 -- 172.21.15.33:0/3055026257 learned_addr learned my addr 172.21.15.33:0/3055026257 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48aa000640 1 --2- 172.21.15.33:0/3055026257 >> v2:172.21.15.103:3300/0 conn(0x7f48ac0b1b00 0x7f48ac0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48ab400640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f48ac15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646538226 0 0) 0x7f48ac06bea0 con 0x7f48ac15a520 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003520 con 0x7f48ac15a520 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117767200 0 0) 0x7f4890003520 con 0x7f48ac15a520 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 msgr2=0x7f48ac15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f48ac15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 >> v2:172.21.15.103:3300/0 conn(0x7f48ac0b1b00 msgr2=0x7f48ac0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 --2- 172.21.15.33:0/3055026257 >> v2:172.21.15.103:3300/0 conn(0x7f48ac0b1b00 0x7f48ac0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac06c740 con 0x7f48ac15a520 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f489c001670 con 0x7f48ac15a520 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 >> v1:172.21.15.33:6789/0 conn(0x7f48ac15a520 legacy=0x7f48ac06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f4890003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4890003ef0 0x7f48900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890004d00 0x7f4890005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac06c180 con 0x7f4890003ef0 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac06c460 con 0x7f4890004d00 2024-09-13T19:01:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.149+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489000b980 con 0x7f48ac0cde50 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4890003ef0 0x7f48900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aaa00640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f4890003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48ab400640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890004d00 0x7f4890005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 -- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 msgr2=0x7f4890003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0cde50 0x7f4890003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 -- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890004d00 msgr2=0x7f4890005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890004d00 0x7f4890005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.150+0000 7f48aa000640 1 -- 172.21.15.33:0/3055026257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890003520 con 0x7f4890003ef0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.151+0000 7f48aa000640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4890003ef0 0x7f48900047c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ac0 tx=0x7f48900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75f7a583d3824e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.151+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898031400 con 0x7f4890003ef0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.151+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489802d050 con 0x7f4890003ef0 2024-09-13T19:01:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.151+0000 7f48a9600640 1 -- 172.21.15.33:0/3055026257 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898031780 con 0x7f4890003ef0 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 -- 172.21.15.33:0/3055026257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4890003ef0 msgr2=0x7f48900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 --2- 172.21.15.33:0/3055026257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4890003ef0 0x7f48900047c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ac0 tx=0x7f48900057f0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48ab400640 1 -- 172.21.15.33:0/3055026257 reap_dead start 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 -- 172.21.15.33:0/3055026257 shutdown_connections 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 -- 172.21.15.33:0/3055026257 >> 172.21.15.33:0/3055026257 conn(0x7f48ac0b0510 msgr2=0x7f48ac0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 -- 172.21.15.33:0/3055026257 shutdown_connections 2024-09-13T19:01:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.152+0000 7f48b1a00640 1 -- 172.21.15.33:0/3055026257 wait complete. 2024-09-13T19:01:16.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.154+0000 7f48b1a00640 1 Processor -- start 2024-09-13T19:01:16.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.154+0000 7f48b1a00640 1 -- start start 2024-09-13T19:01:16.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 0x7f48ac149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0ca9a0 0x7f48ac14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac14c250 con 0x7f48ac14bdd0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac146a40 con 0x7f4890003ef0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48b1a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac145e70 con 0x7f48ac0ca9a0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48ab400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48ab400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47350/0 (socket says 172.21.15.33:47350) 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48ab400640 1 -- 172.21.15.33:0/2030519085 learned_addr learned my addr 172.21.15.33:0/2030519085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48aaa00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 0x7f48ac149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.155+0000 7f48aa000640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0ca9a0 0x7f48ac14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 -- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0ca9a0 msgr2=0x7f48ac14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0ca9a0 0x7f48ac14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 -- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 msgr2=0x7f48ac149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 0x7f48ac149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 -- 172.21.15.33:0/2030519085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac146110 con 0x7f48ac14bdd0 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48aaa00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 0x7f48ac149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48ab400640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06af50 tx=0x7f48a400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400e040 con 0x7f48ac14bdd0 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400f040 con 0x7f48ac14bdd0 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4015430 con 0x7f48ac14bdd0 2024-09-13T19:01:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac1463f0 con 0x7f48ac14bdd0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.156+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac15d140 con 0x7f48ac14bdd0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.157+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac0cd210 con 0x7f48ac14bdd0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.158+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48a4015590 con 0x7f48ac14bdd0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.159+0000 7f48a2a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 0x7f488c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.159+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48a4089d80 con 0x7f48ac14bdd0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.159+0000 7f48aaa00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 0x7f488c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.160+0000 7f48aaa00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 0x7f488c06d0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f489c0015d0 tx=0x7f489c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.163+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f48a4055000 con 0x7f48ac14bdd0 2024-09-13T19:01:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.378+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48ac06bea0 con 0x7f48ac14bdd0 2024-09-13T19:01:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.379+0000 7f48a2a00640 1 -- 172.21.15.33:0/2030519085 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f48a4058620 con 0x7f48ac14bdd0 2024-09-13T19:01:16.382 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T19:01:16.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 msgr2=0x7f488c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 0x7f488c06d0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f489c0015d0 tx=0x7f489c009040 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 msgr2=0x7f48ac15cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06af50 tx=0x7f48a400f580 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 shutdown_connections 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f488c06ac00 0x7f488c06d0c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48ac14bdd0 0x7f48ac15cc00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48ac0ca9a0 0x7f48ac14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 --2- 172.21.15.33:0/2030519085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4890003ef0 0x7f48ac149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 >> 172.21.15.33:0/2030519085 conn(0x7f48ac0b0510 msgr2=0x7f48ac159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:16.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 shutdown_connections 2024-09-13T19:01:16.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:16.381+0000 7f48b1a00640 1 -- 172.21.15.33:0/2030519085 wait complete. 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T19:01:16.401 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T19:01:16.402 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:01:16.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.402 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-13T19:01:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T19:01:16.443 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T19:01:16.443 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T19:01:16.443 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:16.444 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42473sec preferred_lft 42473sec 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3cb9:53ff:fe8d:db66/64 scope link 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:3e:3d:da:7d:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc3e:3dff:feda:7d07/64 scope link 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T19:01:16.446 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 9a:ab:ed:eb:e2:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T19:01:16.446 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::98ab:edff:feeb:e210/64 scope link 2024-09-13T19:01:16.446 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-13T19:01:16.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.446 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T19:01:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-13T19:01:16.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.543 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T19:01:16.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.581 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2024-09-13T19:01:16.581 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-13T19:01:16.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T19:01:16.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T19:01:16.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T19:01:16.582 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-13T19:01:16.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.727 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:01:16.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T19:01:16.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T19:01:16.762 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:01:16.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-13T19:01:16.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:01:16.858 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T19:01:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T19:01:16.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T19:01:16.894 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:01:16.968 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T19:01:16.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:16.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:01:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:01:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:01:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:01:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:01:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:01:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:01:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:01:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.103:3300,172.21.15.103:3301" 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790" 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.103:6789,172.21.15.103:6790:/ 2024-09-13T19:01:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d8de347-8986-4090-a81e-548bd7528fe4" will pass to kernel 2024-09-13T19:01:17.137 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T19:01:17.137 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-13T19:01:17.137 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T19:01:17.137 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T19:01:17.137 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T19:01:17.140 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T19:01:17.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T19:01:17.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.196 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T19:01:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:client7045 2024-09-13T19:01:17.235 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:17.235 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:17.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.310 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_files) 2024-09-13T19:01:17.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.357 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_data) 2024-09-13T19:01:17.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.398 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 100 ./subdir_files) 2024-09-13T19:01:17.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 104857600 ./subdir_data) 2024-09-13T19:01:17.562 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:17.563 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> import uuid 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> n = 20 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> create_hard_links = False 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> if 0 > 0: 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> create_hard_links = True 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:17.599 DEBUG:teuthology.orchestra.run.smithi103:> dpath = os.path.dirname(path) 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> fnameprefix = os.path.basename(path) 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> os.makedirs(dpath, exist_ok=True) 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> try: 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> for i in range(n): 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> f.write(f"{i}") 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> f.flush() 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(f.fileno()) 2024-09-13T19:01:17.600 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:17.601 DEBUG:teuthology.orchestra.run.smithi103:> os.unlink(fpath) 2024-09-13T19:01:17.601 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:17.601 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(dirfd) 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> if create_hard_links: 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> for j in range(0): 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(dirfd) 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> finally: 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> os.close(dirfd) 2024-09-13T19:01:17.602 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-13T19:01:17.923 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:17.923 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:17.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:17.999 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=20 seek=0) 2024-09-13T19:01:18.259 INFO:teuthology.orchestra.run.smithi103.stderr:20+0 records in 2024-09-13T19:01:18.259 INFO:teuthology.orchestra.run.smithi103.stderr:20+0 records out 2024-09-13T19:01:18.260 INFO:teuthology.orchestra.run.smithi103.stderr:20971520 bytes (21 MB, 20 MiB) copied, 0.183385 s, 114 MB/s 2024-09-13T19:01:18.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:18.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir_files) 2024-09-13T19:01:18.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:18.302 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1048576 ./subdir_data) 2024-09-13T19:01:18.382 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:18.382 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> import uuid 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> n = 40 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> create_hard_links = False 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> if 0 > 0: 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> create_hard_links = True 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:18.418 DEBUG:teuthology.orchestra.run.smithi103:> dpath = os.path.dirname(path) 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> fnameprefix = os.path.basename(path) 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> os.makedirs(dpath, exist_ok=True) 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> try: 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> for i in range(n): 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> with open(fpath, '"'"'w'"'"') as f: 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> f.write(f"{i}") 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> f.flush() 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(f.fileno()) 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:18.419 DEBUG:teuthology.orchestra.run.smithi103:> os.unlink(fpath) 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(dirfd) 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> if create_hard_links: 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> for j in range(0): 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> if False: 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> os.fsync(dirfd) 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> finally: 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> os.close(dirfd) 2024-09-13T19:01:18.420 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-13T19:01:18.698 INFO:teuthology.orchestra.run.smithi103.stderr:Traceback (most recent call last): 2024-09-13T19:01:18.698 INFO:teuthology.orchestra.run.smithi103.stderr: File "", line 20, in 2024-09-13T19:01:18.698 INFO:teuthology.orchestra.run.smithi103.stderr:OSError: [Errno 122] Disk quota exceeded: '/home/ubuntu/cephtest/mnt.1/subdir_files/file_20' 2024-09-13T19:01:18.736 INFO:teuthology.orchestra.run.smithi103.stderr:daemon-helper: command failed with exit status 1 2024-09-13T19:01:18.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:01:18.743 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:18.743 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:18.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:18.820 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=40 seek=0) 2024-09-13T19:01:18.915 INFO:teuthology.orchestra.run.smithi103.stderr:dd: error writing 'subdir_data/file': Disk quota exceeded 2024-09-13T19:01:18.916 INFO:teuthology.orchestra.run.smithi103.stderr:2+0 records in 2024-09-13T19:01:18.916 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-13T19:01:18.916 INFO:teuthology.orchestra.run.smithi103.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107114 s, 97.9 MB/s 2024-09-13T19:01:18.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:01:18.917 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T19:01:18.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:01:19.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T19:01:19.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T19:01:19.101 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:19.101 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:19.137 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:19.137 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:19.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:19.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.405+0000 7f3ee9600640 1 Processor -- start 2024-09-13T19:01:19.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.406+0000 7f3ee9600640 1 -- start start 2024-09-13T19:01:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 0x7f3ee40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee9600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40cd850 con 0x7f3ee4071560 2024-09-13T19:01:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee9600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40cd570 con 0x7f3ee406f4b0 2024-09-13T19:01:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee9600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40b1740 con 0x7f3ee4159480 2024-09-13T19:01:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee8c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3ee4071560 0x7f3ee40b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34570/0 (socket says 172.21.15.33:34570) 2024-09-13T19:01:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee8c00640 1 -- 172.21.15.33:0/1772331084 learned_addr learned my addr 172.21.15.33:0/1772331084 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.407+0000 7f3ee3e00640 1 --2- 172.21.15.33:0/1772331084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 0x7f3ee40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329146598 0 0) 0x7f3ee40cd850 con 0x7f3ee4071560 2024-09-13T19:01:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec8003520 con 0x7f3ee4071560 2024-09-13T19:01:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3e00640 1 -- 172.21.15.33:0/1772331084 >> v1:172.21.15.103:6789/0 conn(0x7f3ee406f4b0 legacy=0x7f3ee4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604245139 0 0) 0x7f3ee40cd570 con 0x7f3ee406f4b0 2024-09-13T19:01:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3e00640 1 -- 172.21.15.33:0/1772331084 >> v1:172.21.15.33:6789/0 conn(0x7f3ee4071560 legacy=0x7f3ee40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.408+0000 7f3ee3e00640 1 -- 172.21.15.33:0/1772331084 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40b1a20 con 0x7f3ee4159480 2024-09-13T19:01:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.409+0000 7f3ee3e00640 1 --2- 172.21.15.33:0/1772331084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 0x7f3ee40ccf90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40097d0 tx=0x7f3ed402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686a23a3feececc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.409+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4032440 con 0x7f3ee4159480 2024-09-13T19:01:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.409+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40325a0 con 0x7f3ee4159480 2024-09-13T19:01:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.409+0000 7f3ee3400640 1 -- 172.21.15.33:0/1772331084 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4032930 con 0x7f3ee4159480 2024-09-13T19:01:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 -- 172.21.15.33:0/1772331084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 msgr2=0x7f3ee40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 --2- 172.21.15.33:0/1772331084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 0x7f3ee40ccf90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40097d0 tx=0x7f3ed402a180 comp rx=0 tx=0).stop 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 -- 172.21.15.33:0/1772331084 shutdown_connections 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 --2- 172.21.15.33:0/1772331084 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee4159480 0x7f3ee40ccf90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 -- 172.21.15.33:0/1772331084 >> 172.21.15.33:0/1772331084 conn(0x7f3ee40ae310 msgr2=0x7f3ee40ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 -- 172.21.15.33:0/1772331084 shutdown_connections 2024-09-13T19:01:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.410+0000 7f3ee9600640 1 -- 172.21.15.33:0/1772331084 wait complete. 2024-09-13T19:01:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.412+0000 7f3ee9600640 1 Processor -- start 2024-09-13T19:01:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.412+0000 7f3ee9600640 1 -- start start 2024-09-13T19:01:19.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.412+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee406f4b0 0x7f3ee41efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee4159480 0x7f3ee415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee9600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee415c780 con 0x7f3ee4071560 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee9600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4150f00 con 0x7f3ee4159480 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee9600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41f0130 con 0x7f3ee406f4b0 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47366/0 (socket says 172.21.15.33:47366) 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 -- 172.21.15.33:0/967299558 learned_addr learned my addr 172.21.15.33:0/967299558 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee3e00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee406f4b0 0x7f3ee41efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3ee8c00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee4159480 0x7f3ee415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 -- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee406f4b0 msgr2=0x7f3ee41efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee406f4b0 0x7f3ee41efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 -- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee4159480 msgr2=0x7f3ee415bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee4159480 0x7f3ee415bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.413+0000 7f3edbe00640 1 -- 172.21.15.33:0/967299558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4009400 con 0x7f3ee4071560 2024-09-13T19:01:19.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3edbe00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c4b0 tx=0x7f3ecc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc005480 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0035f0 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0039e0 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee41f0410 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.414+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41f09d0 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.415+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee4067360 con 0x7f3ee4071560 2024-09-13T19:01:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.416+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ecc003b40 con 0x7f3ee4071560 2024-09-13T19:01:19.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.417+0000 7f3ee0c00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 0x7f3ec006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.417+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ecc0888a0 con 0x7f3ee4071560 2024-09-13T19:01:19.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.418+0000 7f3ee3e00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 0x7f3ec006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.418+0000 7f3ee3e00640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 0x7f3ec006d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034000 tx=0x7f3ed402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.422+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ecc053b20 con 0x7f3ee4071560 2024-09-13T19:01:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.604+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ee41510c0 con 0x7f3ee4071560 2024-09-13T19:01:19.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.606+0000 7f3ee0c00640 1 -- 172.21.15.33:0/967299558 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f3ecc017070 con 0x7f3ee4071560 2024-09-13T19:01:19.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:19.609 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 msgr2=0x7f3ec006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 0x7f3ec006d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4034000 tx=0x7f3ed402e000 comp rx=0 tx=0).stop 2024-09-13T19:01:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 msgr2=0x7f3ee41f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c4b0 tx=0x7f3ecc00c970 comp rx=0 tx=0).stop 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 shutdown_connections 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f3ec006ac00 0x7f3ec006d0c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee4159480 0x7f3ee415bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ee4071560 0x7f3ee41f0d10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 --2- 172.21.15.33:0/967299558 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3ee406f4b0 0x7f3ee41efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 >> 172.21.15.33:0/967299558 conn(0x7f3ee40ae310 msgr2=0x7f3ee4072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 shutdown_connections 2024-09-13T19:01:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.608+0000 7f3ee9600640 1 -- 172.21.15.33:0/967299558 wait complete. 2024-09-13T19:01:19.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:01:01.723106+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:01:02.852976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:01:19.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:01:19.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.782+0000 7f8cb9e00640 1 Processor -- start 2024-09-13T19:01:19.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.782+0000 7f8cb9e00640 1 -- start start 2024-09-13T19:01:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb9e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8cb40cbac0 0x7f8cb40cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb9e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40ce490 con 0x7f8cb4154ad0 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb9e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb406b7c0 con 0x7f8cb406f830 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb9e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40cc490 con 0x7f8cb40cbac0 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb2a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8cb4154ad0 0x7f8cb40cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34576/0 (socket says 172.21.15.33:34576) 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb2a00640 1 -- 172.21.15.33:0/3167571622 learned_addr learned my addr 172.21.15.33:0/3167571622 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.783+0000 7f8cb3400640 1 --2- 172.21.15.33:0/3167571622 >> v2:172.21.15.33:3300/0 conn(0x7f8cb40cbac0 0x7f8cb40cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035389804 0 0) 0x7f8cb40ce490 con 0x7f8cb4154ad0 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c98003520 con 0x7f8cb4154ad0 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb3400640 1 -- 172.21.15.33:0/3167571622 >> v1:172.21.15.103:6789/0 conn(0x7f8cb406f830 legacy=0x7f8cb406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790430987 0 0) 0x7f8cb406b7c0 con 0x7f8cb406f830 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb3400640 1 -- 172.21.15.33:0/3167571622 >> v1:172.21.15.33:6789/0 conn(0x7f8cb4154ad0 legacy=0x7f8cb40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.784+0000 7f8cb3400640 1 -- 172.21.15.33:0/3167571622 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb406baa0 con 0x7f8cb40cbac0 2024-09-13T19:01:19.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.785+0000 7f8cb3400640 1 --2- 172.21.15.33:0/3167571622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb40cbac0 0x7f8cb40cbf50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097a0 tx=0x7f8cac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6b53b04edb4856 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.785+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032440 con 0x7f8cb40cbac0 2024-09-13T19:01:19.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.785+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0325a0 con 0x7f8cb40cbac0 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.785+0000 7f8cb2000640 1 -- 172.21.15.33:0/3167571622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032930 con 0x7f8cb40cbac0 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 -- 172.21.15.33:0/3167571622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb40cbac0 msgr2=0x7f8cb40cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/3167571622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb40cbac0 0x7f8cb40cbf50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0097a0 tx=0x7f8cac02a1a0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 -- 172.21.15.33:0/3167571622 shutdown_connections 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/3167571622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb40cbac0 0x7f8cb40cbf50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 -- 172.21.15.33:0/3167571622 >> 172.21.15.33:0/3167571622 conn(0x7f8cb40b0580 msgr2=0x7f8cb40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 -- 172.21.15.33:0/3167571622 shutdown_connections 2024-09-13T19:01:19.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.786+0000 7f8cb9e00640 1 -- 172.21.15.33:0/3167571622 wait complete. 2024-09-13T19:01:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.788+0000 7f8cb9e00640 1 Processor -- start 2024-09-13T19:01:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.788+0000 7f8cb9e00640 1 -- start start 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.788+0000 7f8cb9e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cb40cbac0 0x7f8cb414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb413fc80 0x7f8cb415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb9e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4140130 con 0x7f8cb4154ad0 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb9e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414a110 con 0x7f8cb413fc80 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb9e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414a390 con 0x7f8cb40cbac0 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47386/0 (socket says 172.21.15.33:47386) 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 -- 172.21.15.33:0/2072143689 learned_addr learned my addr 172.21.15.33:0/2072143689 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb3400640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb413fc80 0x7f8cb415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8cb2a00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cb40cbac0 0x7f8cb414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 -- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cb40cbac0 msgr2=0x7f8cb414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cb40cbac0 0x7f8cb414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 -- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb413fc80 msgr2=0x7f8cb415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb413fc80 0x7f8cb415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.789+0000 7f8caa000640 1 -- 172.21.15.33:0/2072143689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009400 con 0x7f8cb4154ad0 2024-09-13T19:01:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8caa000640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c410 tx=0x7f8c9c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0035f0 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c003770 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c003b20 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb414a670 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.790+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb414b150 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.791+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb414ae70 con 0x7f8cb4154ad0 2024-09-13T19:01:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.792+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c9c003c80 con 0x7f8cb4154ad0 2024-09-13T19:01:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.793+0000 7f8cabe00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.793+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c088980 con 0x7f8cb4154ad0 2024-09-13T19:01:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.793+0000 7f8cb2a00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.794+0000 7f8cb2a00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 0x7f8c9006d0c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005c00 tx=0x7f8ca4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.797+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8cb414ae70 con 0x7f8cb4154ad0 2024-09-13T19:01:19.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.981+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cb414ae70 con 0x7f8cb4154ad0 2024-09-13T19:01:19.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.981+0000 7f8cabe00640 1 -- 172.21.15.33:0/2072143689 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cb414ae70 con 0x7f8cb4154ad0 2024-09-13T19:01:19.985 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 msgr2=0x7f8c9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 0x7f8c9006d0c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005c00 tx=0x7f8ca4009040 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 msgr2=0x7f8cb415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c410 tx=0x7f8c9c00c8d0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 shutdown_connections 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cb413fc80 0x7f8cb415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb4154ad0 0x7f8cb415d420 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 --2- 172.21.15.33:0/2072143689 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8cb40cbac0 0x7f8cb414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 >> 172.21.15.33:0/2072143689 conn(0x7f8cb40b0580 msgr2=0x7f8cb4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:19.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.983+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 shutdown_connections 2024-09-13T19:01:19.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:19.984+0000 7f8cb9e00640 1 -- 172.21.15.33:0/2072143689 wait complete. 2024-09-13T19:01:20.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:01:20.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.158+0000 7f60a2c00640 1 Processor -- start 2024-09-13T19:01:20.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.158+0000 7f60a2c00640 1 -- start start 2024-09-13T19:01:20.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a2c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a2c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a2c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c06f5f0 con 0x7f609c156f60 2024-09-13T19:01:20.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a2c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c15aa30 con 0x7f609c0cafa0 2024-09-13T19:01:20.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a2c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c070450 con 0x7f609c071690 2024-09-13T19:01:20.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f6093400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.159+0000 7f60a0c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f60a0c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:35538/0 (socket says 172.21.15.33:35538) 2024-09-13T19:01:20.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f6093400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:57986/0 (socket says 172.21.15.33:57986) 2024-09-13T19:01:20.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f60a0c00640 1 -- 172.21.15.33:0/2217291339 learned_addr learned my addr 172.21.15.33:0/2217291339 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f6093400640 1 -- 172.21.15.33:0/2217291339 >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 msgr2=0x7f609c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f6093400640 1 --2- 172.21.15.33:0/2217291339 >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f6093400640 1 -- 172.21.15.33:0/2217291339 >> v1:172.21.15.103:6789/0 conn(0x7f609c156f60 legacy=0x7f609c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f6093400640 1 -- 172.21.15.33:0/2217291339 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c06f840 con 0x7f609c071690 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.160+0000 7f60a0c00640 1 --2- 172.21.15.33:0/2217291339 >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:01:20.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.161+0000 7f6093400640 1 --2- 172.21.15.33:0/2217291339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60840097a0 tx=0x7f608402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f3f707a5f10578 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.161+0000 7f609b400640 1 -- 172.21.15.33:0/2217291339 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084032440 con 0x7f609c071690 2024-09-13T19:01:20.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f609b400640 1 -- 172.21.15.33:0/2217291339 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60840325a0 con 0x7f609c071690 2024-09-13T19:01:20.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f609b400640 1 -- 172.21.15.33:0/2217291339 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084032930 con 0x7f609c071690 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 -- 172.21.15.33:0/2217291339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 msgr2=0x7f609c15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2217291339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60840097a0 tx=0x7f608402a180 comp rx=0 tx=0).stop 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 -- 172.21.15.33:0/2217291339 shutdown_connections 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2217291339 >> v2:172.21.15.103:3300/0 conn(0x7f609c0cafa0 0x7f609c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2217291339 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c071690 0x7f609c15a4f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 -- 172.21.15.33:0/2217291339 >> 172.21.15.33:0/2217291339 conn(0x7f609c0b0580 msgr2=0x7f609c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 -- 172.21.15.33:0/2217291339 shutdown_connections 2024-09-13T19:01:20.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.162+0000 7f60a2c00640 1 -- 172.21.15.33:0/2217291339 wait complete. 2024-09-13T19:01:20.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.164+0000 7f60a2c00640 1 Processor -- start 2024-09-13T19:01:20.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.164+0000 7f60a2c00640 1 -- start start 2024-09-13T19:01:20.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f609c071690 0x7f609c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c156f60 0x7f609c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c14e7f0 con 0x7f609c0cafa0 2024-09-13T19:01:20.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c157f20 con 0x7f609c071690 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a2c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c15dd80 con 0x7f609c156f60 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f6093400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f6093400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47394/0 (socket says 172.21.15.33:47394) 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f6093400640 1 -- 172.21.15.33:0/2253351203 learned_addr learned my addr 172.21.15.33:0/2253351203 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f609be00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f609c071690 0x7f609c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.165+0000 7f60a0c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c156f60 0x7f609c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 -- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c156f60 msgr2=0x7f609c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c156f60 0x7f609c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 -- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f609c071690 msgr2=0x7f609c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f609c071690 0x7f609c06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 -- 172.21.15.33:0/2253351203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094009b30 con 0x7f609c0cafa0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6093400640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6084035040 tx=0x7f60840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084006e10 con 0x7f609c0cafa0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084032e90 con 0x7f609c0cafa0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084030be0 con 0x7f609c0cafa0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6084009400 con 0x7f609c0cafa0 2024-09-13T19:01:20.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.166+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1578d0 con 0x7f609c0cafa0 2024-09-13T19:01:20.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.167+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c06fde0 con 0x7f609c0cafa0 2024-09-13T19:01:20.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.168+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6084039040 con 0x7f609c0cafa0 2024-09-13T19:01:20.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.169+0000 7f6098c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 0x7f607806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.169+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60840a9ac0 con 0x7f609c0cafa0 2024-09-13T19:01:20.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.169+0000 7f609be00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 0x7f607806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.170+0000 7f609be00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 0x7f607806d0f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f609c15b3b0 tx=0x7f608c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.174+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f609c06fde0 con 0x7f609c0cafa0 2024-09-13T19:01:20.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.353+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f609c06fde0 con 0x7f609c0cafa0 2024-09-13T19:01:20.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.354+0000 7f6098c00640 1 -- 172.21.15.33:0/2253351203 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7f609c06fde0 con 0x7f609c0cafa0 2024-09-13T19:01:20.357 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:01:20.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 msgr2=0x7f607806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 0x7f607806d0f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f609c15b3b0 tx=0x7f608c009040 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 msgr2=0x7f609c14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6084035040 tx=0x7f60840046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 shutdown_connections 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f607806ac30 0x7f607806d0f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f609c156f60 0x7f609c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f609c0cafa0 0x7f609c14e2b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 --2- 172.21.15.33:0/2253351203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f609c071690 0x7f609c06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 >> 172.21.15.33:0/2253351203 conn(0x7f609c0b0580 msgr2=0x7f609c151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 shutdown_connections 2024-09-13T19:01:20.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.356+0000 7f60a2c00640 1 -- 172.21.15.33:0/2253351203 wait complete. 2024-09-13T19:01:20.376 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:01:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.531+0000 7f1d51600640 1 Processor -- start 2024-09-13T19:01:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.531+0000 7f1d51600640 1 -- start start 2024-09-13T19:01:20.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.532+0000 7f1d51600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.532+0000 7f1d51600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ce2c0 0x7f1d4c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.532+0000 7f1d51600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c06b7c0 con 0x7f1d4c06f830 2024-09-13T19:01:20.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.532+0000 7f1d51600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c06b5b0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.532+0000 7f1d51600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c06baa0 con 0x7f1d4c0ce2c0 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47400/0 (socket says 172.21.15.33:47400) 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 -- 172.21.15.33:0/2567881398 learned_addr learned my addr 172.21.15.33:0/2567881398 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 -- 172.21.15.33:0/2567881398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ce2c0 msgr2=0x7f1d4c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 --2- 172.21.15.33:0/2567881398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ce2c0 0x7f1d4c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 -- 172.21.15.33:0/2567881398 >> v1:172.21.15.103:6789/0 conn(0x7f1d4c06f830 legacy=0x7f1d4c06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.533+0000 7f1d4aa00640 1 -- 172.21.15.33:0/2567881398 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c06bd80 con 0x7f1d4c154ad0 2024-09-13T19:01:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.534+0000 7f1d4aa00640 1 --2- 172.21.15.33:0/2567881398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf87b78750283552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.534+0000 7f1d49600640 1 -- 172.21.15.33:0/2567881398 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c02ae90 con 0x7f1d4c154ad0 2024-09-13T19:01:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.534+0000 7f1d49600640 1 -- 172.21.15.33:0/2567881398 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c032440 con 0x7f1d4c154ad0 2024-09-13T19:01:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.534+0000 7f1d49600640 1 -- 172.21.15.33:0/2567881398 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0327d0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 -- 172.21.15.33:0/2567881398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 msgr2=0x7f1d4c0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 --2- 172.21.15.33:0/2567881398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02a180 comp rx=0 tx=0).stop 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 -- 172.21.15.33:0/2567881398 shutdown_connections 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 --2- 172.21.15.33:0/2567881398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ce2c0 0x7f1d4c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 --2- 172.21.15.33:0/2567881398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0cdd80 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 -- 172.21.15.33:0/2567881398 >> 172.21.15.33:0/2567881398 conn(0x7f1d4c0b0580 msgr2=0x7f1d4c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 -- 172.21.15.33:0/2567881398 shutdown_connections 2024-09-13T19:01:20.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.535+0000 7f1d51600640 1 -- 172.21.15.33:0/2567881398 wait complete. 2024-09-13T19:01:20.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.537+0000 7f1d51600640 1 Processor -- start 2024-09-13T19:01:20.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.537+0000 7f1d51600640 1 -- start start 2024-09-13T19:01:20.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ae080 0x7f1d4c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 0x7f1d4c13abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c158240 con 0x7f1d4c154ad0 2024-09-13T19:01:20.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1590a0 con 0x7f1d4c0ab340 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d51600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0acf50 con 0x7f1d4c0ae080 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47408/0 (socket says 172.21.15.33:47408) 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 -- 172.21.15.33:0/3676694423 learned_addr learned my addr 172.21.15.33:0/3676694423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4a000640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ae080 0x7f1d4c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4b400640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 0x7f1d4c13abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 -- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ae080 msgr2=0x7f1d4c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ae080 0x7f1d4c0aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 -- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 msgr2=0x7f1d4c13abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 0x7f1d4c13abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4aa00640 1 -- 172.21.15.33:0/3676694423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0094d0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.538+0000 7f1d4b400640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 0x7f1d4c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d4aa00640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c030950 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c030ab0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c030e60 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c158490 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.539+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c158a50 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.540+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0cb0d0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.541+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d3c039040 con 0x7f1d4c154ad0 2024-09-13T19:01:20.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.542+0000 7f1d42a00640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 0x7f1d2c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.542+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d3c0a9d20 con 0x7f1d4c154ad0 2024-09-13T19:01:20.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.542+0000 7f1d4a000640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 0x7f1d2c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.543+0000 7f1d4a000640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 0x7f1d2c06d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007fd0 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.546+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d3c074dd0 con 0x7f1d4c154ad0 2024-09-13T19:01:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.728+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d4c0cdd80 con 0x7f1d4c154ad0 2024-09-13T19:01:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.728+0000 7f1d42a00640 1 -- 172.21.15.33:0/3676694423 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d3c037020 con 0x7f1d4c154ad0 2024-09-13T19:01:20.732 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.730+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 msgr2=0x7f1d2c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.730+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 0x7f1d2c06d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007fd0 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.730+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 msgr2=0x7f1d4c0adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.730+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 shutdown_connections 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1d2c06ac30 0x7f1d2c06d0f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c0ab340 0x7f1d4c13abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d4c0ae080 0x7f1d4c0aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 --2- 172.21.15.33:0/3676694423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d4c154ad0 0x7f1d4c0adb40 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 >> 172.21.15.33:0/3676694423 conn(0x7f1d4c0b0580 msgr2=0x7f1d4c15d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 shutdown_connections 2024-09-13T19:01:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.731+0000 7f1d51600640 1 -- 172.21.15.33:0/3676694423 wait complete. 2024-09-13T19:01:20.750 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:01:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.902+0000 7ff7ea000640 1 Processor -- start 2024-09-13T19:01:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.903+0000 7ff7ea000640 1 -- start start 2024-09-13T19:01:20.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7ea000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 0x7ff7e40cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7ea000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e40cb8d0 con 0x7ff7e406a410 2024-09-13T19:01:20.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7ea000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e406a8c0 con 0x7ff7e415dc30 2024-09-13T19:01:20.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7ea000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e415e010 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7dbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7e8c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 0x7ff7e40cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7dbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:58008/0 (socket says 172.21.15.33:58008) 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7e8c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 0x7ff7e40cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:35562/0 (socket says 172.21.15.33:35562) 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.904+0000 7ff7dbe00640 1 -- 172.21.15.33:0/2835914385 learned_addr learned my addr 172.21.15.33:0/2835914385 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.905+0000 7ff7dbe00640 1 -- 172.21.15.33:0/2835914385 >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 msgr2=0x7ff7e40cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:20.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.905+0000 7ff7dbe00640 1 --2- 172.21.15.33:0/2835914385 >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 0x7ff7e40cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.905+0000 7ff7dbe00640 1 -- 172.21.15.33:0/2835914385 >> v1:172.21.15.103:6789/0 conn(0x7ff7e406a410 legacy=0x7ff7e406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.905+0000 7ff7dbe00640 1 -- 172.21.15.33:0/2835914385 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40cbbb0 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.906+0000 7ff7dbe00640 1 --2- 172.21.15.33:0/2835914385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098a0 tx=0x7ff7cc02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b611d164bf4ffe25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.906+0000 7ff7e3e00640 1 -- 172.21.15.33:0/2835914385 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc032440 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.906+0000 7ff7e3e00640 1 -- 172.21.15.33:0/2835914385 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0325a0 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.906+0000 7ff7e3e00640 1 -- 172.21.15.33:0/2835914385 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc032930 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 -- 172.21.15.33:0/2835914385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 msgr2=0x7ff7e4069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2835914385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0098a0 tx=0x7ff7cc02a290 comp rx=0 tx=0).stop 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 -- 172.21.15.33:0/2835914385 shutdown_connections 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2835914385 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e4069ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2835914385 >> v2:172.21.15.103:3300/0 conn(0x7ff7e415dc30 0x7ff7e40cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 -- 172.21.15.33:0/2835914385 >> 172.21.15.33:0/2835914385 conn(0x7ff7e40affd0 msgr2=0x7ff7e40b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:20.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 -- 172.21.15.33:0/2835914385 shutdown_connections 2024-09-13T19:01:20.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.907+0000 7ff7ea000640 1 -- 172.21.15.33:0/2835914385 wait complete. 2024-09-13T19:01:20.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.908+0000 7ff7ea000640 1 Processor -- start 2024-09-13T19:01:20.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 -- start start 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e406a410 0x7ff7e4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e41480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414d0b0 con 0x7ff7e415dc30 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4154db0 con 0x7ff7e406a410 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.909+0000 7ff7ea000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4154510 con 0x7ff7e40cb3d0 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47412/0 (socket says 172.21.15.33:47412) 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e406a410 0x7ff7e4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 -- 172.21.15.33:0/2375564650 learned_addr learned my addr 172.21.15.33:0/2375564650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:20.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7dbe00640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e41480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 -- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 msgr2=0x7ff7e41480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e41480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 -- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e406a410 msgr2=0x7ff7e4154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e406a410 0x7ff7e4154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.910+0000 7ff7e9600640 1 -- 172.21.15.33:0/2375564650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0094d0 con 0x7ff7e415dc30 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7e9600640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c7d0 tx=0x7ff7dc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc003b70 con 0x7ff7e415dc30 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc003cf0 con 0x7ff7e415dc30 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00aa90 con 0x7ff7e415dc30 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e41547f0 con 0x7ff7e415dc30 2024-09-13T19:01:20.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.911+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e41485f0 con 0x7ff7e415dc30 2024-09-13T19:01:20.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.912+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e414d1f0 con 0x7ff7e415dc30 2024-09-13T19:01:20.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.913+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7dc00abf0 con 0x7ff7e415dc30 2024-09-13T19:01:20.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.914+0000 7ff7e1600640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:20.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.914+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7dc088ff0 con 0x7ff7e415dc30 2024-09-13T19:01:20.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.914+0000 7ff7e8c00640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:20.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.915+0000 7ff7e8c00640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 0x7ff7c006d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009aa0 tx=0x7ff7d4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:20.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:20.918+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7dc0bc9c0 con 0x7ff7e415dc30 2024-09-13T19:01:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.111+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7e40672f0 con 0x7ff7e415dc30 2024-09-13T19:01:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.112+0000 7ff7e1600640 1 -- 172.21.15.33:0/2375564650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff7dc003e60 con 0x7ff7e415dc30 2024-09-13T19:01:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:01:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 msgr2=0x7ff7c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 0x7ff7c006d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009aa0 tx=0x7ff7d4009190 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 msgr2=0x7ff7e4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c7d0 tx=0x7ff7dc00cc90 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 shutdown_connections 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7e415dc30 0x7ff7e4157a70 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7e40cb3d0 0x7ff7e41480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 --2- 172.21.15.33:0/2375564650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e406a410 0x7ff7e4154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 >> 172.21.15.33:0/2375564650 conn(0x7ff7e40affd0 msgr2=0x7ff7e40ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 shutdown_connections 2024-09-13T19:01:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.114+0000 7ff7ea000640 1 -- 172.21.15.33:0/2375564650 wait complete. 2024-09-13T19:01:21.133 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T19:01:21.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:21.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T19:01:21.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:01:21.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:21.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T19:01:21.233 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:21.234 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:21.273 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:21.273 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:21.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:21.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.504+0000 7f02a6e00640 1 Processor -- start 2024-09-13T19:01:21.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.504+0000 7f02a6e00640 1 -- start start 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f02a6e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f02a0153b20 0x7f02a00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f02a6e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a0153f00 con 0x7f02a0159a80 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f02a6e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00b1a40 con 0x7f02a006f660 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f02a6e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00ce600 con 0x7f02a0153b20 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f029fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f02a0153b20 0x7f02a00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f0297400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f02a0159a80 0x7f02a00b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34588/0 (socket says 172.21.15.33:34588) 2024-09-13T19:01:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f0297400640 1 -- 172.21.15.33:0/3144963762 learned_addr learned my addr 172.21.15.33:0/3144963762 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f029fe00640 1 -- 172.21.15.33:0/3144963762 >> v1:172.21.15.103:6789/0 conn(0x7f02a006f660 legacy=0x7f02a006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f029fe00640 1 -- 172.21.15.33:0/3144963762 >> v1:172.21.15.33:6789/0 conn(0x7f02a0159a80 legacy=0x7f02a00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f029fe00640 1 -- 172.21.15.33:0/3144963762 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a015a1f0 con 0x7f02a0153b20 2024-09-13T19:01:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.506+0000 7f029f400640 1 -- 172.21.15.33:0/3144963762 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153196512 0 0) 0x7f02a0153f00 con 0x7f02a0159a80 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.507+0000 7f029fe00640 1 --2- 172.21.15.33:0/3144963762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a00b3990 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f02900097a0 tx=0x7f029002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f6afe9a957890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f029f400640 1 -- 172.21.15.33:0/3144963762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290032440 con 0x7f02a0153b20 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f029f400640 1 -- 172.21.15.33:0/3144963762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900325a0 con 0x7f02a0153b20 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f029f400640 1 -- 172.21.15.33:0/3144963762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290032930 con 0x7f02a0153b20 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 -- 172.21.15.33:0/3144963762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 msgr2=0x7f02a00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 --2- 172.21.15.33:0/3144963762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a00b3990 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f02900097a0 tx=0x7f029002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 -- 172.21.15.33:0/3144963762 shutdown_connections 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 --2- 172.21.15.33:0/3144963762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a00b3990 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 -- 172.21.15.33:0/3144963762 >> 172.21.15.33:0/3144963762 conn(0x7f02a00b0510 msgr2=0x7f02a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 -- 172.21.15.33:0/3144963762 shutdown_connections 2024-09-13T19:01:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.508+0000 7f02a6e00640 1 -- 172.21.15.33:0/3144963762 wait complete. 2024-09-13T19:01:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.510+0000 7f02a6e00640 1 Processor -- start 2024-09-13T19:01:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.510+0000 7f02a6e00640 1 -- start start 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a006f660 0x7f02a0148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02a0159a80 0x7f02a00af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015b300 con 0x7f02a0153b20 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0156bf0 con 0x7f02a006f660 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a6e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015a9f0 con 0x7f02a0159a80 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f0297400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f0297400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47420/0 (socket says 172.21.15.33:47420) 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f0297400640 1 -- 172.21.15.33:0/2885431965 learned_addr learned my addr 172.21.15.33:0/2885431965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f029fe00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a006f660 0x7f02a0148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.511+0000 7f02a4e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02a0159a80 0x7f02a00af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 -- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02a0159a80 msgr2=0x7f02a00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02a0159a80 0x7f02a00af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 -- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a006f660 msgr2=0x7f02a0148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a006f660 0x7f02a0148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 -- 172.21.15.33:0/2885431965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009400 con 0x7f02a0153b20 2024-09-13T19:01:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f0297400640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f028800c4d0 tx=0x7f028800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02880074e0 con 0x7f02a0153b20 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288007660 con 0x7f02a0153b20 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288004a20 con 0x7f02a0153b20 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0156910 con 0x7f02a0153b20 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.512+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a015af20 con 0x7f02a0153b20 2024-09-13T19:01:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.513+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a00b3990 con 0x7f02a0153b20 2024-09-13T19:01:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.514+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0288004b80 con 0x7f02a0153b20 2024-09-13T19:01:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.515+0000 7f029cc00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 0x7f027c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.515+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0288088550 con 0x7f02a0153b20 2024-09-13T19:01:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.516+0000 7f029fe00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 0x7f027c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.517+0000 7f029fe00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 0x7f027c06d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0290034000 tx=0x7f029002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.519+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0288053740 con 0x7f02a0153b20 2024-09-13T19:01:21.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.700+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02a00ade30 con 0x7f02a0153b20 2024-09-13T19:01:21.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.701+0000 7f029cc00640 1 -- 172.21.15.33:0/2885431965 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f0288056d60 con 0x7f02a0153b20 2024-09-13T19:01:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:21.705 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 msgr2=0x7f027c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 0x7f027c06d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0290034000 tx=0x7f029002e000 comp rx=0 tx=0).stop 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 msgr2=0x7f02a0155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f028800c4d0 tx=0x7f028800c990 comp rx=0 tx=0).stop 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 shutdown_connections 2024-09-13T19:01:21.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f027c06ac00 0x7f027c06d0c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02a0159a80 0x7f02a00af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02a0153b20 0x7f02a0155f50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 --2- 172.21.15.33:0/2885431965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a006f660 0x7f02a0148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.703+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 >> 172.21.15.33:0/2885431965 conn(0x7f02a00b0510 msgr2=0x7f02a00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.704+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 shutdown_connections 2024-09-13T19:01:21.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.704+0000 7f02a6e00640 1 -- 172.21.15.33:0/2885431965 wait complete. 2024-09-13T19:01:21.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:01:01.723106+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:01:02.852976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:01:21.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:01:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.878+0000 7f61f5000640 1 Processor -- start 2024-09-13T19:01:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.878+0000 7f61f5000640 1 -- start start 2024-09-13T19:01:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.879+0000 7f61f5000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 0x7f61f015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.879+0000 7f61f5000640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f006f5f0 con 0x7f61f00cafa0 2024-09-13T19:01:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.879+0000 7f61f5000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f0070450 con 0x7f61f0156f60 2024-09-13T19:01:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.879+0000 7f61f5000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f015aa30 con 0x7f61f0071690 2024-09-13T19:01:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ee800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f61f00cafa0 0x7f61f00cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34590/0 (socket says 172.21.15.33:34590) 2024-09-13T19:01:21.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ee800640 1 -- 172.21.15.33:0/2631932554 learned_addr learned my addr 172.21.15.33:0/2631932554 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ed400640 1 --2- 172.21.15.33:0/2631932554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 0x7f61f015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61eca00640 1 -- 172.21.15.33:0/2631932554 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369526693 0 0) 0x7f61f006f5f0 con 0x7f61f00cafa0 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61eca00640 1 -- 172.21.15.33:0/2631932554 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d4003520 con 0x7f61f00cafa0 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ed400640 1 -- 172.21.15.33:0/2631932554 >> v1:172.21.15.103:6789/0 conn(0x7f61f0156f60 legacy=0x7f61f0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ed400640 1 -- 172.21.15.33:0/2631932554 >> v1:172.21.15.33:6789/0 conn(0x7f61f00cafa0 legacy=0x7f61f00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.880+0000 7f61ed400640 1 -- 172.21.15.33:0/2631932554 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f006f840 con 0x7f61f0071690 2024-09-13T19:01:21.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.881+0000 7f61ed400640 1 --2- 172.21.15.33:0/2631932554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 0x7f61f015a4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0097d0 tx=0x7f61dc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30aa5c83be96ff60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61eca00640 1 -- 172.21.15.33:0/2631932554 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc032440 con 0x7f61f0071690 2024-09-13T19:01:21.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61eca00640 1 -- 172.21.15.33:0/2631932554 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc0325a0 con 0x7f61f0071690 2024-09-13T19:01:21.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61eca00640 1 -- 172.21.15.33:0/2631932554 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc032930 con 0x7f61f0071690 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61f5000640 1 -- 172.21.15.33:0/2631932554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 msgr2=0x7f61f015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61f5000640 1 --2- 172.21.15.33:0/2631932554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 0x7f61f015a4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0097d0 tx=0x7f61dc02a210 comp rx=0 tx=0).stop 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.882+0000 7f61f5000640 1 -- 172.21.15.33:0/2631932554 shutdown_connections 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.883+0000 7f61f5000640 1 --2- 172.21.15.33:0/2631932554 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f0071690 0x7f61f015a4f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.883+0000 7f61f5000640 1 -- 172.21.15.33:0/2631932554 >> 172.21.15.33:0/2631932554 conn(0x7f61f00b0580 msgr2=0x7f61f00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.883+0000 7f61f5000640 1 -- 172.21.15.33:0/2631932554 shutdown_connections 2024-09-13T19:01:21.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.883+0000 7f61f5000640 1 -- 172.21.15.33:0/2631932554 wait complete. 2024-09-13T19:01:21.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.884+0000 7f61f5000640 1 Processor -- start 2024-09-13T19:01:21.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.884+0000 7f61f5000640 1 -- start start 2024-09-13T19:01:21.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 0x7f61f01f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f00cafa0 0x7f61f014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0157ab0 con 0x7f61f0156f60 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f014ef50 con 0x7f61f0071690 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61f5000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f014b660 con 0x7f61f00cafa0 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.885+0000 7f61ee800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47436/0 (socket says 172.21.15.33:47436) 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 -- 172.21.15.33:0/2419541612 learned_addr learned my addr 172.21.15.33:0/2419541612 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ed400640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f00cafa0 0x7f61f014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ede00640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 0x7f61f01f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 -- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f00cafa0 msgr2=0x7f61f014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f00cafa0 0x7f61f014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 -- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 msgr2=0x7f61f01f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 0x7f61f01f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 -- 172.21.15.33:0/2419541612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009400 con 0x7f61f0156f60 2024-09-13T19:01:21.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ede00640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 0x7f61f01f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61ee800640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61e800cc10 tx=0x7f61e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ad40 con 0x7f61f0156f60 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.886+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8012400 con 0x7f61f0156f60 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.887+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f014e990 con 0x7f61f0156f60 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.887+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800aea0 con 0x7f61f0156f60 2024-09-13T19:01:21.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.887+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f01576d0 con 0x7f61f0156f60 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.888+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0157bf0 con 0x7f61f0156f60 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.889+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f61e8007070 con 0x7f61f0156f60 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.889+0000 7f61e6000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 0x7f61d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.890+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61e8089180 con 0x7f61f0156f60 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.890+0000 7f61ede00640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 0x7f61d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:21.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.891+0000 7f61ede00640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 0x7f61d006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f61e0007fd0 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:21.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:21.894+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f61e80544a0 con 0x7f61f0156f60 2024-09-13T19:01:22.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.071+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61f00cb630 con 0x7f61f0156f60 2024-09-13T19:01:22.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.072+0000 7f61e6000640 1 -- 172.21.15.33:0/2419541612 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61e8057ac0 con 0x7f61f0156f60 2024-09-13T19:01:22.075 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:01:22.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 msgr2=0x7f61d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 0x7f61d006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f61e0007fd0 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 msgr2=0x7f61f014c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61e800cc10 tx=0x7f61e800a430 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 shutdown_connections 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f61d006ac00 0x7f61d006d0c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f0156f60 0x7f61f014c090 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61f00cafa0 0x7f61f014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 --2- 172.21.15.33:0/2419541612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61f0071690 0x7f61f01f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 >> 172.21.15.33:0/2419541612 conn(0x7f61f00b0580 msgr2=0x7f61f006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 shutdown_connections 2024-09-13T19:01:22.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.074+0000 7f61f5000640 1 -- 172.21.15.33:0/2419541612 wait complete. 2024-09-13T19:01:22.094 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:01:22.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.248+0000 7fccee800640 1 Processor -- start 2024-09-13T19:01:22.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.248+0000 7fccee800640 1 -- start start 2024-09-13T19:01:22.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fccee800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fccee800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80b2890 con 0x7fcce80b31b0 2024-09-13T19:01:22.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fccee800640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80b1880 con 0x7fcce81461c0 2024-09-13T19:01:22.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fccee800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80b1ad0 con 0x7fcce8071460 2024-09-13T19:01:22.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fcce6a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcce80b31b0 0x7fcce806bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34596/0 (socket says 172.21.15.33:34596) 2024-09-13T19:01:22.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.249+0000 7fcce6a00640 1 -- 172.21.15.33:0/1152624249 learned_addr learned my addr 172.21.15.33:0/1152624249 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce7e00640 1 --2- 172.21.15.33:0/1152624249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966982021 0 0) 0x7fcce80b2890 con 0x7fcce80b31b0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc003520 con 0x7fcce80b31b0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093957335 0 0) 0x7fcce80b1880 con 0x7fcce81461c0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce80b2890 con 0x7fcce81461c0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516127265 0 0) 0x7fcccc003520 con 0x7fcce80b31b0 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce7e00640 1 -- 172.21.15.33:0/1152624249 >> v1:172.21.15.103:6789/0 conn(0x7fcce81461c0 legacy=0x7fcce80b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce7e00640 1 -- 172.21.15.33:0/1152624249 >> v1:172.21.15.33:6789/0 conn(0x7fcce80b31b0 legacy=0x7fcce806bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.250+0000 7fcce7e00640 1 -- 172.21.15.33:0/1152624249 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80b1db0 con 0x7fcce8071460 2024-09-13T19:01:22.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.251+0000 7fcce7e00640 1 --2- 172.21.15.33:0/1152624249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce806c5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009dc0 tx=0x7fcce002a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65891aa182440794 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4001690 con 0x7fcce8071460 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce002d050 con 0x7fcce8071460 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fcce6000640 1 -- 172.21.15.33:0/1152624249 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0007760 con 0x7fcce8071460 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 -- 172.21.15.33:0/1152624249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 msgr2=0x7fcce806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 --2- 172.21.15.33:0/1152624249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce806c5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009dc0 tx=0x7fcce002a540 comp rx=0 tx=0).stop 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 -- 172.21.15.33:0/1152624249 shutdown_connections 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 --2- 172.21.15.33:0/1152624249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce806c5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 -- 172.21.15.33:0/1152624249 >> 172.21.15.33:0/1152624249 conn(0x7fcce80b0580 msgr2=0x7fcce80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 -- 172.21.15.33:0/1152624249 shutdown_connections 2024-09-13T19:01:22.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.252+0000 7fccee800640 1 -- 172.21.15.33:0/1152624249 wait complete. 2024-09-13T19:01:22.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.254+0000 7fccee800640 1 Processor -- start 2024-09-13T19:01:22.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.254+0000 7fccee800640 1 -- start start 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce8143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce80b31b0 0x7fcce81606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8155360 con 0x7fcce81461c0 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8158610 con 0x7fcce80b31b0 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fccee800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81588f0 con 0x7fcce8071460 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fcce7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fcce7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47438/0 (socket says 172.21.15.33:47438) 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fcce7e00640 1 -- 172.21.15.33:0/2700303051 learned_addr learned my addr 172.21.15.33:0/2700303051 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:22.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fcce6a00640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce80b31b0 0x7fcce81606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.255+0000 7fcce7400640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce8143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 -- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 msgr2=0x7fcce8143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce8143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 -- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce80b31b0 msgr2=0x7fcce81606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce80b31b0 0x7fcce81606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 -- 172.21.15.33:0/2700303051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009a70 con 0x7fcce81461c0 2024-09-13T19:01:22.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fcce7e00640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009ee0 tx=0x7fcce0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce003c830 con 0x7fcce81461c0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce003c990 con 0x7fcce81461c0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce003cd00 con 0x7fcce81461c0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8158bd0 con 0x7fcce81461c0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.256+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce81578a0 con 0x7fcce81461c0 2024-09-13T19:01:22.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.258+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce81675b0 con 0x7fcce81461c0 2024-09-13T19:01:22.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.258+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcce0031400 con 0x7fcce81461c0 2024-09-13T19:01:22.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.259+0000 7fccdf400640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 0x7fccc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.259+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcce00aad90 con 0x7fcce81461c0 2024-09-13T19:01:22.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.260+0000 7fcce7400640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 0x7fccc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.261+0000 7fcce7400640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 0x7fccc806d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fccd80011e0 tx=0x7fccd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.263+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcce81675b0 con 0x7fcce81461c0 2024-09-13T19:01:22.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.440+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce81557f0 con 0x7fcce81461c0 2024-09-13T19:01:22.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.440+0000 7fccdf400640 1 -- 172.21.15.33:0/2700303051 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcce0040020 con 0x7fcce81461c0 2024-09-13T19:01:22.444 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 msgr2=0x7fccc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 0x7fccc806d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fccd80011e0 tx=0x7fccd8009040 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 msgr2=0x7fcce8160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009ee0 tx=0x7fcce0004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 shutdown_connections 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fccc806ac00 0x7fccc806d0c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce81461c0 0x7fcce8160c20 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce80b31b0 0x7fcce81606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 --2- 172.21.15.33:0/2700303051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcce8071460 0x7fcce8143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 >> 172.21.15.33:0/2700303051 conn(0x7fcce80b0580 msgr2=0x7fcce815cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 shutdown_connections 2024-09-13T19:01:22.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.442+0000 7fccee800640 1 -- 172.21.15.33:0/2700303051 wait complete. 2024-09-13T19:01:22.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:01:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.617+0000 7f01d5600640 1 Processor -- start 2024-09-13T19:01:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.617+0000 7f01d5600640 1 -- start start 2024-09-13T19:01:22.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d5600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f01d00b1ed0 0x7f01d00cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d5600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d00b30e0 con 0x7f01d00cdae0 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d5600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d015a800 con 0x7f01d015a420 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d5600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d00b24d0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01c7e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f01d00b1ed0 0x7f01d00cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d4c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f01d00cdae0 0x7f01d006b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:34598/0 (socket says 172.21.15.33:34598) 2024-09-13T19:01:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.618+0000 7f01d4c00640 1 -- 172.21.15.33:0/4066369161 learned_addr learned my addr 172.21.15.33:0/4066369161 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.619+0000 7f01c7e00640 1 -- 172.21.15.33:0/4066369161 >> v1:172.21.15.103:6789/0 conn(0x7f01d015a420 legacy=0x7f01d00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.619+0000 7f01c7e00640 1 -- 172.21.15.33:0/4066369161 >> v1:172.21.15.33:6789/0 conn(0x7f01d00cdae0 legacy=0x7f01d006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.619+0000 7f01c7e00640 1 -- 172.21.15.33:0/4066369161 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00b27b0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.619+0000 7f01cf400640 1 -- 172.21.15.33:0/4066369161 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446631508 0 0) 0x7f01d00b30e0 con 0x7f01d00cdae0 2024-09-13T19:01:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.620+0000 7f01c7e00640 1 --2- 172.21.15.33:0/4066369161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d00cd5a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8009059da07d86e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.620+0000 7f01cf400640 1 -- 172.21.15.33:0/4066369161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8032440 con 0x7f01d00b1ed0 2024-09-13T19:01:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.620+0000 7f01cf400640 1 -- 172.21.15.33:0/4066369161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80325a0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.620+0000 7f01cf400640 1 -- 172.21.15.33:0/4066369161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8032930 con 0x7f01d00b1ed0 2024-09-13T19:01:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 -- 172.21.15.33:0/4066369161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 msgr2=0x7f01d00cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 --2- 172.21.15.33:0/4066369161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d00cd5a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b802a230 comp rx=0 tx=0).stop 2024-09-13T19:01:22.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 -- 172.21.15.33:0/4066369161 shutdown_connections 2024-09-13T19:01:22.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 --2- 172.21.15.33:0/4066369161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d00cd5a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 -- 172.21.15.33:0/4066369161 >> 172.21.15.33:0/4066369161 conn(0x7f01d0069ed0 msgr2=0x7f01d006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 -- 172.21.15.33:0/4066369161 shutdown_connections 2024-09-13T19:01:22.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.621+0000 7f01d5600640 1 -- 172.21.15.33:0/4066369161 wait complete. 2024-09-13T19:01:22.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.623+0000 7f01d5600640 1 Processor -- start 2024-09-13T19:01:22.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.623+0000 7f01d5600640 1 -- start start 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d00cdae0 0x7f01d0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01d015a420 0x7f01d01f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00c5920 con 0x7f01d00b1ed0 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d014d600 con 0x7f01d00cdae0 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d5600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01571b0 con 0x7f01d015a420 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47470/0 (socket says 172.21.15.33:47470) 2024-09-13T19:01:22.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 -- 172.21.15.33:0/83602952 learned_addr learned my addr 172.21.15.33:0/83602952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01c7e00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d00cdae0 0x7f01d0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01d4c00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01d015a420 0x7f01d01f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 -- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01d015a420 msgr2=0x7f01d01f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01d015a420 0x7f01d01f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 -- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d00cdae0 msgr2=0x7f01d0157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d00cdae0 0x7f01d0157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.624+0000 7f01cfe00640 1 -- 172.21.15.33:0/83602952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009400 con 0x7f01d00b1ed0 2024-09-13T19:01:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01cfe00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c430 tx=0x7f01c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00052d0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0005430 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d00c5620 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0003830 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.625+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0156880 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.626+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d00ccbc0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.627+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f01c0003990 con 0x7f01d00b1ed0 2024-09-13T19:01:22.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.628+0000 7f01ccc00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.628+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01c0088860 con 0x7f01d00b1ed0 2024-09-13T19:01:22.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.629+0000 7f01c7e00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.630+0000 7f01c7e00640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 0x7f01ac06d0c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f01b8034000 tx=0x7f01b802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.632+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01c0053ae0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.810+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01d00cd5a0 con 0x7f01d00b1ed0 2024-09-13T19:01:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.811+0000 7f01ccc00640 1 -- 172.21.15.33:0/83602952 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01c0017020 con 0x7f01d00b1ed0 2024-09-13T19:01:22.814 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:01:22.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 msgr2=0x7f01ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 0x7f01ac06d0c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f01b8034000 tx=0x7f01b802e000 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 msgr2=0x7f01d014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f01c000c430 tx=0x7f01c000c8f0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 shutdown_connections 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f01ac06ac00 0x7f01ac06d0c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01d015a420 0x7f01d01f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01d00cdae0 0x7f01d0157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 --2- 172.21.15.33:0/83602952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d00b1ed0 0x7f01d014d0c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 >> 172.21.15.33:0/83602952 conn(0x7f01d0069ed0 msgr2=0x7f01d006f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 shutdown_connections 2024-09-13T19:01:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.813+0000 7f01d5600640 1 -- 172.21.15.33:0/83602952 wait complete. 2024-09-13T19:01:22.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T19:01:22.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.985+0000 7fbb65e00640 1 Processor -- start 2024-09-13T19:01:22.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.985+0000 7fbb65e00640 1 -- start start 2024-09-13T19:01:22.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 0x7fbb6006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 0x7fbb600cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb600cba50 0x7fbb600cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600cc3c0 con 0x7fbb600cba50 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600b2270 con 0x7fbb600b1b30 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb65e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600b2550 con 0x7fbb60151590 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.986+0000 7fbb5f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb600cba50 0x7fbb600cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbb600cba50 0x7fbb600cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41130/0 (socket says 172.21.15.33:41130) 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 -- 172.21.15.33:0/3991043080 learned_addr learned my addr 172.21.15.33:0/3991043080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5e000640 1 --2- 172.21.15.33:0/3991043080 >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 0x7fbb600cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5ea00640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 0x7fbb6006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 -- 172.21.15.33:0/3991043080 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 msgr2=0x7fbb6006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 0x7fbb6006b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 -- 172.21.15.33:0/3991043080 >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 msgr2=0x7fbb600cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 --2- 172.21.15.33:0/3991043080 >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 0x7fbb600cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5f400640 1 -- 172.21.15.33:0/3991043080 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600b2830 con 0x7fbb600cba50 2024-09-13T19:01:22.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5e000640 1 --2- 172.21.15.33:0/3991043080 >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 0x7fbb600cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:22.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.987+0000 7fbb5ea00640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 0x7fbb6006b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.988+0000 7fbb5f400640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb600cbe80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fbb6006d780 tx=0x7fbb5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440951f96fa5695c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.988+0000 7fbb5d600640 1 -- 172.21.15.33:0/3991043080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58031600 con 0x7fbb600cba50 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.988+0000 7fbb5d600640 1 -- 172.21.15.33:0/3991043080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5802d050 con 0x7fbb600cba50 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.988+0000 7fbb5d600640 1 -- 172.21.15.33:0/3991043080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58031980 con 0x7fbb600cba50 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 -- 172.21.15.33:0/3991043080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 msgr2=0x7fbb600cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb600cbe80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fbb6006d780 tx=0x7fbb5802a6a0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 -- 172.21.15.33:0/3991043080 shutdown_connections 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb600cbe80 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 --2- 172.21.15.33:0/3991043080 >> v2:172.21.15.103:3300/0 conn(0x7fbb600b1b30 0x7fbb600cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 --2- 172.21.15.33:0/3991043080 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb60151590 0x7fbb6006b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 -- 172.21.15.33:0/3991043080 >> 172.21.15.33:0/3991043080 conn(0x7fbb600b0510 msgr2=0x7fbb600b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 -- 172.21.15.33:0/3991043080 shutdown_connections 2024-09-13T19:01:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.989+0000 7fbb65e00640 1 -- 172.21.15.33:0/3991043080 wait complete. 2024-09-13T19:01:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.991+0000 7fbb65e00640 1 Processor -- start 2024-09-13T19:01:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.991+0000 7fbb65e00640 1 -- start start 2024-09-13T19:01:22.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb600b1b30 0x7fbb600ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 0x7fbb60159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600aec00 con 0x7fbb600cba50 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6014c810 con 0x7fbb60151590 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb65e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6014cab0 con 0x7fbb600b1b30 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41132/0 (socket says 172.21.15.33:41132) 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 -- 172.21.15.33:0/2246266250 learned_addr learned my addr 172.21.15.33:0/2246266250 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5ea00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb600b1b30 0x7fbb600ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5f400640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 0x7fbb60159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 -- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb600b1b30 msgr2=0x7fbb600ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb600b1b30 0x7fbb600ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 -- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 msgr2=0x7fbb60159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 0x7fbb60159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5e000640 1 -- 172.21.15.33:0/2246266250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58009b30 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.992+0000 7fbb5f400640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 0x7fbb60159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb5e000640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d7d0 tx=0x7fbb4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c004030 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c004190 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c004520 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6014cd90 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.993+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6015be60 con 0x7fbb600cba50 2024-09-13T19:01:22.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.994+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb600cbe80 con 0x7fbb600cba50 2024-09-13T19:01:22.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.995+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb4c0096a0 con 0x7fbb600cba50 2024-09-13T19:01:22.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.996+0000 7fbb57400640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 0x7fbb4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:22.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.996+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb4c089a20 con 0x7fbb600cba50 2024-09-13T19:01:22.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.996+0000 7fbb5ea00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 0x7fbb4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:22.997+0000 7fbb5ea00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 0x7fbb4006d0f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbb600cca50 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.000+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb4c054b60 con 0x7fbb600cba50 2024-09-13T19:01:23.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.193+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb600caaa0 con 0x7fbb600cba50 2024-09-13T19:01:23.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.193+0000 7fbb57400640 1 -- 172.21.15.33:0/2246266250 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb4c00b380 con 0x7fbb600cba50 2024-09-13T19:01:23.197 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 msgr2=0x7fbb4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 0x7fbb4006d0f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbb600cca50 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 msgr2=0x7fbb60149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d7d0 tx=0x7fbb4c00dc90 comp rx=0 tx=0).stop 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 shutdown_connections 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fbb4006ac30 0x7fbb4006d0f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb60151590 0x7fbb60159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600cba50 0x7fbb60149b90 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 --2- 172.21.15.33:0/2246266250 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbb600b1b30 0x7fbb600ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.195+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 >> 172.21.15.33:0/2246266250 conn(0x7fbb600b0510 msgr2=0x7fbb6015e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:23.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.196+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 shutdown_connections 2024-09-13T19:01:23.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.196+0000 7fbb65e00640 1 -- 172.21.15.33:0/2246266250 wait complete. 2024-09-13T19:01:23.214 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T19:01:23.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:23.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T19:01:23.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:01:23.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:23.344 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T19:01:23.382 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:23.382 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:23.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:01:23.418 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:23.418 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:23.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:01:23.458 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:23.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.610+0000 7fe3bbe00640 1 Processor -- start 2024-09-13T19:01:23.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.610+0000 7fe3bbe00640 1 -- start start 2024-09-13T19:01:23.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.611+0000 7fe3bbe00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3b4070080 0x7fe3b40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:23.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.611+0000 7fe3bbe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b415dcd0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.611+0000 7fe3bbe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b4142f50 con 0x7fe3b406ad30 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.611+0000 7fe3bbe00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b406b8d0 con 0x7fe3b4070080 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b9400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe3b415d8f0 0x7fe3b406bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42952/0 (socket says 172.21.15.33:42952) 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b9400640 1 -- 172.21.15.33:0/2048381358 learned_addr learned my addr 172.21.15.33:0/2048381358 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b8a00640 1 --2- 172.21.15.33:0/2048381358 >> v2:172.21.15.103:3300/0 conn(0x7fe3b4070080 0x7fe3b40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943616565 0 0) 0x7fe3b415dcd0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe39c003520 con 0x7fe3b415d8f0 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318470616 0 0) 0x7fe3b4142f50 con 0x7fe3b406ad30 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b415dcd0 con 0x7fe3b406ad30 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b8a00640 1 -- 172.21.15.33:0/2048381358 >> v1:172.21.15.103:6789/0 conn(0x7fe3b406ad30 legacy=0x7fe3b406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b8a00640 1 -- 172.21.15.33:0/2048381358 >> v1:172.21.15.33:6789/0 conn(0x7fe3b415d8f0 legacy=0x7fe3b406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.612+0000 7fe3b8a00640 1 -- 172.21.15.33:0/2048381358 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4069f70 con 0x7fe3b4070080 2024-09-13T19:01:23.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.613+0000 7fe3b8a00640 1 --2- 172.21.15.33:0/2048381358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b40704f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00097d0 tx=0x7fe3a002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb3d84edbad1561d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:23.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0032440 con 0x7fe3b4070080 2024-09-13T19:01:23.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00325a0 con 0x7fe3b4070080 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3b3e00640 1 -- 172.21.15.33:0/2048381358 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0032930 con 0x7fe3b4070080 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 -- 172.21.15.33:0/2048381358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 msgr2=0x7fe3b40704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/2048381358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b40704f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00097d0 tx=0x7fe3a002a250 comp rx=0 tx=0).stop 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 -- 172.21.15.33:0/2048381358 shutdown_connections 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/2048381358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b40704f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 -- 172.21.15.33:0/2048381358 >> 172.21.15.33:0/2048381358 conn(0x7fe3b40ae480 msgr2=0x7fe3b40b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 -- 172.21.15.33:0/2048381358 shutdown_connections 2024-09-13T19:01:23.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.614+0000 7fe3bbe00640 1 -- 172.21.15.33:0/2048381358 wait complete. 2024-09-13T19:01:23.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.616+0000 7fe3bbe00640 1 Processor -- start 2024-09-13T19:01:23.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.616+0000 7fe3bbe00640 1 -- start start 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3b406ad30 0x7fe3b415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41e5f00 con 0x7fe3b415d8f0 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41e61e0 con 0x7fe3b4070080 2024-09-13T19:01:23.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3bbe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41e64c0 con 0x7fe3b406ad30 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3b9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3b9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41148/0 (socket says 172.21.15.33:41148) 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3b9e00640 1 -- 172.21.15.33:0/1552789030 learned_addr learned my addr 172.21.15.33:0/1552789030 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3b8a00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.617+0000 7fe3b9400640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3b406ad30 0x7fe3b415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 -- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3b406ad30 msgr2=0x7fe3b415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3b406ad30 0x7fe3b415bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 -- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 msgr2=0x7fe3b415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 -- 172.21.15.33:0/1552789030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009400 con 0x7fe3b415d8f0 2024-09-13T19:01:23.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b9e00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c6e0 tx=0x7fe3ac00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003b70 con 0x7fe3b415d8f0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac003cd0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b41e67a0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0052d0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.618+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b413c020 con 0x7fe3b415d8f0 2024-09-13T19:01:23.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.619+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b40704f0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.620+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3ac005430 con 0x7fe3b415d8f0 2024-09-13T19:01:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.621+0000 7fe3b1600640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 0x7fe39406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.621+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3ac089040 con 0x7fe3b415d8f0 2024-09-13T19:01:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.622+0000 7fe3b9400640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 0x7fe39406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.622+0000 7fe3b9400640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 0x7fe39406d0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80011e0 tx=0x7fe3a8007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:23.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.625+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3ac0bc9c0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.840+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3b40b1820 con 0x7fe3b415d8f0 2024-09-13T19:01:23.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.841+0000 7fe3b1600640 1 -- 172.21.15.33:0/1552789030 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fe3ac0542c0 con 0x7fe3b415d8f0 2024-09-13T19:01:23.845 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:23.845 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:23.846 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 msgr2=0x7fe39406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 0x7fe39406d0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80011e0 tx=0x7fe3a8007d30 comp rx=0 tx=0).stop 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 msgr2=0x7fe3b415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c6e0 tx=0x7fe3ac00cba0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 shutdown_connections 2024-09-13T19:01:23.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fe39406ac00 0x7fe39406d0c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3b415d8f0 0x7fe3b415b0e0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4070080 0x7fe3b415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 --2- 172.21.15.33:0/1552789030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3b406ad30 0x7fe3b415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.843+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 >> 172.21.15.33:0/1552789030 conn(0x7fe3b40ae480 msgr2=0x7fe3b41426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.844+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 shutdown_connections 2024-09-13T19:01:23.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:23.844+0000 7fe3bbe00640 1 -- 172.21.15.33:0/1552789030 wait complete. 2024-09-13T19:01:23.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:24.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.016+0000 7f2b7be00640 1 Processor -- start 2024-09-13T19:01:24.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.016+0000 7f2b7be00640 1 -- start start 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7be00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 0x7f2b7c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 0x7f2b7c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7be00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0cd850 con 0x7f2b7c159480 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7be00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0cd570 con 0x7f2b7c071560 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7be00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b1740 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b7c159480 0x7f2b7c070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42968/0 (socket says 172.21.15.33:42968) 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7aa00640 1 -- 172.21.15.33:0/4091458001 learned_addr learned my addr 172.21.15.33:0/4091458001 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b7b400640 1 --2- 172.21.15.33:0/4091458001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 0x7f2b7c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.017+0000 7f2b72000640 1 --2- 172.21.15.33:0/4091458001 >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 0x7f2b7c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b7b400640 1 -- 172.21.15.33:0/4091458001 >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 msgr2=0x7f2b7c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b7b400640 1 --2- 172.21.15.33:0/4091458001 >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 0x7f2b7c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b7b400640 1 -- 172.21.15.33:0/4091458001 >> v1:172.21.15.33:6789/0 conn(0x7f2b7c159480 legacy=0x7f2b7c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b7a000640 1 -- 172.21.15.33:0/4091458001 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838778311 0 0) 0x7f2b7c0cd850 con 0x7f2b7c159480 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b7b400640 1 -- 172.21.15.33:0/4091458001 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0b1a20 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.018+0000 7f2b72000640 1 --2- 172.21.15.33:0/4091458001 >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 0x7f2b7c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.019+0000 7f2b7b400640 1 --2- 172.21.15.33:0/4091458001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 0x7f2b7c0b2220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009d90 tx=0x7f2b7402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1658a137d0509d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.019+0000 7f2b7a000640 1 -- 172.21.15.33:0/4091458001 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74031600 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.019+0000 7f2b7a000640 1 -- 172.21.15.33:0/4091458001 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7402d050 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.019+0000 7f2b7a000640 1 -- 172.21.15.33:0/4091458001 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74031980 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 -- 172.21.15.33:0/4091458001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 msgr2=0x7f2b7c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4091458001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 0x7f2b7c0b2220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009d90 tx=0x7f2b7402a5d0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 -- 172.21.15.33:0/4091458001 shutdown_connections 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4091458001 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c06f4b0 0x7f2b7c0b2220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4091458001 >> v2:172.21.15.103:3300/0 conn(0x7f2b7c071560 0x7f2b7c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 -- 172.21.15.33:0/4091458001 >> 172.21.15.33:0/4091458001 conn(0x7f2b7c0ae310 msgr2=0x7f2b7c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 -- 172.21.15.33:0/4091458001 shutdown_connections 2024-09-13T19:01:24.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.020+0000 7f2b7be00640 1 -- 172.21.15.33:0/4091458001 wait complete. 2024-09-13T19:01:24.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 Processor -- start 2024-09-13T19:01:24.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 -- start start 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b7c06f4b0 0x7f2b7c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 0x7f2b7c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.022+0000 7f2b7be00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c154ec0 con 0x7f2b7c071560 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b7be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1f5e10 con 0x7f2b7c06f4b0 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b7be00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1f60f0 con 0x7f2b7c159480 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41150/0 (socket says 172.21.15.33:41150) 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 -- 172.21.15.33:0/4120051304 learned_addr learned my addr 172.21.15.33:0/4120051304 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b7b400640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 0x7f2b7c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b7aa00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b7c06f4b0 0x7f2b7c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 -- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 msgr2=0x7f2b7c06b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 0x7f2b7c06b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 -- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b7c06f4b0 msgr2=0x7f2b7c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b7c06f4b0 0x7f2b7c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 -- 172.21.15.33:0/4120051304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009a70 con 0x7f2b7c071560 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b7b400640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 0x7f2b7c06b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.023+0000 7f2b72000640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c7f0 tx=0x7f2b6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.024+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400cea0 con 0x7f2b7c071560 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.024+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64007a30 con 0x7f2b7c071560 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.024+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64007dc0 con 0x7f2b7c071560 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.024+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c1f63d0 con 0x7f2b7c071560 2024-09-13T19:01:24.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.024+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c1f6990 con 0x7f2b7c071560 2024-09-13T19:01:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.025+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c067360 con 0x7f2b7c071560 2024-09-13T19:01:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.026+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b640113f0 con 0x7f2b7c071560 2024-09-13T19:01:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.027+0000 7f2b73400640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 0x7f2b5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.027+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b64089450 con 0x7f2b7c071560 2024-09-13T19:01:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.027+0000 7f2b7aa00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 0x7f2b5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.028+0000 7f2b7aa00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 0x7f2b5806d0f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c000f60 tx=0x7f2b6c007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.031+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b640546c0 con 0x7f2b7c071560 2024-09-13T19:01:24.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.213+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b7c1f6bb0 con 0x7f2b7c071560 2024-09-13T19:01:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.214+0000 7f2b73400640 1 -- 172.21.15.33:0/4120051304 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f2b64057ce0 con 0x7f2b7c071560 2024-09-13T19:01:24.218 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:24.218 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 msgr2=0x7f2b5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 0x7f2b5806d0f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c000f60 tx=0x7f2b6c007c00 comp rx=0 tx=0).stop 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 msgr2=0x7f2b7c148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c7f0 tx=0x7f2b6400ccb0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 shutdown_connections 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b5806ac30 0x7f2b5806d0f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b7c159480 0x7f2b7c06b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b7c071560 0x7f2b7c148690 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 --2- 172.21.15.33:0/4120051304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b7c06f4b0 0x7f2b7c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.216+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 >> 172.21.15.33:0/4120051304 conn(0x7f2b7c0ae310 msgr2=0x7f2b7c070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.217+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 shutdown_connections 2024-09-13T19:01:24.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.217+0000 7f2b7be00640 1 -- 172.21.15.33:0/4120051304 wait complete. 2024-09-13T19:01:24.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:57:03.151946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T19:01:01.723106+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T19:01:02.852976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T19:01:24.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T19:01:24.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.391+0000 7ff8d5a00640 1 Processor -- start 2024-09-13T19:01:24.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.391+0000 7ff8d5a00640 1 -- start start 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.392+0000 7ff8d5a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.392+0000 7ff8d5a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d006f5f0 con 0x7ff8d0156f60 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8d5a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d0070450 con 0x7ff8d00cafa0 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8d5a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d015aa30 con 0x7ff8d0071690 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8cea00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff8d0156f60 0x7ff8d0070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42982/0 (socket says 172.21.15.33:42982) 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8cea00640 1 -- 172.21.15.33:0/1433525191 learned_addr learned my addr 172.21.15.33:0/1433525191 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:24.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8c6000640 1 --2- 172.21.15.33:0/1433525191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261170828 0 0) 0x7ff8d006f5f0 con 0x7ff8d0156f60 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b4003520 con 0x7ff8d0156f60 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449984238 0 0) 0x7ff8d0070450 con 0x7ff8d00cafa0 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d006f5f0 con 0x7ff8d00cafa0 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8c6000640 1 -- 172.21.15.33:0/1433525191 >> v1:172.21.15.103:6789/0 conn(0x7ff8d00cafa0 legacy=0x7ff8d00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8c6000640 1 -- 172.21.15.33:0/1433525191 >> v1:172.21.15.33:6789/0 conn(0x7ff8d0156f60 legacy=0x7ff8d0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.393+0000 7ff8c6000640 1 -- 172.21.15.33:0/1433525191 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d006f840 con 0x7ff8d0071690 2024-09-13T19:01:24.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.395+0000 7ff8c6000640 1 --2- 172.21.15.33:0/1433525191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d015a4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097d0 tx=0x7ff8b802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d151a9bf4b94da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.395+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8032440 con 0x7ff8d0071690 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.395+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b80325a0 con 0x7ff8d0071690 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.395+0000 7ff8ce000640 1 -- 172.21.15.33:0/1433525191 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8032930 con 0x7ff8d0071690 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 -- 172.21.15.33:0/1433525191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 msgr2=0x7ff8d015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/1433525191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d015a4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097d0 tx=0x7ff8b802a200 comp rx=0 tx=0).stop 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 -- 172.21.15.33:0/1433525191 shutdown_connections 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/1433525191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d015a4f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 -- 172.21.15.33:0/1433525191 >> 172.21.15.33:0/1433525191 conn(0x7ff8d00b0580 msgr2=0x7ff8d00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 -- 172.21.15.33:0/1433525191 shutdown_connections 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.396+0000 7ff8d5a00640 1 -- 172.21.15.33:0/1433525191 wait complete. 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.397+0000 7ff8d5a00640 1 Processor -- start 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.397+0000 7ff8d5a00640 1 -- start start 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d0146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 0x7ff8d0157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0145dd0 con 0x7ff8d0156f60 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01460b0 con 0x7ff8d00cafa0 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.398+0000 7ff8d5a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0146390 con 0x7ff8d0071690 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41162/0 (socket says 172.21.15.33:41162) 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 -- 172.21.15.33:0/2811143936 learned_addr learned my addr 172.21.15.33:0/2811143936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:24.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cea00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d0146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8c6000640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 0x7ff8d0157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 -- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 msgr2=0x7ff8d0146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d0146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 -- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 msgr2=0x7ff8d0157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 0x7ff8d0157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 -- 172.21.15.33:0/2811143936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009400 con 0x7ff8d0156f60 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8c6000640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 0x7ff8d0157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.399+0000 7ff8cf400640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c7a0 tx=0x7ff8c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.400+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8003b70 con 0x7ff8d0156f60 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.400+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8003cd0 con 0x7ff8d0156f60 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.400+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800aa90 con 0x7ff8d0156f60 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.400+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0146670 con 0x7ff8d0156f60 2024-09-13T19:01:24.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.400+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d015c690 con 0x7ff8d0156f60 2024-09-13T19:01:24.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.401+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d0146b90 con 0x7ff8d0156f60 2024-09-13T19:01:24.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.402+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8c800abf0 con 0x7ff8d0156f60 2024-09-13T19:01:24.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.403+0000 7ff8c7400640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 0x7ff8ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.403+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c8089230 con 0x7ff8d0156f60 2024-09-13T19:01:24.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.403+0000 7ff8cea00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 0x7ff8ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.404+0000 7ff8cea00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 0x7ff8ac06d0c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00011e0 tx=0x7ff8c0007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.407+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff8d0146b90 con 0x7ff8d0156f60 2024-09-13T19:01:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.584+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8d0146b90 con 0x7ff8d0156f60 2024-09-13T19:01:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.585+0000 7ff8c7400640 1 -- 172.21.15.33:0/2811143936 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8d0146b90 con 0x7ff8d0156f60 2024-09-13T19:01:24.588 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 msgr2=0x7ff8ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 0x7ff8ac06d0c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00011e0 tx=0x7ff8c0007d30 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 msgr2=0x7ff8d01581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c7a0 tx=0x7ff8c800cc60 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 shutdown_connections 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ff8ac06ac00 0x7ff8ac06d0c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d0156f60 0x7ff8d01581f0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d00cafa0 0x7ff8d0157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 --2- 172.21.15.33:0/2811143936 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8d0071690 0x7ff8d0146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 >> 172.21.15.33:0/2811143936 conn(0x7ff8d00b0580 msgr2=0x7ff8d00aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 shutdown_connections 2024-09-13T19:01:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.587+0000 7ff8d5a00640 1 -- 172.21.15.33:0/2811143936 wait complete. 2024-09-13T19:01:24.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T19:01:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.760+0000 7fa4c5400640 1 Processor -- start 2024-09-13T19:01:24.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.760+0000 7fa4c5400640 1 -- start start 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.761+0000 7fa4c5400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4c0154ad0 0x7fa4c00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.761+0000 7fa4c5400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 0x7fa4c00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.761+0000 7fa4c5400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c006b7c0 con 0x7fa4c006f830 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.761+0000 7fa4c5400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c006b5b0 con 0x7fa4c0154ad0 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.761+0000 7fa4c5400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c006baa0 con 0x7fa4c00ce2c0 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bde00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa4c006f830 0x7fa4c006fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:42992/0 (socket says 172.21.15.33:42992) 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bde00640 1 -- 172.21.15.33:0/1206523324 learned_addr learned my addr 172.21.15.33:0/1206523324 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bf200640 1 --2- 172.21.15.33:0/1206523324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 0x7fa4c00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4be800640 1 --2- 172.21.15.33:0/1206523324 >> v2:172.21.15.103:3300/0 conn(0x7fa4c0154ad0 0x7fa4c00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282688629 0 0) 0x7fa4c006b7c0 con 0x7fa4c006f830 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a4003520 con 0x7fa4c006f830 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bf200640 1 -- 172.21.15.33:0/1206523324 >> v2:172.21.15.103:3300/0 conn(0x7fa4c0154ad0 msgr2=0x7fa4c00cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bf200640 1 --2- 172.21.15.33:0/1206523324 >> v2:172.21.15.103:3300/0 conn(0x7fa4c0154ad0 0x7fa4c00cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349957318 0 0) 0x7fa4a4003520 con 0x7fa4c006f830 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bf200640 1 -- 172.21.15.33:0/1206523324 >> v1:172.21.15.33:6789/0 conn(0x7fa4c006f830 legacy=0x7fa4c006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.762+0000 7fa4bf200640 1 -- 172.21.15.33:0/1206523324 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c006bd80 con 0x7fa4c00ce2c0 2024-09-13T19:01:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4bf200640 1 --2- 172.21.15.33:0/1206523324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 0x7fa4c00cbac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531d3d827ceeeb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac001670 con 0x7fa4c00ce2c0 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b802d050 con 0x7fa4c00ce2c0 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4bd400640 1 -- 172.21.15.33:0/1206523324 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8007760 con 0x7fa4c00ce2c0 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4c5400640 1 -- 172.21.15.33:0/1206523324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 msgr2=0x7fa4c00cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4c5400640 1 --2- 172.21.15.33:0/1206523324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 0x7fa4c00cbac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802a550 comp rx=0 tx=0).stop 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4c5400640 1 -- 172.21.15.33:0/1206523324 shutdown_connections 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.764+0000 7fa4c5400640 1 --2- 172.21.15.33:0/1206523324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c00ce2c0 0x7fa4c00cbac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.765+0000 7fa4c5400640 1 --2- 172.21.15.33:0/1206523324 >> v2:172.21.15.103:3300/0 conn(0x7fa4c0154ad0 0x7fa4c00cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.765+0000 7fa4c5400640 1 -- 172.21.15.33:0/1206523324 >> 172.21.15.33:0/1206523324 conn(0x7fa4c00b0580 msgr2=0x7fa4c00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.765+0000 7fa4c5400640 1 -- 172.21.15.33:0/1206523324 shutdown_connections 2024-09-13T19:01:24.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.765+0000 7fa4c5400640 1 -- 172.21.15.33:0/1206523324 wait complete. 2024-09-13T19:01:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.766+0000 7fa4c5400640 1 Processor -- start 2024-09-13T19:01:24.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.766+0000 7fa4c5400640 1 -- start start 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c0154ad0 0x7fa4c015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c0151850 0x7fa4c015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0156110 con 0x7fa4c01470d0 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0151cd0 con 0x7fa4c0154ad0 2024-09-13T19:01:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.767+0000 7fa4c5400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01551b0 con 0x7fa4c0151850 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41164/0 (socket says 172.21.15.33:41164) 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 -- 172.21.15.33:0/2456663920 learned_addr learned my addr 172.21.15.33:0/2456663920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4be800640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c0154ad0 0x7fa4c015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bf200640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c0151850 0x7fa4c015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 -- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c0151850 msgr2=0x7fa4c015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c0151850 0x7fa4c015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 -- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c0154ad0 msgr2=0x7fa4c015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c0154ad0 0x7fa4c015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 -- 172.21.15.33:0/2456663920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009a70 con 0x7fa4c01470d0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.768+0000 7fa4bde00640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0011e0 tx=0x7fa4ac00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.769+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac005ad0 con 0x7fa4c01470d0 2024-09-13T19:01:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.769+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac005c50 con 0x7fa4c01470d0 2024-09-13T19:01:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.769+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac007070 con 0x7fa4c01470d0 2024-09-13T19:01:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.769+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c0155490 con 0x7fa4c01470d0 2024-09-13T19:01:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.769+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0155a50 con 0x7fa4c01470d0 2024-09-13T19:01:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.770+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0156250 con 0x7fa4c01470d0 2024-09-13T19:01:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.771+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4ac0071d0 con 0x7fa4c01470d0 2024-09-13T19:01:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.772+0000 7fa4b6a00640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 0x7fa4a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.772+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4ac088b90 con 0x7fa4c01470d0 2024-09-13T19:01:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.772+0000 7fa4be800640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 0x7fa4a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.773+0000 7fa4be800640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 0x7fa4a006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009a30 tx=0x7fa4b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:24.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.776+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa4c0156250 con 0x7fa4c01470d0 2024-09-13T19:01:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.956+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4c0156250 con 0x7fa4c01470d0 2024-09-13T19:01:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.956+0000 7fa4b6a00640 1 -- 172.21.15.33:0/2456663920 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4c0156250 con 0x7fa4c01470d0 2024-09-13T19:01:24.960 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.958+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 msgr2=0x7fa4a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.958+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 0x7fa4a006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009a30 tx=0x7fa4b0008040 comp rx=0 tx=0).stop 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.958+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 msgr2=0x7fa4c0151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.958+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0011e0 tx=0x7fa4ac00cc00 comp rx=0 tx=0).stop 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 shutdown_connections 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa4a006ac00 0x7fa4a006d0c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa4c0151850 0x7fa4c015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4c01470d0 0x7fa4c0151310 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 --2- 172.21.15.33:0/2456663920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c0154ad0 0x7fa4c015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 >> 172.21.15.33:0/2456663920 conn(0x7fa4c00b0580 msgr2=0x7fa4c00cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 shutdown_connections 2024-09-13T19:01:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:24.959+0000 7fa4c5400640 1 -- 172.21.15.33:0/2456663920 wait complete. 2024-09-13T19:01:24.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T19:01:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.133+0000 7fd046e00640 1 Processor -- start 2024-09-13T19:01:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.133+0000 7fd046e00640 1 -- start start 2024-09-13T19:01:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.134+0000 7fd046e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040156f60 0x7fd04015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.134+0000 7fd046e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd040071690 0x7fd0400cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.134+0000 7fd046e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04006f5f0 con 0x7fd0400cafa0 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.134+0000 7fd046e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04015aa30 con 0x7fd040071690 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.134+0000 7fd046e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040070450 con 0x7fd040156f60 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd037e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd0400cafa0 0x7fd040070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43008/0 (socket says 172.21.15.33:43008) 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd037e00640 1 -- 172.21.15.33:0/3293687131 learned_addr learned my addr 172.21.15.33:0/3293687131 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd044e00640 1 --2- 172.21.15.33:0/3293687131 >> v2:172.21.15.33:3300/0 conn(0x7fd040071690 0x7fd0400cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd03fe00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040156f60 0x7fd04015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd03f400640 1 -- 172.21.15.33:0/3293687131 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708222791 0 0) 0x7fd04006f5f0 con 0x7fd0400cafa0 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd044e00640 1 -- 172.21.15.33:0/3293687131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040156f60 msgr2=0x7fd04015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd044e00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040156f60 0x7fd04015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd044e00640 1 -- 172.21.15.33:0/3293687131 >> v1:172.21.15.33:6789/0 conn(0x7fd0400cafa0 legacy=0x7fd040070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.135+0000 7fd044e00640 1 -- 172.21.15.33:0/3293687131 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04006f840 con 0x7fd040071690 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.136+0000 7fd044e00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040071690 0x7fd0400cc8b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd038009d90 tx=0x7fd03802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b10d5b87040af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.136+0000 7fd03f400640 1 -- 172.21.15.33:0/3293687131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038007740 con 0x7fd040071690 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd03f400640 1 -- 172.21.15.33:0/3293687131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03802d050 con 0x7fd040071690 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd03f400640 1 -- 172.21.15.33:0/3293687131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038007ac0 con 0x7fd040071690 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 -- 172.21.15.33:0/3293687131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040071690 msgr2=0x7fd0400cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040071690 0x7fd0400cc8b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd038009d90 tx=0x7fd03802a660 comp rx=0 tx=0).stop 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 -- 172.21.15.33:0/3293687131 shutdown_connections 2024-09-13T19:01:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040071690 0x7fd0400cc8b0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 --2- 172.21.15.33:0/3293687131 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040156f60 0x7fd04015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 -- 172.21.15.33:0/3293687131 >> 172.21.15.33:0/3293687131 conn(0x7fd0400b0580 msgr2=0x7fd0400b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 -- 172.21.15.33:0/3293687131 shutdown_connections 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.137+0000 7fd046e00640 1 -- 172.21.15.33:0/3293687131 wait complete. 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.139+0000 7fd046e00640 1 Processor -- start 2024-09-13T19:01:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.139+0000 7fd046e00640 1 -- start start 2024-09-13T19:01:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040071690 0x7fd040154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0400cafa0 0x7fd0400ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040142990 con 0x7fd040156f60 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040142c70 con 0x7fd0400cafa0 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd046e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040142f50 con 0x7fd040071690 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd044e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd044e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41192/0 (socket says 172.21.15.33:41192) 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd044e00640 1 -- 172.21.15.33:0/3258228915 learned_addr learned my addr 172.21.15.33:0/3258228915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd03fe00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040071690 0x7fd040154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.140+0000 7fd037e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0400cafa0 0x7fd0400ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 -- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040071690 msgr2=0x7fd040154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040071690 0x7fd040154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 -- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0400cafa0 msgr2=0x7fd0400ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0400cafa0 0x7fd0400ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 -- 172.21.15.33:0/3258228915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038009a70 con 0x7fd040156f60 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd044e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd038009d90 tx=0x7fd038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038003b90 con 0x7fd040156f60 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038003cf0 con 0x7fd040156f60 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038004230 con 0x7fd040156f60 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd040143230 con 0x7fd040156f60 2024-09-13T19:01:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.141+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040154850 con 0x7fd040156f60 2024-09-13T19:01:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.142+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd040143750 con 0x7fd040156f60 2024-09-13T19:01:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.143+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd038004390 con 0x7fd040156f60 2024-09-13T19:01:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.144+0000 7fd03cc00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 0x7fd01c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.144+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0380aa8c0 con 0x7fd040156f60 2024-09-13T19:01:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.145+0000 7fd03fe00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 0x7fd01c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.145+0000 7fd03fe00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 0x7fd01c06d0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd030009aa0 tx=0x7fd030009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.149+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd040143750 con 0x7fd040156f60 2024-09-13T19:01:25.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.329+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd040143750 con 0x7fd040156f60 2024-09-13T19:01:25.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.330+0000 7fd03cc00640 1 -- 172.21.15.33:0/3258228915 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd040143750 con 0x7fd040156f60 2024-09-13T19:01:25.333 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-13T19:01:25.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 msgr2=0x7fd01c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 0x7fd01c06d0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd030009aa0 tx=0x7fd030009190 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 msgr2=0x7fd040141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd038009d90 tx=0x7fd038004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 shutdown_connections 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd01c06ac30 0x7fd01c06d0f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd040156f60 0x7fd040141ec0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0400cafa0 0x7fd0400ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 --2- 172.21.15.33:0/3258228915 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd040071690 0x7fd040154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 >> 172.21.15.33:0/3258228915 conn(0x7fd0400b0580 msgr2=0x7fd04006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 shutdown_connections 2024-09-13T19:01:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.332+0000 7fd046e00640 1 -- 172.21.15.33:0/3258228915 wait complete. 2024-09-13T19:01:25.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.503+0000 7f4b93600640 1 Processor -- start 2024-09-13T19:01:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.503+0000 7f4b93600640 1 -- start start 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b93600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8c153b20 0x7f4b8c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b93600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c06f660 0x7f4b8c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b93600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c153f00 con 0x7f4b8c159a80 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b93600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8c0ce600 con 0x7f4b8c153b20 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b93600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c070f90 con 0x7f4b8c06f660 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b90c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8c153b20 0x7f4b8c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b90c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b8c153b20 0x7f4b8c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41200/0 (socket says 172.21.15.33:41200) 2024-09-13T19:01:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b90c00640 1 -- 172.21.15.33:0/4055515616 learned_addr learned my addr 172.21.15.33:0/4055515616 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.504+0000 7f4b83e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4b8c159a80 0x7f4b8c0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43014/0 (socket says 172.21.15.33:43014) 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.505+0000 7f4b90c00640 1 -- 172.21.15.33:0/4055515616 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c06f660 msgr2=0x7f4b8c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.505+0000 7f4b90c00640 1 --2- 172.21.15.33:0/4055515616 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c06f660 0x7f4b8c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.505+0000 7f4b90c00640 1 -- 172.21.15.33:0/4055515616 >> v1:172.21.15.33:6789/0 conn(0x7f4b8c159a80 legacy=0x7f4b8c0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.505+0000 7f4b90c00640 1 -- 172.21.15.33:0/4055515616 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0b1a40 con 0x7f4b8c153b20 2024-09-13T19:01:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.505+0000 7f4b8be00640 1 -- 172.21.15.33:0/4055515616 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762964818 0 0) 0x7f4b8c153f00 con 0x7f4b8c159a80 2024-09-13T19:01:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b90c00640 1 --2- 172.21.15.33:0/4055515616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c153b20 0x7f4b8c0b3990 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264739ce832c0bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b8be00640 1 -- 172.21.15.33:0/4055515616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c032440 con 0x7f4b8c153b20 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b8be00640 1 -- 172.21.15.33:0/4055515616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0325a0 con 0x7f4b8c153b20 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b8be00640 1 -- 172.21.15.33:0/4055515616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c032930 con 0x7f4b8c153b20 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b93600640 1 -- 172.21.15.33:0/4055515616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c153b20 msgr2=0x7f4b8c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.506+0000 7f4b93600640 1 --2- 172.21.15.33:0/4055515616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c153b20 0x7f4b8c0b3990 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c02a290 comp rx=0 tx=0).stop 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 -- 172.21.15.33:0/4055515616 shutdown_connections 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 --2- 172.21.15.33:0/4055515616 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c06f660 0x7f4b8c06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 --2- 172.21.15.33:0/4055515616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c153b20 0x7f4b8c0b3990 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 -- 172.21.15.33:0/4055515616 >> 172.21.15.33:0/4055515616 conn(0x7f4b8c0b0510 msgr2=0x7f4b8c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 -- 172.21.15.33:0/4055515616 shutdown_connections 2024-09-13T19:01:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.507+0000 7f4b93600640 1 -- 172.21.15.33:0/4055515616 wait complete. 2024-09-13T19:01:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.508+0000 7f4b93600640 1 Processor -- start 2024-09-13T19:01:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.508+0000 7f4b93600640 1 -- start start 2024-09-13T19:01:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c153b20 0x7f4b8c158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 0x7f4b8c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c1571b0 con 0x7f4b8c06f660 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c1563b0 con 0x7f4b8c159a80 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b93600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c15cac0 con 0x7f4b8c153b20 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.509+0000 7f4b90c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41212/0 (socket says 172.21.15.33:41212) 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 -- 172.21.15.33:0/3018140953 learned_addr learned my addr 172.21.15.33:0/3018140953 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b83e00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c153b20 0x7f4b8c158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b91600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 0x7f4b8c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 -- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c153b20 msgr2=0x7f4b8c158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c153b20 0x7f4b8c158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 -- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 msgr2=0x7f4b8c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 0x7f4b8c158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 -- 172.21.15.33:0/3018140953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0094d0 con 0x7f4b8c06f660 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b91600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 0x7f4b8c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b90c00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.510+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c032440 con 0x7f4b8c06f660 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.511+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c030b80 con 0x7f4b8c06f660 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.511+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c03b400 con 0x7f4b8c06f660 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.511+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c156630 con 0x7f4b8c06f660 2024-09-13T19:01:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.511+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c156bf0 con 0x7f4b8c06f660 2024-09-13T19:01:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.512+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c071660 con 0x7f4b8c06f660 2024-09-13T19:01:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.513+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b7c039040 con 0x7f4b8c06f660 2024-09-13T19:01:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.513+0000 7f4b89600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 0x7f4b6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.513+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b7c0a9bc0 con 0x7f4b8c06f660 2024-09-13T19:01:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.514+0000 7f4b83e00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 0x7f4b6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.515+0000 7f4b83e00640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 0x7f4b6806d0c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c15c3c0 tx=0x7f4b74007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.518+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b7c074db0 con 0x7f4b8c06f660 2024-09-13T19:01:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.731+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b8c0cc480 con 0x7f4b8c06f660 2024-09-13T19:01:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.731+0000 7f4b89600640 1 -- 172.21.15.33:0/3018140953 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f4b7c037090 con 0x7f4b8c06f660 2024-09-13T19:01:25.735 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:25.735 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:25.735 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 msgr2=0x7f4b6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 0x7f4b6806d0c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c15c3c0 tx=0x7f4b74007d50 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 msgr2=0x7f4b8c144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0098a0 tx=0x7f4b7c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 shutdown_connections 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4b6806ac00 0x7f4b6806d0c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b8c159a80 0x7f4b8c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4b8c153b20 0x7f4b8c158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 --2- 172.21.15.33:0/3018140953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b8c06f660 0x7f4b8c144030 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 >> 172.21.15.33:0/3018140953 conn(0x7f4b8c0b0510 msgr2=0x7f4b8c06bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 shutdown_connections 2024-09-13T19:01:25.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.733+0000 7f4b93600640 1 -- 172.21.15.33:0/3018140953 wait complete. 2024-09-13T19:01:25.752 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.903+0000 7f74b6c00640 1 Processor -- start 2024-09-13T19:01:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.903+0000 7f74b6c00640 1 -- start start 2024-09-13T19:01:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.904+0000 7f74b6c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b00b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.904+0000 7f74b6c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74b00b2e90 0x7f74b00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.904+0000 7f74b6c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b013fbc0 con 0x7f74b00b3a40 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.904+0000 7f74b6c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b006cca0 con 0x7f74b00b2e90 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.904+0000 7f74b6c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015ce80 con 0x7f74b0160370 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74afe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f74b00b3a40 0x7f74b01428a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43022/0 (socket says 172.21.15.33:43022) 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74afe00640 1 -- 172.21.15.33:0/3360553364 learned_addr learned my addr 172.21.15.33:0/3360553364 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74b4c00640 1 --2- 172.21.15.33:0/3360553364 >> v2:172.21.15.33:3300/0 conn(0x7f74b00b2e90 0x7f74b00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74af400640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b00b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74aea00640 1 -- 172.21.15.33:0/3360553364 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886611828 0 0) 0x7f74b013fbc0 con 0x7f74b00b3a40 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74aea00640 1 -- 172.21.15.33:0/3360553364 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003520 con 0x7f74b00b3a40 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74b4c00640 1 -- 172.21.15.33:0/3360553364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 msgr2=0x7f74b00b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74b4c00640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b00b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74b4c00640 1 -- 172.21.15.33:0/3360553364 >> v1:172.21.15.33:6789/0 conn(0x7f74b00b3a40 legacy=0x7f74b01428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.905+0000 7f74b4c00640 1 -- 172.21.15.33:0/3360553364 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0160910 con 0x7f74b00b2e90 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.906+0000 7f74b4c00640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b2e90 0x7f74b00ac870 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d7865088094de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74aea00640 1 -- 172.21.15.33:0/3360553364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8031600 con 0x7f74b00b2e90 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74aea00640 1 -- 172.21.15.33:0/3360553364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a802d050 con 0x7f74b00b2e90 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74aea00640 1 -- 172.21.15.33:0/3360553364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8031980 con 0x7f74b00b2e90 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 -- 172.21.15.33:0/3360553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b2e90 msgr2=0x7f74b00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b2e90 0x7f74b00ac870 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a802a5d0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 -- 172.21.15.33:0/3360553364 shutdown_connections 2024-09-13T19:01:25.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b00b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 --2- 172.21.15.33:0/3360553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b2e90 0x7f74b00ac870 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 -- 172.21.15.33:0/3360553364 >> 172.21.15.33:0/3360553364 conn(0x7f74b00b0510 msgr2=0x7f74b00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 -- 172.21.15.33:0/3360553364 shutdown_connections 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.907+0000 7f74b6c00640 1 -- 172.21.15.33:0/3360553364 wait complete. 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.909+0000 7f74b6c00640 1 Processor -- start 2024-09-13T19:01:25.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.909+0000 7f74b6c00640 1 -- start start 2024-09-13T19:01:25.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 0x7f74b0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b01f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b01543c0 con 0x7f74b00b3a40 2024-09-13T19:01:25.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b01f5e20 con 0x7f74b00b2e90 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.910+0000 7f74b6c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0139650 con 0x7f74b0160370 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41230/0 (socket says 172.21.15.33:41230) 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 -- 172.21.15.33:0/197583129 learned_addr learned my addr 172.21.15.33:0/197583129 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74afe00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 0x7f74b0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74b4c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b01f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 -- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 msgr2=0x7f74b01f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b01f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 -- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 msgr2=0x7f74b0153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 0x7f74b0153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 -- 172.21.15.33:0/197583129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009a70 con 0x7f74b00b3a40 2024-09-13T19:01:25.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74afe00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 0x7f74b0153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.911+0000 7f74af400640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f749c00e870 tx=0x7f749c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.912+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0094f0 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.912+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00c940 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.912+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00ccf0 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.912+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b01545f0 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.912+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b0154bb0 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.913+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b00ad140 con 0x7f74b00b3a40 2024-09-13T19:01:25.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.914+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f749c013470 con 0x7f74b00b3a40 2024-09-13T19:01:25.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.914+0000 7f74a7e00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:25.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.915+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f749c0894a0 con 0x7f74b00b3a40 2024-09-13T19:01:25.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.915+0000 7f74afe00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:25.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.916+0000 7f74afe00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 0x7f749006d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f74a00011e0 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:25.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:25.919+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f749c0545e0 con 0x7f74b00b3a40 2024-09-13T19:01:26.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.098+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b00ce4d0 con 0x7f74b00b3a40 2024-09-13T19:01:26.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.099+0000 7f74a7e00640 1 -- 172.21.15.33:0/197583129 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f749c057c00 con 0x7f74b00b3a40 2024-09-13T19:01:26.103 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:26.103 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:26.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 msgr2=0x7f749006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 0x7f749006d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f74a00011e0 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2024-09-13T19:01:26.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 msgr2=0x7f74b0139110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f749c00e870 tx=0x7f749c00ed30 comp rx=0 tx=0).stop 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 shutdown_connections 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b0160370 0x7f74b01f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b00b3a40 0x7f74b0139110 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 --2- 172.21.15.33:0/197583129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b00b2e90 0x7f74b0153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 >> 172.21.15.33:0/197583129 conn(0x7f74b00b0510 msgr2=0x7f74b00afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.101+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 shutdown_connections 2024-09-13T19:01:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.102+0000 7f74b6c00640 1 -- 172.21.15.33:0/197583129 wait complete. 2024-09-13T19:01:26.121 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T19:01:26.121 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.274+0000 7fa77e200640 1 Processor -- start 2024-09-13T19:01:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.275+0000 7fa77e200640 1 -- start start 2024-09-13T19:01:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa77e200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 0x7fa778159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa77e200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa778159fc0 con 0x7fa77806f660 2024-09-13T19:01:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa77e200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa778153f00 con 0x7fa778153b20 2024-09-13T19:01:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa77e200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b3df0 con 0x7fa7780b3990 2024-09-13T19:01:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa777e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa77806f660 0x7fa77806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43028/0 (socket says 172.21.15.33:43028) 2024-09-13T19:01:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa777e00640 1 -- 172.21.15.33:0/1283281126 learned_addr learned my addr 172.21.15.33:0/1283281126 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.276+0000 7fa76ea00640 1 --2- 172.21.15.33:0/1283281126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 0x7fa778159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797711898 0 0) 0x7fa778159fc0 con 0x7fa77806f660 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa75c003520 con 0x7fa77806f660 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221970853 0 0) 0x7fa778153f00 con 0x7fa778153b20 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa778159fc0 con 0x7fa778153b20 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa76ea00640 1 -- 172.21.15.33:0/1283281126 >> v1:172.21.15.103:6789/0 conn(0x7fa778153b20 legacy=0x7fa7780b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa76ea00640 1 -- 172.21.15.33:0/1283281126 >> v1:172.21.15.33:6789/0 conn(0x7fa77806f660 legacy=0x7fa77806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.277+0000 7fa76ea00640 1 -- 172.21.15.33:0/1283281126 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780b1a40 con 0x7fa7780b3990 2024-09-13T19:01:26.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.278+0000 7fa76ea00640 1 --2- 172.21.15.33:0/1283281126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 0x7fa778159a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097d0 tx=0x7fa76002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25c2c3e994e8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.278+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760032440 con 0x7fa7780b3990 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.278+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7600325a0 con 0x7fa7780b3990 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.278+0000 7fa776a00640 1 -- 172.21.15.33:0/1283281126 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760032930 con 0x7fa7780b3990 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 -- 172.21.15.33:0/1283281126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 msgr2=0x7fa778159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 --2- 172.21.15.33:0/1283281126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 0x7fa778159a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097d0 tx=0x7fa76002a210 comp rx=0 tx=0).stop 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 -- 172.21.15.33:0/1283281126 shutdown_connections 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 --2- 172.21.15.33:0/1283281126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa7780b3990 0x7fa778159a80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 -- 172.21.15.33:0/1283281126 >> 172.21.15.33:0/1283281126 conn(0x7fa7780b0510 msgr2=0x7fa7780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:26.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 -- 172.21.15.33:0/1283281126 shutdown_connections 2024-09-13T19:01:26.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.279+0000 7fa77e200640 1 -- 172.21.15.33:0/1283281126 wait complete. 2024-09-13T19:01:26.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.281+0000 7fa77e200640 1 Processor -- start 2024-09-13T19:01:26.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.281+0000 7fa77e200640 1 -- start start 2024-09-13T19:01:26.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 0x7fa77814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa778153b20 0x7fa778152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77814f710 con 0x7fa7780b3990 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77814cbb0 con 0x7fa778153b20 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa77e200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77814ea90 con 0x7fa77806f660 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa76ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa76ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41242/0 (socket says 172.21.15.33:41242) 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa76ea00640 1 -- 172.21.15.33:0/786787517 learned_addr learned my addr 172.21.15.33:0/786787517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa777e00640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa778153b20 0x7fa778152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.282+0000 7fa777400640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 0x7fa77814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 -- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 msgr2=0x7fa77814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 0x7fa77814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 -- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa778153b20 msgr2=0x7fa778152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa778153b20 0x7fa778152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 -- 172.21.15.33:0/786787517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760009400 con 0x7fa7780b3990 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa777400640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 0x7fa77814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76ea00640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fa760035040 tx=0x7fa7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76003d8f0 con 0x7fa7780b3990 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76003da70 con 0x7fa7780b3990 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76003de20 con 0x7fa7780b3990 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77814ed70 con 0x7fa7780b3990 2024-09-13T19:01:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.283+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77814f330 con 0x7fa7780b3990 2024-09-13T19:01:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.284+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77814f4f0 con 0x7fa7780b3990 2024-09-13T19:01:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.285+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa760039040 con 0x7fa7780b3990 2024-09-13T19:01:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.286+0000 7fa76fe00640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 0x7fa75406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.286+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7600a9dc0 con 0x7fa7780b3990 2024-09-13T19:01:26.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.287+0000 7fa777400640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 0x7fa75406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.288+0000 7fa777400640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 0x7fa75406d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa7680011e0 tx=0x7fa768009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.291+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa760074f90 con 0x7fa7780b3990 2024-09-13T19:01:26.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.505+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7780ae1f0 con 0x7fa7780b3990 2024-09-13T19:01:26.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.505+0000 7fa76fe00640 1 -- 172.21.15.33:0/786787517 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fa7600785b0 con 0x7fa7780b3990 2024-09-13T19:01:26.509 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:26.509 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:26.510 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 msgr2=0x7fa75406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 0x7fa75406d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa7680011e0 tx=0x7fa768009040 comp rx=0 tx=0).stop 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 msgr2=0x7fa778152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fa760035040 tx=0x7fa7600046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 shutdown_connections 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa75406ac00 0x7fa75406d0c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa778153b20 0x7fa778152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780b3990 0x7fa778152230 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 --2- 172.21.15.33:0/786787517 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa77806f660 0x7fa77814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 >> 172.21.15.33:0/786787517 conn(0x7fa7780b0510 msgr2=0x7fa7780cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:26.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.507+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 shutdown_connections 2024-09-13T19:01:26.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.508+0000 7fa77e200640 1 -- 172.21.15.33:0/786787517 wait complete. 2024-09-13T19:01:26.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:01:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.678+0000 7f33d6a00640 1 Processor -- start 2024-09-13T19:01:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.679+0000 7f33d6a00640 1 -- start start 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f33d0159480 0x7f33d00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d006f4b0 0x7f33d0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00717c0 con 0x7f33d0071390 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00cd850 con 0x7f33d0159480 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00cd570 con 0x7f33d006f4b0 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f33d0071390 0x7f33d015ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43044/0 (socket says 172.21.15.33:43044) 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d6000640 1 -- 172.21.15.33:0/3205498950 learned_addr learned my addr 172.21.15.33:0/3205498950 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d5600640 1 --2- 172.21.15.33:0/3205498950 >> v2:172.21.15.103:3300/0 conn(0x7f33d0159480 0x7f33d00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.680+0000 7f33d4c00640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d006f4b0 0x7f33d0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.681+0000 7f33d5600640 1 -- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d006f4b0 msgr2=0x7f33d0070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:26.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.681+0000 7f33d5600640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d006f4b0 0x7f33d0070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.681+0000 7f33d5600640 1 -- 172.21.15.33:0/3205498950 >> v1:172.21.15.33:6789/0 conn(0x7f33d0071390 legacy=0x7f33d015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.681+0000 7f33cfe00640 1 -- 172.21.15.33:0/3205498950 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548552955 0 0) 0x7f33d00717c0 con 0x7f33d0071390 2024-09-13T19:01:26.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.681+0000 7f33d5600640 1 -- 172.21.15.33:0/3205498950 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00b1740 con 0x7f33d0159480 2024-09-13T19:01:26.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.682+0000 7f33d5600640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0159480 0x7f33d00ccf90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097a0 tx=0x7f33c402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5399093f7a2e193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.682+0000 7f33cfe00640 1 -- 172.21.15.33:0/3205498950 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c402ae40 con 0x7f33d0159480 2024-09-13T19:01:26.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.682+0000 7f33cfe00640 1 -- 172.21.15.33:0/3205498950 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4032440 con 0x7f33d0159480 2024-09-13T19:01:26.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.682+0000 7f33cfe00640 1 -- 172.21.15.33:0/3205498950 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40327d0 con 0x7f33d0159480 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 -- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0159480 msgr2=0x7f33d00ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0159480 0x7f33d00ccf90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097a0 tx=0x7f33c402a0f0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 -- 172.21.15.33:0/3205498950 shutdown_connections 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d006f4b0 0x7f33d0070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 --2- 172.21.15.33:0/3205498950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0159480 0x7f33d00ccf90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 -- 172.21.15.33:0/3205498950 >> 172.21.15.33:0/3205498950 conn(0x7f33d00ae310 msgr2=0x7f33d00ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 -- 172.21.15.33:0/3205498950 shutdown_connections 2024-09-13T19:01:26.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.683+0000 7f33d6a00640 1 -- 172.21.15.33:0/3205498950 wait complete. 2024-09-13T19:01:26.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.685+0000 7f33d6a00640 1 Processor -- start 2024-09-13T19:01:26.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.685+0000 7f33d6a00640 1 -- start start 2024-09-13T19:01:26.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0071390 0x7f33d014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d0159480 0x7f33d00c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00c45c0 con 0x7f33d006f4b0 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d01f64a0 con 0x7f33d0071390 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00c39b0 con 0x7f33d0159480 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d5600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d5600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41248/0 (socket says 172.21.15.33:41248) 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d5600640 1 -- 172.21.15.33:0/857662163 learned_addr learned my addr 172.21.15.33:0/857662163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d4c00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0071390 0x7f33d014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.686+0000 7f33d6000640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d0159480 0x7f33d00c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 -- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d0159480 msgr2=0x7f33d00c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d0159480 0x7f33d00c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 -- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0071390 msgr2=0x7f33d014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0071390 0x7f33d014efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 -- 172.21.15.33:0/857662163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009400 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d5600640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f33c4035040 tx=0x7f33c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c403d8f0 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c403da70 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c403de20 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00c3c90 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.687+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00c4250 con 0x7f33d006f4b0 2024-09-13T19:01:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.688+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d0067360 con 0x7f33d006f4b0 2024-09-13T19:01:26.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.689+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33c4039040 con 0x7f33d006f4b0 2024-09-13T19:01:26.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.690+0000 7f33cd600640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 0x7f33b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:26.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.690+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33c40a9c40 con 0x7f33d006f4b0 2024-09-13T19:01:26.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.691+0000 7f33d4c00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 0x7f33b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:26.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.691+0000 7f33d4c00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 0x7f33b006d0c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f33d00cb2e0 tx=0x7f33bc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:26.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.694+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33c4074f50 con 0x7f33d006f4b0 2024-09-13T19:01:26.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.913+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33d00ccf90 con 0x7f33d006f4b0 2024-09-13T19:01:26.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.914+0000 7f33cd600640 1 -- 172.21.15.33:0/857662163 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f33c4078570 con 0x7f33d006f4b0 2024-09-13T19:01:26.917 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:26.917 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T19:01:03.861712+0000","modified":"2024-09-13T19:01:06.874381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7140":{"gid":7140,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/1677185776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1677185776},{"type":"v1","addr":"172.21.15.33:6834","nonce":1677185776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T19:01:26.918 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 55 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 msgr2=0x7f33b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 0x7f33b006d0c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f33d00cb2e0 tx=0x7f33bc009190 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 msgr2=0x7f33d01f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f33c4035040 tx=0x7f33c40046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 shutdown_connections 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f33b006ac00 0x7f33b006d0c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33d0159480 0x7f33d00c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33d0071390 0x7f33d014efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 --2- 172.21.15.33:0/857662163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33d006f4b0 0x7f33d01f5f60 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 >> 172.21.15.33:0/857662163 conn(0x7f33d00ae310 msgr2=0x7f33d00cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 shutdown_connections 2024-09-13T19:01:26.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:26.916+0000 7f33d6a00640 1 -- 172.21.15.33:0/857662163 wait complete. 2024-09-13T19:01:26.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:27.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.087+0000 7f2b26e00640 1 Processor -- start 2024-09-13T19:01:27.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.087+0000 7f2b26e00640 1 -- start start 2024-09-13T19:01:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b2015a5c0 0x7f2b200b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b2015b9b0 0x7f2b200b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b200cbfc0 con 0x7f2b200cbac0 2024-09-13T19:01:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b200cce20 con 0x7f2b2015b9b0 2024-09-13T19:01:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b200707a0 con 0x7f2b2015a5c0 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b2015b9b0 0x7f2b200b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b2015b9b0 0x7f2b200b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41260/0 (socket says 172.21.15.33:41260) 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b26400640 1 -- 172.21.15.33:0/1157380433 learned_addr learned my addr 172.21.15.33:0/1157380433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.089+0000 7f2b25a00640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b2015a5c0 0x7f2b200b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.090+0000 7f2b26400640 1 -- 172.21.15.33:0/1157380433 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b2015a5c0 msgr2=0x7f2b200b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.090+0000 7f2b26400640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b2015a5c0 0x7f2b200b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.090+0000 7f2b26400640 1 -- 172.21.15.33:0/1157380433 >> v1:172.21.15.103:6789/0 conn(0x7f2b200cbac0 legacy=0x7f2b2006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.090+0000 7f2b26400640 1 -- 172.21.15.33:0/1157380433 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20070a80 con 0x7f2b2015b9b0 2024-09-13T19:01:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.090+0000 7f2b26400640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b200b3ef0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009e50 tx=0x7f2b1802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e401af8745528e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b1fe00640 1 -- 172.21.15.33:0/1157380433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1802aea0 con 0x7f2b2015b9b0 2024-09-13T19:01:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b1fe00640 1 -- 172.21.15.33:0/1157380433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1802d050 con 0x7f2b2015b9b0 2024-09-13T19:01:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b1fe00640 1 -- 172.21.15.33:0/1157380433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18031820 con 0x7f2b2015b9b0 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 -- 172.21.15.33:0/1157380433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 msgr2=0x7f2b200b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b200b3ef0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009e50 tx=0x7f2b1802a680 comp rx=0 tx=0).stop 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 -- 172.21.15.33:0/1157380433 shutdown_connections 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b200b3ef0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 --2- 172.21.15.33:0/1157380433 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b2015a5c0 0x7f2b200b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 -- 172.21.15.33:0/1157380433 >> 172.21.15.33:0/1157380433 conn(0x7f2b200ae310 msgr2=0x7f2b200ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 -- 172.21.15.33:0/1157380433 shutdown_connections 2024-09-13T19:01:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.091+0000 7f2b26e00640 1 -- 172.21.15.33:0/1157380433 wait complete. 2024-09-13T19:01:27.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.093+0000 7f2b26e00640 1 Processor -- start 2024-09-13T19:01:27.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.093+0000 7f2b26e00640 1 -- start start 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b2015a5c0 0x7f2b2006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b2006c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201f0290 con 0x7f2b2015b9b0 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201ef9c0 con 0x7f2b2015a5c0 2024-09-13T19:01:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b201f3ec0 con 0x7f2b200cbac0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b26400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b2006c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b25a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b25a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:58000/0 (socket says 172.21.15.33:58000) 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.094+0000 7f2b25a00640 1 -- 172.21.15.33:0/956833103 learned_addr learned my addr 172.21.15.33:0/956833103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25000640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b2015a5c0 0x7f2b2006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 -- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b2015a5c0 msgr2=0x7f2b2006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b2015a5c0 0x7f2b2006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 -- 172.21.15.33:0/956833103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 msgr2=0x7f2b2006c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b2006c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 -- 172.21.15.33:0/956833103 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18009b30 con 0x7f2b200cbac0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b26400640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b2006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.095+0000 7f2b25a00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400d800 tx=0x7f2b1400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.096+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400b6c0 con 0x7f2b200cbac0 2024-09-13T19:01:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.096+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1400b820 con 0x7f2b200cbac0 2024-09-13T19:01:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.096+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400bbb0 con 0x7f2b200cbac0 2024-09-13T19:01:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.096+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b201f3be0 con 0x7f2b200cbac0 2024-09-13T19:01:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.096+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b201efeb0 con 0x7f2b200cbac0 2024-09-13T19:01:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.097+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b20067360 con 0x7f2b200cbac0 2024-09-13T19:01:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.098+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b1400bd10 con 0x7f2b200cbac0 2024-09-13T19:01:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.099+0000 7f2b1d600640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 0x7f2b0006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.099+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b14089780 con 0x7f2b200cbac0 2024-09-13T19:01:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.099+0000 7f2b25000640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 0x7f2b0006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.100+0000 7f2b25000640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 0x7f2b0006d0f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2b20151b10 tx=0x7f2b0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.104+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b14054a10 con 0x7f2b200cbac0 2024-09-13T19:01:27.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.287+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b200a8800 con 0x7f2b200cbac0 2024-09-13T19:01:27.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.288+0000 7f2b1d600640 1 -- 172.21.15.33:0/956833103 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f2b14058030 con 0x7f2b200cbac0 2024-09-13T19:01:27.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:27.292 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:04.864171+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T19:01:01.723106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T19:01:02.852976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 msgr2=0x7f2b0006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 0x7f2b0006d0f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2b20151b10 tx=0x7f2b0c009040 comp rx=0 tx=0).stop 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 msgr2=0x7f2b20153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400d800 tx=0x7f2b1400dcc0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 shutdown_connections 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2b0006ac30 0x7f2b0006d0f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b2015b9b0 0x7f2b2006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b2015a5c0 0x7f2b2006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 --2- 172.21.15.33:0/956833103 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2b200cbac0 0x7f2b20153790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.290+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 >> 172.21.15.33:0/956833103 conn(0x7f2b200ae310 msgr2=0x7f2b200aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.291+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 shutdown_connections 2024-09-13T19:01:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.291+0000 7f2b26e00640 1 -- 172.21.15.33:0/956833103 wait complete. 2024-09-13T19:01:27.309 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T19:01:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.464+0000 7fd144c00640 1 Processor -- start 2024-09-13T19:01:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.464+0000 7fd144c00640 1 -- start start 2024-09-13T19:01:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.465+0000 7fd144c00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd140151590 0x7fd14006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.465+0000 7fd144c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1400cba50 0x7fd1400cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.465+0000 7fd144c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400cc3a0 con 0x7fd1400b1b30 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.465+0000 7fd144c00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400ce4b0 con 0x7fd140151590 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.465+0000 7fd144c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400b2270 con 0x7fd1400cba50 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd140151590 0x7fd14006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd140151590 0x7fd14006b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41266/0 (socket says 172.21.15.33:41266) 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 -- 172.21.15.33:0/656397121 learned_addr learned my addr 172.21.15.33:0/656397121 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 -- 172.21.15.33:0/656397121 >> v2:172.21.15.103:3300/0 conn(0x7fd1400cba50 msgr2=0x7fd1400cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 --2- 172.21.15.33:0/656397121 >> v2:172.21.15.103:3300/0 conn(0x7fd1400cba50 0x7fd1400cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 -- 172.21.15.33:0/656397121 >> v1:172.21.15.103:6789/0 conn(0x7fd1400b1b30 legacy=0x7fd1400cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.466+0000 7fd13de00640 1 -- 172.21.15.33:0/656397121 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400b2550 con 0x7fd140151590 2024-09-13T19:01:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.467+0000 7fd13de00640 1 --2- 172.21.15.33:0/656397121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd140151590 0x7fd14006b370 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd14015aab0 tx=0x7fd13002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a4b3e43fd7e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.467+0000 7fd13ca00640 1 -- 172.21.15.33:0/656397121 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130032440 con 0x7fd140151590 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.467+0000 7fd13ca00640 1 -- 172.21.15.33:0/656397121 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300325a0 con 0x7fd140151590 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.467+0000 7fd13ca00640 1 -- 172.21.15.33:0/656397121 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130032930 con 0x7fd140151590 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 -- 172.21.15.33:0/656397121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd140151590 msgr2=0x7fd14006b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 --2- 172.21.15.33:0/656397121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd140151590 0x7fd14006b370 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd14015aab0 tx=0x7fd13002a230 comp rx=0 tx=0).stop 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 -- 172.21.15.33:0/656397121 shutdown_connections 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 --2- 172.21.15.33:0/656397121 >> v2:172.21.15.103:3300/0 conn(0x7fd1400cba50 0x7fd1400cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 --2- 172.21.15.33:0/656397121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd140151590 0x7fd14006b370 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 -- 172.21.15.33:0/656397121 >> 172.21.15.33:0/656397121 conn(0x7fd1400b0510 msgr2=0x7fd1400b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 -- 172.21.15.33:0/656397121 shutdown_connections 2024-09-13T19:01:27.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.468+0000 7fd144c00640 1 -- 172.21.15.33:0/656397121 wait complete. 2024-09-13T19:01:27.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.470+0000 7fd144c00640 1 Processor -- start 2024-09-13T19:01:27.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.470+0000 7fd144c00640 1 -- start start 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1400cba50 0x7fd1400aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd140151590 0x7fd1400af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401529b0 con 0x7fd1400b1b30 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015ef50 con 0x7fd140151590 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd144c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015e6f0 con 0x7fd1400cba50 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41282/0 (socket says 172.21.15.33:41282) 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 -- 172.21.15.33:0/3890939632 learned_addr learned my addr 172.21.15.33:0/3890939632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13d400640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1400cba50 0x7fd1400aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13e800640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd140151590 0x7fd1400af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 -- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1400cba50 msgr2=0x7fd1400aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1400cba50 0x7fd1400aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 -- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd140151590 msgr2=0x7fd1400af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd140151590 0x7fd1400af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.471+0000 7fd13de00640 1 -- 172.21.15.33:0/3890939632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300094d0 con 0x7fd1400b1b30 2024-09-13T19:01:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd13de00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c00 tx=0x7fd1300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130032440 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130030b80 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14015e990 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13003b400 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.472+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14015ec00 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.473+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400cd1e0 con 0x7fd1400b1b30 2024-09-13T19:01:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.474+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd130039040 con 0x7fd1400b1b30 2024-09-13T19:01:27.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.475+0000 7fd136000640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.475+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1300a9d10 con 0x7fd1400b1b30 2024-09-13T19:01:27.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.476+0000 7fd13d400640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.476+0000 7fd13d400640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 0x7fd12006d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007fd0 tx=0x7fd12c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.479+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd1300af020 con 0x7fd1400b1b30 2024-09-13T19:01:27.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.694+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1400cbe60 con 0x7fd1400b1b30 2024-09-13T19:01:27.698 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-09-13T19:01:27.695+0000 7f45fc000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T19:01:27.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.703+0000 7fd136000640 1 -- 172.21.15.33:0/3890939632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd130037090 con 0x7fd1400b1b30 2024-09-13T19:01:27.707 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T19:01:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 msgr2=0x7fd12006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 0x7fd12006d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007fd0 tx=0x7fd12c009040 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 msgr2=0x7fd14014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c00 tx=0x7fd1300046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 shutdown_connections 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd140151590 0x7fd1400af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd1400cba50 0x7fd1400aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 --2- 172.21.15.33:0/3890939632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1400b1b30 0x7fd14014e240 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 >> 172.21.15.33:0/3890939632 conn(0x7fd1400b0510 msgr2=0x7fd14006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 shutdown_connections 2024-09-13T19:01:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.706+0000 7fd144c00640 1 -- 172.21.15.33:0/3890939632 wait complete. 2024-09-13T19:01:27.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T19:01:27.774 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-09-13T19:01:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.882+0000 7fee8f600640 1 Processor -- start 2024-09-13T19:01:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.883+0000 7fee8f600640 1 -- start start 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8f600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee880cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8f600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee880cd400 0x7fee880d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8f600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880ce7a0 con 0x7fee880d11e0 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8f600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee880d1690 con 0x7fee880cd400 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8f600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee880d0230 con 0x7fee8815c9e0 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee880cd400 0x7fee880d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee87e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee880cd400 0x7fee880d0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41320/0 (socket says 172.21.15.33:41320) 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8d600640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fee880d11e0 0x7fee880d2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:53314/0 (socket says 172.21.15.33:53314) 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee87e00640 1 -- 172.21.15.33:0/3345426365 learned_addr learned my addr 172.21.15.33:0/3345426365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.884+0000 7fee8cc00640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee880cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.885+0000 7fee87e00640 1 -- 172.21.15.33:0/3345426365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 msgr2=0x7fee880cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:27.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.885+0000 7fee87e00640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee880cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.885+0000 7fee87e00640 1 -- 172.21.15.33:0/3345426365 >> v1:172.21.15.103:6789/0 conn(0x7fee880d11e0 legacy=0x7fee880d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.885+0000 7fee87e00640 1 -- 172.21.15.33:0/3345426365 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880cec30 con 0x7fee880cd400 2024-09-13T19:01:27.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.886+0000 7fee87e00640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880cd400 0x7fee880d0ca0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fee74009870 tx=0x7fee7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8b5dc67b4660e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.886+0000 7fee87400640 1 -- 172.21.15.33:0/3345426365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032440 con 0x7fee880cd400 2024-09-13T19:01:27.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.886+0000 7fee87400640 1 -- 172.21.15.33:0/3345426365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740325a0 con 0x7fee880cd400 2024-09-13T19:01:27.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.886+0000 7fee87400640 1 -- 172.21.15.33:0/3345426365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032930 con 0x7fee880cd400 2024-09-13T19:01:27.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 -- 172.21.15.33:0/3345426365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880cd400 msgr2=0x7fee880d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880cd400 0x7fee880d0ca0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fee74009870 tx=0x7fee7402a270 comp rx=0 tx=0).stop 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 -- 172.21.15.33:0/3345426365 shutdown_connections 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880cd400 0x7fee880d0ca0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 --2- 172.21.15.33:0/3345426365 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee880cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 -- 172.21.15.33:0/3345426365 >> 172.21.15.33:0/3345426365 conn(0x7fee8808bfc0 msgr2=0x7fee8808c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 -- 172.21.15.33:0/3345426365 shutdown_connections 2024-09-13T19:01:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.887+0000 7fee8f600640 1 -- 172.21.15.33:0/3345426365 wait complete. 2024-09-13T19:01:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.889+0000 7fee8f600640 1 Processor -- start 2024-09-13T19:01:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.889+0000 7fee8f600640 1 -- start start 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee880cd400 0x7fee8815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee88152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8815f5f0 con 0x7fee880d11e0 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8815e010 con 0x7fee880cd400 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8f600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8815e2f0 con 0x7fee8815c9e0 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee87e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41332/0 (socket says 172.21.15.33:41332) 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee880cd400 0x7fee8815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee87e00640 1 -- 172.21.15.33:0/2349186677 learned_addr learned my addr 172.21.15.33:0/2349186677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.890+0000 7fee8d600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee88152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 -- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 msgr2=0x7fee88152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee88152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 -- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee880cd400 msgr2=0x7fee8815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee880cd400 0x7fee8815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 -- 172.21.15.33:0/2349186677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740094d0 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee87e00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fee74000c00 tx=0x7fee740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.891+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74032440 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.892+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74030980 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.892+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74030d30 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.892+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8815e5d0 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.892+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8815eb90 con 0x7fee880d11e0 2024-09-13T19:01:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.893+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8815e430 con 0x7fee880d11e0 2024-09-13T19:01:27.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.894+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee74039040 con 0x7fee880d11e0 2024-09-13T19:01:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.895+0000 7fee84c00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.895+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fee740a9cf0 con 0x7fee880d11e0 2024-09-13T19:01:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.895+0000 7fee8cc00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.896+0000 7fee8cc00640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 0x7fee6806d0c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009aa0 tx=0x7fee7c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:27.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:27.899+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fee8815e430 con 0x7fee880d11e0 2024-09-13T19:01:28.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.118+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fee8815e430 con 0x7fee880d11e0 2024-09-13T19:01:28.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.706+0000 7fee84c00640 1 -- 172.21.15.33:0/2349186677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee8815e430 con 0x7fee880d11e0 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 msgr2=0x7fee6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 0x7fee6806d0c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009aa0 tx=0x7fee7c009190 comp rx=0 tx=0).stop 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 msgr2=0x7fee881521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fee74000c00 tx=0x7fee740046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 shutdown_connections 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fee6806ac00 0x7fee6806d0c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee8815c9e0 0x7fee88152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee880d11e0 0x7fee881521a0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 --2- 172.21.15.33:0/2349186677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee880cd400 0x7fee8815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.708+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 >> 172.21.15.33:0/2349186677 conn(0x7fee8808bfc0 msgr2=0x7fee8806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:28.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.709+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 shutdown_connections 2024-09-13T19:01:28.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.709+0000 7fee8f600640 1 -- 172.21.15.33:0/2349186677 wait complete. 2024-09-13T19:01:28.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T19:01:28.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.888+0000 7f85cf200640 1 Processor -- start 2024-09-13T19:01:28.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.888+0000 7f85cf200640 1 -- start start 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85cf200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85d006ffc0 0x7f85d00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85cf200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00cc940 con 0x7f85d006f800 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85cf200640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d015e350 con 0x7f85d00703a0 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85cf200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d006cc20 con 0x7f85d006ffc0 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85c5400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f85d006f800 0x7f85d015d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43072/0 (socket says 172.21.15.33:43072) 2024-09-13T19:01:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85c5400640 1 -- 172.21.15.33:0/4272843502 learned_addr learned my addr 172.21.15.33:0/4272843502 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:28.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.889+0000 7f85cde00640 1 --2- 172.21.15.33:0/4272843502 >> v2:172.21.15.103:3300/0 conn(0x7f85d006ffc0 0x7f85d00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:28.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.890+0000 7f85cd400640 1 -- 172.21.15.33:0/4272843502 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165811572 0 0) 0x7f85d00cc940 con 0x7f85d006f800 2024-09-13T19:01:28.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.890+0000 7f85cd400640 1 -- 172.21.15.33:0/4272843502 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4005730 con 0x7f85d006f800 2024-09-13T19:01:28.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.890+0000 7f85cde00640 1 -- 172.21.15.33:0/4272843502 >> v1:172.21.15.103:6789/0 conn(0x7f85d00703a0 legacy=0x7f85d015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.890+0000 7f85cde00640 1 -- 172.21.15.33:0/4272843502 >> v1:172.21.15.33:6789/0 conn(0x7f85d006f800 legacy=0x7f85d015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.890+0000 7f85cde00640 1 -- 172.21.15.33:0/4272843502 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d006cf00 con 0x7f85d006ffc0 2024-09-13T19:01:28.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.891+0000 7f85cde00640 1 --2- 172.21.15.33:0/4272843502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006ffc0 0x7f85d00ca9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a409464a2d8be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:28.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.891+0000 7f85cd400640 1 -- 172.21.15.33:0/4272843502 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0032440 con 0x7f85d006ffc0 2024-09-13T19:01:28.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.891+0000 7f85cd400640 1 -- 172.21.15.33:0/4272843502 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00325a0 con 0x7f85d006ffc0 2024-09-13T19:01:28.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.891+0000 7f85cd400640 1 -- 172.21.15.33:0/4272843502 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0032930 con 0x7f85d006ffc0 2024-09-13T19:01:28.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 -- 172.21.15.33:0/4272843502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006ffc0 msgr2=0x7f85d00ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 --2- 172.21.15.33:0/4272843502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006ffc0 0x7f85d00ca9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097a0 tx=0x7f85c002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 -- 172.21.15.33:0/4272843502 shutdown_connections 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 --2- 172.21.15.33:0/4272843502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006ffc0 0x7f85d00ca9a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 -- 172.21.15.33:0/4272843502 >> 172.21.15.33:0/4272843502 conn(0x7f85d00b0300 msgr2=0x7f85d00b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 -- 172.21.15.33:0/4272843502 shutdown_connections 2024-09-13T19:01:28.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.892+0000 7f85cf200640 1 -- 172.21.15.33:0/4272843502 wait complete. 2024-09-13T19:01:28.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.894+0000 7f85cf200640 1 Processor -- start 2024-09-13T19:01:28.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.894+0000 7f85cf200640 1 -- start start 2024-09-13T19:01:28.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 0x7f85d015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85d00703a0 0x7f85d0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d015cbc0 con 0x7f85d006ffc0 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d015bf40 con 0x7f85d006f800 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cf200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d015c220 con 0x7f85d00703a0 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85c5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 0x7f85d015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85c5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41348/0 (socket says 172.21.15.33:41348) 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85cde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 0x7f85d015b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:49140/0 (socket says 172.21.15.33:49140) 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85c5400640 1 -- 172.21.15.33:0/3759917753 learned_addr learned my addr 172.21.15.33:0/3759917753 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.895+0000 7f85ce800640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85d00703a0 0x7f85d0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 -- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85d00703a0 msgr2=0x7f85d0152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85d00703a0 0x7f85d0152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 -- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 msgr2=0x7f85d015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 0x7f85d015b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 -- 172.21.15.33:0/3759917753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009400 con 0x7f85d006ffc0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c5400640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c500 tx=0x7f85b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8005ce0 con 0x7f85d006ffc0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8005e40 con 0x7f85d006ffc0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8007330 con 0x7f85d006ffc0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d015c500 con 0x7f85d006ffc0 2024-09-13T19:01:28.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.896+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00c9210 con 0x7f85d006ffc0 2024-09-13T19:01:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.897+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d015cd00 con 0x7f85d006ffc0 2024-09-13T19:01:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.898+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b8007550 con 0x7f85d006ffc0 2024-09-13T19:01:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.900+0000 7f85c6a00640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.900+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f85b8088980 con 0x7f85d006ffc0 2024-09-13T19:01:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.900+0000 7f85cde00640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.901+0000 7f85cde00640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 0x7f85ac06d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f85c0034000 tx=0x7f85c002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:28.904+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85d015cd00 con 0x7f85d006ffc0 2024-09-13T19:01:29.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.085+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85d015cd00 con 0x7f85d006ffc0 2024-09-13T19:01:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.711+0000 7f85c6a00640 1 -- 172.21.15.33:0/3759917753 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85d015cd00 con 0x7f85d006ffc0 2024-09-13T19:01:29.715 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-13T19:01:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 msgr2=0x7f85ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 0x7f85ac06d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f85c0034000 tx=0x7f85c002e000 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 msgr2=0x7f85d00c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c500 tx=0x7f85b800c9c0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 shutdown_connections 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f85d00703a0 0x7f85d0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d006ffc0 0x7f85d00c8cd0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 --2- 172.21.15.33:0/3759917753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d006f800 0x7f85d015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 >> 172.21.15.33:0/3759917753 conn(0x7f85d00b0300 msgr2=0x7f85d01567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.715+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 shutdown_connections 2024-09-13T19:01:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.716+0000 7f85cf200640 1 -- 172.21.15.33:0/3759917753 wait complete. 2024-09-13T19:01:29.739 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T19:01:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.905+0000 7f7797c00640 1 Processor -- start 2024-09-13T19:01:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.905+0000 7f7797c00640 1 -- start start 2024-09-13T19:01:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7797c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77900b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7797c00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f77900cd870 0x7f77900cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7797c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7790151a20 con 0x7f779006cd60 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7797c00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900cc430 con 0x7f77900cd870 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7797c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900b1bb0 con 0x7f779015b770 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7795200640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f779006cd60 0x7f77900cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43082/0 (socket says 172.21.15.33:43082) 2024-09-13T19:01:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.906+0000 7f7795200640 1 -- 172.21.15.33:0/2196095571 learned_addr learned my addr 172.21.15.33:0/2196095571 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778fe00640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77900b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f7795c00640 1 --2- 172.21.15.33:0/2196095571 >> v2:172.21.15.103:3300/0 conn(0x7f77900cd870 0x7f77900cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150362575 0 0) 0x7f7790151a20 con 0x7f779006cd60 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7778003520 con 0x7f779006cd60 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242964643 0 0) 0x7f7778003520 con 0x7f779006cd60 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 msgr2=0x7f77900b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77900b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 >> v2:172.21.15.103:3300/0 conn(0x7f77900cd870 msgr2=0x7f77900cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 --2- 172.21.15.33:0/2196095571 >> v2:172.21.15.103:3300/0 conn(0x7f77900cd870 0x7f77900cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900b1e70 con 0x7f779006cd60 2024-09-13T19:01:29.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7f7784001670 con 0x7f779006cd60 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 >> v1:172.21.15.33:6789/0 conn(0x7f779006cd60 legacy=0x7f77900cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7778003970 0x7f7778003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778004d00 0x7f7778005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900cc430 con 0x7f7778004d00 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900b1bb0 con 0x7f7778003970 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.907+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777800b980 con 0x7f779015b770 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7778003970 0x7f7778003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795c00640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778004d00 0x7f7778005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f778fe00640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 -- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 msgr2=0x7f77780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f779015b770 0x7f77780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 -- 172.21.15.33:0/2196095571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778004d00 msgr2=0x7f7778005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778004d00 0x7f7778005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795200640 1 -- 172.21.15.33:0/2196095571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778003520 con 0x7f7778003970 2024-09-13T19:01:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.908+0000 7f7795c00640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778004d00 0x7f7778005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.909+0000 7f7795200640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7778003970 0x7f7778003d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f778400c190 tx=0x7f77780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9787b1ed3d485e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.909+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784005ad0 con 0x7f7778003970 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.909+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778402d070 con 0x7f7778003970 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.909+0000 7f778f400640 1 -- 172.21.15.33:0/2196095571 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784005e90 con 0x7f7778003970 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 -- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7778003970 msgr2=0x7f7778003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 --2- 172.21.15.33:0/2196095571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7778003970 0x7f7778003d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f778400c190 tx=0x7f77780057f0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7795c00640 1 -- 172.21.15.33:0/2196095571 reap_dead start 2024-09-13T19:01:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 -- 172.21.15.33:0/2196095571 shutdown_connections 2024-09-13T19:01:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 -- 172.21.15.33:0/2196095571 >> 172.21.15.33:0/2196095571 conn(0x7f77900b0510 msgr2=0x7f77900b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 -- 172.21.15.33:0/2196095571 shutdown_connections 2024-09-13T19:01:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.910+0000 7f7797c00640 1 -- 172.21.15.33:0/2196095571 wait complete. 2024-09-13T19:01:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.912+0000 7f7797c00640 1 Processor -- start 2024-09-13T19:01:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.912+0000 7f7797c00640 1 -- start start 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77901f0e00 0x7f77901525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7790152b30 0x7f7790153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900aaaf0 con 0x7f7778003970 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77901f3050 con 0x7f7790152b30 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7797c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900aa470 con 0x7f77901f0e00 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7795200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7795200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41360/0 (socket says 172.21.15.33:41360) 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7795200640 1 -- 172.21.15.33:0/358401966 learned_addr learned my addr 172.21.15.33:0/358401966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f7795c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7790152b30 0x7f7790153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.913+0000 7f778fe00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77901f0e00 0x7f77901525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 -- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77901f0e00 msgr2=0x7f77901525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77901f0e00 0x7f77901525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 -- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7790152b30 msgr2=0x7f7790153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7790152b30 0x7f7790153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 -- 172.21.15.33:0/358401966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790152fb0 con 0x7f7778003970 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7795200640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f778402acb0 tx=0x7f7784001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784004bf0 con 0x7f7778003970 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784004d50 con 0x7f7778003970 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7790153290 con 0x7f7778003970 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.914+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784007290 con 0x7f7778003970 2024-09-13T19:01:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.915+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900ad560 con 0x7f7778003970 2024-09-13T19:01:29.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.916+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77900aad60 con 0x7f7778003970 2024-09-13T19:01:29.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.917+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f778402f030 con 0x7f7778003970 2024-09-13T19:01:29.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.917+0000 7f778cc00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 0x7f777006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:29.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.917+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f77840a8ef0 con 0x7f7778003970 2024-09-13T19:01:29.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.918+0000 7f778fe00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 0x7f777006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:29.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.919+0000 7f778fe00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 0x7f777006d0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77901f11e0 tx=0x7f777c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:29.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:29.922+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f77840742a0 con 0x7f7778003970 2024-09-13T19:01:30.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.100+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77900aad60 con 0x7f7778003970 2024-09-13T19:01:30.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.714+0000 7f778cc00640 1 -- 172.21.15.33:0/358401966 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f77840778c0 con 0x7f7778003970 2024-09-13T19:01:30.718 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-13T19:01:30.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 msgr2=0x7f777006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 0x7f777006d0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77901f11e0 tx=0x7f777c009190 comp rx=0 tx=0).stop 2024-09-13T19:01:30.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 msgr2=0x7f77901f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f778402acb0 tx=0x7f7784001930 comp rx=0 tx=0).stop 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 shutdown_connections 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f777006ac00 0x7f777006d0c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7790152b30 0x7f7790153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77901f0e00 0x7f77901525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 --2- 172.21.15.33:0/358401966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778003970 0x7f77901f2b10 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.718+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 >> 172.21.15.33:0/358401966 conn(0x7f77900b0510 msgr2=0x7f779006c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:30.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.719+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 shutdown_connections 2024-09-13T19:01:30.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.719+0000 7f7797c00640 1 -- 172.21.15.33:0/358401966 wait complete. 2024-09-13T19:01:30.744 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T19:01:30.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.904+0000 7fa113e00640 1 Processor -- start 2024-09-13T19:01:30.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.905+0000 7fa113e00640 1 -- start start 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa113e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa1140b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa113e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11406b5c0 con 0x7fa1140adb90 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa113e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140cc600 con 0x7fa1141591b0 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa113e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406b810 con 0x7fa1140b1db0 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa10a000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa1140adb90 0x7fa1140b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43098/0 (socket says 172.21.15.33:43098) 2024-09-13T19:01:30.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa10a000640 1 -- 172.21.15.33:0/1083381011 learned_addr learned my addr 172.21.15.33:0/1083381011 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:30.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.906+0000 7fa113400640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa1140b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723197228 0 0) 0x7fa11406b5c0 con 0x7fa1140adb90 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f8003520 con 0x7fa1140adb90 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899886629 0 0) 0x7fa1140cc600 con 0x7fa1141591b0 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa11406b5c0 con 0x7fa1141591b0 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277971943 0 0) 0x7fa0f8003520 con 0x7fa1140adb90 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 msgr2=0x7fa1140b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa1140b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 >> v1:172.21.15.103:6789/0 conn(0x7fa1141591b0 legacy=0x7fa1140cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140cc870 con 0x7fa1140adb90 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2040118763 0 0) 0x7fa0fc001670 con 0x7fa1140adb90 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 >> v1:172.21.15.33:6789/0 conn(0x7fa1140adb90 legacy=0x7fa1140b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0f8003b30 0x7fa0f8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa0f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8004d00 0x7fa0f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406b810 con 0x7fa0f8003b30 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f800ba30 con 0x7fa0f8004d00 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f800ddb0 con 0x7fa1140b1db0 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.907+0000 7fa112a00640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0f8003b30 0x7fa0f8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa10a000640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa0f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa113400640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8004d00 0x7fa0f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa112a00640 1 -- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 msgr2=0x7fa0f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa112a00640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1140b1db0 0x7fa0f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa112a00640 1 -- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8004d00 msgr2=0x7fa0f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa112a00640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8004d00 0x7fa0f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.908+0000 7fa112a00640 1 -- 172.21.15.33:0/1083381011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8003520 con 0x7fa0f8003b30 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa112a00640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0f8003b30 0x7fa0f8003f30 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa1040018d0 tx=0x7fa0f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c20fe7263e2dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040052d0 con 0x7fa0f8003b30 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104005430 con 0x7fa0f8003b30 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa112000640 1 -- 172.21.15.33:0/1083381011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10402aca0 con 0x7fa0f8003b30 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa113e00640 1 -- 172.21.15.33:0/1083381011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0f8003b30 msgr2=0x7fa0f8003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.909+0000 7fa113e00640 1 --2- 172.21.15.33:0/1083381011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0f8003b30 0x7fa0f8003f30 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa1040018d0 tx=0x7fa0f80057f0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.910+0000 7fa113400640 1 -- 172.21.15.33:0/1083381011 reap_dead start 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.910+0000 7fa113e00640 1 -- 172.21.15.33:0/1083381011 shutdown_connections 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.910+0000 7fa113e00640 1 -- 172.21.15.33:0/1083381011 >> 172.21.15.33:0/1083381011 conn(0x7fa114069ed0 msgr2=0x7fa11406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.910+0000 7fa113e00640 1 -- 172.21.15.33:0/1083381011 shutdown_connections 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.910+0000 7fa113e00640 1 -- 172.21.15.33:0/1083381011 wait complete. 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.911+0000 7fa113e00640 1 Processor -- start 2024-09-13T19:01:30.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.911+0000 7fa113e00640 1 -- start start 2024-09-13T19:01:30.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003b30 0x7fa114156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa114141f10 0x7fa1141df5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114155b70 con 0x7fa114156000 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114142370 con 0x7fa0f8003b30 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.912+0000 7fa113e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1141dfce0 con 0x7fa114141f10 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41380/0 (socket says 172.21.15.33:41380) 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 -- 172.21.15.33:0/688445926 learned_addr learned my addr 172.21.15.33:0/688445926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa10a000640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa114141f10 0x7fa1141df5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa112a00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003b30 0x7fa114156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 -- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa114141f10 msgr2=0x7fa1141df5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa114141f10 0x7fa1141df5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 -- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003b30 msgr2=0x7fa114156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003b30 0x7fa114156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 -- 172.21.15.33:0/688445926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114155240 con 0x7fa114156000 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.913+0000 7fa113400640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa1140718c0 tx=0x7fa10c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.914+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00e070 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.914+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c011e40 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.914+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c003990 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.914+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa114155520 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.914+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114156480 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.915+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa114155d20 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.916+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa10c003b10 con 0x7fa114156000 2024-09-13T19:01:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.916+0000 7fa10be00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 0x7fa0f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.917+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa10c0896c0 con 0x7fa114156000 2024-09-13T19:01:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.917+0000 7fa112a00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 0x7fa0f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.918+0000 7fa112a00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 0x7fa0f006d0f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa104032000 tx=0x7fa104009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:30.921+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa114155d20 con 0x7fa114156000 2024-09-13T19:01:31.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.100+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa1140ce150 con 0x7fa114156000 2024-09-13T19:01:31.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.104+0000 7fa10be00640 1 -- 172.21.15.33:0/688445926 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa10c058630 con 0x7fa114156000 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 msgr2=0x7fa0f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 0x7fa0f006d0f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa104032000 tx=0x7fa104009030 comp rx=0 tx=0).stop 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 msgr2=0x7fa1141ede90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa1140718c0 tx=0x7fa10c0115a0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 shutdown_connections 2024-09-13T19:01:31.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fa0f006ac30 0x7fa0f006d0f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114156000 0x7fa1141ede90 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa114141f10 0x7fa1141df5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 --2- 172.21.15.33:0/688445926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003b30 0x7fa114156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.106+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 >> 172.21.15.33:0/688445926 conn(0x7fa114069ed0 msgr2=0x7fa114070900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.107+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 shutdown_connections 2024-09-13T19:01:31.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.107+0000 7fa113e00640 1 -- 172.21.15.33:0/688445926 wait complete. 2024-09-13T19:01:31.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-13T19:01:31.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.279+0000 7f07ebe00640 1 Processor -- start 2024-09-13T19:01:31.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.279+0000 7f07ebe00640 1 -- start start 2024-09-13T19:01:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.280+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:31.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.280+0000 7f07ebe00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0b5cb0 con 0x7f07ec0b4520 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.280+0000 7f07ebe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0d07e0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.280+0000 7f07ebe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0cd4e0 con 0x7f07ec15c8b0 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.280+0000 7f07eb400640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f07ec0b4520 0x7f07ec0d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43112/0 (socket says 172.21.15.33:43112) 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07eb400640 1 -- 172.21.15.33:0/2961135447 learned_addr learned my addr 172.21.15.33:0/2961135447 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07eaa00640 1 --2- 172.21.15.33:0/2961135447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655239596 0 0) 0x7f07ec0b5cb0 con 0x7f07ec0b4520 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d0003520 con 0x7f07ec0b4520 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07eaa00640 1 -- 172.21.15.33:0/2961135447 >> v1:172.21.15.103:6789/0 conn(0x7f07ec0d1cd0 legacy=0x7f07ec0b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128898599 0 0) 0x7f07ec0d07e0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07eaa00640 1 -- 172.21.15.33:0/2961135447 >> v1:172.21.15.33:6789/0 conn(0x7f07ec0b4520 legacy=0x7f07ec0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.281+0000 7f07eaa00640 1 -- 172.21.15.33:0/2961135447 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0cd7c0 con 0x7f07ec15c8b0 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.282+0000 7f07eaa00640 1 --2- 172.21.15.33:0/2961135447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec0ccf00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097d0 tx=0x7f07dc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ea12416b028780 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc032440 con 0x7f07ec15c8b0 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc0325a0 con 0x7f07ec15c8b0 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07e9600640 1 -- 172.21.15.33:0/2961135447 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc032930 con 0x7f07ec15c8b0 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 -- 172.21.15.33:0/2961135447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 msgr2=0x7f07ec0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2961135447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec0ccf00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097d0 tx=0x7f07dc02a210 comp rx=0 tx=0).stop 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 -- 172.21.15.33:0/2961135447 shutdown_connections 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2961135447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec0ccf00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 -- 172.21.15.33:0/2961135447 >> 172.21.15.33:0/2961135447 conn(0x7f07ec0cf540 msgr2=0x7f07ec0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 -- 172.21.15.33:0/2961135447 shutdown_connections 2024-09-13T19:01:31.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.283+0000 7f07ebe00640 1 -- 172.21.15.33:0/2961135447 wait complete. 2024-09-13T19:01:31.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.285+0000 7f07ebe00640 1 Processor -- start 2024-09-13T19:01:31.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.285+0000 7f07ebe00640 1 -- start start 2024-09-13T19:01:31.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07ec0b4520 0x7f07ec1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0a9210 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec15c0c0 con 0x7f07ec0b4520 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ebe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0aae50 con 0x7f07ec15c8b0 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ea000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:31.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ea000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41384/0 (socket says 172.21.15.33:41384) 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07ea000640 1 -- 172.21.15.33:0/2634431523 learned_addr learned my addr 172.21.15.33:0/2634431523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07eaa00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07ec0b4520 0x7f07ec1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.286+0000 7f07eb400640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 -- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 msgr2=0x7f07ec15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 -- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07ec0b4520 msgr2=0x7f07ec1f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07ec0b4520 0x7f07ec1f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 -- 172.21.15.33:0/2634431523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009400 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ea000640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c520 tx=0x7f07d800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:31.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80035f0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8003770 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003b20 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec0ab130 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.287+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec0ab6f0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.288+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec0a93c0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.289+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07d8003c80 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.290+0000 7f07e2a00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 0x7f07cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.291+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07d8088650 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.291+0000 7f07eaa00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 0x7f07cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:31.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.292+0000 7f07eaa00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 0x7f07cc06d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f07dc034000 tx=0x7f07dc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:31.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.295+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f07ec0a93c0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.542+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) v1 -- 0x7f07ec0a93c0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.716+0000 7f07e2a00640 1 -- 172.21.15.33:0/2634431523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v260) v1 ==== 137+0+0 (secure 0 0 0) 0x7f07ec0a93c0 con 0x7f07ec0d1cd0 2024-09-13T19:01:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 msgr2=0x7f07cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 0x7f07cc06d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f07dc034000 tx=0x7f07dc02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 msgr2=0x7f07ec15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c520 tx=0x7f07d800c9e0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 shutdown_connections 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f07cc06ac00 0x7f07cc06d0c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f07ec15c8b0 0x7f07ec15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07ec0d1cd0 0x7f07ec15b780 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 --2- 172.21.15.33:0/2634431523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07ec0b4520 0x7f07ec1f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 >> 172.21.15.33:0/2634431523 conn(0x7f07ec0cf540 msgr2=0x7f07ec0b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 shutdown_connections 2024-09-13T19:01:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:31.718+0000 7f07ebe00640 1 -- 172.21.15.33:0/2634431523 wait complete. 2024-09-13T19:01:31.737 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-13T19:01:31.737 INFO:tasks.cephfs_test_runner: 2024-09-13T19:01:31.738 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T19:01:31.738 INFO:tasks.cephfs_test_runner:Ran 6 tests in 221.244s 2024-09-13T19:01:31.738 INFO:tasks.cephfs_test_runner: 2024-09-13T19:01:31.738 INFO:tasks.cephfs_test_runner:OK 2024-09-13T19:01:31.738 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T19:01:31.747 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T19:01:31.805 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T19:01:31.806 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:31.806 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:31.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:01:31.842 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-13T19:01:31.842 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:31.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T19:01:31.919 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:31.919 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:31.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:01:31.959 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-13T19:01:31.959 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T19:01:32.038 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052630,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T19:01:32.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.038 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T19:01:32.073 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T19:01:32.073 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T19:01:32.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.074 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T19:01:32.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.171 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T19:01:32.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-13T19:01:32.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.750 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-13T19:01:32.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.786 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-13T19:01:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-09-13T19:01:32.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:01:32.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.890 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:01:32.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T19:01:32.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T19:01:32.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:32.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T19:01:33.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:33.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T19:01:33.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:33.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-13T19:01:33.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:33.574 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-13T19:01:33.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T19:01:33.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-13T19:01:33.709 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-13T19:01:33.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:01:33.712 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T19:01:33.721 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:01:33.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:33.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.881+0000 7f961e600640 1 Processor -- start 2024-09-13T19:01:33.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.881+0000 7f961e600640 1 -- start start 2024-09-13T19:01:33.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f961e600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9618153b20 0x7f96180b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f961e600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f961806f660 0x7f961806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f961e600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9618153f00 con 0x7f9618159a80 2024-09-13T19:01:33.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f961e600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180ce600 con 0x7f9618153b20 2024-09-13T19:01:33.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f961e600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618070f90 con 0x7f961806f660 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f9617400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9618153b20 0x7f96180b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f960ea00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9618159a80 0x7f96180b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.33:46578/0 (socket says 172.21.15.33:46578) 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f960ea00640 1 -- 172.21.15.33:0/3668805677 learned_addr learned my addr 172.21.15.33:0/3668805677 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.883+0000 7f9617e00640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f961806f660 0x7f961806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.884+0000 7f9617400640 1 -- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f961806f660 msgr2=0x7f961806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.884+0000 7f9617400640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f961806f660 0x7f961806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.884+0000 7f9617400640 1 -- 172.21.15.33:0/3668805677 >> v1:172.21.15.103:6789/0 conn(0x7f9618159a80 legacy=0x7f96180b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:33.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.884+0000 7f9617400640 1 -- 172.21.15.33:0/3668805677 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180b1a40 con 0x7f9618153b20 2024-09-13T19:01:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.884+0000 7f9616a00640 1 -- 172.21.15.33:0/3668805677 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180606015 0 0) 0x7f9618153f00 con 0x7f9618159a80 2024-09-13T19:01:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.885+0000 7f9617400640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618153b20 0x7f96180b3990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f96080097d0 tx=0x7f960802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee3a9a1ed9e56c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.885+0000 7f9616a00640 1 -- 172.21.15.33:0/3668805677 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608032440 con 0x7f9618153b20 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.885+0000 7f9616a00640 1 -- 172.21.15.33:0/3668805677 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96080325a0 con 0x7f9618153b20 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.885+0000 7f9616a00640 1 -- 172.21.15.33:0/3668805677 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608032930 con 0x7f9618153b20 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 -- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618153b20 msgr2=0x7f96180b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618153b20 0x7f96180b3990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f96080097d0 tx=0x7f960802a1c0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 -- 172.21.15.33:0/3668805677 shutdown_connections 2024-09-13T19:01:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f961806f660 0x7f961806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 --2- 172.21.15.33:0/3668805677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618153b20 0x7f96180b3990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 -- 172.21.15.33:0/3668805677 >> 172.21.15.33:0/3668805677 conn(0x7f96180b0510 msgr2=0x7f96180b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 -- 172.21.15.33:0/3668805677 shutdown_connections 2024-09-13T19:01:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.886+0000 7f961e600640 1 -- 172.21.15.33:0/3668805677 wait complete. 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.888+0000 7f961e600640 1 Processor -- start 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.888+0000 7f961e600640 1 -- start start 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9618153b20 0x7f961814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618159a80 0x7f961814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961815ad60 con 0x7f961806f660 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961815b040 con 0x7f9618159a80 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f961e600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961815b320 con 0x7f9618153b20 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53496/0 (socket says 172.21.15.33:53496) 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 -- 172.21.15.33:0/1279276263 learned_addr learned my addr 172.21.15.33:0/1279276263 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f960ea00640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9618153b20 0x7f961814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617e00640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618159a80 0x7f961814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 -- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9618153b20 msgr2=0x7f961814c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9618153b20 0x7f961814c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 -- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618159a80 msgr2=0x7f961814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618159a80 0x7f961814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.889+0000 7f9617400640 1 -- 172.21.15.33:0/1279276263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009400 con 0x7f961806f660 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f9617400640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9608035040 tx=0x7f96080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:33.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608030b80 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608032e90 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608006e10 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961815b600 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.890+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961815a9f0 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.891+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961815bb20 con 0x7f961806f660 2024-09-13T19:01:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.892+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9608039040 con 0x7f961806f660 2024-09-13T19:01:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.893+0000 7f960fe00640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 0x7f95f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.893+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96080a9ab0 con 0x7f961806f660 2024-09-13T19:01:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.893+0000 7f960ea00640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 0x7f95f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.894+0000 7f960ea00640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 0x7f95f406d0c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f961814f530 tx=0x7f9600007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:33.897+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f961815bb20 con 0x7f961806f660 2024-09-13T19:01:34.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.073+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f961815a7b0 con 0x7f95f406ac00 2024-09-13T19:01:34.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.076+0000 7f960fe00640 1 -- 172.21.15.33:0/1279276263 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50994 (secure 0 0 0) 0x7f9600004c70 con 0x7f95f406ac00 2024-09-13T19:01:34.079 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:34.080 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 msgr2=0x7f95f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 0x7f95f406d0c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f961814f530 tx=0x7f9600007d50 comp rx=0 tx=0).stop 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 msgr2=0x7f9618144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9608035040 tx=0x7f96080046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 shutdown_connections 2024-09-13T19:01:34.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f95f406ac00 0x7f95f406d0c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9618159a80 0x7f961814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9618153b20 0x7f961814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 --2- 172.21.15.33:0/1279276263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f961806f660 0x7f9618144c60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 >> 172.21.15.33:0/1279276263 conn(0x7f96180b0510 msgr2=0x7f96180ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 shutdown_connections 2024-09-13T19:01:34.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.078+0000 7f961e600640 1 -- 172.21.15.33:0/1279276263 wait complete. 2024-09-13T19:01:34.097 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-13T19:01:33.156047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259744,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714976,"statfs":{"total":773094113280,"available":772828135424,"internally_reserved":0,"allocated":11051008,"data_stored":5358083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-213534,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-137,"num_write_kb":-20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001613"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T19:01:29.714924+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:29.714924+0000","last_peered":"2024-09-13T19:01:29.714924+0000","last_clean":"2024-09-13T19:01:29.714924+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:29.714924+0000","last_undegraded":"2024-09-13T19:01:29.714924+0000","last_fullsized":"2024-09-13T19:01:29.714924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.622},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":1.105},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.498},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.492,"15min":1.492},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.61799999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77500000000000002,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.433,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.873},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70599999999999996,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79700000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.72399999999999998},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.25,"15min":1.25},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76800000000000002,"5min":1.337,"15min":1.337},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70499999999999996,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.373,"15min":1.373},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.68100000000000005,"15min":0.71599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84899999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84499999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90800000000000003,"5min":1.792,"15min":1.792},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.49,"15min":1.49},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91600000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.45500000000000002,"15min":0.47899999999999998},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59499999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.51300000000000001,"15min":0.59799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":3.339,"15min":3.339},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.107,"15min":1.107},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52700000000000002,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.5},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76900000000000002,"15min":0.86699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86699999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.89200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":3.383,"15min":3.383},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84299999999999997,"15min":0.95299999999999996},"min":{"1min":0.54700000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.89800000000000002},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80700000000000005,"15min":0.89400000000000002},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91000000000000003,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82599999999999996,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81699999999999995,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.88900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32328,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64000000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.498},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0229999999999999,"5min":1.079,"15min":1.079},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96999999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.075},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92800000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.171,"15min":1.171},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96599999999999997,"5min":1.077,"15min":1.077},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":518700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":1.486,"15min":1.486},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.48399999999999999},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":1.27,"15min":1.27},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.74299999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.228,"15min":1.228},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91300000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.78700000000000003},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":1.611,"15min":1.611},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.236,"15min":1.236},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":1.137,"15min":1.137},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91200000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.006,"5min":1.284,"15min":1.284},"last":0.748}]},{"osd":7,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.84599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0800000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61599999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98899999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96699999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.23,"15min":1.23},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.151,"15min":1.151},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0289999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.093,"15min":1.093},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0700000000000001,"5min":1.339,"15min":1.339},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:34.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.251+0000 7f4e5b800640 1 Processor -- start 2024-09-13T19:01:34.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.251+0000 7f4e5b800640 1 -- start start 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.252+0000 7f4e5b800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e5415a520 0x7f4e5406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.252+0000 7f4e5b800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e540ce020 0x7f4e5415a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.252+0000 7f4e5b800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5406bc00 con 0x7f4e540b1b00 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.252+0000 7f4e5b800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5406bea0 con 0x7f4e540ce020 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.252+0000 7f4e5b800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5406c180 con 0x7f4e5415a520 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e59800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e540ce020 0x7f4e5415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e53e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4e540b1b00 0x7f4e540cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44452/0 (socket says 172.21.15.33:44452) 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e53e00640 1 -- 172.21.15.33:0/1291190860 learned_addr learned my addr 172.21.15.33:0/1291190860 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e58e00640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e5415a520 0x7f4e5406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e59800640 1 -- 172.21.15.33:0/1291190860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e5415a520 msgr2=0x7f4e5406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e59800640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e5415a520 0x7f4e5406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e59800640 1 -- 172.21.15.33:0/1291190860 >> v1:172.21.15.33:6789/0 conn(0x7f4e540b1b00 legacy=0x7f4e540cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e59800640 1 -- 172.21.15.33:0/1291190860 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5406c460 con 0x7f4e540ce020 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.253+0000 7f4e53400640 1 -- 172.21.15.33:0/1291190860 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519740278 0 0) 0x7f4e5406bc00 con 0x7f4e540b1b00 2024-09-13T19:01:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.254+0000 7f4e59800640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e540ce020 0x7f4e5415a900 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009d90 tx=0x7f4e4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baf13f917d5d744 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.254+0000 7f4e53400640 1 -- 172.21.15.33:0/1291190860 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c007740 con 0x7f4e540ce020 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.254+0000 7f4e53400640 1 -- 172.21.15.33:0/1291190860 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c02d050 con 0x7f4e540ce020 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.254+0000 7f4e53400640 1 -- 172.21.15.33:0/1291190860 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c007ac0 con 0x7f4e540ce020 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 -- 172.21.15.33:0/1291190860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e540ce020 msgr2=0x7f4e5415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e540ce020 0x7f4e5415a900 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009d90 tx=0x7f4e4c02a660 comp rx=0 tx=0).stop 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 -- 172.21.15.33:0/1291190860 shutdown_connections 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e540ce020 0x7f4e5415a900 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 --2- 172.21.15.33:0/1291190860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e5415a520 0x7f4e5406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 -- 172.21.15.33:0/1291190860 >> 172.21.15.33:0/1291190860 conn(0x7f4e540b0510 msgr2=0x7f4e540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 -- 172.21.15.33:0/1291190860 shutdown_connections 2024-09-13T19:01:34.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.255+0000 7f4e5b800640 1 -- 172.21.15.33:0/1291190860 wait complete. 2024-09-13T19:01:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.257+0000 7f4e5b800640 1 Processor -- start 2024-09-13T19:01:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.257+0000 7f4e5b800640 1 -- start start 2024-09-13T19:01:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e540ce020 0x7f4e540ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5415a520 0x7f4e540acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54145350 con 0x7f4e5415a520 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54147df0 con 0x7f4e540b1b00 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e5b800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541477c0 con 0x7f4e540ce020 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e59800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5415a520 0x7f4e540acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.33:48174/0 (socket says 172.21.15.33:48174) 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 -- 172.21.15.33:0/3165226608 learned_addr learned my addr 172.21.15.33:0/3165226608 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e53e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e540ce020 0x7f4e540ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 -- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e540ce020 msgr2=0x7f4e540ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e540ce020 0x7f4e540ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 -- 172.21.15.33:0/3165226608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5415a520 msgr2=0x7f4e540acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5415a520 0x7f4e540acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.258+0000 7f4e58e00640 1 -- 172.21.15.33:0/3165226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009a70 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e58e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e870 tx=0x7f4e4800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480094f0 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4800c940 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e54070390 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800ccf0 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.259+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e54148280 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.260+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54159d20 con 0x7f4e540b1b00 2024-09-13T19:01:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.261+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e48013470 con 0x7f4e540b1b00 2024-09-13T19:01:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.262+0000 7f4e50c00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 0x7f4e3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.262+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e48088fe0 con 0x7f4e540b1b00 2024-09-13T19:01:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.262+0000 7f4e53e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 0x7f4e3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.263+0000 7f4e53e00640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 0x7f4e3406d0f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4e54156d20 tx=0x7f4e40007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.268+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e480545c0 con 0x7f4e540b1b00 2024-09-13T19:01:34.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.444+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e54147640 con 0x7f4e3406ac30 2024-09-13T19:01:34.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.447+0000 7f4e50c00640 1 -- 172.21.15.33:0/3165226608 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50994 (secure 0 0 0) 0x7f4e40004c70 con 0x7f4e3406ac30 2024-09-13T19:01:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:34.451 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 msgr2=0x7f4e3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 0x7f4e3406d0f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4e54156d20 tx=0x7f4e40007d50 comp rx=0 tx=0).stop 2024-09-13T19:01:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 msgr2=0x7f4e54144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e870 tx=0x7f4e4800ed30 comp rx=0 tx=0).stop 2024-09-13T19:01:34.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 shutdown_connections 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4e3406ac30 0x7f4e3406d0f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5415a520 0x7f4e540acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e540ce020 0x7f4e540ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 --2- 172.21.15.33:0/3165226608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e540b1b00 0x7f4e54144e10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 >> 172.21.15.33:0/3165226608 conn(0x7f4e540b0510 msgr2=0x7f4e540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 shutdown_connections 2024-09-13T19:01:34.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.449+0000 7f4e5b800640 1 -- 172.21.15.33:0/3165226608 wait complete. 2024-09-13T19:01:34.467 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-13T19:01:33.156047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259744,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714976,"statfs":{"total":773094113280,"available":772828135424,"internally_reserved":0,"allocated":11051008,"data_stored":5358083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-213534,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-137,"num_write_kb":-20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001613"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T19:01:29.714924+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:29.714924+0000","last_peered":"2024-09-13T19:01:29.714924+0000","last_clean":"2024-09-13T19:01:29.714924+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:29.714924+0000","last_undegraded":"2024-09-13T19:01:29.714924+0000","last_fullsized":"2024-09-13T19:01:29.714924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.622},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":1.105},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.498},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.492,"15min":1.492},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.61799999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77500000000000002,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.433,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.873},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70599999999999996,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79700000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.72399999999999998},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.25,"15min":1.25},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76800000000000002,"5min":1.337,"15min":1.337},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70499999999999996,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.373,"15min":1.373},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.68100000000000005,"15min":0.71599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84899999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84499999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90800000000000003,"5min":1.792,"15min":1.792},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.49,"15min":1.49},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91600000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.45500000000000002,"15min":0.47899999999999998},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59499999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.51300000000000001,"15min":0.59799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":3.339,"15min":3.339},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.107,"15min":1.107},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52700000000000002,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.5},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76900000000000002,"15min":0.86699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86699999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.89200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":3.383,"15min":3.383},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84299999999999997,"15min":0.95299999999999996},"min":{"1min":0.54700000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.89800000000000002},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80700000000000005,"15min":0.89400000000000002},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91000000000000003,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82599999999999996,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81699999999999995,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.88900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32328,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64000000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.498},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0229999999999999,"5min":1.079,"15min":1.079},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96999999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.075},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92800000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.171,"15min":1.171},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96599999999999997,"5min":1.077,"15min":1.077},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":518700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":1.486,"15min":1.486},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.48399999999999999},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":1.27,"15min":1.27},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.74299999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.228,"15min":1.228},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91300000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.78700000000000003},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":1.611,"15min":1.611},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.236,"15min":1.236},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":1.137,"15min":1.137},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91200000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.006,"5min":1.284,"15min":1.284},"last":0.748}]},{"osd":7,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.84599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0800000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61599999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98899999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96699999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.23,"15min":1.23},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.151,"15min":1.151},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0289999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.093,"15min":1.093},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0700000000000001,"5min":1.339,"15min":1.339},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:34.469 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:01:34.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:34.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.622+0000 7f9abe200640 1 Processor -- start 2024-09-13T19:01:34.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.623+0000 7f9abe200640 1 -- start start 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abe200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9ab815a5c0 0x7f9ab80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abe200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80cbac0 0x7f9ab80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abe200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80cbfc0 con 0x7f9ab80afe10 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abe200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab80cce20 con 0x7f9ab815a5c0 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abe200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80707a0 con 0x7f9ab80cbac0 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abd800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9ab80afe10 0x7f9ab806f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44464/0 (socket says 172.21.15.33:44464) 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abd800640 1 -- 172.21.15.33:0/3676193303 learned_addr learned my addr 172.21.15.33:0/3676193303 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9abce00640 1 --2- 172.21.15.33:0/3676193303 >> v2:172.21.15.103:3300/0 conn(0x7f9ab815a5c0 0x7f9ab80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.624+0000 7f9ab7e00640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80cbac0 0x7f9ab80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.625+0000 7f9abce00640 1 -- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80cbac0 msgr2=0x7f9ab80b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.625+0000 7f9abce00640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80cbac0 0x7f9ab80b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.625+0000 7f9abce00640 1 -- 172.21.15.33:0/3676193303 >> v1:172.21.15.33:6789/0 conn(0x7f9ab80afe10 legacy=0x7f9ab806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.625+0000 7f9ab7400640 1 -- 172.21.15.33:0/3676193303 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196817088 0 0) 0x7f9ab80cbfc0 con 0x7f9ab80afe10 2024-09-13T19:01:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.625+0000 7f9abce00640 1 -- 172.21.15.33:0/3676193303 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8070a80 con 0x7f9ab815a5c0 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.626+0000 7f9abce00640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b39b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0097a0 tx=0x7f9aac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f206f31f849ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.626+0000 7f9ab7400640 1 -- 172.21.15.33:0/3676193303 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac032440 con 0x7f9ab815a5c0 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.626+0000 7f9ab7400640 1 -- 172.21.15.33:0/3676193303 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac0325a0 con 0x7f9ab815a5c0 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.626+0000 7f9ab7400640 1 -- 172.21.15.33:0/3676193303 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac032930 con 0x7f9ab815a5c0 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 -- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab815a5c0 msgr2=0x7f9ab80b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b39b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0097a0 tx=0x7f9aac02a180 comp rx=0 tx=0).stop 2024-09-13T19:01:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 -- 172.21.15.33:0/3676193303 shutdown_connections 2024-09-13T19:01:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80cbac0 0x7f9ab80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 --2- 172.21.15.33:0/3676193303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b39b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 -- 172.21.15.33:0/3676193303 >> 172.21.15.33:0/3676193303 conn(0x7f9ab80ae310 msgr2=0x7f9ab80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 -- 172.21.15.33:0/3676193303 shutdown_connections 2024-09-13T19:01:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.627+0000 7f9abe200640 1 -- 172.21.15.33:0/3676193303 wait complete. 2024-09-13T19:01:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.628+0000 7f9abe200640 1 Processor -- start 2024-09-13T19:01:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.629+0000 7f9abe200640 1 -- start start 2024-09-13T19:01:34.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.629+0000 7f9abe200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80afe10 0x7f9ab8141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abe200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab80cbac0 0x7f9ab80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abe200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abe200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81424c0 con 0x7f9ab815a5c0 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abe200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80b1ed0 con 0x7f9ab80cbac0 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abe200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80b2170 con 0x7f9ab80afe10 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53516/0 (socket says 172.21.15.33:53516) 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 -- 172.21.15.33:0/3930879875 learned_addr learned my addr 172.21.15.33:0/3930879875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abce00640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80afe10 0x7f9ab8141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9ab7e00640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab80cbac0 0x7f9ab80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 -- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80afe10 msgr2=0x7f9ab8141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80afe10 0x7f9ab8141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 -- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab80cbac0 msgr2=0x7f9ab80b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab80cbac0 0x7f9ab80b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.630+0000 7f9abd800640 1 -- 172.21.15.33:0/3930879875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac009400 con 0x7f9ab815a5c0 2024-09-13T19:01:34.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9abd800640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c700 tx=0x7f9ab000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000ce10 con 0x7f9ab815a5c0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000a640 con 0x7f9ab815a5c0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000a9f0 con 0x7f9ab815a5c0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80b2450 con 0x7f9ab815a5c0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.631+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab80b2a10 con 0x7f9ab815a5c0 2024-09-13T19:01:34.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.632+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8067360 con 0x7f9ab815a5c0 2024-09-13T19:01:34.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.633+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ab000ab50 con 0x7f9ab815a5c0 2024-09-13T19:01:34.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.634+0000 7f9ab4c00640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 0x7f9a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:34.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.634+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9ab0088470 con 0x7f9ab815a5c0 2024-09-13T19:01:34.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.634+0000 7f9abce00640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 0x7f9a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:34.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.635+0000 7f9abce00640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 0x7f9a9806d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9aac034000 tx=0x7f9aac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:34.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.638+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9ab0053960 con 0x7f9ab815a5c0 2024-09-13T19:01:34.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.816+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ab8071280 con 0x7f9a9806ac00 2024-09-13T19:01:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.819+0000 7f9ab4c00640 1 -- 172.21.15.33:0/3930879875 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50994 (secure 0 0 0) 0x7f9aac006e10 con 0x7f9a9806ac00 2024-09-13T19:01:34.823 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.821+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 msgr2=0x7f9a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.821+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 0x7f9a9806d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9aac034000 tx=0x7f9aac02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 msgr2=0x7f9ab80b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c700 tx=0x7f9ab000cbc0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 shutdown_connections 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f9a9806ac00 0x7f9a9806d0c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ab815a5c0 0x7f9ab80b3210 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab80cbac0 0x7f9ab80b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 --2- 172.21.15.33:0/3930879875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9ab80afe10 0x7f9ab8141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 >> 172.21.15.33:0/3930879875 conn(0x7f9ab80ae310 msgr2=0x7f9ab806b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 shutdown_connections 2024-09-13T19:01:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.822+0000 7f9abe200640 1 -- 172.21.15.33:0/3930879875 wait complete. 2024-09-13T19:01:34.841 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-13T19:01:33.156047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259744,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714976,"statfs":{"total":773094113280,"available":772828135424,"internally_reserved":0,"allocated":11051008,"data_stored":5358083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-213534,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-137,"num_write_kb":-20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001613"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T19:01:29.714924+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:29.714924+0000","last_peered":"2024-09-13T19:01:29.714924+0000","last_clean":"2024-09-13T19:01:29.714924+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:29.714924+0000","last_undegraded":"2024-09-13T19:01:29.714924+0000","last_fullsized":"2024-09-13T19:01:29.714924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.622},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":1.105},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.498},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.492,"15min":1.492},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.61799999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77500000000000002,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.433,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.873},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70599999999999996,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79700000000000004,"5min":1.204,"15min":1.204},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.72399999999999998},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.25,"15min":1.25},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76800000000000002,"5min":1.337,"15min":1.337},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70499999999999996,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.373,"15min":1.373},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.68100000000000005,"15min":0.71599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84899999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84499999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90800000000000003,"5min":1.792,"15min":1.792},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.49,"15min":1.49},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32312,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1224704,"data_stored":518691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91600000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.45500000000000002,"15min":0.47899999999999998},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59499999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.51300000000000001,"15min":0.59799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":3.339,"15min":3.339},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.107,"15min":1.107},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52700000000000002,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.5},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76900000000000002,"15min":0.86699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86699999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.89200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":3.383,"15min":3.383},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84299999999999997,"15min":0.95299999999999996},"min":{"1min":0.54700000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.89800000000000002},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80700000000000005,"15min":0.89400000000000002},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91000000000000003,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82599999999999996,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81699999999999995,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.88900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32328,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64000000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.498},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.375}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0229999999999999,"5min":1.079,"15min":1.079},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96999999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.075},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92800000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88800000000000001}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.171,"15min":1.171},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96599999999999997,"5min":1.077,"15min":1.077},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":518700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":1.486,"15min":1.486},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.48399999999999999},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":1.27,"15min":1.27},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.74299999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.228,"15min":1.228},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91300000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.78700000000000003},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":1.611,"15min":1.611},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.236,"15min":1.236},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":1.137,"15min":1.137},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91200000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.006,"5min":1.284,"15min":1.284},"last":0.748}]},{"osd":7,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.84599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0800000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61599999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98899999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96699999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.23,"15min":1.23},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.151,"15min":1.151},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0289999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.093,"15min":1.093},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0700000000000001,"5min":1.339,"15min":1.339},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:34.843 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:01:34.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.995+0000 7f0143a00640 1 Processor -- start 2024-09-13T19:01:34.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.995+0000 7f0143a00640 1 -- start start 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0143a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0143a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f013c0cde50 0x7f013c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0143a00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c06bea0 con 0x7f013c15a520 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0143a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c06c180 con 0x7f013c0cde50 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0143a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c06c460 con 0x7f013c0b1b00 2024-09-13T19:01:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0141000640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f013c15a520 0x7f013c06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44480/0 (socket says 172.21.15.33:44480) 2024-09-13T19:01:35.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0141000640 1 -- 172.21.15.33:0/1092723354 learned_addr learned my addr 172.21.15.33:0/1092723354 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0141a00640 1 --2- 172.21.15.33:0/1092723354 >> v2:172.21.15.103:3300/0 conn(0x7f013c0cde50 0x7f013c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f0133e00640 1 --2- 172.21.15.33:0/1092723354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.997+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599622258 0 0) 0x7f013c06bea0 con 0x7f013c15a520 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0120003520 con 0x7f013c15a520 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404763934 0 0) 0x7f0120003520 con 0x7f013c15a520 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f0133e00640 1 -- 172.21.15.33:0/1092723354 >> v2:172.21.15.103:3300/0 conn(0x7f013c0cde50 msgr2=0x7f013c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f0133e00640 1 --2- 172.21.15.33:0/1092723354 >> v2:172.21.15.103:3300/0 conn(0x7f013c0cde50 0x7f013c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f0133e00640 1 -- 172.21.15.33:0/1092723354 >> v1:172.21.15.33:6789/0 conn(0x7f013c15a520 legacy=0x7f013c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.998+0000 7f0133e00640 1 -- 172.21.15.33:0/1092723354 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c06c740 con 0x7f013c0b1b00 2024-09-13T19:01:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.999+0000 7f0133e00640 1 --2- 172.21.15.33:0/1092723354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c0cd910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f01240097d0 tx=0x7f012402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b650147d2da4ecfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.999+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c001670 con 0x7f013c0b1b00 2024-09-13T19:01:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.999+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012402abd0 con 0x7f013c0b1b00 2024-09-13T19:01:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:34.999+0000 7f013be00640 1 -- 172.21.15.33:0/1092723354 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124032440 con 0x7f013c0b1b00 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 -- 172.21.15.33:0/1092723354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 msgr2=0x7f013c0cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 --2- 172.21.15.33:0/1092723354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c0cd910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f01240097d0 tx=0x7f012402a140 comp rx=0 tx=0).stop 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 -- 172.21.15.33:0/1092723354 shutdown_connections 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 --2- 172.21.15.33:0/1092723354 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c0cd910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 --2- 172.21.15.33:0/1092723354 >> v2:172.21.15.103:3300/0 conn(0x7f013c0cde50 0x7f013c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 -- 172.21.15.33:0/1092723354 >> 172.21.15.33:0/1092723354 conn(0x7f013c0b0510 msgr2=0x7f013c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 -- 172.21.15.33:0/1092723354 shutdown_connections 2024-09-13T19:01:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.000+0000 7f0143a00640 1 -- 172.21.15.33:0/1092723354 wait complete. 2024-09-13T19:01:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.002+0000 7f0143a00640 1 Processor -- start 2024-09-13T19:01:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.002+0000 7f0143a00640 1 -- start start 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c1ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f013c15a520 0x7f013c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0ad250 con 0x7f013c0cde50 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c14ca60 con 0x7f013c15a520 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0143a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1efd30 con 0x7f013c0b1b00 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0133e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0133e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53522/0 (socket says 172.21.15.33:53522) 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0133e00640 1 -- 172.21.15.33:0/839092397 learned_addr learned my addr 172.21.15.33:0/839092397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0141000640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c1ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.003+0000 7f0141a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f013c15a520 0x7f013c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 -- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 msgr2=0x7f013c1ef7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c1ef7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 -- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f013c15a520 msgr2=0x7f013c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f013c15a520 0x7f013c0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 -- 172.21.15.33:0/839092397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124009400 con 0x7f013c0cde50 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0133e00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f01240098f0 tx=0x7f01240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012403d830 con 0x7f013c0cde50 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012403d9b0 con 0x7f013c0cde50 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c0ac9b0 con 0x7f013c0cde50 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.004+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012403dd60 con 0x7f013c0cde50 2024-09-13T19:01:35.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.005+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0acf70 con 0x7f013c0cde50 2024-09-13T19:01:35.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.006+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c0cd910 con 0x7f013c0cde50 2024-09-13T19:01:35.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.006+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0124039040 con 0x7f013c0cde50 2024-09-13T19:01:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.007+0000 7f0139600640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.007+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01240a9890 con 0x7f013c0cde50 2024-09-13T19:01:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.008+0000 7f0141000640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.008+0000 7f0141000640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f012c000f60 tx=0x7f012c001d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.011+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0124074d80 con 0x7f013c0cde50 2024-09-13T19:01:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.213+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f013c0b0b00 con 0x7f013c0cde50 2024-09-13T19:01:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.214+0000 7f0139600640 1 -- 172.21.15.33:0/839092397 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+12987 (secure 0 0 0) 0x7f0124037090 con 0x7f013c0cde50 2024-09-13T19:01:35.218 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:35.218 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":99,"fsid":"6d8de347-8986-4090-a81e-548bd7528fe4","created":"2024-09-13T18:56:50.281963+0000","modified":"2024-09-13T19:01:30.711147+0000","last_up_change":"2024-09-13T18:57:02.385949+0000","last_in_change":"2024-09-13T18:56:53.122939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:57:03.151946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60955b6d-5159-48a6-a896-8faf79641779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6809","nonce":2676372550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6811","nonce":2676372550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6815","nonce":2676372550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2676372550},{"type":"v1","addr":"172.21.15.33:6813","nonce":2676372550}]},"public_addr":"172.21.15.33:6809/2676372550","cluster_addr":"172.21.15.33:6811/2676372550","heartbeat_back_addr":"172.21.15.33:6815/2676372550","heartbeat_front_addr":"172.21.15.33:6813/2676372550","state":["exists","up"]},{"osd":1,"uuid":"c6efa374-4e9c-4b37-877d-af163da1970e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6817","nonce":3216118851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6819","nonce":3216118851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6823","nonce":3216118851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3216118851},{"type":"v1","addr":"172.21.15.33:6821","nonce":3216118851}]},"public_addr":"172.21.15.33:6817/3216118851","cluster_addr":"172.21.15.33:6819/3216118851","heartbeat_back_addr":"172.21.15.33:6823/3216118851","heartbeat_front_addr":"172.21.15.33:6821/3216118851","state":["exists","up"]},{"osd":2,"uuid":"795d61d4-1c34-4be4-b67d-86c86c30e081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6825","nonce":3897994756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6827","nonce":3897994756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6831","nonce":3897994756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3897994756},{"type":"v1","addr":"172.21.15.33:6829","nonce":3897994756}]},"public_addr":"172.21.15.33:6825/3897994756","cluster_addr":"172.21.15.33:6827/3897994756","heartbeat_back_addr":"172.21.15.33:6831/3897994756","heartbeat_front_addr":"172.21.15.33:6829/3897994756","state":["exists","up"]},{"osd":3,"uuid":"d36b8624-f3b8-4fff-87cd-01200098c1d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6801","nonce":2901377922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6803","nonce":2901377922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6807","nonce":2901377922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2901377922},{"type":"v1","addr":"172.21.15.33:6805","nonce":2901377922}]},"public_addr":"172.21.15.33:6801/2901377922","cluster_addr":"172.21.15.33:6803/2901377922","heartbeat_back_addr":"172.21.15.33:6807/2901377922","heartbeat_front_addr":"172.21.15.33:6805/2901377922","state":["exists","up"]},{"osd":4,"uuid":"c665d7c5-361b-4630-8e25-9ee736497bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6825","nonce":3878985058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6827","nonce":3878985058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6831","nonce":3878985058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":3878985058},{"type":"v1","addr":"172.21.15.103:6829","nonce":3878985058}]},"public_addr":"172.21.15.103:6825/3878985058","cluster_addr":"172.21.15.103:6827/3878985058","heartbeat_back_addr":"172.21.15.103:6831/3878985058","heartbeat_front_addr":"172.21.15.103:6829/3878985058","state":["exists","up"]},{"osd":5,"uuid":"f0857cc5-18c0-462d-8fdb-d7df105bc7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6817","nonce":1671521011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6819","nonce":1671521011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6823","nonce":1671521011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1671521011},{"type":"v1","addr":"172.21.15.103:6821","nonce":1671521011}]},"public_addr":"172.21.15.103:6817/1671521011","cluster_addr":"172.21.15.103:6819/1671521011","heartbeat_back_addr":"172.21.15.103:6823/1671521011","heartbeat_front_addr":"172.21.15.103:6821/1671521011","state":["exists","up"]},{"osd":6,"uuid":"0c6ca12f-45d2-4ba9-b5a3-613b7d783c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6801","nonce":1700981467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6803","nonce":1700981467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6807","nonce":1700981467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1700981467},{"type":"v1","addr":"172.21.15.103:6805","nonce":1700981467}]},"public_addr":"172.21.15.103:6801/1700981467","cluster_addr":"172.21.15.103:6803/1700981467","heartbeat_back_addr":"172.21.15.103:6807/1700981467","heartbeat_front_addr":"172.21.15.103:6805/1700981467","state":["exists","up"]},{"osd":7,"uuid":"43cf2024-fe96-4120-b898-31cdd51ffb56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6809","nonce":713706450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6811","nonce":713706450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6815","nonce":713706450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":713706450},{"type":"v1","addr":"172.21.15.103:6813","nonce":713706450}]},"public_addr":"172.21.15.103:6809/713706450","cluster_addr":"172.21.15.103:6811/713706450","heartbeat_back_addr":"172.21.15.103:6815/713706450","heartbeat_front_addr":"172.21.15.103:6813/713706450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.492990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.406692+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.463661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.474670+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.526541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.536947+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.496948+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:56:58.449431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6834/1677185776":"2024-09-14T19:01:27.695845+0000","172.21.15.33:6832/1677185776":"2024-09-14T19:01:27.695845+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:01:35.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 msgr2=0x7f011806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f012c000f60 tx=0x7f012c001d40 comp rx=0 tx=0).stop 2024-09-13T19:01:35.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 msgr2=0x7f013c154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f01240098f0 tx=0x7f01240046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 shutdown_connections 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f011806ac00 0x7f011806d0c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f013c15a520 0x7f013c0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f013c0cde50 0x7f013c154b20 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 --2- 172.21.15.33:0/839092397 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f013c0b1b00 0x7f013c1ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 >> 172.21.15.33:0/839092397 conn(0x7f013c0b0510 msgr2=0x7f013c158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 shutdown_connections 2024-09-13T19:01:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:35.217+0000 7f0143a00640 1 -- 172.21.15.33:0/839092397 wait complete. 2024-09-13T19:01:36.237 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T19:01:36.238 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.398+0000 7fd329400640 1 Processor -- start 2024-09-13T19:01:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.398+0000 7fd329400640 1 -- start start 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd329400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3240adeb0 0x7fd3240704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd329400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd324070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd329400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd324070030 con 0x7fd3241592f0 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd329400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd324071870 con 0x7fd3240adeb0 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd329400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32406f700 con 0x7fd3241596d0 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.399+0000 7fd321e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3240adeb0 0x7fd3240704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3240adeb0 0x7fd3240704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53534/0 (socket says 172.21.15.33:53534) 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 -- 172.21.15.33:0/2705005984 learned_addr learned my addr 172.21.15.33:0/2705005984 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd323200640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd324070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 -- 172.21.15.33:0/2705005984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 msgr2=0x7fd324070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd324070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 -- 172.21.15.33:0/2705005984 >> v1:172.21.15.33:6789/0 conn(0x7fd3241592f0 legacy=0x7fd3240b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321e00640 1 -- 172.21.15.33:0/2705005984 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32406f9e0 con 0x7fd3240adeb0 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.400+0000 7fd321400640 1 -- 172.21.15.33:0/2705005984 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583586913 0 0) 0x7fd324070030 con 0x7fd3241592f0 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.401+0000 7fd321e00640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240adeb0 0x7fd3240704c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd310009870 tx=0x7fd31002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0938363c6f99b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.401+0000 7fd321400640 1 -- 172.21.15.33:0/2705005984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310032440 con 0x7fd3240adeb0 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.401+0000 7fd321400640 1 -- 172.21.15.33:0/2705005984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3100325a0 con 0x7fd3240adeb0 2024-09-13T19:01:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.401+0000 7fd321400640 1 -- 172.21.15.33:0/2705005984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310032930 con 0x7fd3240adeb0 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 -- 172.21.15.33:0/2705005984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240adeb0 msgr2=0x7fd3240704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240adeb0 0x7fd3240704c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd310009870 tx=0x7fd31002a270 comp rx=0 tx=0).stop 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 -- 172.21.15.33:0/2705005984 shutdown_connections 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd324070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 --2- 172.21.15.33:0/2705005984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240adeb0 0x7fd3240704c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 -- 172.21.15.33:0/2705005984 >> 172.21.15.33:0/2705005984 conn(0x7fd3240b0510 msgr2=0x7fd3240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 -- 172.21.15.33:0/2705005984 shutdown_connections 2024-09-13T19:01:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.402+0000 7fd329400640 1 -- 172.21.15.33:0/2705005984 wait complete. 2024-09-13T19:01:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.404+0000 7fd329400640 1 Processor -- start 2024-09-13T19:01:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.404+0000 7fd329400640 1 -- start start 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3240adeb0 0x7fd32414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 0x7fd32414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd32414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154890 con 0x7fd3241592f0 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154b70 con 0x7fd3240adeb0 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd329400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154e50 con 0x7fd3241596d0 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 0x7fd32414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 0x7fd32414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53536/0 (socket says 172.21.15.33:53536) 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 -- 172.21.15.33:0/3320398346 learned_addr learned my addr 172.21.15.33:0/3320398346 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd322800640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3240adeb0 0x7fd32414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd323200640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd32414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 -- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 msgr2=0x7fd32414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd3241596d0 0x7fd32414dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 -- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3240adeb0 msgr2=0x7fd32414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3240adeb0 0x7fd32414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.405+0000 7fd321e00640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100094d0 con 0x7fd3241592f0 2024-09-13T19:01:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd321e00640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 0x7fd32414c250 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd310000c00 tx=0x7fd3100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310032440 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310030b80 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31003d440 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324155130 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.406+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32414e160 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.407+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd324154ce0 con 0x7fd3241592f0 2024-09-13T19:01:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.408+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd310039040 con 0x7fd3241592f0 2024-09-13T19:01:36.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd31aa00640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd30406ac30 0x7fd30406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd3100a9c30 con 0x7fd3241592f0 2024-09-13T19:01:36.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd31aa00640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7fd304070a90 0x7fd304072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd304073560 con 0x7fd304070a90 2024-09-13T19:01:36.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3100ae2a0 con 0x7fd3241592f0 2024-09-13T19:01:36.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd323200640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7fd304070a90 0x7fd304072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.409+0000 7fd322800640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd30406ac30 0x7fd30406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.410+0000 7fd323200640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7fd304070a90 0x7fd304072eb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.410+0000 7fd322800640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd30406ac30 0x7fd30406d0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd314000f60 tx=0x7fd314009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.411+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== osd.0 v2:172.21.15.33:6808/2676372550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd304073560 con 0x7fd304070a90 2024-09-13T19:01:36.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 --> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd324070f40 con 0x7fd304070a90 2024-09-13T19:01:36.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd31aa00640 1 -- 172.21.15.33:0/3320398346 <== osd.0 v2:172.21.15.33:6808/2676372550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd31c009b70 con 0x7fd304070a90 2024-09-13T19:01:36.426 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:36.426 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:36.427 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:36.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7fd304070a90 msgr2=0x7fd304072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:6808/2676372550,v1:172.21.15.33:6809/2676372550] conn(0x7fd304070a90 0x7fd304072eb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd30406ac30 msgr2=0x7fd30406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd30406ac30 0x7fd30406d0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd314000f60 tx=0x7fd314009040 comp rx=0 tx=0).stop 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 msgr2=0x7fd32414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 --2- 172.21.15.33:0/3320398346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3241592f0 0x7fd32414c250 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd310000c00 tx=0x7fd3100046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd323200640 1 -- 172.21.15.33:0/3320398346 reap_dead start 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 shutdown_connections 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.424+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 >> 172.21.15.33:0/3320398346 conn(0x7fd3240b0510 msgr2=0x7fd3240cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.425+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 shutdown_connections 2024-09-13T19:01:36.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.425+0000 7fd329400640 1 -- 172.21.15.33:0/3320398346 wait complete. 2024-09-13T19:01:36.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T19:01:36.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.596+0000 7fdcc1800640 1 Processor -- start 2024-09-13T19:01:36.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.596+0000 7fdcc1800640 1 -- start start 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.597+0000 7fdcc1800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcbc153b20 0x7fdcbc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcc1800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdcbc06f660 0x7fdcbc06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcc1800640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc153f00 con 0x7fdcbc159a80 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcc1800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0ce600 con 0x7fdcbc153b20 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcc1800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc070f90 con 0x7fdcbc06f660 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcbc153b20 0x7fdcbc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcbc153b20 0x7fdcbc0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53540/0 (socket says 172.21.15.33:53540) 2024-09-13T19:01:36.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 -- 172.21.15.33:0/1668254386 learned_addr learned my addr 172.21.15.33:0/1668254386 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcb2000640 1 --1- 172.21.15.33:0/1668254386 >> v1:172.21.15.33:6789/0 conn(0x7fdcbc159a80 0x7fdcbc0b1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44498/0 (socket says 172.21.15.33:44498) 2024-09-13T19:01:36.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbb400640 1 --2- 172.21.15.33:0/1668254386 >> v2:172.21.15.103:3300/0 conn(0x7fdcbc06f660 0x7fdcbc06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 -- 172.21.15.33:0/1668254386 >> v2:172.21.15.103:3300/0 conn(0x7fdcbc06f660 msgr2=0x7fdcbc06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:36.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 --2- 172.21.15.33:0/1668254386 >> v2:172.21.15.103:3300/0 conn(0x7fdcbc06f660 0x7fdcbc06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 -- 172.21.15.33:0/1668254386 >> v1:172.21.15.33:6789/0 conn(0x7fdcbc159a80 legacy=0x7fdcbc0b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.598+0000 7fdcbaa00640 1 -- 172.21.15.33:0/1668254386 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0b1a40 con 0x7fdcbc153b20 2024-09-13T19:01:36.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.599+0000 7fdcbaa00640 1 --2- 172.21.15.33:0/1668254386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc0b3990 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0cb060 tx=0x7fdcac02c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205bb0b945f064f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcba000640 1 -- 172.21.15.33:0/1668254386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac032830 con 0x7fdcbc153b20 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcba000640 1 -- 172.21.15.33:0/1668254386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac032990 con 0x7fdcbc153b20 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcba000640 1 -- 172.21.15.33:0/1668254386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac032d20 con 0x7fdcbc153b20 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 -- 172.21.15.33:0/1668254386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 msgr2=0x7fdcbc0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 --2- 172.21.15.33:0/1668254386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc0b3990 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0cb060 tx=0x7fdcac02c970 comp rx=0 tx=0).stop 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 -- 172.21.15.33:0/1668254386 shutdown_connections 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 --2- 172.21.15.33:0/1668254386 >> v2:172.21.15.103:3300/0 conn(0x7fdcbc06f660 0x7fdcbc06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 --2- 172.21.15.33:0/1668254386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc0b3990 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 -- 172.21.15.33:0/1668254386 >> 172.21.15.33:0/1668254386 conn(0x7fdcbc0b0510 msgr2=0x7fdcbc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:36.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 -- 172.21.15.33:0/1668254386 shutdown_connections 2024-09-13T19:01:36.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.600+0000 7fdcc1800640 1 -- 172.21.15.33:0/1668254386 wait complete. 2024-09-13T19:01:36.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.602+0000 7fdcc1800640 1 Processor -- start 2024-09-13T19:01:36.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.602+0000 7fdcc1800640 1 -- start start 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcbc06f660 0x7fdcbc13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcbc159a80 0x7fdcbc1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc13e610 con 0x7fdcbc153b20 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc157110 con 0x7fdcbc159a80 2024-09-13T19:01:36.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcc1800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc156870 con 0x7fdcbc06f660 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53544/0 (socket says 172.21.15.33:53544) 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.603+0000 7fdcb2000640 1 -- 172.21.15.33:0/4148192975 learned_addr learned my addr 172.21.15.33:0/4148192975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcbaa00640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcbc06f660 0x7fdcbc13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcbb400640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcbc159a80 0x7fdcbc1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 -- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcbc06f660 msgr2=0x7fdcbc13e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcbc06f660 0x7fdcbc13e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 -- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcbc159a80 msgr2=0x7fdcbc1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcbc159a80 0x7fdcbc1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 -- 172.21.15.33:0/4148192975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac00b770 con 0x7fdcbc153b20 2024-09-13T19:01:36.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb2000640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c4d0 tx=0x7fdca400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4007480 con 0x7fdcbc153b20 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40075e0 con 0x7fdcbc153b20 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40049e0 con 0x7fdcbc153b20 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.604+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc156b50 con 0x7fdcbc153b20 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.605+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc15aa90 con 0x7fdcbc153b20 2024-09-13T19:01:36.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.606+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc15acb0 con 0x7fdcbc153b20 2024-09-13T19:01:36.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.607+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdca4004b40 con 0x7fdcbc153b20 2024-09-13T19:01:36.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.607+0000 7fdcb3400640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 0x7fdc9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.608+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdca4088090 con 0x7fdcbc153b20 2024-09-13T19:01:36.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.608+0000 7fdcbaa00640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 0x7fdc9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.609+0000 7fdcbaa00640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 0x7fdc9806d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdcac037000 tx=0x7fdcac032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.612+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdca4053620 con 0x7fdcbc153b20 2024-09-13T19:01:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.792+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcbc0ce140 con 0x7fdc9806ac00 2024-09-13T19:01:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.793+0000 7fdcb3400640 1 -- 172.21.15.33:0/4148192975 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdcbc0ce140 con 0x7fdc9806ac00 2024-09-13T19:01:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T19:01:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 msgr2=0x7fdc9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 0x7fdc9806d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdcac037000 tx=0x7fdcac032000 comp rx=0 tx=0).stop 2024-09-13T19:01:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 msgr2=0x7fdcbc155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c4d0 tx=0x7fdca400c990 comp rx=0 tx=0).stop 2024-09-13T19:01:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 shutdown_connections 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fdc9806ac00 0x7fdc9806d0c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcbc159a80 0x7fdcbc1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcbc153b20 0x7fdcbc155f20 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 --2- 172.21.15.33:0/4148192975 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcbc06f660 0x7fdcbc13e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 >> 172.21.15.33:0/4148192975 conn(0x7fdcbc0b0510 msgr2=0x7fdcbc0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 shutdown_connections 2024-09-13T19:01:36.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.795+0000 7fdcc1800640 1 -- 172.21.15.33:0/4148192975 wait complete. 2024-09-13T19:01:36.812 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T19:01:36.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.969+0000 7fb629e00640 1 Processor -- start 2024-09-13T19:01:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.969+0000 7fb629e00640 1 -- start start 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb629e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6241461a0 0x7fb6240b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb629e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6240b2d60 0x7fb6240ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb629e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240ad1c0 con 0x7fb6240acdb0 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb629e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62406b3e0 con 0x7fb6240b2d60 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb629e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240b3370 con 0x7fb6241461a0 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6240b2d60 0x7fb6240ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6240b2d60 0x7fb6240ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53548/0 (socket says 172.21.15.33:53548) 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 -- 172.21.15.33:0/2691794224 learned_addr learned my addr 172.21.15.33:0/2691794224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb622a00640 1 --2- 172.21.15.33:0/2691794224 >> v2:172.21.15.103:3300/0 conn(0x7fb6241461a0 0x7fb6240b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 -- 172.21.15.33:0/2691794224 >> v2:172.21.15.103:3300/0 conn(0x7fb6241461a0 msgr2=0x7fb6240b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 --2- 172.21.15.33:0/2691794224 >> v2:172.21.15.103:3300/0 conn(0x7fb6241461a0 0x7fb6240b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 -- 172.21.15.33:0/2691794224 >> v1:172.21.15.103:6789/0 conn(0x7fb6240acdb0 legacy=0x7fb624160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.971+0000 7fb61a000640 1 -- 172.21.15.33:0/2691794224 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240b3650 con 0x7fb6240b2d60 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.972+0000 7fb61a000640 1 --2- 172.21.15.33:0/2691794224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240b2d60 0x7fb6240ac870 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb6240b1580 tx=0x7fb60c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10e14474274e3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb622000640 1 -- 172.21.15.33:0/2691794224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c032440 con 0x7fb6240b2d60 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb622000640 1 -- 172.21.15.33:0/2691794224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c0325a0 con 0x7fb6240b2d60 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb622000640 1 -- 172.21.15.33:0/2691794224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c032930 con 0x7fb6240b2d60 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 -- 172.21.15.33:0/2691794224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240b2d60 msgr2=0x7fb6240ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 --2- 172.21.15.33:0/2691794224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240b2d60 0x7fb6240ac870 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb6240b1580 tx=0x7fb60c02a270 comp rx=0 tx=0).stop 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 -- 172.21.15.33:0/2691794224 shutdown_connections 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 --2- 172.21.15.33:0/2691794224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240b2d60 0x7fb6240ac870 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 --2- 172.21.15.33:0/2691794224 >> v2:172.21.15.103:3300/0 conn(0x7fb6241461a0 0x7fb6240b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 -- 172.21.15.33:0/2691794224 >> 172.21.15.33:0/2691794224 conn(0x7fb6240b0510 msgr2=0x7fb6240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 -- 172.21.15.33:0/2691794224 shutdown_connections 2024-09-13T19:01:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.973+0000 7fb629e00640 1 -- 172.21.15.33:0/2691794224 wait complete. 2024-09-13T19:01:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.975+0000 7fb629e00640 1 Processor -- start 2024-09-13T19:01:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.975+0000 7fb629e00640 1 -- start start 2024-09-13T19:01:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 0x7fb6241f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6240b2d60 0x7fb6240cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6241461a0 0x7fb6240cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415f240 con 0x7fb6240acdb0 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415e6a0 con 0x7fb6241461a0 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb629e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415e910 con 0x7fb6240b2d60 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb622a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 0x7fb6241f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb622a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 0x7fb6241f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53558/0 (socket says 172.21.15.33:53558) 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb622a00640 1 -- 172.21.15.33:0/2855669931 learned_addr learned my addr 172.21.15.33:0/2855669931 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb61a000640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6240b2d60 0x7fb6240cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.976+0000 7fb623400640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6241461a0 0x7fb6240cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 -- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6240b2d60 msgr2=0x7fb6240cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6240b2d60 0x7fb6240cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 -- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6241461a0 msgr2=0x7fb6240cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6241461a0 0x7fb6240cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0094d0 con 0x7fb6240acdb0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb623400640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6241461a0 0x7fb6240cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb622a00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 0x7fb6241f2cc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e870 tx=0x7fb61400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140094f0 con 0x7fb6240acdb0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400c940 con 0x7fb6240acdb0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400ccf0 con 0x7fb6240acdb0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62415ebf0 con 0x7fb6240acdb0 2024-09-13T19:01:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.977+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240ce010 con 0x7fb6240acdb0 2024-09-13T19:01:36.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.978+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb624146580 con 0x7fb6240acdb0 2024-09-13T19:01:36.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.979+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb614013470 con 0x7fb6240acdb0 2024-09-13T19:01:36.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.980+0000 7fb61be00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb60006ac30 0x7fb60006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.980+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb614089120 con 0x7fb6240acdb0 2024-09-13T19:01:36.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.980+0000 7fb61be00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7fb600070a90 0x7fb600072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:36.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.980+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb600073560 con 0x7fb600070a90 2024-09-13T19:01:36.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.981+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb61408b700 con 0x7fb6240acdb0 2024-09-13T19:01:36.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.981+0000 7fb623400640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7fb600070a90 0x7fb600072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.981+0000 7fb61a000640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb60006ac30 0x7fb60006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:36.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.981+0000 7fb623400640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7fb600070a90 0x7fb600072eb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.982+0000 7fb61a000640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb60006ac30 0x7fb60006d0f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034000 tx=0x7fb60c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:36.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.982+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== osd.1 v2:172.21.15.33:6816/3216118851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb600073560 con 0x7fb600070a90 2024-09-13T19:01:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.995+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 --> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb62415ea80 con 0x7fb600070a90 2024-09-13T19:01:36.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.995+0000 7fb61be00640 1 -- 172.21.15.33:0/2855669931 <== osd.1 v2:172.21.15.33:6816/3216118851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb62415ea80 con 0x7fb600070a90 2024-09-13T19:01:36.998 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:36.998 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:36.998 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.995+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7fb600070a90 msgr2=0x7fb600072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.995+0000 7fb629e00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:6816/3216118851,v1:172.21.15.33:6817/3216118851] conn(0x7fb600070a90 0x7fb600072eb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb60006ac30 msgr2=0x7fb60006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb60006ac30 0x7fb60006d0f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034000 tx=0x7fb60c02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 msgr2=0x7fb6241f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 --2- 172.21.15.33:0/2855669931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6240acdb0 0x7fb6241f2cc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e870 tx=0x7fb61400ed30 comp rx=0 tx=0).stop 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb623400640 1 -- 172.21.15.33:0/2855669931 reap_dead start 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 shutdown_connections 2024-09-13T19:01:36.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 >> 172.21.15.33:0/2855669931 conn(0x7fb6240b0510 msgr2=0x7fb62415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 shutdown_connections 2024-09-13T19:01:37.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:36.996+0000 7fb629e00640 1 -- 172.21.15.33:0/2855669931 wait complete. 2024-09-13T19:01:37.012 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T19:01:37.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.165+0000 7fd8bfe00640 1 Processor -- start 2024-09-13T19:01:37.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.165+0000 7fd8bfe00640 1 -- start start 2024-09-13T19:01:37.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bfe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b80b3a40 0x7fd8b81428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b80accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bfe00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b813fbc0 con 0x7fd8b8160370 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bfe00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b806cca0 con 0x7fd8b80b3a40 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80ad200 con 0x7fd8b80ac870 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b80b3a40 0x7fd8b81428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b80b3a40 0x7fd8b81428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53574/0 (socket says 172.21.15.33:53574) 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 -- 172.21.15.33:0/3527195720 learned_addr learned my addr 172.21.15.33:0/3527195720 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bde00640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b80accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 -- 172.21.15.33:0/3527195720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 msgr2=0x7fd8b80accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b80accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 -- 172.21.15.33:0/3527195720 >> v1:172.21.15.103:6789/0 conn(0x7fd8b8160370 legacy=0x7fd8b80b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.167+0000 7fd8bd400640 1 -- 172.21.15.33:0/3527195720 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b815ce80 con 0x7fd8b80b3a40 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.168+0000 7fd8bd400640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b80b3a40 0x7fd8b81428a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009870 tx=0x7fd8ac02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660738a6b0154487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8b7e00640 1 -- 172.21.15.33:0/3527195720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac02ae80 con 0x7fd8b80b3a40 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8b7e00640 1 -- 172.21.15.33:0/3527195720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac032440 con 0x7fd8b80b3a40 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8b7e00640 1 -- 172.21.15.33:0/3527195720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0327b0 con 0x7fd8b80b3a40 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 -- 172.21.15.33:0/3527195720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b80b3a40 msgr2=0x7fd8b81428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b80b3a40 0x7fd8b81428a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009870 tx=0x7fd8ac02a130 comp rx=0 tx=0).stop 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 -- 172.21.15.33:0/3527195720 shutdown_connections 2024-09-13T19:01:37.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b80accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/3527195720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b80b3a40 0x7fd8b81428a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.169+0000 7fd8bfe00640 1 -- 172.21.15.33:0/3527195720 >> 172.21.15.33:0/3527195720 conn(0x7fd8b80b0510 msgr2=0x7fd8b80b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.170+0000 7fd8bfe00640 1 -- 172.21.15.33:0/3527195720 shutdown_connections 2024-09-13T19:01:37.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.170+0000 7fd8bfe00640 1 -- 172.21.15.33:0/3527195720 wait complete. 2024-09-13T19:01:37.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.171+0000 7fd8bfe00640 1 Processor -- start 2024-09-13T19:01:37.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.171+0000 7fd8bfe00640 1 -- start start 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b8140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b80b3a40 0x7fd8b8139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b81440a0 con 0x7fd8b8160370 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8143490 con 0x7fd8b80b3a40 2024-09-13T19:01:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bfe00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8143770 con 0x7fd8b80ac870 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bde00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53584/0 (socket says 172.21.15.33:53584) 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.172+0000 7fd8bde00640 1 -- 172.21.15.33:0/2981305034 learned_addr learned my addr 172.21.15.33:0/2981305034 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bd400640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b8140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bca00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b80b3a40 0x7fd8b8139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 -- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 msgr2=0x7fd8b8140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b8140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 -- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b80b3a40 msgr2=0x7fd8b8139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b80b3a40 0x7fd8b8139210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 -- 172.21.15.33:0/2981305034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0094d0 con 0x7fd8b8160370 2024-09-13T19:01:37.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bde00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000efc0 tx=0x7fd8b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0014480 con 0x7fd8b8160370 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000f040 con 0x7fd8b8160370 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.173+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8143a50 con 0x7fd8b8160370 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.174+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0014820 con 0x7fd8b8160370 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.174+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8139750 con 0x7fd8b8160370 2024-09-13T19:01:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.175+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b8144250 con 0x7fd8b8160370 2024-09-13T19:01:37.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.175+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8b0014980 con 0x7fd8b8160370 2024-09-13T19:01:37.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.176+0000 7fd8b5600640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 0x7fd89806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.176+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8b0089e20 con 0x7fd8b8160370 2024-09-13T19:01:37.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.177+0000 7fd8bd400640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 0x7fd89806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.177+0000 7fd8bd400640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 0x7fd89806d0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac034000 tx=0x7fd8ac02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.180+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd8b8144250 con 0x7fd8b8160370 2024-09-13T19:01:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.364+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b8160bf0 con 0x7fd89806ac30 2024-09-13T19:01:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.365+0000 7fd8b5600640 1 -- 172.21.15.33:0/2981305034 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd8ac032a60 con 0x7fd89806ac30 2024-09-13T19:01:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T19:01:37.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 msgr2=0x7fd89806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 0x7fd89806d0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac034000 tx=0x7fd8ac02e000 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 msgr2=0x7fd8b8144530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000efc0 tx=0x7fd8b000c490 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 shutdown_connections 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fd89806ac30 0x7fd89806d0f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b8160370 0x7fd8b8144530 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b80b3a40 0x7fd8b8139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 --2- 172.21.15.33:0/2981305034 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd8b80ac870 0x7fd8b8140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 >> 172.21.15.33:0/2981305034 conn(0x7fd8b80b0510 msgr2=0x7fd8b8070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 shutdown_connections 2024-09-13T19:01:37.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.367+0000 7fd8bfe00640 1 -- 172.21.15.33:0/2981305034 wait complete. 2024-09-13T19:01:37.385 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T19:01:37.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:37.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.542+0000 7f4418400640 1 Processor -- start 2024-09-13T19:01:37.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.542+0000 7f4418400640 1 -- start start 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f441006cd60 0x7f44100b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f441015b770 0x7f44100cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44100cd870 0x7f44100cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4410151a20 con 0x7f441006cd60 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100cc430 con 0x7f441015b770 2024-09-13T19:01:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4418400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44100b1bb0 con 0x7f44100cd870 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4415a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f441006cd60 0x7f44100b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4415a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f441006cd60 0x7f44100b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53592/0 (socket says 172.21.15.33:53592) 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.543+0000 7f4415a00640 1 -- 172.21.15.33:0/825044708 learned_addr learned my addr 172.21.15.33:0/825044708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415000640 1 --2- 172.21.15.33:0/825044708 >> v2:172.21.15.103:3300/0 conn(0x7f441015b770 0x7f44100cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4416400640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44100cd870 0x7f44100cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415a00640 1 -- 172.21.15.33:0/825044708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44100cd870 msgr2=0x7f44100cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:37.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415a00640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44100cd870 0x7f44100cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415a00640 1 -- 172.21.15.33:0/825044708 >> v2:172.21.15.103:3300/0 conn(0x7f441015b770 msgr2=0x7f44100cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:37.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415a00640 1 --2- 172.21.15.33:0/825044708 >> v2:172.21.15.103:3300/0 conn(0x7f441015b770 0x7f44100cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.544+0000 7f4415a00640 1 -- 172.21.15.33:0/825044708 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100b1e70 con 0x7f441006cd60 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.545+0000 7f4415a00640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441006cd60 0x7f44100b2950 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f441006daf0 tx=0x7f440402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892228871e9f243b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.545+0000 7f440fe00640 1 -- 172.21.15.33:0/825044708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404032440 con 0x7f441006cd60 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.545+0000 7f440fe00640 1 -- 172.21.15.33:0/825044708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44040325a0 con 0x7f441006cd60 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.545+0000 7f440fe00640 1 -- 172.21.15.33:0/825044708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404032930 con 0x7f441006cd60 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 -- 172.21.15.33:0/825044708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441006cd60 msgr2=0x7f44100b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441006cd60 0x7f44100b2950 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f441006daf0 tx=0x7f440402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 -- 172.21.15.33:0/825044708 shutdown_connections 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f44100cd870 0x7f44100cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 --2- 172.21.15.33:0/825044708 >> v2:172.21.15.103:3300/0 conn(0x7f441015b770 0x7f44100cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 --2- 172.21.15.33:0/825044708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441006cd60 0x7f44100b2950 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 -- 172.21.15.33:0/825044708 >> 172.21.15.33:0/825044708 conn(0x7f44100b0510 msgr2=0x7f44100b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 -- 172.21.15.33:0/825044708 shutdown_connections 2024-09-13T19:01:37.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.546+0000 7f4418400640 1 -- 172.21.15.33:0/825044708 wait complete. 2024-09-13T19:01:37.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.547+0000 7f4418400640 1 Processor -- start 2024-09-13T19:01:37.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.547+0000 7f4418400640 1 -- start start 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f441006cd60 0x7f4410150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44100cd870 0x7f4410157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 0x7f441014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44101e1920 con 0x7f441015b770 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44101502c0 con 0x7f44100cd870 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.548+0000 7f4418400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44101e1640 con 0x7f441006cd60 2024-09-13T19:01:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 0x7f441014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 0x7f441014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53608/0 (socket says 172.21.15.33:53608) 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 -- 172.21.15.33:0/2929057125 learned_addr learned my addr 172.21.15.33:0/2929057125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4415000640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44100cd870 0x7f4410157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4415a00640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f441006cd60 0x7f4410150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 -- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f441006cd60 msgr2=0x7f4410150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f441006cd60 0x7f4410150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 -- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44100cd870 msgr2=0x7f4410157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44100cd870 0x7f4410157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.549+0000 7f4416400640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040094d0 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f4416400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 0x7f441014e220 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4408007d40 tx=0x7f440800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408014420 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44080145a0 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408014950 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44101504d0 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.550+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44101583e0 con 0x7f441015b770 2024-09-13T19:01:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.551+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44100b2430 con 0x7f441015b770 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.552+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4408014ab0 con 0x7f441015b770 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f440d600640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f43f006ac00 0x7f43f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44080897c0 con 0x7f441015b770 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f440d600640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7f43f0070a60 0x7f43f0072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43f0073530 con 0x7f43f0070a60 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f440808bda0 con 0x7f441015b770 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f4415a00640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f43f006ac00 0x7f43f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.553+0000 7f4415000640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7f43f0070a60 0x7f43f0072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.554+0000 7f4415a00640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f43f006ac00 0x7f43f006d0c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4404034000 tx=0x7f440402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.554+0000 7f4415000640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7f43f0070a60 0x7f43f0072e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.555+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== osd.2 v2:172.21.15.33:6824/3897994756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f43f0073530 con 0x7f43f0070a60 2024-09-13T19:01:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.567+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 --> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f44100ce200 con 0x7f43f0070a60 2024-09-13T19:01:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f440d600640 1 -- 172.21.15.33:0/2929057125 <== osd.2 v2:172.21.15.33:6824/3897994756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f43fc0075f0 con 0x7f43f0070a60 2024-09-13T19:01:37.570 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:37.570 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7f43f0070a60 msgr2=0x7f43f0072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:6824/3897994756,v1:172.21.15.33:6825/3897994756] conn(0x7f43f0070a60 0x7f43f0072e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f43f006ac00 msgr2=0x7f43f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f43f006ac00 0x7f43f006d0c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4404034000 tx=0x7f440402e000 comp rx=0 tx=0).stop 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 msgr2=0x7f441014e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 --2- 172.21.15.33:0/2929057125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f441015b770 0x7f441014e220 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4408007d40 tx=0x7f440800e4b0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4416400640 1 -- 172.21.15.33:0/2929057125 reap_dead start 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 shutdown_connections 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 >> 172.21.15.33:0/2929057125 conn(0x7f44100b0510 msgr2=0x7f4410069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 shutdown_connections 2024-09-13T19:01:37.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.568+0000 7f4418400640 1 -- 172.21.15.33:0/2929057125 wait complete. 2024-09-13T19:01:37.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T19:01:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.738+0000 7f2ab6600640 1 Processor -- start 2024-09-13T19:01:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.738+0000 7f2ab6600640 1 -- start start 2024-09-13T19:01:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2ab6600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 0x7f2ab0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2ab6600640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab0159fc0 con 0x7f2ab006f660 2024-09-13T19:01:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2ab6600640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab0153f00 con 0x7f2ab0153b20 2024-09-13T19:01:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2ab6600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00b3df0 con 0x7f2ab00b3990 2024-09-13T19:01:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2aafe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2ab006f660 0x7f2ab006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44502/0 (socket says 172.21.15.33:44502) 2024-09-13T19:01:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2aafe00640 1 -- 172.21.15.33:0/1585970119 learned_addr learned my addr 172.21.15.33:0/1585970119 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.739+0000 7f2aa6a00640 1 --2- 172.21.15.33:0/1585970119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 0x7f2ab0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917213589 0 0) 0x7f2ab0159fc0 con 0x7f2ab006f660 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a94003520 con 0x7f2ab006f660 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478447560 0 0) 0x7f2ab0153f00 con 0x7f2ab0153b20 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab0159fc0 con 0x7f2ab0153b20 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aa6a00640 1 -- 172.21.15.33:0/1585970119 >> v1:172.21.15.103:6789/0 conn(0x7f2ab0153b20 legacy=0x7f2ab00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aa6a00640 1 -- 172.21.15.33:0/1585970119 >> v1:172.21.15.33:6789/0 conn(0x7f2ab006f660 legacy=0x7f2ab006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.740+0000 7f2aa6a00640 1 -- 172.21.15.33:0/1585970119 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00b1a40 con 0x7f2ab00b3990 2024-09-13T19:01:37.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.741+0000 7f2aa6a00640 1 --2- 172.21.15.33:0/1585970119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 0x7f2ab0159a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a980097d0 tx=0x7f2a9802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f683cda9b45b4024 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.741+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98032440 con 0x7f2ab00b3990 2024-09-13T19:01:37.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.741+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a980325a0 con 0x7f2ab00b3990 2024-09-13T19:01:37.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.741+0000 7f2aaea00640 1 -- 172.21.15.33:0/1585970119 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98032910 con 0x7f2ab00b3990 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 -- 172.21.15.33:0/1585970119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 msgr2=0x7f2ab0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 --2- 172.21.15.33:0/1585970119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 0x7f2ab0159a80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a980097d0 tx=0x7f2a9802a210 comp rx=0 tx=0).stop 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 -- 172.21.15.33:0/1585970119 shutdown_connections 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 --2- 172.21.15.33:0/1585970119 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab00b3990 0x7f2ab0159a80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 -- 172.21.15.33:0/1585970119 >> 172.21.15.33:0/1585970119 conn(0x7f2ab00b0510 msgr2=0x7f2ab00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 -- 172.21.15.33:0/1585970119 shutdown_connections 2024-09-13T19:01:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.742+0000 7f2ab6600640 1 -- 172.21.15.33:0/1585970119 wait complete. 2024-09-13T19:01:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.744+0000 7f2ab6600640 1 Processor -- start 2024-09-13T19:01:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.744+0000 7f2ab6600640 1 -- start start 2024-09-13T19:01:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab006f660 0x7f2ab00cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0153b20 0x7f2ab013ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01502d0 con 0x7f2ab00b3990 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01eead0 con 0x7f2ab0153b20 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2ab6600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab013d870 con 0x7f2ab006f660 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53610/0 (socket says 172.21.15.33:53610) 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 -- 172.21.15.33:0/2270834386 learned_addr learned my addr 172.21.15.33:0/2270834386 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aaf400640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab006f660 0x7f2ab00cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aafe00640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0153b20 0x7f2ab013ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 -- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab006f660 msgr2=0x7f2ab00cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab006f660 0x7f2ab00cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 -- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0153b20 msgr2=0x7f2ab013ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0153b20 0x7f2ab013ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.745+0000 7f2aa6a00640 1 -- 172.21.15.33:0/2270834386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009400 con 0x7f2ab00b3990 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2aa6a00640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2a980098f0 tx=0x7f2a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9803e920 con 0x7f2ab00b3990 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9803ea80 con 0x7f2ab00b3990 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9803ee10 con 0x7f2ab00b3990 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab01edb90 con 0x7f2ab00b3990 2024-09-13T19:01:37.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.746+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab01ee130 con 0x7f2ab00b3990 2024-09-13T19:01:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.747+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab00cb5f0 con 0x7f2ab00b3990 2024-09-13T19:01:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.748+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a9803c400 con 0x7f2ab00b3990 2024-09-13T19:01:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.749+0000 7f2aa7e00640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 0x7f2a8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.749+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a980a9dd0 con 0x7f2ab00b3990 2024-09-13T19:01:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.750+0000 7f2aaf400640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 0x7f2a8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.750+0000 7f2aaf400640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 0x7f2a8c06d0c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00011e0 tx=0x7f2aa0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.753+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a98075350 con 0x7f2ab00b3990 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.931+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab0151690 con 0x7f2a8c06ac00 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.932+0000 7f2aa7e00640 1 -- 172.21.15.33:0/2270834386 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2ab0151690 con 0x7f2a8c06ac00 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 msgr2=0x7f2a8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 0x7f2a8c06d0c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00011e0 tx=0x7f2aa0009040 comp rx=0 tx=0).stop 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 msgr2=0x7f2ab00cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2a980098f0 tx=0x7f2a980046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 shutdown_connections 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f2a8c06ac00 0x7f2a8c06d0c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0153b20 0x7f2ab013ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ab00b3990 0x7f2ab00cce10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 --2- 172.21.15.33:0/2270834386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ab006f660 0x7f2ab00cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:37.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 >> 172.21.15.33:0/2270834386 conn(0x7f2ab00b0510 msgr2=0x7f2ab00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:37.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 shutdown_connections 2024-09-13T19:01:37.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:37.934+0000 7f2ab6600640 1 -- 172.21.15.33:0/2270834386 wait complete. 2024-09-13T19:01:37.952 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T19:01:37.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:38.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.109+0000 7f4cc7200640 1 Processor -- start 2024-09-13T19:01:38.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.110+0000 7f4cc7200640 1 -- start start 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cc80c8f80 0x7f4cc80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4cc80c98a0 0x7f4cc80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 0x7f4cc80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc815ab90 con 0x7f4cc80c98a0 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc80717c0 con 0x7f4cc80c8f80 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc7200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8070fa0 con 0x7f4cc80c9d00 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cbd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4cc80c98a0 0x7f4cc80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cbd400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4cc80c98a0 0x7f4cc80cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53626/0 (socket says 172.21.15.33:53626) 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cbd400640 1 -- 172.21.15.33:0/2023260274 learned_addr learned my addr 172.21.15.33:0/2023260274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc5e00640 1 --2- 172.21.15.33:0/2023260274 >> v2:172.21.15.103:3300/0 conn(0x7f4cc80c8f80 0x7f4cc80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.111+0000 7f4cc6800640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 0x7f4cc80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cbd400640 1 -- 172.21.15.33:0/2023260274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 msgr2=0x7f4cc80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cbd400640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 0x7f4cc80cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cbd400640 1 -- 172.21.15.33:0/2023260274 >> v2:172.21.15.103:3300/0 conn(0x7f4cc80c8f80 msgr2=0x7f4cc80c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cbd400640 1 --2- 172.21.15.33:0/2023260274 >> v2:172.21.15.103:3300/0 conn(0x7f4cc80c8f80 0x7f4cc80c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cbd400640 1 -- 172.21.15.33:0/2023260274 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80711b0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.112+0000 7f4cc6800640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 0x7f4cc80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cbd400640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80cc480 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4cc806df70 tx=0x7f4cb002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560cc7df69fa83f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cc5400640 1 -- 172.21.15.33:0/2023260274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb002ae90 con 0x7f4cc80c98a0 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cc5400640 1 -- 172.21.15.33:0/2023260274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb0032440 con 0x7f4cc80c98a0 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cc5400640 1 -- 172.21.15.33:0/2023260274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00327d0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cc7200640 1 -- 172.21.15.33:0/2023260274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 msgr2=0x7f4cc80cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.113+0000 7f4cc7200640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80cc480 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4cc806df70 tx=0x7f4cb002a140 comp rx=0 tx=0).stop 2024-09-13T19:01:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 -- 172.21.15.33:0/2023260274 shutdown_connections 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c9d00 0x7f4cc80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 --2- 172.21.15.33:0/2023260274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80cc480 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 --2- 172.21.15.33:0/2023260274 >> v2:172.21.15.103:3300/0 conn(0x7f4cc80c8f80 0x7f4cc80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 -- 172.21.15.33:0/2023260274 >> 172.21.15.33:0/2023260274 conn(0x7f4cc80b0330 msgr2=0x7f4cc80b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 -- 172.21.15.33:0/2023260274 shutdown_connections 2024-09-13T19:01:38.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.114+0000 7f4cc7200640 1 -- 172.21.15.33:0/2023260274 wait complete. 2024-09-13T19:01:38.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.115+0000 7f4cc7200640 1 Processor -- start 2024-09-13T19:01:38.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.115+0000 7f4cc7200640 1 -- start start 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c8f80 0x7f4cc815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc80c9d00 0x7f4cc80c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc813fa80 con 0x7f4cc80c98a0 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc813fcf0 con 0x7f4cc80c9d00 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.116+0000 7f4cc7200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc813ffd0 con 0x7f4cc80c8f80 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53630/0 (socket says 172.21.15.33:53630) 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 -- 172.21.15.33:0/1951037579 learned_addr learned my addr 172.21.15.33:0/1951037579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cc5e00640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c8f80 0x7f4cc815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cc6800640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc80c9d00 0x7f4cc80c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 -- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c8f80 msgr2=0x7f4cc815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc80c8f80 0x7f4cc815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 -- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc80c9d00 msgr2=0x7f4cc80c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc80c9d00 0x7f4cc80c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00094d0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.117+0000 7f4cbd400640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80c82b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0000c00 tx=0x7f4cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.118+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb003d830 con 0x7f4cc80c98a0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.118+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb003d990 con 0x7f4cc80c98a0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.118+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb003dd20 con 0x7f4cc80c98a0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.118+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc81402b0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.118+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc81428f0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.119+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4cc806fa90 con 0x7f4cc80c98a0 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.120+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4cb0039040 con 0x7f4cc80c98a0 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cbea00640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ca406ac00 0x7f4ca406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4cb00a9b20 con 0x7f4cc80c98a0 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cbea00640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f4ca4070a60 0x7f4ca4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ca4073530 con 0x7f4ca4070a60 2024-09-13T19:01:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cb00ae2a0 con 0x7f4cc80c98a0 2024-09-13T19:01:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cc5e00640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ca406ac00 0x7f4ca406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.121+0000 7f4cc6800640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f4ca4070a60 0x7f4ca4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.122+0000 7f4cc5e00640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ca406ac00 0x7f4ca406d0c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009a20 tx=0x7f4cb8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.122+0000 7f4cc6800640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f4ca4070a60 0x7f4ca4072e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.123+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== osd.3 v2:172.21.15.33:6800/2901377922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4ca4073530 con 0x7f4ca4070a60 2024-09-13T19:01:38.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.135+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 --> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4cc8071450 con 0x7f4ca4070a60 2024-09-13T19:01:38.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cbea00640 1 -- 172.21.15.33:0/1951037579 <== osd.3 v2:172.21.15.33:6800/2901377922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4cc000f040 con 0x7f4ca4070a60 2024-09-13T19:01:38.138 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:38.138 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:38.138 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f4ca4070a60 msgr2=0x7f4ca4072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:6800/2901377922,v1:172.21.15.33:6801/2901377922] conn(0x7f4ca4070a60 0x7f4ca4072e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ca406ac00 msgr2=0x7f4ca406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f4ca406ac00 0x7f4ca406d0c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009a20 tx=0x7f4cb8009190 comp rx=0 tx=0).stop 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 msgr2=0x7f4cc80c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 --2- 172.21.15.33:0/1951037579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc80c98a0 0x7f4cc80c82b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0000c00 tx=0x7f4cb00046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc6800640 1 -- 172.21.15.33:0/1951037579 reap_dead start 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 shutdown_connections 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 >> 172.21.15.33:0/1951037579 conn(0x7f4cc80b0330 msgr2=0x7f4cc806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 shutdown_connections 2024-09-13T19:01:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.136+0000 7f4cc7200640 1 -- 172.21.15.33:0/1951037579 wait complete. 2024-09-13T19:01:38.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T19:01:38.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.307+0000 7f1e6d600640 1 Processor -- start 2024-09-13T19:01:38.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.308+0000 7f1e6d600640 1 -- start start 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e6815a5c0 0x7f1e680b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e680cbac0 0x7f1e680b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e6806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680cce20 con 0x7f1e680cbac0 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680cbfc0 con 0x7f1e6815a5c0 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6d600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680707a0 con 0x7f1e680afe10 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e5fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e680cbac0 0x7f1e680b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e5fe00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e680cbac0 0x7f1e680b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53636/0 (socket says 172.21.15.33:53636) 2024-09-13T19:01:38.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e5fe00640 1 -- 172.21.15.33:0/194197076 learned_addr learned my addr 172.21.15.33:0/194197076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e67e00640 1 --2- 172.21.15.33:0/194197076 >> v2:172.21.15.103:3300/0 conn(0x7f1e6815a5c0 0x7f1e680b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.309+0000 7f1e6cc00640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e6806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e5fe00640 1 -- 172.21.15.33:0/194197076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 msgr2=0x7f1e6806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e5fe00640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e6806f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e5fe00640 1 -- 172.21.15.33:0/194197076 >> v2:172.21.15.103:3300/0 conn(0x7f1e6815a5c0 msgr2=0x7f1e680b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e5fe00640 1 --2- 172.21.15.33:0/194197076 >> v2:172.21.15.103:3300/0 conn(0x7f1e6815a5c0 0x7f1e680b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e5fe00640 1 -- 172.21.15.33:0/194197076 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68070a80 con 0x7f1e680cbac0 2024-09-13T19:01:38.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.310+0000 7f1e6cc00640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e6806f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:38.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e5fe00640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e680cbac0 0x7f1e680b3ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1e68067270 tx=0x7f1e5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bef565f8c685c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e67400640 1 -- 172.21.15.33:0/194197076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032440 con 0x7f1e680cbac0 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e67400640 1 -- 172.21.15.33:0/194197076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500325a0 con 0x7f1e680cbac0 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e67400640 1 -- 172.21.15.33:0/194197076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032930 con 0x7f1e680cbac0 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e6d600640 1 -- 172.21.15.33:0/194197076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e680cbac0 msgr2=0x7f1e680b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.311+0000 7f1e6d600640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e680cbac0 0x7f1e680b3ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f1e68067270 tx=0x7f1e5002a1e0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 -- 172.21.15.33:0/194197076 shutdown_connections 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e6806f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 --2- 172.21.15.33:0/194197076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e680cbac0 0x7f1e680b3ef0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 --2- 172.21.15.33:0/194197076 >> v2:172.21.15.103:3300/0 conn(0x7f1e6815a5c0 0x7f1e680b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 -- 172.21.15.33:0/194197076 >> 172.21.15.33:0/194197076 conn(0x7f1e680ae310 msgr2=0x7f1e680ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 -- 172.21.15.33:0/194197076 shutdown_connections 2024-09-13T19:01:38.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.312+0000 7f1e6d600640 1 -- 172.21.15.33:0/194197076 wait complete. 2024-09-13T19:01:38.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.313+0000 7f1e6d600640 1 Processor -- start 2024-09-13T19:01:38.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.313+0000 7f1e6d600640 1 -- start start 2024-09-13T19:01:38.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e68143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e680cbac0 0x7f1e68155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68144500 con 0x7f1e6815a5c0 2024-09-13T19:01:38.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e681f3500 con 0x7f1e680cbac0 2024-09-13T19:01:38.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.314+0000 7f1e6d600640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e681f3350 con 0x7f1e680afe10 2024-09-13T19:01:38.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e67e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e68143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53652/0 (socket says 172.21.15.33:53652) 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 -- 172.21.15.33:0/2915089151 learned_addr learned my addr 172.21.15.33:0/2915089151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e5fe00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e680cbac0 0x7f1e68155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 -- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 msgr2=0x7f1e68143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e68143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 -- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e680cbac0 msgr2=0x7f1e68155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e680cbac0 0x7f1e68155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 -- 172.21.15.33:0/2915089151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500094d0 con 0x7f1e6815a5c0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.315+0000 7f1e6cc00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007e20 tx=0x7f1e6000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.316+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60015600 con 0x7f1e6815a5c0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.316+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000f040 con 0x7f1e6815a5c0 2024-09-13T19:01:38.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.316+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600159c0 con 0x7f1e6815a5c0 2024-09-13T19:01:38.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.316+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e681f3070 con 0x7f1e6815a5c0 2024-09-13T19:01:38.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.316+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e68153330 con 0x7f1e6815a5c0 2024-09-13T19:01:38.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.317+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68067360 con 0x7f1e6815a5c0 2024-09-13T19:01:38.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.318+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e6001e3b0 con 0x7f1e6815a5c0 2024-09-13T19:01:38.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.318+0000 7f1e64c00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 0x7f1e4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.319+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e600893a0 con 0x7f1e6815a5c0 2024-09-13T19:01:38.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.319+0000 7f1e67e00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 0x7f1e4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.320+0000 7f1e67e00640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 0x7f1e4406d0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1e6815a320 tx=0x7f1e58009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.323+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e60054890 con 0x7f1e6815a5c0 2024-09-13T19:01:38.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.501+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e680ae0c0 con 0x7f1e4406ac00 2024-09-13T19:01:38.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.502+0000 7f1e64c00640 1 -- 172.21.15.33:0/2915089151 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e680ae0c0 con 0x7f1e4406ac00 2024-09-13T19:01:38.504 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 msgr2=0x7f1e4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 0x7f1e4406d0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1e6815a320 tx=0x7f1e58009190 comp rx=0 tx=0).stop 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 msgr2=0x7f1e68156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007e20 tx=0x7f1e6000d4a0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 shutdown_connections 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f1e4406ac00 0x7f1e4406d0c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e6815a5c0 0x7f1e68156170 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e680cbac0 0x7f1e68155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 --2- 172.21.15.33:0/2915089151 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e680afe10 0x7f1e68143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.504+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 >> 172.21.15.33:0/2915089151 conn(0x7f1e680ae310 msgr2=0x7f1e680ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.505+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 shutdown_connections 2024-09-13T19:01:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.505+0000 7f1e6d600640 1 -- 172.21.15.33:0/2915089151 wait complete. 2024-09-13T19:01:38.522 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T19:01:38.523 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:38.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.679+0000 7f9893c00640 1 Processor -- start 2024-09-13T19:01:38.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.679+0000 7f9893c00640 1 -- start start 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.680+0000 7f9893c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 0x7f988c0704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.680+0000 7f9893c00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c070030 con 0x7f988c1596d0 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f9893c00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c071110 con 0x7f988c1592f0 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f9893c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c071870 con 0x7f988c0adeb0 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f9891c00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f988c1596d0 0x7f988c070a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44510/0 (socket says 172.21.15.33:44510) 2024-09-13T19:01:38.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f9891c00640 1 -- 172.21.15.33:0/107633285 learned_addr learned my addr 172.21.15.33:0/107633285 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988be00640 1 --2- 172.21.15.33:0/107633285 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 0x7f988c0704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806461539 0 0) 0x7f988c070030 con 0x7f988c1596d0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9874005730 con 0x7f988c1596d0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685390876 0 0) 0x7f988c071110 con 0x7f988c1592f0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f988c070030 con 0x7f988c1592f0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2184210104 0 0) 0x7f9874005730 con 0x7f988c1596d0 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988be00640 1 -- 172.21.15.33:0/107633285 >> v1:172.21.15.103:6789/0 conn(0x7f988c1592f0 legacy=0x7f988c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988be00640 1 -- 172.21.15.33:0/107633285 >> v1:172.21.15.33:6789/0 conn(0x7f988c1596d0 legacy=0x7f988c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.681+0000 7f988be00640 1 -- 172.21.15.33:0/107633285 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c06f700 con 0x7f988c0adeb0 2024-09-13T19:01:38.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f988be00640 1 --2- 172.21.15.33:0/107633285 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 0x7f988c0704c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98780097d0 tx=0x7f987802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def7cd4441aed880 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840019f0 con 0x7f988c0adeb0 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987802ac30 con 0x7f988c0adeb0 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f988b400640 1 -- 172.21.15.33:0/107633285 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878032440 con 0x7f988c0adeb0 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f9893c00640 1 -- 172.21.15.33:0/107633285 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 msgr2=0x7f988c0704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f9893c00640 1 --2- 172.21.15.33:0/107633285 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 0x7f988c0704c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98780097d0 tx=0x7f987802a1a0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f9893c00640 1 -- 172.21.15.33:0/107633285 shutdown_connections 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f9893c00640 1 --2- 172.21.15.33:0/107633285 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c0adeb0 0x7f988c0704c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.683+0000 7f9893c00640 1 -- 172.21.15.33:0/107633285 >> 172.21.15.33:0/107633285 conn(0x7f988c0b0510 msgr2=0x7f988c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.684+0000 7f9893c00640 1 -- 172.21.15.33:0/107633285 shutdown_connections 2024-09-13T19:01:38.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.684+0000 7f9893c00640 1 -- 172.21.15.33:0/107633285 wait complete. 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.685+0000 7f9893c00640 1 Processor -- start 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.685+0000 7f9893c00640 1 -- start start 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f988c0adeb0 0x7f988c146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c1592f0 0x7f988c156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 0x7f988c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c157b90 con 0x7f988c1596d0 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c156f80 con 0x7f988c0adeb0 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9893c00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c157260 con 0x7f988c1592f0 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.686+0000 7f9891c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 0x7f988c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 0x7f988c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53668/0 (socket says 172.21.15.33:53668) 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 -- 172.21.15.33:0/2653708927 learned_addr learned my addr 172.21.15.33:0/2653708927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f988be00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c1592f0 0x7f988c156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891200640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f988c0adeb0 0x7f988c146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 -- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c1592f0 msgr2=0x7f988c156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f988c1592f0 0x7f988c156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 -- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f988c0adeb0 msgr2=0x7f988c146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f988c0adeb0 0x7f988c146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878009400 con 0x7f988c1596d0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9891c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 0x7f988c156950 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f988400cbf0 tx=0x7f988400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.687+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400ad50 con 0x7f988c1596d0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.688+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884012400 con 0x7f988c1596d0 2024-09-13T19:01:38.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.688+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840127b0 con 0x7f988c1596d0 2024-09-13T19:01:38.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.688+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c157540 con 0x7f988c1596d0 2024-09-13T19:01:38.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.688+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c15be60 con 0x7f988c1596d0 2024-09-13T19:01:38.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.689+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f988c06fcc0 con 0x7f988c1596d0 2024-09-13T19:01:38.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.690+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9884007070 con 0x7f988c1596d0 2024-09-13T19:01:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9888c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f986c06ac00 0x7f986c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9884089940 con 0x7f988c1596d0 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9888c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f986c070a60 0x7f986c072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f986c073530 con 0x7f986c070a60 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9884089cb0 con 0x7f988c1596d0 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f9891200640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f986c06ac00 0x7f986c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.691+0000 7f988be00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f986c070a60 0x7f986c072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.692+0000 7f9891200640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f986c06ac00 0x7f986c06d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f98800011e0 tx=0x7f9880009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.692+0000 7f988be00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f986c070a60 0x7f986c072e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.693+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== osd.4 v2:172.21.15.103:6824/3878985058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f986c073530 con 0x7f986c070a60 2024-09-13T19:01:38.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.705+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 --> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f988c0b1810 con 0x7f986c070a60 2024-09-13T19:01:38.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.706+0000 7f9888c00640 1 -- 172.21.15.33:0/2653708927 <== osd.4 v2:172.21.15.103:6824/3878985058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f988c0b1810 con 0x7f986c070a60 2024-09-13T19:01:38.709 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:38.709 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:38.709 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f986c070a60 msgr2=0x7f986c072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6824/3878985058,v1:172.21.15.103:6825/3878985058] conn(0x7f986c070a60 0x7f986c072e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f986c06ac00 msgr2=0x7f986c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f986c06ac00 0x7f986c06d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f98800011e0 tx=0x7f9880009040 comp rx=0 tx=0).stop 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 msgr2=0x7f988c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 --2- 172.21.15.33:0/2653708927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f988c1596d0 0x7f988c156950 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f988400cbf0 tx=0x7f988400a430 comp rx=0 tx=0).stop 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9891c00640 1 -- 172.21.15.33:0/2653708927 reap_dead start 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 shutdown_connections 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 >> 172.21.15.33:0/2653708927 conn(0x7f988c0b0510 msgr2=0x7f988c0704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 shutdown_connections 2024-09-13T19:01:38.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.707+0000 7f9893c00640 1 -- 172.21.15.33:0/2653708927 wait complete. 2024-09-13T19:01:38.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T19:01:38.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.877+0000 7f9023200640 1 Processor -- start 2024-09-13T19:01:38.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.878+0000 7f9023200640 1 -- start start 2024-09-13T19:01:38.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9023200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c15a5c0 0x7f901c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9023200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f901c0cbac0 0x7f901c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9023200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c0cbfc0 con 0x7f901c0afe10 2024-09-13T19:01:38.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9023200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0cce20 con 0x7f901c0cbac0 2024-09-13T19:01:38.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9023200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0707a0 con 0x7f901c15a5c0 2024-09-13T19:01:38.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9022800640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f901c0afe10 0x7f901c06f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44526/0 (socket says 172.21.15.33:44526) 2024-09-13T19:01:38.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9022800640 1 -- 172.21.15.33:0/2408313715 learned_addr learned my addr 172.21.15.33:0/2408313715 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:38.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9021400640 1 --2- 172.21.15.33:0/2408313715 >> v2:172.21.15.103:3300/0 conn(0x7f901c0cbac0 0x7f901c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.879+0000 7f9021e00640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c15a5c0 0x7f901c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9020a00640 1 -- 172.21.15.33:0/2408313715 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993501594 0 0) 0x7f901c0cbfc0 con 0x7f901c0afe10 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9020a00640 1 -- 172.21.15.33:0/2408313715 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9004003520 con 0x7f901c0afe10 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9021400640 1 -- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c15a5c0 msgr2=0x7f901c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9021400640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c15a5c0 0x7f901c0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9021400640 1 -- 172.21.15.33:0/2408313715 >> v1:172.21.15.33:6789/0 conn(0x7f901c0afe10 legacy=0x7f901c06f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.880+0000 7f9021400640 1 -- 172.21.15.33:0/2408313715 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c070a80 con 0x7f901c0cbac0 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.881+0000 7f9021400640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0cbac0 0x7f901c0b3ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f900c0097a0 tx=0x7f900c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2bcbdb8bfa84d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.881+0000 7f9020a00640 1 -- 172.21.15.33:0/2408313715 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c032440 con 0x7f901c0cbac0 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.881+0000 7f9020a00640 1 -- 172.21.15.33:0/2408313715 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0325a0 con 0x7f901c0cbac0 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.881+0000 7f9020a00640 1 -- 172.21.15.33:0/2408313715 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c032930 con 0x7f901c0cbac0 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 -- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0cbac0 msgr2=0x7f901c0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0cbac0 0x7f901c0b3ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f900c0097a0 tx=0x7f900c02a180 comp rx=0 tx=0).stop 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 -- 172.21.15.33:0/2408313715 shutdown_connections 2024-09-13T19:01:38.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0cbac0 0x7f901c0b3ef0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 --2- 172.21.15.33:0/2408313715 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c15a5c0 0x7f901c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 -- 172.21.15.33:0/2408313715 >> 172.21.15.33:0/2408313715 conn(0x7f901c0ae310 msgr2=0x7f901c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:38.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 -- 172.21.15.33:0/2408313715 shutdown_connections 2024-09-13T19:01:38.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.882+0000 7f9023200640 1 -- 172.21.15.33:0/2408313715 wait complete. 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.883+0000 7f9023200640 1 Processor -- start 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.884+0000 7f9023200640 1 -- start start 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c0afe10 0x7f901c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c15a5c0 0x7f901c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c14fe90 con 0x7f901c0cbac0 2024-09-13T19:01:38.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0b3630 con 0x7f901c15a5c0 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9023200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c150100 con 0x7f901c0afe10 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53670/0 (socket says 172.21.15.33:53670) 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 -- 172.21.15.33:0/2127765272 learned_addr learned my addr 172.21.15.33:0/2127765272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9022800640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c15a5c0 0x7f901c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021e00640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c0afe10 0x7f901c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 -- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c0afe10 msgr2=0x7f901c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c0afe10 0x7f901c0b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 -- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c15a5c0 msgr2=0x7f901c0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c15a5c0 0x7f901c0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.885+0000 7f9021400640 1 -- 172.21.15.33:0/2127765272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c009400 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9021400640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f900c035040 tx=0x7f900c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c03d8f0 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c03da70 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c03de20 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c1503e0 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.886+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c0b2700 con 0x7f901c0cbac0 2024-09-13T19:01:38.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.887+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c067360 con 0x7f901c0cbac0 2024-09-13T19:01:38.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.888+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f900c039040 con 0x7f901c0cbac0 2024-09-13T19:01:38.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.889+0000 7f9016000640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 0x7f900006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:38.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.889+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f900c0a9710 con 0x7f901c0cbac0 2024-09-13T19:01:38.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.889+0000 7f9021e00640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 0x7f900006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:38.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.890+0000 7f9021e00640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 0x7f900006d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9010009b40 tx=0x7f9010009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:38.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:38.893+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f900c074db0 con 0x7f901c0cbac0 2024-09-13T19:01:39.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.075+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f901c150270 con 0x7f900006ac00 2024-09-13T19:01:39.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.075+0000 7f9016000640 1 -- 172.21.15.33:0/2127765272 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f901c150270 con 0x7f900006ac00 2024-09-13T19:01:39.078 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T19:01:39.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 msgr2=0x7f900006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 0x7f900006d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9010009b40 tx=0x7f9010009190 comp rx=0 tx=0).stop 2024-09-13T19:01:39.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 msgr2=0x7f901c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f900c035040 tx=0x7f900c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 shutdown_connections 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f900006ac00 0x7f900006d0c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c15a5c0 0x7f901c0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c0cbac0 0x7f901c0ac870 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 --2- 172.21.15.33:0/2127765272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f901c0afe10 0x7f901c0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 >> 172.21.15.33:0/2127765272 conn(0x7f901c0ae310 msgr2=0x7f901c06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 shutdown_connections 2024-09-13T19:01:39.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.078+0000 7f9023200640 1 -- 172.21.15.33:0/2127765272 wait complete. 2024-09-13T19:01:39.096 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T19:01:39.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.253+0000 7f7be3e00640 1 Processor -- start 2024-09-13T19:01:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.254+0000 7f7be3e00640 1 -- start start 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be3e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7be40c9970 0x7f7be40c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be3e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7be415c9d0 0x7f7be40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be3e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40ca290 con 0x7f7be40c8120 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be3e00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40b3820 con 0x7f7be40c9970 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be3e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40b2ba0 con 0x7f7be415c9d0 2024-09-13T19:01:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7be40c9970 0x7f7be40c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be2a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7be40c9970 0x7f7be40c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53674/0 (socket says 172.21.15.33:53674) 2024-09-13T19:01:39.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7be2a00640 1 -- 172.21.15.33:0/1153376294 learned_addr learned my addr 172.21.15.33:0/1153376294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:39.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.255+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/1153376294 >> v2:172.21.15.103:3300/0 conn(0x7f7be415c9d0 0x7f7be40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.256+0000 7f7be2a00640 1 -- 172.21.15.33:0/1153376294 >> v2:172.21.15.103:3300/0 conn(0x7f7be415c9d0 msgr2=0x7f7be40c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:39.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.256+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1153376294 >> v2:172.21.15.103:3300/0 conn(0x7f7be415c9d0 0x7f7be40c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.256+0000 7f7be2a00640 1 -- 172.21.15.33:0/1153376294 >> v1:172.21.15.103:6789/0 conn(0x7f7be40c8120 legacy=0x7f7be4160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.256+0000 7f7be2a00640 1 -- 172.21.15.33:0/1153376294 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40b2e80 con 0x7f7be40c9970 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.257+0000 7f7be2a00640 1 --2- 172.21.15.33:0/1153376294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c9970 0x7f7be40c9d50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7be40b13f0 tx=0x7f7bd402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377b6aa1b13e750a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.257+0000 7f7be2000640 1 -- 172.21.15.33:0/1153376294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4032440 con 0x7f7be40c9970 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.257+0000 7f7be2000640 1 -- 172.21.15.33:0/1153376294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd40325a0 con 0x7f7be40c9970 2024-09-13T19:01:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.257+0000 7f7be2000640 1 -- 172.21.15.33:0/1153376294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4032930 con 0x7f7be40c9970 2024-09-13T19:01:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 -- 172.21.15.33:0/1153376294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c9970 msgr2=0x7f7be40c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 --2- 172.21.15.33:0/1153376294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c9970 0x7f7be40c9d50 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7be40b13f0 tx=0x7f7bd402a200 comp rx=0 tx=0).stop 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 -- 172.21.15.33:0/1153376294 shutdown_connections 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 --2- 172.21.15.33:0/1153376294 >> v2:172.21.15.103:3300/0 conn(0x7f7be415c9d0 0x7f7be40c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 --2- 172.21.15.33:0/1153376294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c9970 0x7f7be40c9d50 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 -- 172.21.15.33:0/1153376294 >> 172.21.15.33:0/1153376294 conn(0x7f7be40b0330 msgr2=0x7f7be40b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 -- 172.21.15.33:0/1153376294 shutdown_connections 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.258+0000 7f7be3e00640 1 -- 172.21.15.33:0/1153376294 wait complete. 2024-09-13T19:01:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.259+0000 7f7be3e00640 1 Processor -- start 2024-09-13T19:01:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.260+0000 7f7be3e00640 1 -- start start 2024-09-13T19:01:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.260+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 0x7f7be4142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7be40c9970 0x7f7be41e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7be415c9d0 0x7f7be415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be41e76e0 con 0x7f7be40c8120 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40a8720 con 0x7f7be40c9970 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be41e6a60 con 0x7f7be415c9d0 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 0x7f7be4142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 0x7f7be4142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53680/0 (socket says 172.21.15.33:53680) 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 -- 172.21.15.33:0/992044597 learned_addr learned my addr 172.21.15.33:0/992044597 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7be40c9970 0x7f7be41e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be3400640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7be415c9d0 0x7f7be415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 -- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7be415c9d0 msgr2=0x7f7be415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7be415c9d0 0x7f7be415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 -- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7be40c9970 msgr2=0x7f7be41e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7be40c9970 0x7f7be41e5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.261+0000 7f7be2a00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40094d0 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7be2a00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 0x7f7be4142fd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4000c00 tx=0x7f7bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4032440 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4030b80 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be40c8730 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd403b400 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.262+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be41e7020 con 0x7f7be40c8120 2024-09-13T19:01:39.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.263+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7be4066820 con 0x7f7be40c8120 2024-09-13T19:01:39.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.264+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bd4039040 con 0x7f7be40c8120 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdaa00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bc006ac00 0x7f7bc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7bd40a99f0 con 0x7f7be40c8120 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bc006ac00 0x7f7bc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdaa00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7f7bc0070a60 0x7f7bc0072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bc0073530 con 0x7f7bc0070a60 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.265+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bd40ae2a0 con 0x7f7be40c8120 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.266+0000 7f7be3400640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7f7bc0070a60 0x7f7bc0072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.266+0000 7f7bdbe00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bc006ac00 0x7f7bc006d0c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7be41e6680 tx=0x7f7bcc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.266+0000 7f7be3400640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7f7bc0070a60 0x7f7bc0072e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.268+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== osd.5 v2:172.21.15.103:6816/1671521011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7bc0073530 con 0x7f7bc0070a60 2024-09-13T19:01:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.280+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 --> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7be40b1280 con 0x7f7bc0070a60 2024-09-13T19:01:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.281+0000 7f7bdaa00640 1 -- 172.21.15.33:0/992044597 <== osd.5 v2:172.21.15.103:6816/1671521011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7be40b1280 con 0x7f7bc0070a60 2024-09-13T19:01:39.284 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:39.284 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:39.284 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:39.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7f7bc0070a60 msgr2=0x7f7bc0072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6816/1671521011,v1:172.21.15.103:6817/1671521011] conn(0x7f7bc0070a60 0x7f7bc0072e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bc006ac00 msgr2=0x7f7bc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f7bc006ac00 0x7f7bc006d0c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7be41e6680 tx=0x7f7bcc008040 comp rx=0 tx=0).stop 2024-09-13T19:01:39.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 msgr2=0x7f7be4142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 --2- 172.21.15.33:0/992044597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7be40c8120 0x7f7be4142fd0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4000c00 tx=0x7f7bd40046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3400640 1 -- 172.21.15.33:0/992044597 reap_dead start 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 shutdown_connections 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 >> 172.21.15.33:0/992044597 conn(0x7f7be40b0330 msgr2=0x7f7be40af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 shutdown_connections 2024-09-13T19:01:39.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.282+0000 7f7be3e00640 1 -- 172.21.15.33:0/992044597 wait complete. 2024-09-13T19:01:39.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T19:01:39.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.452+0000 7f5e95e00640 1 Processor -- start 2024-09-13T19:01:39.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.453+0000 7f5e95e00640 1 -- start start 2024-09-13T19:01:39.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e95e00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e900cbac0 0x7f5e9015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e95e00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900cbfc0 con 0x7f5e900b40c0 2024-09-13T19:01:39.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e95e00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900707a0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e95e00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e900cce20 con 0x7f5e900cbac0 2024-09-13T19:01:39.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e8fe00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5e900b40c0 0x7f5e9015a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44528/0 (socket says 172.21.15.33:44528) 2024-09-13T19:01:39.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e8fe00640 1 -- 172.21.15.33:0/3585796019 learned_addr learned my addr 172.21.15.33:0/3585796019 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.454+0000 7f5e95400640 1 --2- 172.21.15.33:0/3585796019 >> v2:172.21.15.103:3300/0 conn(0x7f5e900cbac0 0x7f5e9015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953035599 0 0) 0x7f5e900cbfc0 con 0x7f5e900b40c0 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e78003520 con 0x7f5e900b40c0 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718021213 0 0) 0x7f5e900707a0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e900cbfc0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084486770 0 0) 0x7f5e78003520 con 0x7f5e900b40c0 2024-09-13T19:01:39.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e95400640 1 -- 172.21.15.33:0/3585796019 >> v1:172.21.15.103:6789/0 conn(0x7f5e9015a5c0 legacy=0x7f5e900b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e95400640 1 -- 172.21.15.33:0/3585796019 >> v1:172.21.15.33:6789/0 conn(0x7f5e900b40c0 legacy=0x7f5e9015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.455+0000 7f5e95400640 1 -- 172.21.15.33:0/3585796019 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90070a80 con 0x7f5e900cbac0 2024-09-13T19:01:39.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.456+0000 7f5e95400640 1 --2- 172.21.15.33:0/3585796019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900cbac0 0x7f5e9015b0b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009d90 tx=0x7f5e8802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef85c49cb075c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.456+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c001670 con 0x7f5e900cbac0 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.456+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8802d050 con 0x7f5e900cbac0 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.456+0000 7f5e8f400640 1 -- 172.21.15.33:0/3585796019 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88007740 con 0x7f5e900cbac0 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 -- 172.21.15.33:0/3585796019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900cbac0 msgr2=0x7f5e9015b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 --2- 172.21.15.33:0/3585796019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900cbac0 0x7f5e9015b0b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009d90 tx=0x7f5e8802a5f0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 -- 172.21.15.33:0/3585796019 shutdown_connections 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 --2- 172.21.15.33:0/3585796019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900cbac0 0x7f5e9015b0b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 -- 172.21.15.33:0/3585796019 >> 172.21.15.33:0/3585796019 conn(0x7f5e900ae310 msgr2=0x7f5e900ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 -- 172.21.15.33:0/3585796019 shutdown_connections 2024-09-13T19:01:39.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.457+0000 7f5e95e00640 1 -- 172.21.15.33:0/3585796019 wait complete. 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.459+0000 7f5e95e00640 1 Processor -- start 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.459+0000 7f5e95e00640 1 -- start start 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900b40c0 0x7f5e901f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e900cbac0 0x7f5e90153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9015b4e0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900a9ef0 con 0x7f5e900b40c0 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95e00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9015ab40 con 0x7f5e900cbac0 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53692/0 (socket says 172.21.15.33:53692) 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e95400640 1 -- 172.21.15.33:0/2517875900 learned_addr learned my addr 172.21.15.33:0/2517875900 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e94a00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900b40c0 0x7f5e901f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.460+0000 7f5e8fe00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e900cbac0 0x7f5e90153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 -- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e900cbac0 msgr2=0x7f5e90153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e900cbac0 0x7f5e90153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 -- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900b40c0 msgr2=0x7f5e901f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900b40c0 0x7f5e901f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 -- 172.21.15.33:0/2517875900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88009a70 con 0x7f5e9015a5c0 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95400640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5e8802abe0 tx=0x7f5e88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88003b90 con 0x7f5e9015a5c0 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88003cf0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8803c850 con 0x7f5e9015a5c0 2024-09-13T19:01:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9015ae20 con 0x7f5e9015a5c0 2024-09-13T19:01:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.461+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9015b900 con 0x7f5e9015a5c0 2024-09-13T19:01:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.462+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e90067360 con 0x7f5e9015a5c0 2024-09-13T19:01:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.463+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e8802ad50 con 0x7f5e9015a5c0 2024-09-13T19:01:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.464+0000 7f5e8cc00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 0x7f5e7006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.464+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e880a9da0 con 0x7f5e9015a5c0 2024-09-13T19:01:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.464+0000 7f5e94a00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 0x7f5e7006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.465+0000 7f5e94a00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 0x7f5e7006d0f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e840011e0 tx=0x7f5e84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.468+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5e88075330 con 0x7f5e9015a5c0 2024-09-13T19:01:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.645+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e90071280 con 0x7f5e7006ac30 2024-09-13T19:01:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.646+0000 7f5e8cc00640 1 -- 172.21.15.33:0/2517875900 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e840014f0 con 0x7f5e7006ac30 2024-09-13T19:01:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T19:01:39.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 msgr2=0x7f5e7006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 0x7f5e7006d0f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e840011e0 tx=0x7f5e84009040 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 msgr2=0x7f5e901540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5e8802abe0 tx=0x7f5e88004a40 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 shutdown_connections 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f5e7006ac30 0x7f5e7006d0f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e9015a5c0 0x7f5e901540a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e900cbac0 0x7f5e90153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 --2- 172.21.15.33:0/2517875900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e900b40c0 0x7f5e901f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 >> 172.21.15.33:0/2517875900 conn(0x7f5e900ae310 msgr2=0x7f5e900b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 shutdown_connections 2024-09-13T19:01:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.648+0000 7f5e95e00640 1 -- 172.21.15.33:0/2517875900 wait complete. 2024-09-13T19:01:39.665 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T19:01:39.666 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:39.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.822+0000 7f8d4a000640 1 Processor -- start 2024-09-13T19:01:39.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.823+0000 7f8d4a000640 1 -- start start 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d4a000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d440c9a70 0x7f8d4406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d4a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 0x7f8d4406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d4a000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d440711b0 con 0x7f8d440c8f80 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d4a000640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4415ab90 con 0x7f8d440c9a70 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d4a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440717c0 con 0x7f8d4406bbe0 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d3be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d440c9a70 0x7f8d4406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d3be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d440c9a70 0x7f8d4406b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53698/0 (socket says 172.21.15.33:53698) 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d3be00640 1 -- 172.21.15.33:0/1458383329 learned_addr learned my addr 172.21.15.33:0/1458383329 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.824+0000 7f8d49600640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 0x7f8d4406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d3be00640 1 -- 172.21.15.33:0/1458383329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 msgr2=0x7f8d4406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d3be00640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 0x7f8d4406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d3be00640 1 -- 172.21.15.33:0/1458383329 >> v1:172.21.15.103:6789/0 conn(0x7f8d440c8f80 legacy=0x7f8d440c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d3be00640 1 -- 172.21.15.33:0/1458383329 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4406f7b0 con 0x7f8d440c9a70 2024-09-13T19:01:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d43e00640 1 -- 172.21.15.33:0/1458383329 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229281608 0 0) 0x7f8d440711b0 con 0x7f8d440c8f80 2024-09-13T19:01:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d49600640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 0x7f8d4406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.825+0000 7f8d3be00640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c9a70 0x7f8d4406b6a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad451fb676ce3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d43e00640 1 -- 172.21.15.33:0/1458383329 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c032440 con 0x7f8d440c9a70 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d43e00640 1 -- 172.21.15.33:0/1458383329 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c0325a0 con 0x7f8d440c9a70 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d43e00640 1 -- 172.21.15.33:0/1458383329 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c032930 con 0x7f8d440c9a70 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 -- 172.21.15.33:0/1458383329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c9a70 msgr2=0x7f8d4406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c9a70 0x7f8d4406b6a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c02a1c0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 -- 172.21.15.33:0/1458383329 shutdown_connections 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d4406bbe0 0x7f8d4406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 --2- 172.21.15.33:0/1458383329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c9a70 0x7f8d4406b6a0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 -- 172.21.15.33:0/1458383329 >> 172.21.15.33:0/1458383329 conn(0x7f8d440b0330 msgr2=0x7f8d440b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.826+0000 7f8d4a000640 1 -- 172.21.15.33:0/1458383329 shutdown_connections 2024-09-13T19:01:39.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.827+0000 7f8d4a000640 1 -- 172.21.15.33:0/1458383329 wait complete. 2024-09-13T19:01:39.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.828+0000 7f8d4a000640 1 Processor -- start 2024-09-13T19:01:39.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.828+0000 7f8d4a000640 1 -- start start 2024-09-13T19:01:39.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d4406bbe0 0x7f8d44156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 0x7f8d440a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d440c9a70 0x7f8d44154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44154ac0 con 0x7f8d440c8f80 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44157120 con 0x7f8d4406bbe0 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d4a000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d441597a0 con 0x7f8d440c9a70 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d3be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 0x7f8d440a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d3be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 0x7f8d440a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53710/0 (socket says 172.21.15.33:53710) 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.829+0000 7f8d3be00640 1 -- 172.21.15.33:0/2043589079 learned_addr learned my addr 172.21.15.33:0/2043589079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d49600640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d440c9a70 0x7f8d44154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d48c00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d4406bbe0 0x7f8d44156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 -- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d440c9a70 msgr2=0x7f8d44154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8d440c9a70 0x7f8d44154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 -- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d4406bbe0 msgr2=0x7f8d44156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d4406bbe0 0x7f8d44156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0094d0 con 0x7f8d440c8f80 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d48c00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d4406bbe0 0x7f8d44156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d3be00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 0x7f8d440a84f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000c00 tx=0x7f8d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c032440 con 0x7f8d440c8f80 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c030b80 con 0x7f8d440c8f80 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c03d440 con 0x7f8d440c8f80 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d44154190 con 0x7f8d440c8f80 2024-09-13T19:01:39.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.830+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d44154750 con 0x7f8d440c8f80 2024-09-13T19:01:39.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.831+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d440c9ed0 con 0x7f8d440c8f80 2024-09-13T19:01:39.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.832+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d2c039040 con 0x7f8d440c8f80 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d41600640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d2006ac00 0x7f8d2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d2c0a9cb0 con 0x7f8d440c8f80 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d41600640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7f8d20070a60 0x7f8d20072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d20073530 con 0x7f8d20070a60 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d2c0ac290 con 0x7f8d440c8f80 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.833+0000 7f8d48c00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d2006ac00 0x7f8d2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.834+0000 7f8d49600640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7f8d20070a60 0x7f8d20072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:39.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.834+0000 7f8d48c00640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d2006ac00 0x7f8d2006d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000f60 tx=0x7f8d34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.834+0000 7f8d49600640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7f8d20070a60 0x7f8d20072e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:39.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.835+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== osd.6 v2:172.21.15.103:6800/1700981467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8d20073530 con 0x7f8d20070a60 2024-09-13T19:01:39.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.848+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 --> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d4406fa90 con 0x7f8d20070a60 2024-09-13T19:01:39.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.849+0000 7f8d41600640 1 -- 172.21.15.33:0/2043589079 <== osd.6 v2:172.21.15.103:6800/1700981467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d3c00f040 con 0x7f8d20070a60 2024-09-13T19:01:39.851 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:39.852 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:39.852 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.849+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7f8d20070a60 msgr2=0x7f8d20072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.849+0000 7f8d4a000640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6800/1700981467,v1:172.21.15.103:6801/1700981467] conn(0x7f8d20070a60 0x7f8d20072e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.849+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d2006ac00 msgr2=0x7f8d2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.849+0000 7f8d4a000640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f8d2006ac00 0x7f8d2006d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000f60 tx=0x7f8d34009040 comp rx=0 tx=0).stop 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 msgr2=0x7f8d440a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 --2- 172.21.15.33:0/2043589079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d440c8f80 0x7f8d440a84f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000c00 tx=0x7f8d2c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d49600640 1 -- 172.21.15.33:0/2043589079 reap_dead start 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 shutdown_connections 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 >> 172.21.15.33:0/2043589079 conn(0x7f8d440b0330 msgr2=0x7f8d440c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 shutdown_connections 2024-09-13T19:01:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:39.850+0000 7f8d4a000640 1 -- 172.21.15.33:0/2043589079 wait complete. 2024-09-13T19:01:39.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T19:01:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.020+0000 7fda4e400640 1 Processor -- start 2024-09-13T19:01:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.020+0000 7fda4e400640 1 -- start start 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.021+0000 7fda4e400640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fda4815a520 0x7fda4806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.021+0000 7fda4e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 0x7fda4815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.021+0000 7fda4e400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4806bc00 con 0x7fda480b1b00 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.021+0000 7fda4e400640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4806bea0 con 0x7fda4815a520 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.021+0000 7fda4e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4806c180 con 0x7fda480ce020 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda46a00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fda480b1b00 0x7fda480cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44544/0 (socket says 172.21.15.33:44544) 2024-09-13T19:01:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda46a00640 1 -- 172.21.15.33:0/3876428249 learned_addr learned my addr 172.21.15.33:0/3876428249 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47400640 1 --2- 172.21.15.33:0/3876428249 >> v2:172.21.15.103:3300/0 conn(0x7fda4815a520 0x7fda4806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47e00640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 0x7fda4815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda46000640 1 -- 172.21.15.33:0/3876428249 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241421718 0 0) 0x7fda4806bc00 con 0x7fda480b1b00 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda46000640 1 -- 172.21.15.33:0/3876428249 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda2c003520 con 0x7fda480b1b00 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47400640 1 -- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 msgr2=0x7fda4815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47400640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 0x7fda4815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47400640 1 -- 172.21.15.33:0/3876428249 >> v1:172.21.15.33:6789/0 conn(0x7fda480b1b00 legacy=0x7fda480cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47400640 1 -- 172.21.15.33:0/3876428249 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4806c460 con 0x7fda4815a520 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.022+0000 7fda47e00640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 0x7fda4815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T19:01:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.023+0000 7fda47400640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806b6c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda3802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8881ddb9ea9381 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.024+0000 7fda46000640 1 -- 172.21.15.33:0/3876428249 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3802ae50 con 0x7fda4815a520 2024-09-13T19:01:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.024+0000 7fda46000640 1 -- 172.21.15.33:0/3876428249 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda38032440 con 0x7fda4815a520 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.024+0000 7fda46000640 1 -- 172.21.15.33:0/3876428249 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380327d0 con 0x7fda4815a520 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 -- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 msgr2=0x7fda4806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806b6c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda380097a0 tx=0x7fda3802a100 comp rx=0 tx=0).stop 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 -- 172.21.15.33:0/3876428249 shutdown_connections 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480ce020 0x7fda4815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 --2- 172.21.15.33:0/3876428249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806b6c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 -- 172.21.15.33:0/3876428249 >> 172.21.15.33:0/3876428249 conn(0x7fda480b0510 msgr2=0x7fda480b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 -- 172.21.15.33:0/3876428249 shutdown_connections 2024-09-13T19:01:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.025+0000 7fda4e400640 1 -- 172.21.15.33:0/3876428249 wait complete. 2024-09-13T19:01:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.027+0000 7fda4e400640 1 Processor -- start 2024-09-13T19:01:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.027+0000 7fda4e400640 1 -- start start 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 0x7fda481f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481f2f00 con 0x7fda480ce020 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481f2430 con 0x7fda4815a520 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda4e400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda48154640 con 0x7fda480b1b00 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53716/0 (socket says 172.21.15.33:53716) 2024-09-13T19:01:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 -- 172.21.15.33:0/4261272482 learned_addr learned my addr 172.21.15.33:0/4261272482 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda47e00640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda47400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 0x7fda481f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 -- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 msgr2=0x7fda481f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 0x7fda481f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 -- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 msgr2=0x7fda4806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda46a00640 1 -- 172.21.15.33:0/4261272482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009a70 con 0x7fda480ce020 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.028+0000 7fda47400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 0x7fda481f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda46a00640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c500 tx=0x7fda3400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34005ce0 con 0x7fda480ce020 2024-09-13T19:01:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34005e40 con 0x7fda480ce020 2024-09-13T19:01:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340072b0 con 0x7fda480ce020 2024-09-13T19:01:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda38009400 con 0x7fda480ce020 2024-09-13T19:01:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.029+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda481f2940 con 0x7fda480ce020 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.030+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4815a900 con 0x7fda480ce020 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.031+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda340074d0 con 0x7fda480ce020 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.032+0000 7fda3f400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 0x7fda2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.032+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fda34088660 con 0x7fda480ce020 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.033+0000 7fda47400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 0x7fda2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.033+0000 7fda47400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 0x7fda2806d0c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fda38034000 tx=0x7fda3802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.036+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda34053b60 con 0x7fda480ce020 2024-09-13T19:01:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.218+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fda4806cf40 con 0x7fda2806ac00 2024-09-13T19:01:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.219+0000 7fda3f400640 1 -- 172.21.15.33:0/4261272482 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda38032980 con 0x7fda2806ac00 2024-09-13T19:01:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T19:01:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.221+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 msgr2=0x7fda2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.221+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 0x7fda2806d0c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fda38034000 tx=0x7fda3802e000 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.221+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 msgr2=0x7fda4814b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.221+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c500 tx=0x7fda3400c900 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 shutdown_connections 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fda2806ac00 0x7fda2806d0c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda4815a520 0x7fda4806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda480ce020 0x7fda4814b080 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 --2- 172.21.15.33:0/4261272482 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fda480b1b00 0x7fda481f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 >> 172.21.15.33:0/4261272482 conn(0x7fda480b0510 msgr2=0x7fda480ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 shutdown_connections 2024-09-13T19:01:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.222+0000 7fda4e400640 1 -- 172.21.15.33:0/4261272482 wait complete. 2024-09-13T19:01:40.240 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T19:01:40.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:01:40.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.399+0000 7ffb7f400640 1 Processor -- start 2024-09-13T19:01:40.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.399+0000 7ffb7f400640 1 -- start start 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.400+0000 7ffb7f400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb780acd00 0x7ffb7806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.400+0000 7ffb7f400640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7806b3e0 con 0x7ffb781461a0 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.400+0000 7ffb7f400640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780b3370 con 0x7ffb780ac870 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.400+0000 7ffb7f400640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb780b3650 con 0x7ffb780acd00 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.400+0000 7ffb7d400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb780acd00 0x7ffb7806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7d400640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb780acd00 0x7ffb7806bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53730/0 (socket says 172.21.15.33:53730) 2024-09-13T19:01:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7ca00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ffb781461a0 0x7ffb780b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44556/0 (socket says 172.21.15.33:44556) 2024-09-13T19:01:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7d400640 1 -- 172.21.15.33:0/3322644247 learned_addr learned my addr 172.21.15.33:0/3322644247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7d400640 1 -- 172.21.15.33:0/3322644247 >> v1:172.21.15.103:6789/0 conn(0x7ffb780ac870 legacy=0x7ffb7806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7d400640 1 -- 172.21.15.33:0/3322644247 >> v1:172.21.15.33:6789/0 conn(0x7ffb781461a0 legacy=0x7ffb780b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.401+0000 7ffb7d400640 1 -- 172.21.15.33:0/3322644247 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780b3930 con 0x7ffb780acd00 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.402+0000 7ffb7d400640 1 --2- 172.21.15.33:0/3322644247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb7806bfd0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009e50 tx=0x7ffb7002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3a82b523cf7842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.402+0000 7ffb77400640 1 -- 172.21.15.33:0/3322644247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70031600 con 0x7ffb780acd00 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.402+0000 7ffb77400640 1 -- 172.21.15.33:0/3322644247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7002d050 con 0x7ffb780acd00 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.402+0000 7ffb77400640 1 -- 172.21.15.33:0/3322644247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70031980 con 0x7ffb780acd00 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 -- 172.21.15.33:0/3322644247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 msgr2=0x7ffb7806bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 --2- 172.21.15.33:0/3322644247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb7806bfd0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009e50 tx=0x7ffb7002a760 comp rx=0 tx=0).stop 2024-09-13T19:01:40.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 -- 172.21.15.33:0/3322644247 shutdown_connections 2024-09-13T19:01:40.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 --2- 172.21.15.33:0/3322644247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb7806bfd0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 -- 172.21.15.33:0/3322644247 >> 172.21.15.33:0/3322644247 conn(0x7ffb780b0510 msgr2=0x7ffb780b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 -- 172.21.15.33:0/3322644247 shutdown_connections 2024-09-13T19:01:40.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.403+0000 7ffb7f400640 1 -- 172.21.15.33:0/3322644247 wait complete. 2024-09-13T19:01:40.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.405+0000 7ffb7f400640 1 Processor -- start 2024-09-13T19:01:40.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.405+0000 7ffb7f400640 1 -- start start 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb780ac870 0x7ffb781427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb780c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb781461a0 0x7ffb7812f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781303f0 con 0x7ffb780acd00 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781420f0 con 0x7ffb781461a0 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7f400640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78132980 con 0x7ffb780ac870 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb780c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb780c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53736/0 (socket says 172.21.15.33:53736) 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7ca00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb780ac870 0x7ffb781427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 -- 172.21.15.33:0/1083773389 learned_addr learned my addr 172.21.15.33:0/1083773389 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb7d400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb781461a0 0x7ffb7812f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 -- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb780ac870 msgr2=0x7ffb781427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb780ac870 0x7ffb781427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.406+0000 7ffb77e00640 1 -- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb781461a0 msgr2=0x7ffb7812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb77e00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb781461a0 0x7ffb7812f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb77e00640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009b30 con 0x7ffb780acd00 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb77e00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb780c37f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c430 tx=0x7ffb6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011790 con 0x7ffb780acd00 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb640118f0 con 0x7ffb780acd00 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78132c60 con 0x7ffb780acd00 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011ce0 con 0x7ffb780acd00 2024-09-13T19:01:40.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.407+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78133220 con 0x7ffb780acd00 2024-09-13T19:01:40.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.408+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb780ad110 con 0x7ffb780acd00 2024-09-13T19:01:40.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.409+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb6401c460 con 0x7ffb780acd00 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb74c00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ffb5806ac00 0x7ffb5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb64088f20 con 0x7ffb780acd00 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb74c00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7ffb58070a60 0x7ffb58072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb58073530 con 0x7ffb58070a60 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb6408b500 con 0x7ffb780acd00 2024-09-13T19:01:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.410+0000 7ffb7ca00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ffb5806ac00 0x7ffb5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.411+0000 7ffb7d400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7ffb58070a60 0x7ffb58072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.411+0000 7ffb7ca00640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ffb5806ac00 0x7ffb5806d0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c000f60 tx=0x7ffb6c000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.411+0000 7ffb7d400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7ffb58070a60 0x7ffb58072e80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.413+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== osd.7 v2:172.21.15.103:6808/713706450 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffb58073530 con 0x7ffb58070a60 2024-09-13T19:01:40.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.425+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 --> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb78146580 con 0x7ffb58070a60 2024-09-13T19:01:40.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.426+0000 7ffb74c00640 1 -- 172.21.15.33:0/1083773389 <== osd.7 v2:172.21.15.103:6808/713706450 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb70031680 con 0x7ffb58070a60 2024-09-13T19:01:40.429 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-13T19:01:40.429 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:01:40.429 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.426+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7ffb58070a60 msgr2=0x7ffb58072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.426+0000 7ffb7f400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6808/713706450,v1:172.21.15.103:6809/713706450] conn(0x7ffb58070a60 0x7ffb58072e80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ffb5806ac00 msgr2=0x7ffb5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7ffb5806ac00 0x7ffb5806d0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c000f60 tx=0x7ffb6c000ed0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 msgr2=0x7ffb780c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 --2- 172.21.15.33:0/1083773389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb780acd00 0x7ffb780c37f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c430 tx=0x7ffb6400c8f0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7d400640 1 -- 172.21.15.33:0/1083773389 reap_dead start 2024-09-13T19:01:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 shutdown_connections 2024-09-13T19:01:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 >> 172.21.15.33:0/1083773389 conn(0x7ffb780b0510 msgr2=0x7ffb780cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 shutdown_connections 2024-09-13T19:01:40.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.427+0000 7ffb7f400640 1 -- 172.21.15.33:0/1083773389 wait complete. 2024-09-13T19:01:40.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T19:01:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.597+0000 7fcf9b200640 1 Processor -- start 2024-09-13T19:01:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.598+0000 7fcf9b200640 1 -- start start 2024-09-13T19:01:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9b200640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcf9c071560 0x7fcf9c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9b200640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf9c06f4b0 0x7fcf9c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9b200640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0cd850 con 0x7fcf9c159480 2024-09-13T19:01:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9b200640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0cd570 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9b200640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0b1740 con 0x7fcf9c071560 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf99e00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcf9c159480 0x7fcf9c070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44560/0 (socket says 172.21.15.33:44560) 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf99e00640 1 -- 172.21.15.33:0/1616098398 learned_addr learned my addr 172.21.15.33:0/1616098398 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf9a800640 1 --2- 172.21.15.33:0/1616098398 >> v2:172.21.15.33:3300/0 conn(0x7fcf9c06f4b0 0x7fcf9c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.599+0000 7fcf91400640 1 --2- 172.21.15.33:0/1616098398 >> v2:172.21.15.103:3300/0 conn(0x7fcf9c071560 0x7fcf9c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf99400640 1 -- 172.21.15.33:0/1616098398 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613327737 0 0) 0x7fcf9c0cd850 con 0x7fcf9c159480 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf99400640 1 -- 172.21.15.33:0/1616098398 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf80005730 con 0x7fcf9c159480 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf9a800640 1 -- 172.21.15.33:0/1616098398 >> v2:172.21.15.103:3300/0 conn(0x7fcf9c071560 msgr2=0x7fcf9c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf9a800640 1 --2- 172.21.15.33:0/1616098398 >> v2:172.21.15.103:3300/0 conn(0x7fcf9c071560 0x7fcf9c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf9a800640 1 -- 172.21.15.33:0/1616098398 >> v1:172.21.15.33:6789/0 conn(0x7fcf9c159480 legacy=0x7fcf9c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.600+0000 7fcf9a800640 1 -- 172.21.15.33:0/1616098398 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0b1a20 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf9a800640 1 --2- 172.21.15.33:0/1616098398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c0b2220 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c06e030 tx=0x7fcf9402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2013240113c18a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf99400640 1 -- 172.21.15.33:0/1616098398 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94007740 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf99400640 1 -- 172.21.15.33:0/1616098398 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9402d050 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf99400640 1 -- 172.21.15.33:0/1616098398 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94007aa0 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf9b200640 1 -- 172.21.15.33:0/1616098398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 msgr2=0x7fcf9c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.601+0000 7fcf9b200640 1 --2- 172.21.15.33:0/1616098398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c0b2220 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c06e030 tx=0x7fcf9402a5f0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 -- 172.21.15.33:0/1616098398 shutdown_connections 2024-09-13T19:01:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 --2- 172.21.15.33:0/1616098398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c0b2220 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 --2- 172.21.15.33:0/1616098398 >> v2:172.21.15.103:3300/0 conn(0x7fcf9c071560 0x7fcf9c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 -- 172.21.15.33:0/1616098398 >> 172.21.15.33:0/1616098398 conn(0x7fcf9c0ae310 msgr2=0x7fcf9c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 -- 172.21.15.33:0/1616098398 shutdown_connections 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.602+0000 7fcf9b200640 1 -- 172.21.15.33:0/1616098398 wait complete. 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.603+0000 7fcf9b200640 1 Processor -- start 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.603+0000 7fcf9b200640 1 -- start start 2024-09-13T19:01:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf9c071560 0x7fcf9c0af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9c159480 0x7fcf9c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15a400 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15cc90 con 0x7fcf9c159480 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf9b200640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c15cf70 con 0x7fcf9c071560 2024-09-13T19:01:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.604+0000 7fcf99e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53756/0 (socket says 172.21.15.33:53756) 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 -- 172.21.15.33:0/876191583 learned_addr learned my addr 172.21.15.33:0/876191583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf91400640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf9c071560 0x7fcf9c0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf9a800640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9c159480 0x7fcf9c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 -- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf9c071560 msgr2=0x7fcf9c0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf9c071560 0x7fcf9c0af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 -- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9c159480 msgr2=0x7fcf9c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9c159480 0x7fcf9c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 -- 172.21.15.33:0/876191583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94009a70 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf99e00640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c390 tx=0x7fcf8c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.605+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c005ce0 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.606+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c005e40 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.606+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0072f0 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.606+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c15d250 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.606+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c15d810 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.607+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c067360 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.608+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf8c007450 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.608+0000 7fcf92a00640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 0x7fcf7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.609+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf8c0885c0 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.609+0000 7fcf91400640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 0x7fcf7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.609+0000 7fcf91400640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 0x7fcf7806d0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0afdb0 tx=0x7fcf84009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.613+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcf8c053b40 con 0x7fcf9c06f4b0 2024-09-13T19:01:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.790+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf9c0ce280 con 0x7fcf7806ac00 2024-09-13T19:01:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.791+0000 7fcf92a00640 1 -- 172.21.15.33:0/876191583 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf84011a30 con 0x7fcf7806ac00 2024-09-13T19:01:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 msgr2=0x7fcf7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 0x7fcf7806d0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0afdb0 tx=0x7fcf84009190 comp rx=0 tx=0).stop 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 msgr2=0x7fcf9c154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c390 tx=0x7fcf8c00c850 comp rx=0 tx=0).stop 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 shutdown_connections 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fcf7806ac00 0x7fcf7806d0c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9c159480 0x7fcf9c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcf9c071560 0x7fcf9c0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 --2- 172.21.15.33:0/876191583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf9c06f4b0 0x7fcf9c154bc0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 >> 172.21.15.33:0/876191583 conn(0x7fcf9c0ae310 msgr2=0x7fcf9c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 shutdown_connections 2024-09-13T19:01:40.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.793+0000 7fcf9b200640 1 -- 172.21.15.33:0/876191583 wait complete. 2024-09-13T19:01:40.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:01:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.963+0000 7f027e000640 1 Processor -- start 2024-09-13T19:01:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.964+0000 7f027e000640 1 -- start start 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027e000640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f027815a5c0 0x7f02780b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027e000640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780cbfc0 con 0x7f02780afe10 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027e000640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02780cce20 con 0x7f027815a5c0 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02780707a0 con 0x7f02780cbac0 2024-09-13T19:01:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f026fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f026fe00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.33:60506/0 (socket says 172.21.15.33:60506) 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f026fe00640 1 -- 172.21.15.33:0/2438871461 learned_addr learned my addr 172.21.15.33:0/2438871461 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.965+0000 7f027cc00640 1 --2- 172.21.15.33:0/2438871461 >> v2:172.21.15.103:3300/0 conn(0x7f027815a5c0 0x7f02780b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.966+0000 7f026fe00640 1 -- 172.21.15.33:0/2438871461 >> v2:172.21.15.103:3300/0 conn(0x7f027815a5c0 msgr2=0x7f02780b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.966+0000 7f026fe00640 1 --2- 172.21.15.33:0/2438871461 >> v2:172.21.15.103:3300/0 conn(0x7f027815a5c0 0x7f02780b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.966+0000 7f026fe00640 1 -- 172.21.15.33:0/2438871461 >> v1:172.21.15.103:6789/0 conn(0x7f02780afe10 legacy=0x7f027806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.966+0000 7f026fe00640 1 -- 172.21.15.33:0/2438871461 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278070a80 con 0x7f02780cbac0 2024-09-13T19:01:40.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.967+0000 7f026fe00640 1 --2- 172.21.15.33:0/2438871461 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0260009870 tx=0x7f026002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff0297360a2470f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.967+0000 7f0277e00640 1 -- 172.21.15.33:0/2438871461 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260032440 con 0x7f02780cbac0 2024-09-13T19:01:40.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.967+0000 7f0277e00640 1 -- 172.21.15.33:0/2438871461 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02600325a0 con 0x7f02780cbac0 2024-09-13T19:01:40.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.967+0000 7f0277e00640 1 -- 172.21.15.33:0/2438871461 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260032930 con 0x7f02780cbac0 2024-09-13T19:01:40.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 -- 172.21.15.33:0/2438871461 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 msgr2=0x7f02780b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 --2- 172.21.15.33:0/2438871461 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0260009870 tx=0x7f026002a250 comp rx=0 tx=0).stop 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 -- 172.21.15.33:0/2438871461 shutdown_connections 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 --2- 172.21.15.33:0/2438871461 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02780cbac0 0x7f02780b3ef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 --2- 172.21.15.33:0/2438871461 >> v2:172.21.15.103:3300/0 conn(0x7f027815a5c0 0x7f02780b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 -- 172.21.15.33:0/2438871461 >> 172.21.15.33:0/2438871461 conn(0x7f02780ae310 msgr2=0x7f02780ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 -- 172.21.15.33:0/2438871461 shutdown_connections 2024-09-13T19:01:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.968+0000 7f027e000640 1 -- 172.21.15.33:0/2438871461 wait complete. 2024-09-13T19:01:40.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.970+0000 7f027e000640 1 Processor -- start 2024-09-13T19:01:40.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.970+0000 7f027e000640 1 -- start start 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02780cbac0 0x7f027814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027815a5c0 0x7f0278153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027814eb60 con 0x7f02780afe10 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027814ee40 con 0x7f02780cbac0 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027e000640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027814f120 con 0x7f027815a5c0 2024-09-13T19:01:40.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53768/0 (socket says 172.21.15.33:53768) 2024-09-13T19:01:40.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 -- 172.21.15.33:0/3371475831 learned_addr learned my addr 172.21.15.33:0/3371475831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:01:40.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f026fe00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02780cbac0 0x7f027814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027d600640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027815a5c0 0x7f0278153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 -- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027815a5c0 msgr2=0x7f0278153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027815a5c0 0x7f0278153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 -- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02780cbac0 msgr2=0x7f027814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:40.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02780cbac0 0x7f027814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:40.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.971+0000 7f027cc00640 1 -- 172.21.15.33:0/3371475831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600094d0 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f027cc00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f026800e9b0 tx=0x7f026800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268009670 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026800c9a0 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026800cd50 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027814f400 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.972+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278150140 con 0x7f02780afe10 2024-09-13T19:01:40.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.973+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0278067360 con 0x7f02780afe10 2024-09-13T19:01:40.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.974+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0268013470 con 0x7f02780afe10 2024-09-13T19:01:40.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.975+0000 7f0275600640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 0x7f025406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:01:40.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.975+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02680893d0 con 0x7f02780afe10 2024-09-13T19:01:40.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.975+0000 7f026fe00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 0x7f025406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:01:40.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.976+0000 7f026fe00640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 0x7f025406d0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0260034000 tx=0x7f026002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:01:40.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:40.979+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0268054830 con 0x7f02780afe10 2024-09-13T19:01:41.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.155+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0278071280 con 0x7f025406ac00 2024-09-13T19:01:41.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.157+0000 7f0275600640 1 -- 172.21.15.33:0/3371475831 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50898 (secure 0 0 0) 0x7f02600329c0 con 0x7f025406ac00 2024-09-13T19:01:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:01:41.161 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:01:41.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.159+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 msgr2=0x7f025406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:41.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.159+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 0x7f025406d0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0260034000 tx=0x7f026002e000 comp rx=0 tx=0).stop 2024-09-13T19:01:41.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.159+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 msgr2=0x7f02781513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:01:41.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.159+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f026800e9b0 tx=0x7f026800ee70 comp rx=0 tx=0).stop 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 shutdown_connections 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f025406ac00 0x7f025406d0c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027815a5c0 0x7f0278153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02780cbac0 0x7f027814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 --2- 172.21.15.33:0/3371475831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02780afe10 0x7f02781513f0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:01:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 >> 172.21.15.33:0/3371475831 conn(0x7f02780ae310 msgr2=0x7f027806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:01:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 shutdown_connections 2024-09-13T19:01:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:01:41.160+0000 7f027e000640 1 -- 172.21.15.33:0/3371475831 wait complete. 2024-09-13T19:01:41.177 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-13T19:01:39.157015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259740,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714980,"statfs":{"total":773094113280,"available":772828139520,"internally_reserved":0,"allocated":11051008,"data_stored":5374760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1048606,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-21524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.445331"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-13T19:01:29.714924+0000","last_change":"2024-09-13T18:57:04.506826+0000","last_active":"2024-09-13T19:01:29.714924+0000","last_peered":"2024-09-13T19:01:29.714924+0000","last_clean":"2024-09-13T19:01:29.714924+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:29.714924+0000","last_undegraded":"2024-09-13T19:01:29.714924+0000","last_fullsized":"2024-09-13T19:01:29.714924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:57:03.398250+0000","last_clean_scrub_stamp":"2024-09-13T18:57:03.398250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:31.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":1.105},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.37}]},{"osd":5,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.492,"15min":1.492},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.61799999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77500000000000002,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.433,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.751},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70599999999999996,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79700000000000004,"5min":1.204,"15min":1.204},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.72399999999999998},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.25,"15min":1.25},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76800000000000002,"5min":1.337,"15min":1.337},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70499999999999996,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.373,"15min":1.373},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.68100000000000005,"15min":0.71599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84899999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84499999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90800000000000003,"5min":1.792,"15min":1.792},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.49,"15min":1.49},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.62}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.503},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.45500000000000002,"15min":0.47899999999999998},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59499999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.51300000000000001,"15min":0.59799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":3.339,"15min":3.339},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.107,"15min":1.107},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52700000000000002,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76900000000000002,"15min":0.86699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86699999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.89200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":3.383,"15min":3.383},"last":0.623}]},{"osd":5,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84299999999999997,"15min":0.95299999999999996},"min":{"1min":0.54700000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":1.198,"15min":1.198},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.89800000000000002},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80700000000000005,"15min":0.89400000000000002},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91000000000000003,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82599999999999996,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81699999999999995,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32328,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64000000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.498},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":2.4670000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0229999999999999,"5min":1.079,"15min":1.079},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96999999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.075},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92800000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.171,"15min":1.171},"last":0.749},{"interface":"front","average":{"1min":0.754,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96599999999999997,"5min":1.077,"15min":1.077},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":1.486,"15min":1.486},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.48399999999999999},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":1.27,"15min":1.27},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.74299999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.228,"15min":1.228},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91300000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.78700000000000003},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":1.611,"15min":1.611},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.236,"15min":1.236},"last":0.87},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":1.137,"15min":1.137},"last":0.92200000000000004}]},{"osd":6,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91200000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.006,"5min":1.284,"15min":1.284},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.879},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.84599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0800000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61599999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.502}]},{"osd":3,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98899999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96699999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.23,"15min":1.23},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.151,"15min":1.151},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.246,"15min":1.246},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0289999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.093,"15min":1.093},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0700000000000001,"5min":1.339,"15min":1.339},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:01:41.181 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:57:03.398250+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=57, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=1, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:01:41.181 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:01:42.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:01:42.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:02:01.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:02:01.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.346+0000 7f03f7a00640 1 Processor -- start 2024-09-13T19:02:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.346+0000 7f03f7a00640 1 -- start start 2024-09-13T19:02:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f7a00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03f0153b20 0x7f03f00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f7a00640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03f0159a80 0x7f03f00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f7a00640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f0153f00 con 0x7f03f00b2410 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f7a00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00ce600 con 0x7f03f0153b20 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f7a00640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f0070f90 con 0x7f03f0159a80 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03f0153b20 0x7f03f00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03f0153b20 0x7f03f00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41884/0 (socket says 172.21.15.33:41884) 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 -- 172.21.15.33:0/1035388936 learned_addr learned my addr 172.21.15.33:0/1035388936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03efe00640 1 --2- 172.21.15.33:0/1035388936 >> v2:172.21.15.103:3300/0 conn(0x7f03f0159a80 0x7f03f00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 -- 172.21.15.33:0/1035388936 >> v2:172.21.15.103:3300/0 conn(0x7f03f0159a80 msgr2=0x7f03f00b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 --2- 172.21.15.33:0/1035388936 >> v2:172.21.15.103:3300/0 conn(0x7f03f0159a80 0x7f03f00b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 -- 172.21.15.33:0/1035388936 >> v1:172.21.15.103:6789/0 conn(0x7f03f00b2410 legacy=0x7f03f006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.348+0000 7f03f5000640 1 -- 172.21.15.33:0/1035388936 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00b1a40 con 0x7f03f0153b20 2024-09-13T19:02:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.349+0000 7f03f5000640 1 --2- 172.21.15.33:0/1035388936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f00b3990 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f03f00707d0 tx=0x7f03e402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154943baa4d8eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03ef400640 1 -- 172.21.15.33:0/1035388936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4032440 con 0x7f03f0153b20 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03ef400640 1 -- 172.21.15.33:0/1035388936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40325a0 con 0x7f03f0153b20 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03ef400640 1 -- 172.21.15.33:0/1035388936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4032930 con 0x7f03f0153b20 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 -- 172.21.15.33:0/1035388936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 msgr2=0x7f03f00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 --2- 172.21.15.33:0/1035388936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f00b3990 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f03f00707d0 tx=0x7f03e402a2a0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 -- 172.21.15.33:0/1035388936 shutdown_connections 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 --2- 172.21.15.33:0/1035388936 >> v2:172.21.15.103:3300/0 conn(0x7f03f0159a80 0x7f03f00b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 --2- 172.21.15.33:0/1035388936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f00b3990 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 -- 172.21.15.33:0/1035388936 >> 172.21.15.33:0/1035388936 conn(0x7f03f00b0510 msgr2=0x7f03f00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 -- 172.21.15.33:0/1035388936 shutdown_connections 2024-09-13T19:02:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.350+0000 7f03f7a00640 1 -- 172.21.15.33:0/1035388936 wait complete. 2024-09-13T19:02:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.352+0000 7f03f7a00640 1 Processor -- start 2024-09-13T19:02:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.352+0000 7f03f7a00640 1 -- start start 2024-09-13T19:02:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 0x7f03f0145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03f0159a80 0x7f03f015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01540b0 con 0x7f03f0153b20 2024-09-13T19:02:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0154670 con 0x7f03f00b2410 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03f7a00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f014f1c0 con 0x7f03f0159a80 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41894/0 (socket says 172.21.15.33:41894) 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.353+0000 7f03efe00640 1 -- 172.21.15.33:0/2254472801 learned_addr learned my addr 172.21.15.33:0/2254472801 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03f5000640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 0x7f03f0145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03f5a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03f0159a80 0x7f03f015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 -- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03f0159a80 msgr2=0x7f03f015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03f0159a80 0x7f03f015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 -- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 msgr2=0x7f03f0145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 0x7f03f0145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 -- 172.21.15.33:0/2254472801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40094d0 con 0x7f03f0153b20 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03f5000640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 0x7f03f0145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:02:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03efe00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00d830 tx=0x7f03dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00b6c0 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00b840 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00bbf0 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.354+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f014f4a0 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.355+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f0145560 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.356+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00b3990 con 0x7f03f0153b20 2024-09-13T19:02:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.357+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03dc01e460 con 0x7f03f0153b20 2024-09-13T19:02:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.357+0000 7f03ecc00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 0x7f03d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.357+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03dc089920 con 0x7f03f0153b20 2024-09-13T19:02:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.358+0000 7f03f5000640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 0x7f03d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.358+0000 7f03f5000640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 0x7f03d006d0c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f03e4034000 tx=0x7f03e402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.362+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f03dc054d60 con 0x7f03f0153b20 2024-09-13T19:02:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.535+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 --> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03f015a7b0 con 0x7f03d006ac00 2024-09-13T19:02:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.538+0000 7f03ecc00640 1 -- 172.21.15.33:0/2254472801 <== mgr.4108 v2:172.21.15.103:6832/1814036668 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50842 (secure 0 0 0) 0x7f03e4042090 con 0x7f03d006ac00 2024-09-13T19:02:01.542 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:02:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 msgr2=0x7f03d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 0x7f03d006d0c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f03e4034000 tx=0x7f03e402e000 comp rx=0 tx=0).stop 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 msgr2=0x7f03f015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00d830 tx=0x7f03dc00dcf0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 shutdown_connections 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7f03d006ac00 0x7f03d006d0c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03f0159a80 0x7f03f015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03f0153b20 0x7f03f015bb70 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 --2- 172.21.15.33:0/2254472801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f00b2410 0x7f03f0145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 >> 172.21.15.33:0/2254472801 conn(0x7f03f00b0510 msgr2=0x7f03f006ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 shutdown_connections 2024-09-13T19:02:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.540+0000 7f03f7a00640 1 -- 172.21.15.33:0/2254472801 wait complete. 2024-09-13T19:02:01.559 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-13T19:02:01.162614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259724,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714996,"statfs":{"total":773094113280,"available":772828155904,"internally_reserved":0,"allocated":11051008,"data_stored":5374760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"1.0","version":"99'119","reported_seq":259,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-13T19:01:40.910578+0000","last_change":"2024-09-13T19:01:40.910702+0000","last_active":"2024-09-13T19:01:40.910578+0000","last_peered":"2024-09-13T19:01:40.910578+0000","last_clean":"2024-09-13T19:01:40.910578+0000","last_became_active":"2024-09-13T18:57:04.505746+0000","last_became_peered":"2024-09-13T18:57:04.505746+0000","last_unstale":"2024-09-13T19:01:40.910578+0000","last_undegraded":"2024-09-13T19:01:40.910578+0000","last_fullsized":"2024-09-13T19:01:40.910578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'119","last_scrub_stamp":"2024-09-13T19:01:40.910556+0000","last_deep_scrub":"99'119","last_deep_scrub_stamp":"2024-09-13T19:01:40.910556+0000","last_clean_scrub_stamp":"2024-09-13T19:01:40.910556+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:26.174423+0000","scrub_duration":0.0056404030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.56599999999999995},"min":{"1min":0.52100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88200000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.625,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96199999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68200000000000005,"15min":0.69799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69399999999999995,"15min":0.69799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":1.105},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.69199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.873},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90200000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.492,"15min":1.492},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Sep 13 19:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.61799999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.501},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77500000000000002,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.433,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82999999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70599999999999996,"15min":0.73899999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79700000000000004,"5min":1.204,"15min":1.204},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.72399999999999998},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.25,"15min":1.25},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76800000000000002,"5min":1.337,"15min":1.337},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70499999999999996,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.83599999999999997}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.373,"15min":1.373},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.68100000000000005,"15min":0.71599999999999997},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84899999999999998,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92800000000000005,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84499999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90800000000000003,"5min":1.792,"15min":1.792},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.036,"5min":1.49,"15min":1.49},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.59199999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.92600000000000005}]},{"osd":1,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.53000000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.294,"15min":1.294},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.94499999999999995}]},{"osd":2,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69499999999999995,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80500000000000005,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84499999999999997,"5min":1.474,"15min":1.474},"last":0.872},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86899999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.999,"5min":1.232,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85899999999999999,"5min":1.117,"15min":1.117},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 19:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69599999999999995,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.075,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.45500000000000002,"15min":0.47899999999999998},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59499999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.51300000000000001,"15min":0.59799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55200000000000005,"5min":3.339,"15min":3.339},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77500000000000002,"5min":1.107,"15min":1.107},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52700000000000002,"15min":0.55700000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58799999999999997,"5min":1.095,"15min":1.095},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76900000000000002,"15min":0.86699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86699999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.89200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95999999999999996,"5min":3.383,"15min":3.383},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84299999999999997,"15min":0.95299999999999996},"min":{"1min":0.54700000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.56000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":1.198,"15min":1.198},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.89800000000000002},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Sep 13 19:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80700000000000005,"15min":0.89400000000000002},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91000000000000003,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82599999999999996,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81699999999999995,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.81499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32328,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64000000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.433,"15min":0.434},"min":{"1min":0.31,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.498},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.53700000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0229999999999999,"5min":1.079,"15min":1.079},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96999999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.075},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92800000000000005,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93000000000000005,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Sep 13 19:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98099999999999998,"5min":1.171,"15min":1.171},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.57499999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96599999999999997,"5min":1.077,"15min":1.077},"last":1}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1232896,"data_stored":524253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.58899999999999997,"5min":1.486,"15min":1.486},"last":0.436},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.48399999999999999},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.76100000000000001,"5min":1.27,"15min":1.27},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.74299999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.228,"15min":1.228},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91300000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.02},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.78700000000000003},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94899999999999995,"5min":1.611,"15min":1.611},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.236,"15min":1.236},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96799999999999997,"5min":1.137,"15min":1.137},"last":0.94899999999999995}]},{"osd":6,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91200000000000003,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.006,"5min":1.284,"15min":1.284},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Sep 13 19:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.84599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0800000000000001,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1826816,"data_stored":1114621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61599999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.443,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.501}]},{"osd":3,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98899999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96699999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0149999999999999,"5min":1.23,"15min":1.23},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.151,"15min":1.151},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.55500000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.246,"15min":1.246},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0289999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Sep 13 19:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.093,"15min":1.093},"last":0.751},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0700000000000001,"5min":1.339,"15min":1.339},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:02:01.562 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T19:02:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.710+0000 7fad73800640 1 Processor -- start 2024-09-13T19:02:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.710+0000 7fad73800640 1 -- start start 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 0x7fad6c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c06f830 0x7fad6c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 0x7fad6c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c06b5b0 con 0x7fad6c06f830 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c06b7c0 con 0x7fad6c154ad0 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad73800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c06baa0 con 0x7fad6c0ce2c0 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad63e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c06f830 0x7fad6c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad63e00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c06f830 0x7fad6c06fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41902/0 (socket says 172.21.15.33:41902) 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.711+0000 7fad63e00640 1 -- 172.21.15.33:0/1797045658 learned_addr learned my addr 172.21.15.33:0/1797045658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad70e00640 1 --2- 172.21.15.33:0/1797045658 >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 0x7fad6c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad71800640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 0x7fad6c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad63e00640 1 -- 172.21.15.33:0/1797045658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 msgr2=0x7fad6c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad63e00640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 0x7fad6c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad63e00640 1 -- 172.21.15.33:0/1797045658 >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 msgr2=0x7fad6c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad63e00640 1 --2- 172.21.15.33:0/1797045658 >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 0x7fad6c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad63e00640 1 -- 172.21.15.33:0/1797045658 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c06bd80 con 0x7fad6c06f830 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad71800640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 0x7fad6c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.712+0000 7fad70e00640 1 --2- 172.21.15.33:0/1797045658 >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 0x7fad6c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.713+0000 7fad63e00640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c06f830 0x7fad6c06fee0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0b1340 tx=0x7fad5402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fe43d5e23894b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.713+0000 7fad6be00640 1 -- 172.21.15.33:0/1797045658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5402ae90 con 0x7fad6c06f830 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.713+0000 7fad6be00640 1 -- 172.21.15.33:0/1797045658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54032440 con 0x7fad6c06f830 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.713+0000 7fad6be00640 1 -- 172.21.15.33:0/1797045658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540327d0 con 0x7fad6c06f830 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 -- 172.21.15.33:0/1797045658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c06f830 msgr2=0x7fad6c06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c06f830 0x7fad6c06fee0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0b1340 tx=0x7fad5402a140 comp rx=0 tx=0).stop 2024-09-13T19:02:01.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 -- 172.21.15.33:0/1797045658 shutdown_connections 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c0ce2c0 0x7fad6c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 --2- 172.21.15.33:0/1797045658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c06f830 0x7fad6c06fee0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 --2- 172.21.15.33:0/1797045658 >> v2:172.21.15.103:3300/0 conn(0x7fad6c154ad0 0x7fad6c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 -- 172.21.15.33:0/1797045658 >> 172.21.15.33:0/1797045658 conn(0x7fad6c0b0580 msgr2=0x7fad6c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 -- 172.21.15.33:0/1797045658 shutdown_connections 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.714+0000 7fad73800640 1 -- 172.21.15.33:0/1797045658 wait complete. 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.715+0000 7fad73800640 1 Processor -- start 2024-09-13T19:02:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 -- start start 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad6c154ad0 0x7fad6c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c146ef0 0x7fad6c147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1478b0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0b3390 con 0x7fad6c154ad0 2024-09-13T19:02:01.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.716+0000 7fad73800640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1f63d0 con 0x7fad6c146ef0 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41914/0 (socket says 172.21.15.33:41914) 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 -- 172.21.15.33:0/3938057618 learned_addr learned my addr 172.21.15.33:0/3938057618 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad71800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c146ef0 0x7fad6c147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad70e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad6c154ad0 0x7fad6c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 -- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c146ef0 msgr2=0x7fad6c147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c146ef0 0x7fad6c147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 -- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad6c154ad0 msgr2=0x7fad6c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad6c154ad0 0x7fad6c0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.717+0000 7fad63e00640 1 -- 172.21.15.33:0/3938057618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540094d0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad63e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fad5402a180 tx=0x7fad540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54030850 con 0x7fad6c1f5f50 2024-09-13T19:02:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540309b0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54030d60 con 0x7fad6c1f5f50 2024-09-13T19:02:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c0b2750 con 0x7fad6c1f5f50 2024-09-13T19:02:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.718+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c0b2d40 con 0x7fad6c1f5f50 2024-09-13T19:02:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.719+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c06fee0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.720+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad54039040 con 0x7fad6c1f5f50 2024-09-13T19:02:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.721+0000 7fad69600640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 0x7fad4806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.721+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad540a9be0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.721+0000 7fad70e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 0x7fad4806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.722+0000 7fad70e00640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 0x7fad4806d0f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad5c006fd0 tx=0x7fad5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.725+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fad540750d0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.902+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fad6c0b34d0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.906+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad540750d0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.907+0000 7fad69600640 1 -- 172.21.15.33:0/3938057618 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad540786f0 con 0x7fad6c1f5f50 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.909+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 msgr2=0x7fad4806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.909+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 0x7fad4806d0f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad5c006fd0 tx=0x7fad5c008040 comp rx=0 tx=0).stop 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 msgr2=0x7fad6c1f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fad5402a180 tx=0x7fad540046c0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 shutdown_connections 2024-09-13T19:02:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fad4806ac30 0x7fad4806d0f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad6c146ef0 0x7fad6c147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c1f5f50 0x7fad6c1f1810 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 --2- 172.21.15.33:0/3938057618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad6c154ad0 0x7fad6c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 >> 172.21.15.33:0/3938057618 conn(0x7fad6c0b0580 msgr2=0x7fad6c15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 shutdown_connections 2024-09-13T19:02:01.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:01.910+0000 7fad73800640 1 -- 172.21.15.33:0/3938057618 wait complete. 2024-09-13T19:02:01.930 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T19:02:01.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T19:02:02.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.081+0000 7fb86be00640 1 Processor -- start 2024-09-13T19:02:02.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.082+0000 7fb86be00640 1 -- start start 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86be00640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb86c0afe10 0x7fb86c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86be00640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0b1e00 con 0x7fb86c15fa70 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86be00640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c15dbe0 con 0x7fb86c0afe10 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86be00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0b3230 con 0x7fb86c0acf80 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86aa00640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb86c15fa70 0x7fb86c0ac870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48176/0 (socket says 172.21.15.33:48176) 2024-09-13T19:02:02.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86aa00640 1 -- 172.21.15.33:0/3253511892 learned_addr learned my addr 172.21.15.33:0/3253511892 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb86b400640 1 --2- 172.21.15.33:0/3253511892 >> v2:172.21.15.33:3300/0 conn(0x7fb86c0afe10 0x7fb86c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.083+0000 7fb862000640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86a000640 1 -- 172.21.15.33:0/3253511892 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793440170 0 0) 0x7fb86c0b1e00 con 0x7fb86c15fa70 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86a000640 1 -- 172.21.15.33:0/3253511892 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850003520 con 0x7fb86c15fa70 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86b400640 1 -- 172.21.15.33:0/3253511892 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 msgr2=0x7fb86c15d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86b400640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c15d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86b400640 1 -- 172.21.15.33:0/3253511892 >> v1:172.21.15.33:6789/0 conn(0x7fb86c15fa70 legacy=0x7fb86c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.084+0000 7fb86b400640 1 -- 172.21.15.33:0/3253511892 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0b1840 con 0x7fb86c0afe10 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.085+0000 7fb86b400640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c0afe10 0x7fb86c15dd40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb86402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445591fa8a70ae9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.085+0000 7fb86a000640 1 -- 172.21.15.33:0/3253511892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864007740 con 0x7fb86c0afe10 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.085+0000 7fb86a000640 1 -- 172.21.15.33:0/3253511892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb86402d050 con 0x7fb86c0afe10 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.085+0000 7fb86a000640 1 -- 172.21.15.33:0/3253511892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864007ae0 con 0x7fb86c0afe10 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 -- 172.21.15.33:0/3253511892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c0afe10 msgr2=0x7fb86c15dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c0afe10 0x7fb86c15dd40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb86402a530 comp rx=0 tx=0).stop 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 -- 172.21.15.33:0/3253511892 shutdown_connections 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c15d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 --2- 172.21.15.33:0/3253511892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c0afe10 0x7fb86c15dd40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 -- 172.21.15.33:0/3253511892 >> 172.21.15.33:0/3253511892 conn(0x7fb86c0ae310 msgr2=0x7fb86c0ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 -- 172.21.15.33:0/3253511892 shutdown_connections 2024-09-13T19:02:02.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.086+0000 7fb86be00640 1 -- 172.21.15.33:0/3253511892 wait complete. 2024-09-13T19:02:02.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.087+0000 7fb86be00640 1 Processor -- start 2024-09-13T19:02:02.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.088+0000 7fb86be00640 1 -- start start 2024-09-13T19:02:02.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0afe10 0x7fb86c14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1520d0 con 0x7fb86c15fa70 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1514c0 con 0x7fb86c0afe10 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86be00640 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1517a0 con 0x7fb86c0acf80 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41946/0 (socket says 172.21.15.33:41946) 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 -- 172.21.15.33:0/3001346481 learned_addr learned my addr 172.21.15.33:0/3001346481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb862000640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0afe10 0x7fb86c14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86aa00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 -- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 msgr2=0x7fb86c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 -- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0afe10 msgr2=0x7fb86c14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0afe10 0x7fb86c14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.089+0000 7fb86b400640 1 -- 172.21.15.33:0/3001346481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009a70 con 0x7fb86c15fa70 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb86b400640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86403b820 con 0x7fb86c15fa70 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb86403b980 con 0x7fb86c15fa70 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86403bcf0 con 0x7fb86c15fa70 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c151a80 con 0x7fb86c15fa70 2024-09-13T19:02:02.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.090+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c14f7d0 con 0x7fb86c15fa70 2024-09-13T19:02:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.091+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c067360 con 0x7fb86c15fa70 2024-09-13T19:02:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.092+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb86402ad50 con 0x7fb86c15fa70 2024-09-13T19:02:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.093+0000 7fb863e00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 0x7fb84806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:02:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.093+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8640aa540 con 0x7fb86c15fa70 2024-09-13T19:02:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.094+0000 7fb86aa00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 0x7fb84806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:02:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.094+0000 7fb86aa00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 0x7fb84806d0f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0011e0 tx=0x7fb85c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:02:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.097+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb864075a30 con 0x7fb86c15fa70 2024-09-13T19:02:02.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.324+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb86c1607f0 con 0x7fb86c15fa70 2024-09-13T19:02:02.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.325+0000 7fb863e00640 1 -- 172.21.15.33:0/3001346481 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb864079050 con 0x7fb86c15fa70 2024-09-13T19:02:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-13T19:02:02.329 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/1200543698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1200543698},{"type":"v1","addr":"172.21.15.103:6836","nonce":1200543698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/787627464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":787627464},{"type":"v1","addr":"172.21.15.103:6837","nonce":787627464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2215798288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2215798288},{"type":"v1","addr":"172.21.15.33:6835","nonce":2215798288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7470,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/4252405406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":4252405406},{"type":"v1","addr":"172.21.15.33:6834","nonce":4252405406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2024-09-13T19:02:02.330 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 57 2024-09-13T19:02:02.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 msgr2=0x7fb84806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 0x7fb84806d0f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0011e0 tx=0x7fb85c007d30 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 msgr2=0x7fb86c144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d90 tx=0x7fb864004a40 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 shutdown_connections 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:6832/1814036668,v1:172.21.15.103:6833/1814036668] conn(0x7fb84806ac30 0x7fb84806d0f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb86c15fa70 0x7fb86c144e40 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb86c0afe10 0x7fb86c14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 --2- 172.21.15.33:0/3001346481 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb86c0acf80 0x7fb86c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 >> 172.21.15.33:0/3001346481 conn(0x7fb86c0ae310 msgr2=0x7fb86c1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 shutdown_connections 2024-09-13T19:02:02.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-13T19:02:02.327+0000 7fb86be00640 1 -- 172.21.15.33:0/3001346481 wait complete. 2024-09-13T19:02:02.347 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T19:02:02.347 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T19:02:02.347 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T19:02:02.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.360 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T19:02:02.361 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T19:02:02.361 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.415 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T19:02:02.415 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T19:02:02.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.432 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T19:02:02.432 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T19:02:02.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.488 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T19:02:02.488 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T19:02:02.489 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T19:02:02.489 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.526 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T19:02:02.526 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T19:02:02.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.612 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T19:02:02.612 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T19:02:02.612 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.654 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T19:02:02.655 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T19:02:02.655 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.715 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T19:02:02.716 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T19:02:02.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.763 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T19:02:02.763 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T19:02:02.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.814 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T19:02:02.814 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T19:02:02.815 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.866 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T19:02:02.866 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T19:02:02.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.920 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T19:02:02.920 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T19:02:02.920 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T19:02:02.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:02.982 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T19:02:02.982 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T19:02:02.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:03.051 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T19:02:03.051 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T19:02:03.052 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T19:02:03.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:03.073 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T19:02:03.073 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T19:02:03.073 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:03.092 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T19:02:03.092 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T19:02:03.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:02:03.152 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T19:02:03.157 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T19:02:03.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T19:02:03.232 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:02:03.233 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T19:02:03.476 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:02:03.476 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T19:02:03.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:02:03.599 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T19:02:03.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:02:03.708 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T19:02:03.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:02:03.846 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T19:02:04.055 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:02:04.055 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T19:02:04.171 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:02:04.171 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T19:02:04.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:02:04.298 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T19:02:04.424 INFO:tasks.ceph:Archiving mon data... 2024-09-13T19:02:04.425 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/data/mon.a.tgz 2024-09-13T19:02:04.425 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-13T19:02:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.yXL7QWrH80 2024-09-13T19:02:04.461 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yXL7QWrH80 2024-09-13T19:02:04.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.yXL7QWrH80 2024-09-13T19:02:04.778 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.yXL7QWrH80 is 461KB 2024-09-13T19:02:04.878 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.yXL7QWrH80 2024-09-13T19:02:04.913 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/data/mon.b.tgz 2024-09-13T19:02:04.913 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-13T19:02:04.950 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.2TgL7gwKtX 2024-09-13T19:02:04.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2TgL7gwKtX 2024-09-13T19:02:05.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.2TgL7gwKtX 2024-09-13T19:02:05.275 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.2TgL7gwKtX is 593KB 2024-09-13T19:02:05.367 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.2TgL7gwKtX 2024-09-13T19:02:05.401 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/data/mon.c.tgz 2024-09-13T19:02:05.402 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-13T19:02:05.476 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.Lqhx7MAEXJ 2024-09-13T19:02:05.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Lqhx7MAEXJ 2024-09-13T19:02:05.696 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.Lqhx7MAEXJ 2024-09-13T19:02:05.789 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.Lqhx7MAEXJ is 593KB 2024-09-13T19:02:05.881 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.Lqhx7MAEXJ 2024-09-13T19:02:05.916 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T19:02:05.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:02:05.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:02:06.012 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T19:02:06.012 DEBUG:teuthology.orchestra.run.smithi033:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T19:02:06.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T19:02:06.077 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T19:02:06.078 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T19:02:06.088 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T19:02:06.090 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi033/crash 2024-09-13T19:02:06.091 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:02:06.147 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi103/crash 2024-09-13T19:02:06.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:02:06.202 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T19:02:06.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:02:06.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T19:02:06.318 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T19:02:06.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T19:02:06.429 INFO:tasks.ceph:Compressing logs... 2024-09-13T19:02:06.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:02:06.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:02:08.736 INFO:tasks.ceph:Archiving logs... 2024-09-13T19:02:08.736 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi033/log 2024-09-13T19:02:08.737 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:02:09.425 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi103/log 2024-09-13T19:02:09.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:02:09.716 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T19:02:09.847 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T19:02:09.848 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:02:09.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:02:09.979 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T19:02:10.085 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T19:02:10.085 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:02:10.089 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:02:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:02:10.123 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:02:10.128 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:02:10.128 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-13T19:02:10.128 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -1481us[-1485us] +/- 47ms 2024-09-13T19:02:10.128 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 65 +3047us[+3044us] +/- 52ms 2024-09-13T19:02:10.129 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -1635us[-1639us] +/- 60ms 2024-09-13T19:02:10.129 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -1468us[-1455us] +/- 46ms 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +3093us[+3093us] +/- 53ms 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -1605us[-1605us] +/- 61ms 2024-09-13T19:02:10.131 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:02:10.132 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T19:02:10.141 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T19:02:10.142 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T19:02:10.165 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T19:02:10.304 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T19:02:10.423 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:02:10.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:02:10.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:02:10.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:02:10.546 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T19:02:10.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T19:02:10.564 INFO:teuthology.task.internal:Duration was 744.133844 seconds 2024-09-13T19:02:10.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T19:02:10.574 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T19:02:10.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:02:10.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:02:10.662 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:02:10.666 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:02:11.182 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T19:02:11.182 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-09-13T19:02:11.183 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:02:11.232 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-13T19:02:11.232 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:02:11.293 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T19:02:11.293 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:02:11.297 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:02:11.357 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T19:02:11.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:02:11.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:02:11.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T19:02:11.528 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T19:02:11.528 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:02:11.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:02:11.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T19:02:11.651 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:02:11.655 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:02:11.721 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-09-13T19:02:11.726 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-13T19:02:11.755 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:02:11.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:02:11.789 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:02:11.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:02:11.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T19:02:11.832 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T19:02:11.833 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi033 2024-09-13T19:02:11.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:02:11.898 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904017/remote/smithi103 2024-09-13T19:02:11.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:02:11.963 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T19:02:11.964 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:02:11.968 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:02:12.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T19:02:12.014 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T19:02:12.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T19:02:12.023 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T19:02:12.023 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:02:12.044 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:02:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:02 /home/ubuntu/cephtest 2024-09-13T19:02:12.079 INFO:teuthology.orchestra.run.smithi103.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:02 /home/ubuntu/cephtest 2024-09-13T19:02:12.081 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T19:02:12.092 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T19:02:12.144 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota} duration: 744.1338438987732 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T19:02:12.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:02:12.236 INFO:teuthology.run:pass